Commit graph

454 commits

Author SHA1 Message Date
shortcutme
b21b885aa9
Move site add to separate function 2019-09-28 17:01:37 +02:00
Lola Dam
0738964e64 Save content.json of site even if limit size is reached (#2114)
* fix #2107; Still save the content.json received even if site size limit is reached but dont download files; Allow better distribution of latest version of content.json

* Added test

* Fix test for huge content file (now it fails)

* Dont download huge content.json file and update test

* Remove comments
2019-09-10 18:18:21 +02:00
shortcutme
8a7ae368d8
No opened services if we are in tor always mode 2019-08-23 03:40:20 +02:00
shortcutme
2bdd073608
Move resolveDomain to SiteManager for easier resolver plugins 2019-08-15 03:05:29 +02:00
shortcutme
88f2b39576
Don't try to connect to onion addresses if not supported by the client 2019-08-08 14:37:19 +02:00
shortcutme
bf10cdef63
Add some delay on pex error before try the next peer 2019-08-08 14:36:33 +02:00
shortcutme
3696db89ab
Don't increment tracker error number if no internet connection 2019-08-08 14:35:58 +02:00
shortcutme
eeaa5d21d8
Start unrealible trackers on force reannounce 2019-08-08 14:35:35 +02:00
shortcutme
6cd18bbf04
Display more clean error on users.json/sites.json load error 2019-08-07 14:11:30 +02:00
shortcutme
1eb97ea381
Delayed save of sites.json 2019-08-02 14:06:25 +02:00
shortcutme
f6e06456b0
Use advaced json dumper to save sites.json and users.json 2019-08-02 14:06:05 +02:00
shortcutme
5e90cd9714
Move advanced json formatter to helper.py 2019-08-02 14:05:14 +02:00
Vadim Ushakov
a2cb1615b3 Move the BitTorrent related code from SiteAnnouncer.py (#2078)
* Move the BitTorrent related code from SiteAnnouncer.py to a separate plugin

* AnnounceBitTorrentPlugin.py: add missing `from Debug import Debug`
2019-07-10 16:12:25 +02:00
ZeroNet
951e47469a
Merge pull request #2060 from imachug/default-subdir-clone
Fix siteCloning subdirectory with -default files
2019-07-05 17:13:29 +02:00
Ivanq
743f92d15e Allow some paths to contain .. but not ../ 2019-07-01 18:17:42 +03:00
Ivanq
8eee9caa01 Fix siteCloning subdirectory with -default files 2019-07-01 09:49:03 +03:00
Lola Dam
753396ac0c Try and catch block for dbRebuild (#2047)
* Try and catch block for dbRebuild

* Use self.log.error and not logging

* Use self.log.error and not logging in SiteStorage also

* Check if the rebuild is working
2019-06-23 14:21:50 +02:00
shortcutme
8cb629fb55
Return True on rebuildDb success 2019-06-06 02:27:59 +02:00
Lola Dam
9cda561091 Show error message when db failed to rebuild (#2043)
* Show error message when db failed to rebuild; fix #1908;

* Forgot file
2019-06-04 13:54:35 +02:00
shortcutme
8e2a7c2b2d
Respect optionalHelp when checking files 2019-05-30 04:28:41 +02:00
shortcutme
fce30baa12
Check files in offline mode on update 2019-05-30 04:28:09 +02:00
shortcutme
4222c31b3e
Don't push body of content.json with updates if larger than 10kb 2019-05-30 04:26:41 +02:00
shortcutme
e688671972
Fix rename error variable problem in site storage 2019-04-23 01:59:59 +02:00
shortcutme
f414f0746c
Don't update site in offline mode 2019-04-15 15:48:16 +02:00
shortcutme
998ec3eb4f
Disable all site serving using a global offline argument 2019-04-15 15:06:25 +02:00
radfish
f6e3a74567 [setuptools packaging] access modules via imports (#1969) 2019-04-15 12:31:33 +02:00
shortcutme
9fd059aef8
Give admin permission to updater site 2019-04-08 18:12:58 +02:00
shortcutme
b5b0626251
Add name for websocket event on site deletion 2019-03-29 02:30:26 +01:00
shortcutme
74e71a1971
Fix http tracker announce compatibility 2019-03-27 03:09:47 +01:00
shortcutme
f3a4b9c709
Fix announce py3 compatibility 2019-03-16 03:43:11 +01:00
shortcutme
a1a4a73260
Save sites.json as utf8 2019-03-16 00:41:26 +01:00
shortcutme
627edeb0f2
Py3 support in announce requests 2019-03-16 00:33:12 +01:00
shortcutme
16f29b65f2
Use if in protocol port detection 2019-03-16 00:32:50 +01:00
shortcutme
002303a765
Db rebuilding error display, reconnect bug fix 2019-03-16 00:11:52 +01:00
shortcutme
59426c31f7
SiteStorage Py3 compatibility 2019-03-16 00:10:49 +01:00
shortcutme
b0b9a4d33c
Change to Python3 coding style 2019-03-15 21:06:59 +01:00
rllola
58516913b4 if protocol https choose port 443 2019-03-10 22:19:37 +01:00
rllola
fb836fcf6f If no port defined in tracker url assume it is port 80; fix #1917 2019-03-09 18:41:50 +01:00
shortcutme
5c57cd6541
Support https trackers, add browser-like user agent for tracker http requests 2019-02-14 15:48:36 +01:00
shortcutme
c2b879ccab
Rev3831, Fix Stats page compatibility with latest gevent 2019-01-31 00:39:45 +01:00
shortcutme
31a7effa5f
Rev3827, Share FileServer between sites for non-main CLI commands 2019-01-29 03:17:24 +01:00
shortcutme
447f5fd5c8
Store opened port status per IP version 2019-01-23 02:11:31 +01:00
shortcutme
42156edc76
Opened ipv6 port support for tracker request 2019-01-20 16:31:30 +01:00
shortcutme
7ae98477d5
Separate function for parsing tracker addresses 2019-01-20 16:29:38 +01:00
shortcutme
626b6f5ccd
Formatting 2019-01-20 16:28:47 +01:00
shortcutme
9c82de7df2
Ipv6 support of opened services 2019-01-20 16:28:42 +01:00
shortcutme
e7de562b93
Don't request ipv6 trackers if not supported by the client 2019-01-20 16:27:59 +01:00
shortcutme
78a7aa91c0
Add ipv6 address to blacklist 2019-01-20 03:26:12 +01:00
shortcutme
3e82595193
Store site download time 2019-01-20 03:10:07 +01:00
shortcutme
4fe6ae9811
Allow only SELECT in storage.query 2018-12-15 17:45:17 +01:00
shortcutme
8cf30893f2
Don't close idle db connection during rebuild 2018-11-08 01:20:33 +01:00
shortcutme
cf7d194dbf
Remove missing optional files from content.json on cloning 2018-11-07 22:48:35 +01:00
shortcutme
39d442a05d
Fix getConnectablePeers for low peer sites 2018-10-20 02:26:29 +02:00
shortcutme
6b2f619096
Fix updateHashfield optional file detection 2018-10-15 12:59:28 +02:00
shortcutme
f74ddc1010
Don't delete connecting sites at startup 2018-10-15 12:59:04 +02:00
shortcutme
6fc66b7b13
Move file forgot to separate function 2018-09-17 15:27:29 +02:00
shortcutme
9658c2d553
Stop downloadcontent pool if reached 95% of site limit 2018-09-17 15:27:11 +02:00
shortcutme
577761a6bb
Add cache to default settings 2018-09-17 15:25:17 +02:00
shortcutme
4fe33268ac
Don't allow parallel rebuild 2018-09-02 02:24:07 +02:00
shortcutme
b84abea670
Order more peers for connected peers simply by reputation 2018-09-02 02:23:46 +02:00
shortcutme
a5fcc7d65f
Sort recent peers by reputation 2018-09-02 02:23:19 +02:00
shortcutme
313d9a4ef9
Need less peer sites with less peers 2018-09-02 02:23:06 +02:00
shortcutme
6edabeeecc
Log hashfield query time 2018-08-29 19:55:50 +02:00
shortcutme
23284e1f35
Reduce the reannounce to unreliable trackers not just single announces 2018-08-27 11:50:53 +02:00
shortcutme
71d05a6fc2
Global stats to reduce tracker request for unreliable trackers 2018-08-26 22:58:27 +02:00
shortcutme
867cf478b1
Log tracker request mode on error 2018-08-26 22:57:34 +02:00
shortcutme
b43a05b662
Don't increase request tracker number before actually sending it 2018-08-26 22:57:09 +02:00
shortcutme
92db3878cf
Don't include skipped trackers to report 2018-08-26 22:56:46 +02:00
shortcutme
b6d11d6be3
Fix request number counting with zero trackers 2018-08-26 22:56:20 +02:00
shortcutme
0b38d73cc5
AnnounceZero return None on skipped announce due batching 2018-08-26 22:52:21 +02:00
shortcutme
33877c73bb
Test tracker address validity 2018-08-26 02:56:24 +02:00
shortcutme
0e3698fa2f
Announce to next tracker on fail 2018-08-26 02:55:08 +02:00
shortcutme
65f48800b9
Allow tracker list to be extended by plugins 2018-08-26 02:53:39 +02:00
shortcutme
f143000f4a
Fix parsing udp trackers with request path 2018-07-19 20:43:14 +02:00
shortcutme
7475fa69fa
Support custom proxy for tracker connections 2018-07-16 01:47:49 +02:00
shortcutme
ec8b53263c
Store last announce error time 2018-07-16 01:36:23 +02:00
shortcutme
6c4ce03d59
Reload trackers file before start downloading new site 2018-07-10 03:34:23 +02:00
shortcutme
86e4679e04
Skip tracker announce on incalid url pattern 2018-07-10 03:34:06 +02:00
shortcutme
8b91abd0dc
Use FileServer to avoid plugin incompatiblity problems 2018-06-21 21:57:06 +02:00
shortcutme
3de13a2e6d
Fix tracker statistics 2018-06-03 12:47:17 +02:00
shortcutme
d125551c0d
Proritize currently requested site update 2018-06-03 12:46:00 +02:00
shortcutme
f3b17d4896
Force reannounce if announce is enabled on update 2018-04-29 14:52:56 +02:00
shortcutme
247b89aec5
Fix non-ascii tracker error message logging 2018-04-29 13:05:02 +02:00
shortcutme
cafb9ddcf4
No need to announce if no peer as checkModifications will do 2018-04-29 02:45:10 +02:00
shortcutme
ca3b02229f
Fix announcer typo 2018-04-29 01:02:39 +02:00
shortcutme
8039aa3eb1
Report port 1 to trackers as not connectable to improve compatibility 2018-04-29 01:02:24 +02:00
shortcutme
5a494ca50e
Less verbose tracker logging 2018-04-29 01:01:13 +02:00
shortcutme
35cf4f3009
Rev3456, Fix SiteAnnouncer import 2018-04-28 22:31:54 +02:00
shortcutme
b69e466de0
Add loading of new SiteAnnounce class 2018-04-28 21:49:31 +02:00
shortcutme
37fcf2fed7
Fix deletion with missing content.json files 2018-04-28 21:49:12 +02:00
shortcutme
8f69575b95
Fix SiteManager logging message 2018-04-28 21:48:36 +02:00
shortcutme
2f71c2b784
Refactor and move announcer code to separate class 2018-04-28 21:48:21 +02:00
shortcutme
f3a809a495
Fix publish logging message 2018-04-28 21:47:43 +02:00
shortcutme
ad955b157b
My port and ip is no longer necessary for updates 2018-04-28 21:47:33 +02:00
shortcutme
a87b6c7022
Announce on update if no peers 2018-04-28 21:47:11 +02:00
shortcutme
5104d0d250
Always have connectionserver for site 2018-04-28 21:46:50 +02:00
shortcutme
0459c75dc0
Make file verification process handle correctly different files with same has_id by using new isDownloaded function 2018-03-29 03:19:26 +02:00
shortcutme
d61cd96d8f
VerifyFiles call returns more detailed statistics 2018-03-29 02:49:06 +02:00
shortcutme
3d7dea52a0
Always load my sites from sites.json 2018-03-14 22:32:15 +01:00
shortcutme
c5f77a1c38
Handle global onion address correctly in needConnections 2018-03-14 22:31:58 +01:00