oci/zeronet
2
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
4092 commits 10 branches 50 tags 16 MiB
Commit graph

304 commits

Author SHA1 Message Date
Vadim Ushakov
168c436b73 Add new configuration variables and temporarily disable Site.persistent_peer_req 
New configuration options:

site_announce_interval_min
site_announce_interval_max

site_peer_check_interval_min
site_peer_check_interval_max

site_update_check_interval_min
site_update_check_interval_max

site_connectable_peer_count_max
site_connectable_peer_count_min

Site.persistent_peer_req is temporarily disabled since it makes excessive pressure on the network when working over TOR and needs some reworking.
 2021-10-27 20:57:44 +07:00
Vadim Ushakov
ef69dcd331 Implement Send Back LRU cache to reduce useless network transfers 2021-10-27 01:06:12 +07:00
Vadim Ushakov
645f3ba34a Reorganization of Peer class and peer-related Site's methods 2021-10-26 17:38:40 +07:00
Vadim Ushakov
1a8d30146e Fix typos in comments 2021-10-25 16:18:35 +07:00
Vadim Ushakov
ce971ab738 Don't increment bad_file failed tries counter on rediscovering the same file on update() 
Do increment it only on actual fileFailed() event.
 2021-10-25 13:18:43 +07:00
Vadim Ushakov
b512c54f75 Implement new logic for waiting for connected peers when updating or publishing a site 2021-10-24 23:53:08 +07:00
Vadim Ushakov
b4f94e5022 Make use of waitForPeers() when running FileServer-driven update() 2021-10-23 21:44:41 +07:00
Vadim Ushakov
19b840defd Implement new websocket command serverSetOfflineMode 2021-10-22 02:59:28 +07:00
Vadim Ushakov
e3daa09316 Improve the file server shutdown logic and display the shutdown progress bar in the UI 2021-10-22 00:30:42 +07:00
Vadim Ushakov
ddc4861223 Site.py: code cleanup 2021-10-21 16:18:40 +07:00
Vadim Ushakov
b194eb0f33 Rename param to reflect its meaning: check_site_on_reconnect -> update_site_on_reconnect 2021-10-21 14:37:53 +07:00
Vadim Ushakov
5744e40505 Redesign the scheduling of site checking and verification 
Save `check_files_timestamp` and `verify_files_timestamp` in sites.json and run checks only when the time interval is expired.
 2021-10-21 13:19:10 +07:00
Vadim Ushakov
5ec970adb8 Add option verify_files to Site.update() to allow the real content verification check, not just the simple file size-based one 
Add more informative updateWebsocket() notification in Site.update() and SiteStorage.verifyFiles()
 2021-10-21 02:24:16 +07:00
Vadim Ushakov
7e438a90e1 Don't spam in log.info() from getRecentPeers() 2021-10-20 21:10:04 +07:00
Vadim Ushakov
b9ec7124f9 minor changes for debugging 2021-10-20 14:02:00 +07:00
Vadim Ushakov
be65ff2c40 Make more efforts of looking for peers when publishing a site 2021-03-31 11:27:19 +07:00
Vadim Ushakov
986dedfa7f Trying to fix incomplete updates 
Partially fixes https://github.com/HelloZeroNet/ZeroNet/issues/2476

Approx. every 10th update check is now performed with `since = 0`
 2021-03-25 12:41:53 +07:00
Vadim Ushakov
570f854485 Fix a typo in Site.py 2020-11-04 21:58:32 +07:00
Vadim Ushakov
7354d712e0 Be more persistent in delivering site updates. 2020-11-04 16:08:01 +07:00
Vadim Ushakov
c84b413f58 Refactor ConnectionServer, FileServer; fix bugs introduced in previous commits 2020-11-03 21:21:33 +07:00
Vadim Ushakov
ba16fdcae9 Fix a typo 2020-11-02 09:04:38 +07:00
Vadim Ushakov
ea21b32b93 Add explicit invalidation and expiration of site update timestamps 2020-10-31 18:05:50 +07:00
Vadim Ushakov
e8358ee8f2 More fixes on the way to reliable site updates. 2020-10-31 03:59:54 +07:00
Vadim Ushakov
d1b9cc8261 Redesign the Internet outage detection. Improvements in FileServer threads. 2020-10-30 23:28:16 +07:00
Vadim Ushakov
829fd46781 Redesign the site updating strategy in Site.py, SiteAnnouncer.py, FileServer.py 2020-10-30 14:36:08 +07:00
Vadim Ushakov
8fd88c50f9 Redesign cleanupSites() and all the related stuff and rename it to periodic maintenance. 2020-10-28 23:38:17 +07:00
Vadim Ushakov
511a90a5c5 Redesign Site.needConnections() 2020-10-28 20:31:48 +07:00
Tamas Kocsis
ce5b4c3eda Don't non-existent files as bad 2020-09-18 18:45:42 +02:00
Tamas Kocsis
4da89580c1 Don't mark content.json as bad file if update failed 2020-09-18 18:43:54 +02:00
Tamas Kocsis
5a226baaa5 Reduce announce number for not recently added sites 2020-09-08 19:28:04 +02:00
Tamas Kocsis
b7bc197012 Only try to get more peers for timeout task if site is recently added 2020-09-08 19:26:18 +02:00
Tamas Kocsis
0907edb6b1 Remove obsolate auth_key generation 2020-09-04 17:35:48 +02:00
shortcutme
9b85d8638d
Don't allow run site api calls when site is deleting 2020-02-20 17:25:56 +01:00
shortcutme
c6b07f1294
Wait until checkmodification spawned pools are finishing 2019-12-21 03:04:36 +01:00
shortcutme
3ccce46314
Wait until downloadContent pool finishes 2019-12-21 03:03:49 +01:00
shortcutme
7c1da5da52
Abilty to disable file bad file retry at end of download 2019-12-21 03:03:32 +01:00
shortcutme
c5de1447c8
onComplete will be triggered by WorkerManager 2019-12-21 03:02:53 +01:00
shortcutme
e16ace433c
Better logging in site download content 2019-12-21 03:02:36 +01:00
shortcutme
d7cabb47ca
Log task numbers on content.json start 2019-12-17 14:31:41 +01:00
shortcutme
8de1714f08
Fix onComplete call when donwload end 2019-12-17 14:31:12 +01:00
shortcutme
20ba9cd589
Log site download time 2019-12-17 14:30:29 +01:00
shortcutme
af1ac9bce8
Try to find already running task for file before start a new one 2019-12-17 14:30:14 +01:00
shortcutme
31a6e3ee9a
Don't allow clone to run in parallel 2019-12-17 14:29:48 +01:00
shortcutme
04ecb89e9a
Avoid sending too many publish request to an outdated client 2019-12-04 17:15:42 +01:00
shortcutme
afd23849a6
Log site delete as info 2019-11-27 03:04:49 +01:00
shortcutme
5df5e25d68
Better logging of recent peers 2019-11-25 14:49:40 +01:00
shortcutme
07633ba79d
Fix local peers dropping out from recent peers 2019-11-25 14:33:18 +01:00
shortcutme
1c607645c7
Track and stop site connected greenlets on delete 2019-11-19 02:07:51 +01:00
shortcutme
6eb79ba75e
Don't annunce site if not serving 2019-10-06 03:08:54 +02:00
Lola Dam
0738964e64 Save content.json of site even if limit size is reached (#2114) 
* fix #2107; Still save the content.json received even if site size limit is reached but dont download files; Allow better distribution of latest version of content.json

* Added test

* Fix test for huge content file (now it fails)

* Dont download huge content.json file and update test

* Remove comments
 2019-09-10 18:18:21 +02:00