Commit graph

295 commits

Author SHA1 Message Date
Vadim Ushakov
ddc4861223 Site.py: code cleanup 2021-10-21 16:18:40 +07:00
Vadim Ushakov
b194eb0f33 Rename param to reflect its meaning: check_site_on_reconnect -> update_site_on_reconnect 2021-10-21 14:37:53 +07:00
Vadim Ushakov
5744e40505 Redesign the scheduling of site checking and verification
Save `check_files_timestamp` and `verify_files_timestamp` in sites.json and run checks only when the time interval is expired.
2021-10-21 13:19:10 +07:00
Vadim Ushakov
5ec970adb8 Add option verify_files to Site.update() to allow the real content verification check, not just the simple file size-based one
Add more informative updateWebsocket() notification in Site.update() and SiteStorage.verifyFiles()
2021-10-21 02:24:16 +07:00
Vadim Ushakov
7e438a90e1 Don't spam in log.info() from getRecentPeers() 2021-10-20 21:10:04 +07:00
Vadim Ushakov
b9ec7124f9 minor changes for debugging 2021-10-20 14:02:00 +07:00
Vadim Ushakov
be65ff2c40 Make more efforts of looking for peers when publishing a site 2021-03-31 11:27:19 +07:00
Vadim Ushakov
986dedfa7f Trying to fix incomplete updates
Partially fixes https://github.com/HelloZeroNet/ZeroNet/issues/2476

Approx. every 10th update check is now performed with `since = 0`
2021-03-25 12:41:53 +07:00
Vadim Ushakov
570f854485 Fix a typo in Site.py 2020-11-04 21:58:32 +07:00
Vadim Ushakov
7354d712e0 Be more persistent in delivering site updates. 2020-11-04 16:08:01 +07:00
Vadim Ushakov
c84b413f58 Refactor ConnectionServer, FileServer; fix bugs introduced in previous commits 2020-11-03 21:21:33 +07:00
Vadim Ushakov
ba16fdcae9 Fix a typo 2020-11-02 09:04:38 +07:00
Vadim Ushakov
ea21b32b93 Add explicit invalidation and expiration of site update timestamps 2020-10-31 18:05:50 +07:00
Vadim Ushakov
e8358ee8f2 More fixes on the way to reliable site updates. 2020-10-31 03:59:54 +07:00
Vadim Ushakov
d1b9cc8261 Redesign the Internet outage detection. Improvements in FileServer threads. 2020-10-30 23:28:16 +07:00
Vadim Ushakov
829fd46781 Redesign the site updating strategy in Site.py, SiteAnnouncer.py, FileServer.py 2020-10-30 14:36:08 +07:00
Vadim Ushakov
8fd88c50f9 Redesign cleanupSites() and all the related stuff and rename it to periodic maintenance. 2020-10-28 23:38:17 +07:00
Vadim Ushakov
511a90a5c5 Redesign Site.needConnections() 2020-10-28 20:31:48 +07:00
Tamas Kocsis
ce5b4c3eda Don't non-existent files as bad 2020-09-18 18:45:42 +02:00
Tamas Kocsis
4da89580c1 Don't mark content.json as bad file if update failed 2020-09-18 18:43:54 +02:00
Tamas Kocsis
5a226baaa5 Reduce announce number for not recently added sites 2020-09-08 19:28:04 +02:00
Tamas Kocsis
b7bc197012 Only try to get more peers for timeout task if site is recently added 2020-09-08 19:26:18 +02:00
Tamas Kocsis
0907edb6b1 Remove obsolate auth_key generation 2020-09-04 17:35:48 +02:00
shortcutme
9b85d8638d
Don't allow run site api calls when site is deleting 2020-02-20 17:25:56 +01:00
shortcutme
c6b07f1294
Wait until checkmodification spawned pools are finishing 2019-12-21 03:04:36 +01:00
shortcutme
3ccce46314
Wait until downloadContent pool finishes 2019-12-21 03:03:49 +01:00
shortcutme
7c1da5da52
Abilty to disable file bad file retry at end of download 2019-12-21 03:03:32 +01:00
shortcutme
c5de1447c8
onComplete will be triggered by WorkerManager 2019-12-21 03:02:53 +01:00
shortcutme
e16ace433c
Better logging in site download content 2019-12-21 03:02:36 +01:00
shortcutme
d7cabb47ca
Log task numbers on content.json start 2019-12-17 14:31:41 +01:00
shortcutme
8de1714f08
Fix onComplete call when donwload end 2019-12-17 14:31:12 +01:00
shortcutme
20ba9cd589
Log site download time 2019-12-17 14:30:29 +01:00
shortcutme
af1ac9bce8
Try to find already running task for file before start a new one 2019-12-17 14:30:14 +01:00
shortcutme
31a6e3ee9a
Don't allow clone to run in parallel 2019-12-17 14:29:48 +01:00
shortcutme
04ecb89e9a
Avoid sending too many publish request to an outdated client 2019-12-04 17:15:42 +01:00
shortcutme
afd23849a6
Log site delete as info 2019-11-27 03:04:49 +01:00
shortcutme
5df5e25d68
Better logging of recent peers 2019-11-25 14:49:40 +01:00
shortcutme
07633ba79d
Fix local peers dropping out from recent peers 2019-11-25 14:33:18 +01:00
shortcutme
1c607645c7
Track and stop site connected greenlets on delete 2019-11-19 02:07:51 +01:00
shortcutme
6eb79ba75e
Don't annunce site if not serving 2019-10-06 03:08:54 +02:00
Lola Dam
0738964e64 Save content.json of site even if limit size is reached (#2114)
* fix #2107; Still save the content.json received even if site size limit is reached but dont download files; Allow better distribution of latest version of content.json

* Added test

* Fix test for huge content file (now it fails)

* Dont download huge content.json file and update test

* Remove comments
2019-09-10 18:18:21 +02:00
shortcutme
88f2b39576
Don't try to connect to onion addresses if not supported by the client 2019-08-08 14:37:19 +02:00
shortcutme
1eb97ea381
Delayed save of sites.json 2019-08-02 14:06:25 +02:00
Ivanq
8eee9caa01 Fix siteCloning subdirectory with -default files 2019-07-01 09:49:03 +03:00
Lola Dam
753396ac0c Try and catch block for dbRebuild (#2047)
* Try and catch block for dbRebuild

* Use self.log.error and not logging

* Use self.log.error and not logging in SiteStorage also

* Check if the rebuild is working
2019-06-23 14:21:50 +02:00
shortcutme
fce30baa12
Check files in offline mode on update 2019-05-30 04:28:09 +02:00
shortcutme
4222c31b3e
Don't push body of content.json with updates if larger than 10kb 2019-05-30 04:26:41 +02:00
shortcutme
f414f0746c
Don't update site in offline mode 2019-04-15 15:48:16 +02:00
shortcutme
998ec3eb4f
Disable all site serving using a global offline argument 2019-04-15 15:06:25 +02:00
radfish
f6e3a74567 [setuptools packaging] access modules via imports (#1969) 2019-04-15 12:31:33 +02:00