Commit graph

300 commits

Author SHA1 Message Date
shortcutme
6610914fdb
Rev2167, Skip downloading if no connection server specified 2017-07-28 22:57:41 +02:00
shortcutme
2aba9cc3c2
Only download content.json files as content 2017-07-19 16:45:12 +02:00
shortcutme
bb27e3124f
Remove files without info on retry bad files 2017-07-18 20:54:39 +02:00
shortcutme
066f54f521
Only log listModification request in verbose mode 2017-06-19 16:12:41 +02:00
shortcutme
64199c7ded
Reduce logging on tracker error 2017-06-19 16:12:24 +02:00
shortcutme
ff69b04216
Catch verify exceptions on manual site files verification process 2017-06-19 15:57:02 +02:00
shortcutme
fec3ff7d8e
Remove bad files that has no info 2017-06-19 15:40:13 +02:00
shortcutme
4b346243eb
On clone sign content.json after all other files copied 2017-06-19 15:39:14 +02:00
shortcutme
f506ac9701
Faster getPath 2017-06-15 13:30:36 +02:00
shortcutme
6167dda01d
Compact json list output 2017-06-03 00:53:59 +02:00
shortcutme
aacde33614
File size limit default to 10MB 2017-05-23 12:41:37 +02:00
shortcutme
3f59727ab6
Formatting 2017-05-23 12:40:42 +02:00
shortcutme
84b535767b
By default nothing is domain 2017-05-11 18:02:05 +02:00
shortcutme
438bdbc141
Protect peers for low traffic sites from closing 2017-05-07 18:15:23 +02:00
shortcutme
728e497057
Display database rebuilding progressbar 2017-05-07 18:14:13 +02:00
shortcutme
169cf2e6ae
Support optional db files 2017-04-12 17:36:03 +02:00
shortcutme
16bfb35109
No positive preference for peers with more than 5 shared sites to avoid centralization 2017-04-09 11:57:35 +02:00
shortcutme
03f3e9e4fd
Rev2025, Publish remotely outdated files on modification check 2017-04-07 21:17:25 +02:00
shortcutme
8ea8e8c28a
Publish incoming files to more peers 2017-04-07 18:17:30 +02:00
shortcutme
909b9da9da
Unnecessary log and comment 2017-03-06 15:30:42 +01:00
ZeroNet
0e2f742b7e Merge pull request #842 from mishfit/refactorListAndWalk
Rename SiteStorage.list to SiteStorage.walk
2017-03-04 12:39:06 +01:00
shortcutme
4e846774b4
Log formatting 2017-02-27 00:13:30 +01:00
shortcutme
a6be8ddc2d
Connectable peers ordered 2017-02-27 00:13:18 +01:00
shortcutme
b65670b9e4
Don't remove peers with atleast 5 sites 2017-02-27 00:12:55 +01:00
shortcutme
ea635d4630
Only totally connected peers counted to peer cleanup 2017-02-27 00:12:36 +01:00
shortcutme
2e9737c149
Faster and better getConnectedpeers 2017-02-27 00:11:57 +01:00
shortcutme
0f8de2b7c1
Use latest added peers and use reputation for listModifications and publishing 2017-02-27 00:11:45 +01:00
shortcutme
2188c5d9fa
Use getRecentPeers for publishing 2017-02-27 00:11:02 +01:00
shortcutme
b5d879c1cd
Start site update check on site re-connect 2017-02-27 00:10:27 +01:00
shortcutme
fd365a19f7
Use getRecentPeers for listModification 2017-02-27 00:09:59 +01:00
shortcutme
adbaadae81
Allow 100 sec timeout for listModification 2017-02-27 00:09:41 +01:00
shortcutme
09ad4133fb
20 sec timeout for listModified 2017-02-27 00:08:46 +01:00
shortcutme
bad2a79f05
Reason for connection closing 2017-02-27 00:02:24 +01:00
mishfit
656c818211 rename SiteStorage.list to SiteStorage.walk
also, add SiteStorage.list as non-recursive
directory listing (`os.listdir`)
2017-02-24 21:58:46 -07:00
shortcutme
26bad8d05b
Fix needConnections bug 2017-02-24 01:16:22 +01:00
shortcutme
4aff146812
Log giving up on a file 2017-02-22 11:29:35 +01:00
shortcutme
221aa16433
Rev1929, Fix file filed on not bad files 2017-02-19 12:32:41 +01:00
shortcutme
63b609f725
Give up files after 30 tries 2017-02-19 00:52:31 +01:00
shortcutme
2eef0bded1
Only increment bad_file if internet connection is active 2017-02-19 00:52:20 +01:00
shortcutme
cfad85b30e
Log file object on db load 2017-02-13 16:12:56 +01:00
shortcutme
6149f5c6ee
Download everything on add 2017-02-11 18:26:37 +01:00
shortcutme
56efa02820
GetDbFiles return inner path 2017-02-09 01:57:12 +01:00
shortcutme
f3c71f3e6c
Move SiteStorage database updating to separate function 2017-02-09 01:56:20 +01:00
shortcutme
66e2bfd76b
Reset bad_files on full update 2017-01-29 19:03:22 +01:00
shortcutme
db7dad6731
Don't delete content.json files from bad_files on update 2017-01-29 19:03:08 +01:00
shortcutme
2b389e4e85
Support since parameter for siteUpdate 2017-01-29 19:02:08 +01:00
shortcutme
a0c3d7f8a6
Rev1833, Fix utf8 system paths 2017-01-22 21:22:53 +01:00
shortcutme
2dc981496b
Rev1821, Show progress bar on publishing 2017-01-16 13:41:57 +01:00
shortcutme
4e96ddfb9e
Allow .. in data_dir path 2017-01-11 13:14:02 +01:00
shortcutme
d9f8e83429 Safe disk write for content.json files 2017-01-05 02:26:44 +01:00
shortcutme
c94e73a029 Skip sites with broken content.json on startup 2017-01-05 02:26:05 +01:00
shortcutme
f89f351b3c Dont copy content.json-default file 2016-12-14 00:43:08 +01:00
shortcutme
34ab2bad49 Clone inner path dest fix 2016-12-14 00:42:52 +01:00
shortcutme
62501d00b1 Use content.json-default if exists 2016-12-14 00:42:31 +01:00
shortcutme
10772a704e Root path parameter for cloning 2016-12-08 17:14:55 +01:00
shortcutme
20ed04af84 Also delete orphan sites from site_id cache 2016-12-04 18:54:43 +01:00
shortcutme
2e08d68d87 Remove content.json files from bad file list 2016-11-16 11:19:08 +01:00
shortcutme
2cdde7dd46 Retry file deletion on error 2016-11-07 23:47:09 +01:00
shortcutme
9765afc286 Modify checkfiles to use optionalRemove, optionalDownloaded and isDownloadable functions 2016-11-07 23:46:54 +01:00
shortcutme
4890c4cb2f Fix big site download 2016-11-07 23:43:08 +01:00
shortcutme
73b3c8db55 Use site object on delete from contentdb 2016-11-07 23:42:28 +01:00
shortcutme
713a2f88a9 Query and send more hashfield 2016-11-07 23:42:13 +01:00
shortcutme
30a2116abf Only announce if trackers 2016-11-07 23:42:00 +01:00
shortcutme
6acc81cb50 Retry bad files in separate thread 2016-11-07 23:41:25 +01:00
shortcutme
af571deb16 Peer cleanup ttl based on peer numbers 2016-11-07 23:40:04 +01:00
shortcutme
e6a82d4c64 Pooled file downloads to handle large ammount of files better 2016-11-07 23:39:45 +01:00
shortcutme
83b3dc8fbe Autodownload optional pattern check to separate function to allow plugins 2016-11-07 23:39:04 +01:00
shortcutme
d1ad7e0850 Stats for total optional files and downloaded optional files in a site 2016-11-07 23:36:04 +01:00
shortcutme
0418a3e6de Only save sites.json if fully loaded to avoid data loss 2016-11-07 22:40:12 +01:00
shortcutme
8f3dfd7435 Fix site deletion errors on startup 2016-11-07 22:38:01 +01:00
shortcutme
d6da0c421c Better json compressing 2016-10-02 14:23:05 +02:00
shortcutme
bb23bc7b3c Send diff to second batch of peers 2016-10-02 14:22:32 +02:00
shortcutme
d760a71b76 Rev1529, Fix json write bug with [] characters in value 2016-09-29 13:01:02 +02:00
shortcutme
117a82c059 Delete bad_files without size 2016-09-28 20:35:53 +02:00
shortcutme
67c9921ace Only add non-connected peers to publish if necessary 2016-09-17 21:01:16 +02:00
shortcutme
4690a111bf Push updates to newer clients first 2016-09-17 21:00:40 +02:00
shortcutme
65e5d05a9e Delete cleanup bad files without file info on update 2016-09-17 21:00:20 +02:00
shortcutme
9fd19bf382 Fix content deletion 2016-09-14 10:52:41 +02:00
shortcutme
b2b91c9aff Remove save error message when no sites loaded yet 2016-09-07 17:41:55 +02:00
shortcutme
a6c4a77e13 Rev1510, Fix site save without loaded SiteManager 2016-09-06 14:52:55 +02:00
shortcutme
d9bbb20743 Rev1509, Fix site delete 2016-09-06 10:16:09 +02:00
shortcutme
dae5cd3969 Fix startup with 1000+ sites 2016-09-05 13:57:12 +02:00
shortcutme
59205088d2 Move site deletion to dedicted function 2016-09-05 13:55:51 +02:00
shortcutme
37a3b4678d Fix user file pre-content.json downloading 2016-09-04 18:01:09 +02:00
shortcutme
365f0cd646 Reset files on cloning 2016-09-04 18:00:51 +02:00
shortcutme
f698ec2502 Also delete sites from content.db 2016-09-04 17:59:47 +02:00
shortcutme
a1f0c20afc Rename checkFiles to updateBadFiles 2016-09-04 17:59:29 +02:00
shortcutme
b0a85b0669 Dont check every file on update 2016-09-04 17:58:18 +02:00
shortcutme
9528d333bd Retry failed files on download end 2016-09-04 17:57:44 +02:00
shortcutme
4437a99330 Use pool to download large ammount of content.json files 2016-09-04 17:57:32 +02:00
shortcutme
8f158cbc8f Make listmodified query use content.db cache 2016-09-04 17:56:33 +02:00
shortcutme
135a9b8f5c Fix content.json retry 2016-09-04 17:54:57 +02:00
shortcutme
1dd488ef89 Remove deleted sites from content.db 2016-09-04 17:52:14 +02:00
shortcutme
a614545467 Faster site settings load 2016-09-04 17:51:55 +02:00
shortcutme
3724e0f376 Save sites.json on exit 2016-09-04 17:51:20 +02:00
shortcutme
1bd6e2f493 Cache bad_files and optional hashfield in sites.json 2016-09-04 17:43:30 +02:00
shortcutme
ecb5885dba Cache file sizes and modification date in sqlite db 2016-09-04 17:41:04 +02:00
shortcutme
709dc854e7 Add site to site manager if required 2016-08-29 11:17:19 +02:00
shortcutme
887a07c3fb Rev1427, Skip invalid files on dbRebuild 2016-08-27 11:01:41 +02:00
shortcutme
d76c1ca98e Also cleanup connections for smaller sites 2016-08-26 11:42:23 +02:00