Commit graph

725 commits

Author SHA1 Message Date
shortcutme
9fcd456205 Return file send stats 2016-11-07 23:19:33 +01:00
shortcutme
c727443ea3 Log connection cpu time usage for non io heavy commands 2016-11-07 23:19:17 +01:00
shortcutme
7ffd897653 Change contentdb after it modified in db 2016-11-07 23:17:41 +01:00
shortcutme
e7c9c2d192 Call ContentDb functions with site object 2016-11-07 23:16:22 +01:00
shortcutme
0b599a95e8 Only import supported cols 2016-11-07 23:15:09 +01:00
shortcutme
5893bbc199 Fix map command overwrite 2016-11-07 23:14:36 +01:00
shortcutme
7baeb8e10f Allow keyvalue table creation before json_id present 2016-11-07 23:14:09 +01:00
shortcutme
14f10d7d10 Open cursor if necessary 2016-11-07 23:13:05 +01:00
shortcutme
bdc8c7e5cc Formatting 2016-11-07 23:12:48 +01:00
shortcutme
f55a1f1bf3 Support delayed commands in Db 2016-11-07 23:11:14 +01:00
shortcutme
b7ede15b06 Print message before shutdown 2016-11-07 23:10:31 +01:00
shortcutme
d5d3f32bf8 Support traceback info formatting 2016-11-07 23:09:39 +01:00
shortcutme
0d9e3baebc Formatting 2016-11-07 23:09:06 +01:00
shortcutme
8955998d25 Support insertOrUpdate in database cursor 2016-11-07 23:08:57 +01:00
shortcutme
d595373f9f Use insertOrUpdate instead of replace on setcontent 2016-11-07 23:08:13 +01:00
shortcutme
12bf5bb152 Sote site in contentdb after files loaded 2016-11-07 23:02:37 +01:00
shortcutme
c35ffccf6c Change to schema based ContentDb to easier extension 2016-11-07 23:01:40 +01:00
shortcutme
0706748d10 Accept plugins to ContentDB 2016-11-07 23:00:59 +01:00
shortcutme
b3ba79a0fd Function to check if the user has permission to modife a site 2016-11-07 22:55:09 +01:00
shortcutme
81744c584e Merge wrapper js modifications 2016-11-07 22:53:07 +01:00
shortcutme
0774662689 Allow more connection backlog 2016-11-07 22:52:34 +01:00
shortcutme
6201612169 Store cpu time used by connection 2016-11-07 22:52:22 +01:00
shortcutme
fc239cfd0d Change tracker to more reliable one 2016-11-07 22:52:03 +01:00
shortcutme
7677b6859e Move config file modification to Config class 2016-11-07 22:51:43 +01:00
shortcutme
76af3a2e78 Gevent timer helper 2016-11-07 22:50:45 +01:00
shortcutme
38838b94a2 Formatting 2016-11-07 22:50:33 +01:00
shortcutme
5ff31e7cb4 Get free space on HDD function 2016-11-07 22:50:01 +01:00
shortcutme
ccb35f1353 Send content size header for normal files 2016-11-07 22:49:13 +01:00
shortcutme
a4a52e7ed4 Add websockets messages until its connected 2016-11-07 22:44:54 +01:00
shortcutme
0214741345 Hashfield test fix 2016-11-07 22:44:03 +01:00
shortcutme
d5b8722bb0 Kill greenlets between tests 2016-11-07 22:43:26 +01:00
shortcutme
c5851cd166 Better DB tests 2016-11-07 22:42:27 +01:00
shortcutme
0418a3e6de Only save sites.json if fully loaded to avoid data loss 2016-11-07 22:40:12 +01:00
shortcutme
8f3dfd7435 Fix site deletion errors on startup 2016-11-07 22:38:01 +01:00
shortcutme
efbd485f5f Update more hashfield on site check 2016-11-07 22:37:31 +01:00
shortcutme
3ba2ecedce Only try to close upnp opened port if necessary 2016-11-07 22:36:14 +01:00
shortcutme
cb214476e4 Keep plugin order after reload to allow plugins to extend other ones 2016-11-07 22:35:28 +01:00
shortcutme
91513f15ae Remove hash by id from hashfield 2016-11-07 22:35:05 +01:00
shortcutme
d39d6a2bd4 Mark if peer has hasfield 2016-11-07 22:34:46 +01:00
shortcutme
65d2b0d996 Still open browser if already running 2016-11-07 22:34:27 +01:00
shortcutme
484659fc3f Separate lock file instad of log file locking 2016-11-07 22:34:12 +01:00
shortcutme
64179e7dc1 Rev1536, Start download optional files on help check 2016-10-04 16:24:33 +02:00
shortcutme
b003c8df01 Rev1535, Fix err not defined on content load 2016-10-04 11:36:33 +02:00
shortcutme
83158de1ce Rev1534 2016-10-03 19:26:51 +02:00
shortcutme
c9efcf7389 Catch socket errors on uPnP punch 2016-10-03 19:26:37 +02:00
shortcutme
3774630476 Close socket after uPnP request 2016-10-03 19:26:06 +02:00
shortcutme
1849547133 Rev1533, Add uPnP open protocols as parameter 2016-10-02 14:39:03 +02:00
shortcutme
8f6f6abb0e Rev1532 2016-10-02 14:27:37 +02:00
shortcutme
fbdc9e2b40 Comment typo 2016-10-02 14:24:48 +02:00
shortcutme
bca08970ba Always disable announce when testing 2016-10-02 14:23:30 +02:00
shortcutme
d6da0c421c Better json compressing 2016-10-02 14:23:05 +02:00
shortcutme
bb23bc7b3c Send diff to second batch of peers 2016-10-02 14:22:32 +02:00
shortcutme
31077eb346 Move uPnP port remove to fileserver 2016-10-02 14:22:01 +02:00
shortcutme
2ab04deded Move optional files hashfield adding to workermanager for better performance 2016-10-02 14:18:35 +02:00
ZeroNet
906f6c65d9 Merge pull request #577 from sirMackk/upnp_update
Closes #466 - Close ports on exit + minor refactoring w/ tests
2016-10-01 13:24:48 +02:00
sirMackk
ea47c47b5e Makes opening a port stop after first successful try. 2016-09-29 15:24:46 +02:00
shortcutme
d760a71b76 Rev1529, Fix json write bug with [] characters in value 2016-09-29 13:01:02 +02:00
ZeroNet
6a58083431 Merge pull request #588 from dldx/master
Update UiRequest.py
2016-09-28 20:42:44 +02:00
shortcutme
a5a56355dc Rev1527 2016-09-28 20:40:10 +02:00
shortcutme
3331e2305b Fix sitePublish cli command 2016-09-28 20:36:02 +02:00
shortcutme
117a82c059 Delete bad_files without size 2016-09-28 20:35:53 +02:00
Durand D'souza
13837971a7 Update UiRequest.py
Fixed a bug where a lack of a trailing slash in every url caused zeronet to fail to load the page, even if it existed.
2016-09-20 05:23:34 +01:00
shortcutme
d608a0d847 Rev1525 2016-09-17 21:01:26 +02:00
shortcutme
67c9921ace Only add non-connected peers to publish if necessary 2016-09-17 21:01:16 +02:00
shortcutme
4690a111bf Push updates to newer clients first 2016-09-17 21:00:40 +02:00
shortcutme
65e5d05a9e Delete cleanup bad files without file info on update 2016-09-17 21:00:20 +02:00
shortcutme
fe59618eaf Rev1523, Real fix file write confirmation 2016-09-14 18:41:28 +02:00
shortcutme
60dd797d1a Rev1522, Fix file write confirmation dialog 2016-09-14 18:28:48 +02:00
shortcutme
e7762e03b4 Rev1521 2016-09-14 10:54:33 +02:00
shortcutme
a7de4aca91 Stop connection loop when closed 2016-09-14 10:54:08 +02:00
shortcutme
1c86a6c58a Close connection on crypt error 2016-09-14 10:53:47 +02:00
shortcutme
ca2a30f7ae Ignore not existent files on dbdict items 2016-09-14 10:53:24 +02:00
shortcutme
9fd19bf382 Fix content deletion 2016-09-14 10:52:41 +02:00
shortcutme
14544922bf Don't check files on siteUpdate 2016-09-14 10:51:10 +02:00
sirMackk
bd5ebdb2de Integrates updated upnppunch with project; Makes project close ports using UPnP on exit. 2016-09-09 12:37:22 +02:00
shortcutme
931426e4fc Rev1518 2016-09-09 12:24:27 +02:00
shortcutme
8241651a28 Add new tracker 2016-09-09 12:24:14 +02:00
shortcutme
e3de6da87e Ignore deleted files on contetndb iteritems 2016-09-09 12:24:00 +02:00
shortcutme
7d78623c92 Remove unnecessary logging 2016-09-09 12:23:26 +02:00
shortcutme
c8325589cc Rev1515 2016-09-07 17:43:18 +02:00
shortcutme
212eabbc20 Remove broken torrent tracker 2016-09-07 17:42:06 +02:00
shortcutme
b2b91c9aff Remove save error message when no sites loaded yet 2016-09-07 17:41:55 +02:00
shortcutme
d5651f1df3 Lazy create peerhashfield objects 2016-09-07 17:41:33 +02:00
shortcutme
7572f8c98b Display Python and ZeroNet version for every command 2016-09-07 17:41:09 +02:00
shortcutme
75e74f1ff7 Always close db after 5 min idle time 2016-09-07 17:40:35 +02:00
shortcutme
a6c4a77e13 Rev1510, Fix site save without loaded SiteManager 2016-09-06 14:52:55 +02:00
shortcutme
d9bbb20743 Rev1509, Fix site delete 2016-09-06 10:16:09 +02:00
shortcutme
ac530b53f6 Rev1508 2016-09-05 13:58:37 +02:00
shortcutme
b8bf773c40 Make test compatible with new content.db 2016-09-05 13:58:10 +02:00
shortcutme
dae5cd3969 Fix startup with 1000+ sites 2016-09-05 13:57:12 +02:00
shortcutme
59205088d2 Move site deletion to dedicted function 2016-09-05 13:55:51 +02:00
shortcutme
cb20280530 Less verbose logging on filerequest 2016-09-05 13:54:17 +02:00
shortcutme
6806eed2ae Dont reload the whole site on content.json update 2016-09-05 13:54:03 +02:00
shortcutme
b7dfeb139b Support callstack formatting 2016-09-05 13:53:40 +02:00
shortcutme
25cb7d9ffa Only check optional files if content.json downloaded 2016-09-05 13:53:10 +02:00
shortcutme
bc875b396b Multiple content.db support 2016-09-05 13:52:52 +02:00
shortcutme
6ac4c8c9cb Version 0.4.1, Rev1501 2016-09-04 18:07:56 +02:00
shortcutme
4dbaab7dd4 List site content.json files without user files 2016-09-04 18:07:09 +02:00
shortcutme
7eab490089 Get optional files size from content.db 2016-09-04 18:06:18 +02:00
shortcutme
49efcd0c2d Execute garbage collection on site delete 2016-09-04 18:05:55 +02:00
shortcutme
69f0e972d3 Check site files on forced update 2016-09-04 18:05:42 +02:00
shortcutme
46a2ea9421 Log slow db queries on verbose mode 2016-09-04 18:05:31 +02:00
shortcutme
96043ba279 Try not to overwrite currently in sync files 2016-09-04 18:05:17 +02:00
shortcutme
d778f2a989 Try to find peers for optional files again if workers failed 2016-09-04 18:03:27 +02:00
shortcutme
5a36a002bf Use bad_files to display progress if that is larger 2016-09-04 18:01:48 +02:00
shortcutme
37a3b4678d Fix user file pre-content.json downloading 2016-09-04 18:01:09 +02:00
shortcutme
365f0cd646 Reset files on cloning 2016-09-04 18:00:51 +02:00
shortcutme
2a7f03af8a Try to reconnect to Tor on send error 2016-09-04 18:00:08 +02:00
shortcutme
f698ec2502 Also delete sites from content.db 2016-09-04 17:59:47 +02:00
shortcutme
a1f0c20afc Rename checkFiles to updateBadFiles 2016-09-04 17:59:29 +02:00
shortcutme
b0a85b0669 Dont check every file on update 2016-09-04 17:58:18 +02:00
shortcutme
9528d333bd Retry failed files on download end 2016-09-04 17:57:44 +02:00
shortcutme
4437a99330 Use pool to download large ammount of content.json files 2016-09-04 17:57:32 +02:00
shortcutme
8f158cbc8f Make listmodified query use content.db cache 2016-09-04 17:56:33 +02:00
shortcutme
135a9b8f5c Fix content.json retry 2016-09-04 17:54:57 +02:00
shortcutme
1dd488ef89 Remove deleted sites from content.db 2016-09-04 17:52:14 +02:00
shortcutme
a614545467 Faster site settings load 2016-09-04 17:51:55 +02:00
shortcutme
3724e0f376 Save sites.json on exit 2016-09-04 17:51:20 +02:00
shortcutme
a12c639bed Dont check files on startup 2016-09-04 17:51:00 +02:00
shortcutme
d6cc40cf3b List modified files using content.db 2016-09-04 17:50:29 +02:00
shortcutme
f4de16fde6 Close db after 5 min idle time 2016-09-04 17:49:56 +02:00
shortcutme
0ab2630519 Change db journal to memory for faster connection time 2016-09-04 17:49:47 +02:00
shortcutme
682fa80a8a Fix site size calculation 2016-09-04 17:44:45 +02:00
shortcutme
1801df32a6 Change getTotalSize to use content.db cache 2016-09-04 17:44:30 +02:00
shortcutme
23e06a09cb Remove deleted files from hashfield 2016-09-04 17:43:57 +02:00
shortcutme
1bd6e2f493 Cache bad_files and optional hashfield in sites.json 2016-09-04 17:43:30 +02:00
shortcutme
ecb5885dba Cache file sizes and modification date in sqlite db 2016-09-04 17:41:04 +02:00
shortcutme
2fcfa21761 Rev1429 2016-08-29 11:18:01 +02:00
shortcutme
4efaaaabc0 Stop when siteVerify find a bad file 2016-08-29 11:17:36 +02:00
shortcutme
709dc854e7 Add site to site manager if required 2016-08-29 11:17:19 +02:00
shortcutme
b52e8f74e2 Rev1428, Don't display websocket error when navigating away 2016-08-27 11:52:44 +02:00
shortcutme
887a07c3fb Rev1427, Skip invalid files on dbRebuild 2016-08-27 11:01:41 +02:00
shortcutme
3ce11a0dab Rev1426 2016-08-26 11:43:08 +02:00
shortcutme
6c6ce54a20 Run test in verbose mode 2016-08-26 11:42:44 +02:00
shortcutme
d76c1ca98e Also cleanup connections for smaller sites 2016-08-26 11:42:23 +02:00
shortcutme
1557d3c390 Always keep connections for the sites 2016-08-26 11:41:45 +02:00
shortcutme
7edb784305 Fix user file updating on owned sites 2016-08-26 11:40:22 +02:00
shortcutme
f44de281a8 Rev1425 2016-08-22 03:41:20 +02:00
shortcutme
5061e0051a Test missing cert verification 2016-08-22 03:41:12 +02:00
shortcutme
2c4f566687 Fix missing cert verification 2016-08-22 03:40:55 +02:00
shortcutme
21812ec064 Merge branch 'master' of https://github.com/HelloZeroNet/ZeroNet 2016-08-20 10:40:03 +02:00
shortcutme
173355bc02 Rev1424, Fix connected_limit and size_limit paramter parsing 2016-08-20 10:39:52 +02:00
ZeroNet
3c7a9f0f82 Merge pull request #537 from megfault/patch-1
Fix typos in log message
2016-08-17 11:32:25 +02:00
shortcutme
3049e489fb Rev1422 2016-08-16 19:58:27 +02:00
shortcutme
3524198599 Don't log owned local file reload 2016-08-16 19:56:35 +02:00
shortcutme
274414a54b Give up user's content.json after 5 retrys 2016-08-16 19:56:18 +02:00
shortcutme
b40b3e2d85 Fix config size_limit parsing 2016-08-16 19:55:55 +02:00
Ana Barroso
c9660ed20e Fix typos in log message 2016-08-16 18:14:02 +02:00
shortcutme
8cd7a63490 Rev1416, Remove merger permission from merged sites 2016-08-15 23:05:05 +02:00
shortcutme
e9009c5c75 WorkerManager quickfix 2016-08-15 15:59:49 +02:00
shortcutme
686a2de570 Rev1411 2016-08-15 13:57:16 +02:00
shortcutme
92e4dd64d1 Dont recalculate site size on update 2016-08-15 13:56:17 +02:00
shortcutme
3c5e4e64ca Fix site size calculation 2016-08-15 13:56:04 +02:00
shortcutme
16ed55a745 Dont recalculate site size on owned site update 2016-08-15 13:55:45 +02:00
shortcutme
64febc7f61 Publish incoming modifications only to 2 peers 2016-08-15 13:54:00 +02:00
shortcutme
4975ef82d7 Fix port open checking 2016-08-15 13:53:20 +02:00
shortcutme
954c6bcbc3 Worker number related to connection limit 2016-08-15 13:52:48 +02:00
ZeroNet
af4447e666 Version 0.4.0, Rev1400 2016-08-10 13:03:12 +02:00
ZeroNet
b7b238b890 Re-sign testdata 2016-08-10 13:00:14 +02:00
ZeroNet
96f368c7e2 Test user file archiving 2016-08-10 12:59:42 +02:00
ZeroNet
48d59e355c Allow content.json without modification date 2016-08-10 12:59:19 +02:00
ZeroNet
7bd76270ba Remove bad status from deleted files 2016-08-10 12:58:54 +02:00
ZeroNet
bed66cdcd2 ContentManager.py formatting 2016-08-10 12:58:19 +02:00
ZeroNet
f719b89a7a Always apply extended information to content.json if keys missing 2016-08-10 12:57:55 +02:00
ZeroNet
7291ac8c6b No exception on incomplete content.json signing 2016-08-10 12:57:24 +02:00
ZeroNet
ec759442ed Support and delete archived users files 2016-08-10 12:55:39 +02:00
ZeroNet
238cb25bb4 Small incoming connection optimization 2016-08-10 12:51:38 +02:00
ZeroNet
f21fdb23b6 Allow to store field in json table 2016-08-10 12:49:38 +02:00
ZeroNet
0ddc1e47ba Delete file's database entries if file paramter is False 2016-08-10 12:49:22 +02:00
ZeroNet
55cc496c2e Type 3 json table format 2016-08-10 12:47:29 +02:00
ZeroNet
721bed76a9 Type 3 dbschema version for merger sites 2016-08-10 12:46:27 +02:00
ZeroNet
a38b6c9fb2 It new js should be at least 1 second newer than previous file to merge again 2016-08-10 12:45:48 +02:00
ZeroNet
1f4609d1a3 Fix dbRebuild command line action 2016-08-10 12:44:17 +02:00
ZeroNet
07a6bd523c Accept only 30 peers on pex 2016-08-10 12:44:00 +02:00
ZeroNet
122ef02605 Hot-patch in memory plugin classes 2016-08-10 12:43:35 +02:00
ZeroNet
67f75c4bef Skip archived user files 2016-08-10 12:42:29 +02:00
ZeroNet
0275954fb7 Tracker log total peers 2016-08-10 12:42:13 +02:00
ZeroNet
44dc4c41c9 Wait for user's content.json on file request 2016-08-10 12:41:35 +02:00
ZeroNet
e5e76a4ef5 Do not reload the whole site on update command 2016-08-10 12:41:04 +02:00
ZeroNet
021a084796 Peers query optimize 2016-08-10 12:40:17 +02:00
ZeroNet
1ec00947ad Save site on content.json arrive 2016-08-10 12:36:20 +02:00
ZeroNet
f38f4c3758 Use SiteManager to save site 2016-08-10 12:35:40 +02:00
ZeroNet
2852bbc657 Remove unnecessary site savings 2016-08-10 12:35:17 +02:00
ZeroNet
0d565dc64d Better site settings saving 2016-08-10 12:34:28 +02:00
ZeroNet
1f3a4f0e2f Remove orphan sites from sites.json 2016-08-10 12:33:34 +02:00
ZeroNet
53249f4f07 Add own logger to SiteManager 2016-08-10 12:32:28 +02:00
ZeroNet
0569697d98 Update database on delete 2016-08-10 12:31:54 +02:00
ZeroNet
acf24aab6f Allow to pass file object on file updated 2016-08-10 12:31:30 +02:00
ZeroNet
3ff75c6602 Also trigger onUpdated on file delete 2016-08-10 12:30:35 +02:00
ZeroNet
0be6cb6602 Move database files listing to separate funcion 2016-08-10 12:30:04 +02:00
ZeroNet
9def3b58eb Allow plugins on SiteStorage 2016-08-10 12:28:57 +02:00
ZeroNet
447a37f228 Compiled wrapper.coffee 2016-08-10 12:28:05 +02:00
ZeroNet
70cf67498b Hide progress bar after 300ms 2016-08-10 12:27:37 +02:00
ZeroNet
10b46db524 Also display progress bar for other sites 2016-08-10 12:27:24 +02:00
ZeroNet
687208a785 Fix wrapperReload command 2016-08-10 12:26:00 +02:00
ZeroNet
2915eb7a83 Reply to setlocalstorage 2016-08-10 12:25:39 +02:00
ZeroNet
f82055fef7 Wrapper permissionadd confirm 2016-08-10 12:25:25 +02:00
ZeroNet
835381fbb1 Filter media referrer by original request address 2016-08-10 12:24:47 +02:00
ZeroNet
04bed98a97 Store original request address 2016-08-10 12:24:09 +02:00
ZeroNet
d542cc5b32 Log fileWrite permission errors 2016-08-10 12:23:01 +02:00