Commit Graph

470 Commits

Author SHA1 Message Date
Jakub Sztandera
3a46c15c4a
Disable blockstore bloom filter
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-10-21 04:22:49 +02:00
Steven Allen
86e30729bf give the TimeCacheBS tests a bit more time
Otherwise, they flake once in a while.
2020-10-14 16:51:26 -07:00
Steven Allen
811f1304e6 test timed cache blockstore 2020-10-14 16:17:55 -07:00
Steven Allen
15fe998c68 add an timed-cache blockstore
This blockstore lets us write to a temporary scratch location where blocks older
than the specified cache time are automatically cleared.
2020-10-14 14:43:58 -07:00
Steven Allen
4b38809c0b in-memory blockstore
Instead of using an in-memory datastore and dealing with the overhead of
computing datastore keys, creating new blocks, etc, use an in-memory blockstore.
2020-10-14 14:43:58 -07:00
Łukasz Magiera
8cdf078999 backup: append checksum 2020-10-06 01:50:54 +02:00
Łukasz Magiera
d7ec5e3618 lotus-miner init restore 2020-10-01 17:55:48 +02:00
Łukasz Magiera
c8a3269c4b shed: utils to read datastore backups 2020-10-01 17:55:47 +02:00
Łukasz Magiera
2dc9a1ee4e lotus-miner backup command 2020-10-01 17:55:47 +02:00
Łukasz Magiera
4d4bab12eb Improve miner sectors list UX 2020-09-30 13:34:05 +02:00
Jakub Sztandera
4fce0181ab
Ignore the linter
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-09-08 12:18:48 +02:00
Jakub Sztandera
74e577610a
Forward peers from hello to blocksync
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-09-08 10:18:51 +02:00
Aayush Rajasekaran
39755a294a Update to specs v0.9.6 2020-09-07 15:48:41 -04:00
frrist
0d61e0d717 refactor(ctx): update to latest go-jsonrpc 2020-08-25 15:20:41 -07:00
Steven Allen
5733c71c50 Lint everything
We were ignoring quite a few error cases, and had one case where we weren't
actually updating state where we wanted to. Unfortunately, if the linter doesn't
pass, nobody has any reason to actually check lint failures in CI.

There are three remaining XXXs marked in the code for lint.
2020-08-20 20:46:36 -07:00
whyrusleeping
38a2f82f78 fix fd limit test 2020-08-20 18:43:43 -07:00
whyrusleeping
2010bf55b7 add a doc on environment variables that can be used to tweak lotus 2020-08-20 12:52:50 -07:00
Raúl Kripalani
862bafc63a fix lint errors. 2020-08-17 14:39:33 +01:00
Raúl Kripalani
efdc428d5d keep storage-fsm (renamed to storage-sealing) and sector-storage in extern. 2020-08-17 14:26:18 +01:00
Raúl Kripalani
fb0ccc9260 integrate extern/storage-fsm into lotus proper. 2020-08-16 10:42:13 +01:00
Łukasz Magiera
a52e406c0d Fix AddPiece with data and multiple workers 2020-08-15 01:36:29 +02:00
Łukasz Magiera
4ca5fef0de rpcenc: fix bug 2020-08-14 23:49:08 +02:00
Łukasz Magiera
42bb91c2e6 gofmt 2020-08-14 23:40:41 +02:00
Łukasz Magiera
aa611e49fd rpcenc: Add timeout for readers 2020-08-14 23:12:55 +02:00
Łukasz Magiera
0c75dd3865 Support AddPiece on workers 2020-08-14 16:06:53 +02:00
Łukasz Magiera
e4f475ee59 gofmt 2020-08-04 19:07:31 +02:00
Łukasz Magiera
adee59c795 client cli: improve lit-deals output 2020-08-04 19:07:17 +02:00
Łukasz Magiera
4cb4e7c2c2 Merge remote-tracking branch 'origin/master' into next 2020-07-31 14:02:04 +02:00
Simon Peffers
78739d9417 Fixes for failed CI tests 2020-07-26 00:46:23 -04:00
Simon Peffers
0f3105a01f Integrate blst signature library: https://github.com/supranational/blst 2020-07-25 21:38:18 -04:00
Steven Allen
b7a4dbb07f Support inline CIDs
And use the new CidBuilder from the spec actors.

This patch does not switch over to inline CIDs by default, but paves the way.
2020-07-23 23:12:32 -07:00
Łukasz Magiera
774c6901a8 Merge remote-tracking branch 'origin/master' into next 2020-07-23 22:48:38 +02:00
Steven Allen
5fc83f4d05 Refactor to use actor adt types instead of directly using HAMTs and AMTs
This way there's a single source of truth. Preparation for fixing
https://github.com/filecoin-project/specs-actors/issues/517 (requires changing
HAMT parameters).
2020-07-23 09:34:57 -07:00
Łukasz Magiera
df801470ca
Return size in bufbs.GetSize 2020-07-23 10:23:44 +02:00
Hannah Howard
7b00bb1ffe
Merge pull request #2448 from filecoin-project/feat/payment-channel-settler
Submit vouchers automatically when payment channels settle
2020-07-22 18:03:48 -07:00
Aayush Rajasekaran
54c0ae17f4 Implement buffered blocktore GetSize() 2020-07-22 19:58:35 -04:00
Łukasz Magiera
67a1b3e382
Merge pull request #2530 from filecoin-project/master
Merge master into next
2020-07-22 21:24:37 +02:00
Łukasz Magiera
d70edbcb7c Set things on syscallShim 2020-07-22 13:35:10 -04:00
lanzafame
6f04b1dbd8 change debug to debugf 2020-07-22 10:40:41 +10:00
Anton Evangelatov
d16529dacb shutdown for peermgr 2020-07-20 17:45:46 +02:00
Ignacio Hagopian
fd2262f51f
ipbsbstore: offlinemode, and Has() fix
Signed-off-by: Ignacio Hagopian <jsign.uy@gmail.com>
2020-07-17 18:02:12 -03:00
Łukasz Magiera
c1233291bc Merge remote-tracking branch 'origin/master' into next 2020-07-15 19:47:27 +02:00
Whyrusleeping
62a503d686
Merge pull request #1563 from filecoin-project/feat/cache-bs
add an lru caching blockstore
2020-07-13 16:20:43 -07:00
Raúl Kripalani
973dbd6a13 Merge branch 'next' into mock-clock 2020-07-13 11:29:53 +01:00
Łukasz Magiera
8ce35e30dd Merge remote-tracking branch 'origin/master' into next 2020-07-10 21:50:38 +02:00
Raúl Kripalani
13de81b3b2 introduce the ability to mock time. 2020-07-10 15:51:45 +01:00
Jakub Sztandera
b0cf3d3228
Mute RtRefreshManager logs as they break terminal emulation
RtRefreshManager logs random binary strings, which somtimes might be
partial multi-byte Unicode or ASCI escape codes.

Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-07-09 16:21:55 +02:00
Jakub Sztandera
9936439608
Merge remote-tracking branch 'origin/master' into next
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-07-03 14:56:06 +02:00
whyrusleeping
809a3ba07c check underlying datastore for objects before putting to bufbstore 2020-07-02 16:48:14 -07:00
Łukasz Magiera
4c422c2d50 specs-actors v0.7.1 2020-07-01 13:47:40 +02:00
Łukasz Magiera
9030b559e8
Merge pull request #1470 from hunjixin/hunjixin/test/bls_benchmarks
add bench mark for bls sign and verify
2020-07-01 10:57:34 +02:00
Jakub Sztandera
2a78ebabd9
Use HashVerify
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-15 17:39:16 +02:00
Jakub Sztandera
96ade5f2dd
Cleanup more lint warnings
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-02 18:38:41 +02:00
Jakub Sztandera
5605aae269
Fix even more lint warnings
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-02 16:29:39 +02:00
Jeromy
bac1e3f901 put blocks in cache after get 2020-05-29 15:15:59 -07:00
Jeromy
94555ea8c1 delete block should delete from cache too 2020-05-29 15:13:18 -07:00
Jeromy
cc233c6956 add an lru caching blockstore 2020-05-29 15:13:18 -07:00
Łukasz Magiera
785eeb1eee
Merge pull request #1850 from filecoin-project/chore/lint
Cleanup many lint warnings
2020-05-29 18:06:06 +02:00
Jeromy
e2a554c2e6 update specs actors to version with batch porep verification 2020-05-28 13:19:18 -07:00
Ignacio Hagopian
de3edc2ec7 remote ipfs support & automatic env
Signed-off-by: Ignacio Hagopian <jsign.uy@gmail.com>
2020-05-28 22:11:49 +02:00
Jakub Sztandera
b372881e91
Fix more lint warnings
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-05-28 01:15:19 +02:00
Jakub Sztandera
d6615b6286
Cleanup many lint warnings
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-05-27 22:53:20 +02:00
Ignacio Hagopian
d5346f8326
remote ipfs support & automatic env
Signed-off-by: Ignacio Hagopian <jsign.uy@gmail.com>
2020-05-26 14:52:51 -03:00
Łukasz Magiera
f7325a69c1 Extract auth utils to go-jsonrpc 2020-05-20 20:37:45 +02:00
Łukasz Magiera
eeca031525 extract lib/jsonrpc to go-jsonrpc 2020-05-20 19:49:09 +02:00
Whyrusleeping
70657e35ba
Merge pull request #1708 from filecoin-project/feat/block-validator
Improved pubsub block validator
2020-05-15 11:26:26 -07:00
Jeromy
edae6a3ae8 fix the problem 2020-05-14 12:05:01 -07:00
Jeromy
987571dd8c add test to demonstrate failure 2020-05-14 11:48:58 -07:00
vyzo
81bc159b3e cache successful block signature validation 2020-05-14 20:48:40 +03:00
Jeromy
8d85aedeff clean up output channel handling logic to prevent send on closed channels 2020-05-13 16:31:17 -07:00
Łukasz Magiera
35b1963eeb gofmt 2020-05-01 21:51:31 +02:00
Łukasz Magiera
4014cbdb44 jsonrpc: Correctly cancel server-side contexts on lost connection 2020-05-01 21:50:34 +02:00
Łukasz Magiera
971282a9a5 jsonrpc: Test hanging ctx on unclean disconnect 2020-05-01 21:30:32 +02:00
Łukasz Magiera
9f2df68906 workers: handle disconnecting workers more gracefully 2020-05-01 20:15:06 +02:00
Łukasz Magiera
6077edb3d0 jsonrpc: Test channel closing on when connection drops 2020-05-01 16:52:05 +02:00
Łukasz Magiera
0d4bf2e980 Merge branch 'testnet/3' into feat/ipfsclient 2020-04-30 13:09:47 +02:00
Łukasz Magiera
be439d3b13 Merge remote-tracking branch 'origin/master' into testnet/3 2020-04-30 13:03:08 +02:00
Łukasz Magiera
5ec76d4b7b support making deals with data directly from IPFS nodes 2020-04-30 01:56:45 +02:00
Jeromy
bfa93bb933 add script to run a local devnet, and helper command 2020-04-27 15:26:46 -07:00
Jeromy
f4948dcba0 remove api dependency on sealing fsm package 2020-04-23 15:33:59 -07:00
Jeromy
216072468f handle websocket clients disconnecting more properly 2020-04-20 09:52:16 -07:00
Jakub Sztandera
f1c890ca54 Tests pass
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-04-08 18:31:16 +02:00
Łukasz Magiera
0417e4bd0c pond: Use tipestKeys for state calls 2020-04-03 01:09:31 +02:00
Łukasz Magiera
f15eb8b172 Merge pull request #1487 from filecoin-project/fix/partial-sync-responses
properly handle partial sync responses
2020-04-02 00:03:25 +02:00
Łukasz Magiera
f727f1db26 bufbs: Env var to disable blockstore buffering 2020-04-01 22:37:34 +02:00
Jeromy
27d57264d9 properly handle partial sync responses 2020-04-01 11:35:09 -07:00
lijunlong
8c05251cce simplify code 2020-04-01 09:41:26 +08:00
lijunlong
7c15d1e8c3 add bench mark for bls sign and verify 2020-03-28 12:34:12 +08:00
Łukasz Magiera
c66d3dfad7 sectorstorage: Untangle from lotus deps 2020-03-27 22:35:33 +01:00
Łukasz Magiera
cd618dfdbd gofmt 2020-03-22 22:39:27 +01:00
Łukasz Magiera
df9aa0e357 storagemitner: manage ulimit on start 2020-03-22 22:08:22 +01:00
Łukasz Magiera
1ed7779701 Merge remote-tracking branch 'origin/testnet/3' into feat/new-workers 2020-03-19 03:28:55 +01:00
Łukasz Magiera
94ebbd9d90 workers: Actually register in miner 2020-03-19 00:23:32 +01:00
Jakub Sztandera
06ce4f21c5 Warn on non zero result with error
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-03-14 15:08:24 +01:00
Jim Pick
b6d5ea629b Make websocket connection upgrade header check case-insensitive
I was having troubles configuring an nginx reverse-proxy when
using Websockets.

It turns out my configuration was sending a "Connection: upgrade"
header, but Lotus expected "Connection: Upgrade".

This commit converts the check to be case-insensitive.

Some of the examples on the MDN page show lower-case "upgrade",
so I think it's not unusual for the usage to vary.
2020-03-13 13:07:39 -07:00
Jakub Sztandera
21b34ba133 Fix chan handling
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-03-11 19:14:49 +01:00
Jakub Sztandera
8d870a03b5 Fix Error and Result being returne at the same time in JSON-RPC
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-03-11 18:48:02 +01:00
whyrusleeping
baca881473 dont panic when replay fails to find a message 2020-03-10 12:44:50 -07:00
whyrusleeping
24bf720a9a Merge branch 'master' into testnet/3 2020-03-07 16:46:12 -08:00
Łukasz Magiera
3d1a5f4bf3 libs: Use go-statemachine 2020-03-06 20:01:03 +01:00