Raúl Kripalani
7c442e1a98
godocs.
2020-11-06 18:55:13 +00:00
Raúl Kripalani
de4a0725f3
rename files.
2020-11-06 18:32:44 +00:00
Raúl Kripalani
b1aa43741a
remove file that sneaked in.
2020-11-05 13:34:41 +00:00
Łukasz Magiera
a1e1b03ca4
Optionally allow bitswap for chainstore
2020-11-03 23:44:44 +01:00
Łukasz Magiera
b0824ada15
bufbs: Get from write blockstore first
2020-11-03 23:02:01 +01:00
Raúl Kripalani
d1ebf3c769
introduce non-pooled StorageKey method.
2020-11-02 13:32:07 +00:00
Raúl Kripalani
7facdf63c9
support legacy keying: base32 multihashes *sigh*.
2020-11-02 12:55:56 +00:00
Raúl Kripalani
72e573d98d
fix lint.
2020-11-01 17:09:14 +00:00
Raúl Kripalani
9437136f84
fixup.
2020-11-01 13:01:38 +00:00
Raúl Kripalani
ce27b13076
add a native badger blockstore with View() method.
2020-11-01 12:55:49 +00:00
Łukasz Magiera
c3d00b0ac6
Merge pull request #4650 from jsign/jsign/offlinemode
...
make IPFS online mode configurable
2020-10-29 22:24:58 +01:00
Ignacio Hagopian
7d0f279353
make IPFS online mode configurable
...
Signed-off-by: Ignacio Hagopian <jsign.uy@gmail.com>
2020-10-29 15:16:45 -03:00
Łukasz Magiera
8c60069bb8
Merge pull request #4535 from filecoin-project/feat/clientdeal-cache-commd
...
client deal: Cache CommD when creating multiple deals
2020-10-27 03:58:25 +01:00
Łukasz Magiera
31a474a1ca
Move CommPWriter to lib/
2020-10-26 15:16:28 +01:00
Jakub Sztandera
9fbd2a50ff
Fix lint
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-10-23 20:50:17 +02:00
Jakub Sztandera
ea69386519
Fix flaky TestTimedBSSimple
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-10-23 20:46:06 +02:00
Jakub Sztandera
3a46c15c4a
Disable blockstore bloom filter
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-10-21 04:22:49 +02:00
Steven Allen
86e30729bf
give the TimeCacheBS tests a bit more time
...
Otherwise, they flake once in a while.
2020-10-14 16:51:26 -07:00
Steven Allen
811f1304e6
test timed cache blockstore
2020-10-14 16:17:55 -07:00
Steven Allen
15fe998c68
add an timed-cache blockstore
...
This blockstore lets us write to a temporary scratch location where blocks older
than the specified cache time are automatically cleared.
2020-10-14 14:43:58 -07:00
Steven Allen
4b38809c0b
in-memory blockstore
...
Instead of using an in-memory datastore and dealing with the overhead of
computing datastore keys, creating new blocks, etc, use an in-memory blockstore.
2020-10-14 14:43:58 -07:00
Łukasz Magiera
8cdf078999
backup: append checksum
2020-10-06 01:50:54 +02:00
Łukasz Magiera
d7ec5e3618
lotus-miner init restore
2020-10-01 17:55:48 +02:00
Łukasz Magiera
c8a3269c4b
shed: utils to read datastore backups
2020-10-01 17:55:47 +02:00
Łukasz Magiera
2dc9a1ee4e
lotus-miner backup command
2020-10-01 17:55:47 +02:00
Łukasz Magiera
4d4bab12eb
Improve miner sectors list UX
2020-09-30 13:34:05 +02:00
Jakub Sztandera
4fce0181ab
Ignore the linter
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-09-08 12:18:48 +02:00
Jakub Sztandera
74e577610a
Forward peers from hello to blocksync
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-09-08 10:18:51 +02:00
Aayush Rajasekaran
39755a294a
Update to specs v0.9.6
2020-09-07 15:48:41 -04:00
frrist
0d61e0d717
refactor(ctx): update to latest go-jsonrpc
2020-08-25 15:20:41 -07:00
Steven Allen
5733c71c50
Lint everything
...
We were ignoring quite a few error cases, and had one case where we weren't
actually updating state where we wanted to. Unfortunately, if the linter doesn't
pass, nobody has any reason to actually check lint failures in CI.
There are three remaining XXXs marked in the code for lint.
2020-08-20 20:46:36 -07:00
whyrusleeping
38a2f82f78
fix fd limit test
2020-08-20 18:43:43 -07:00
whyrusleeping
2010bf55b7
add a doc on environment variables that can be used to tweak lotus
2020-08-20 12:52:50 -07:00
Raúl Kripalani
862bafc63a
fix lint errors.
2020-08-17 14:39:33 +01:00
Raúl Kripalani
efdc428d5d
keep storage-fsm (renamed to storage-sealing) and sector-storage in extern.
2020-08-17 14:26:18 +01:00
Raúl Kripalani
fb0ccc9260
integrate extern/storage-fsm into lotus proper.
2020-08-16 10:42:13 +01:00
Łukasz Magiera
a52e406c0d
Fix AddPiece with data and multiple workers
2020-08-15 01:36:29 +02:00
Łukasz Magiera
4ca5fef0de
rpcenc: fix bug
2020-08-14 23:49:08 +02:00
Łukasz Magiera
42bb91c2e6
gofmt
2020-08-14 23:40:41 +02:00
Łukasz Magiera
aa611e49fd
rpcenc: Add timeout for readers
2020-08-14 23:12:55 +02:00
Łukasz Magiera
0c75dd3865
Support AddPiece on workers
2020-08-14 16:06:53 +02:00
Łukasz Magiera
e4f475ee59
gofmt
2020-08-04 19:07:31 +02:00
Łukasz Magiera
adee59c795
client cli: improve lit-deals output
2020-08-04 19:07:17 +02:00
Łukasz Magiera
4cb4e7c2c2
Merge remote-tracking branch 'origin/master' into next
2020-07-31 14:02:04 +02:00
Simon Peffers
78739d9417
Fixes for failed CI tests
2020-07-26 00:46:23 -04:00
Simon Peffers
0f3105a01f
Integrate blst signature library: https://github.com/supranational/blst
2020-07-25 21:38:18 -04:00
Steven Allen
b7a4dbb07f
Support inline CIDs
...
And use the new CidBuilder from the spec actors.
This patch does not switch over to inline CIDs by default, but paves the way.
2020-07-23 23:12:32 -07:00
Łukasz Magiera
774c6901a8
Merge remote-tracking branch 'origin/master' into next
2020-07-23 22:48:38 +02:00
Steven Allen
5fc83f4d05
Refactor to use actor adt types instead of directly using HAMTs and AMTs
...
This way there's a single source of truth. Preparation for fixing
https://github.com/filecoin-project/specs-actors/issues/517 (requires changing
HAMT parameters).
2020-07-23 09:34:57 -07:00
Łukasz Magiera
df801470ca
Return size in bufbs.GetSize
2020-07-23 10:23:44 +02:00
Hannah Howard
7b00bb1ffe
Merge pull request #2448 from filecoin-project/feat/payment-channel-settler
...
Submit vouchers automatically when payment channels settle
2020-07-22 18:03:48 -07:00
Aayush Rajasekaran
54c0ae17f4
Implement buffered blocktore GetSize()
2020-07-22 19:58:35 -04:00
Łukasz Magiera
67a1b3e382
Merge pull request #2530 from filecoin-project/master
...
Merge master into next
2020-07-22 21:24:37 +02:00
Łukasz Magiera
d70edbcb7c
Set things on syscallShim
2020-07-22 13:35:10 -04:00
lanzafame
6f04b1dbd8
change debug to debugf
2020-07-22 10:40:41 +10:00
Anton Evangelatov
d16529dacb
shutdown for peermgr
2020-07-20 17:45:46 +02:00
Ignacio Hagopian
fd2262f51f
ipbsbstore: offlinemode, and Has() fix
...
Signed-off-by: Ignacio Hagopian <jsign.uy@gmail.com>
2020-07-17 18:02:12 -03:00
Łukasz Magiera
c1233291bc
Merge remote-tracking branch 'origin/master' into next
2020-07-15 19:47:27 +02:00
Whyrusleeping
62a503d686
Merge pull request #1563 from filecoin-project/feat/cache-bs
...
add an lru caching blockstore
2020-07-13 16:20:43 -07:00
Raúl Kripalani
973dbd6a13
Merge branch 'next' into mock-clock
2020-07-13 11:29:53 +01:00
Łukasz Magiera
8ce35e30dd
Merge remote-tracking branch 'origin/master' into next
2020-07-10 21:50:38 +02:00
Raúl Kripalani
13de81b3b2
introduce the ability to mock time.
2020-07-10 15:51:45 +01:00
Jakub Sztandera
b0cf3d3228
Mute RtRefreshManager logs as they break terminal emulation
...
RtRefreshManager logs random binary strings, which somtimes might be
partial multi-byte Unicode or ASCI escape codes.
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-07-09 16:21:55 +02:00
Jakub Sztandera
9936439608
Merge remote-tracking branch 'origin/master' into next
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-07-03 14:56:06 +02:00
whyrusleeping
809a3ba07c
check underlying datastore for objects before putting to bufbstore
2020-07-02 16:48:14 -07:00
Łukasz Magiera
4c422c2d50
specs-actors v0.7.1
2020-07-01 13:47:40 +02:00
Łukasz Magiera
9030b559e8
Merge pull request #1470 from hunjixin/hunjixin/test/bls_benchmarks
...
add bench mark for bls sign and verify
2020-07-01 10:57:34 +02:00
Jakub Sztandera
2a78ebabd9
Use HashVerify
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-15 17:39:16 +02:00
Jakub Sztandera
96ade5f2dd
Cleanup more lint warnings
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-02 18:38:41 +02:00
Jakub Sztandera
5605aae269
Fix even more lint warnings
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-02 16:29:39 +02:00
Jeromy
bac1e3f901
put blocks in cache after get
2020-05-29 15:15:59 -07:00
Jeromy
94555ea8c1
delete block should delete from cache too
2020-05-29 15:13:18 -07:00
Jeromy
cc233c6956
add an lru caching blockstore
2020-05-29 15:13:18 -07:00
Łukasz Magiera
785eeb1eee
Merge pull request #1850 from filecoin-project/chore/lint
...
Cleanup many lint warnings
2020-05-29 18:06:06 +02:00
Jeromy
e2a554c2e6
update specs actors to version with batch porep verification
2020-05-28 13:19:18 -07:00
Ignacio Hagopian
de3edc2ec7
remote ipfs support & automatic env
...
Signed-off-by: Ignacio Hagopian <jsign.uy@gmail.com>
2020-05-28 22:11:49 +02:00
Jakub Sztandera
b372881e91
Fix more lint warnings
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-05-28 01:15:19 +02:00
Jakub Sztandera
d6615b6286
Cleanup many lint warnings
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-05-27 22:53:20 +02:00
Ignacio Hagopian
d5346f8326
remote ipfs support & automatic env
...
Signed-off-by: Ignacio Hagopian <jsign.uy@gmail.com>
2020-05-26 14:52:51 -03:00
Łukasz Magiera
f7325a69c1
Extract auth utils to go-jsonrpc
2020-05-20 20:37:45 +02:00
Łukasz Magiera
eeca031525
extract lib/jsonrpc to go-jsonrpc
2020-05-20 19:49:09 +02:00
Whyrusleeping
70657e35ba
Merge pull request #1708 from filecoin-project/feat/block-validator
...
Improved pubsub block validator
2020-05-15 11:26:26 -07:00
Jeromy
edae6a3ae8
fix the problem
2020-05-14 12:05:01 -07:00
Jeromy
987571dd8c
add test to demonstrate failure
2020-05-14 11:48:58 -07:00
vyzo
81bc159b3e
cache successful block signature validation
2020-05-14 20:48:40 +03:00
Jeromy
8d85aedeff
clean up output channel handling logic to prevent send on closed channels
2020-05-13 16:31:17 -07:00
Łukasz Magiera
35b1963eeb
gofmt
2020-05-01 21:51:31 +02:00
Łukasz Magiera
4014cbdb44
jsonrpc: Correctly cancel server-side contexts on lost connection
2020-05-01 21:50:34 +02:00
Łukasz Magiera
971282a9a5
jsonrpc: Test hanging ctx on unclean disconnect
2020-05-01 21:30:32 +02:00
Łukasz Magiera
9f2df68906
workers: handle disconnecting workers more gracefully
2020-05-01 20:15:06 +02:00
Łukasz Magiera
6077edb3d0
jsonrpc: Test channel closing on when connection drops
2020-05-01 16:52:05 +02:00
Łukasz Magiera
0d4bf2e980
Merge branch 'testnet/3' into feat/ipfsclient
2020-04-30 13:09:47 +02:00
Łukasz Magiera
be439d3b13
Merge remote-tracking branch 'origin/master' into testnet/3
2020-04-30 13:03:08 +02:00
Łukasz Magiera
5ec76d4b7b
support making deals with data directly from IPFS nodes
2020-04-30 01:56:45 +02:00
Jeromy
bfa93bb933
add script to run a local devnet, and helper command
2020-04-27 15:26:46 -07:00
Jeromy
f4948dcba0
remove api dependency on sealing fsm package
2020-04-23 15:33:59 -07:00
Jeromy
216072468f
handle websocket clients disconnecting more properly
2020-04-20 09:52:16 -07:00
Jakub Sztandera
f1c890ca54
Tests pass
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-04-08 18:31:16 +02:00
Łukasz Magiera
0417e4bd0c
pond: Use tipestKeys for state calls
2020-04-03 01:09:31 +02:00
Łukasz Magiera
f15eb8b172
Merge pull request #1487 from filecoin-project/fix/partial-sync-responses
...
properly handle partial sync responses
2020-04-02 00:03:25 +02:00
Łukasz Magiera
f727f1db26
bufbs: Env var to disable blockstore buffering
2020-04-01 22:37:34 +02:00
Jeromy
27d57264d9
properly handle partial sync responses
2020-04-01 11:35:09 -07:00
lijunlong
8c05251cce
simplify code
2020-04-01 09:41:26 +08:00
lijunlong
7c15d1e8c3
add bench mark for bls sign and verify
2020-03-28 12:34:12 +08:00
Łukasz Magiera
c66d3dfad7
sectorstorage: Untangle from lotus deps
2020-03-27 22:35:33 +01:00
Łukasz Magiera
cd618dfdbd
gofmt
2020-03-22 22:39:27 +01:00
Łukasz Magiera
df9aa0e357
storagemitner: manage ulimit on start
2020-03-22 22:08:22 +01:00
Łukasz Magiera
1ed7779701
Merge remote-tracking branch 'origin/testnet/3' into feat/new-workers
2020-03-19 03:28:55 +01:00
Łukasz Magiera
94ebbd9d90
workers: Actually register in miner
2020-03-19 00:23:32 +01:00
Jakub Sztandera
06ce4f21c5
Warn on non zero result with error
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-03-14 15:08:24 +01:00
Jim Pick
b6d5ea629b
Make websocket connection upgrade header check case-insensitive
...
I was having troubles configuring an nginx reverse-proxy when
using Websockets.
It turns out my configuration was sending a "Connection: upgrade"
header, but Lotus expected "Connection: Upgrade".
This commit converts the check to be case-insensitive.
Some of the examples on the MDN page show lower-case "upgrade",
so I think it's not unusual for the usage to vary.
2020-03-13 13:07:39 -07:00
Jakub Sztandera
21b34ba133
Fix chan handling
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-03-11 19:14:49 +01:00
Jakub Sztandera
8d870a03b5
Fix Error and Result being returne at the same time in JSON-RPC
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-03-11 18:48:02 +01:00
whyrusleeping
baca881473
dont panic when replay fails to find a message
2020-03-10 12:44:50 -07:00
whyrusleeping
24bf720a9a
Merge branch 'master' into testnet/3
2020-03-07 16:46:12 -08:00
Łukasz Magiera
3d1a5f4bf3
libs: Use go-statemachine
2020-03-06 20:01:03 +01:00
Łukasz Magiera
79237a9309
libs: Remove rlepluslazy (using specs-actors everywhere)
2020-03-06 19:52:38 +01:00
Łukasz Magiera
e51fa5c9ac
libs: Use zerocomm from sectorbuilder
2020-03-06 19:50:41 +01:00
whyrusleeping
16096e2c71
some go vet fixes
2020-03-05 22:46:07 -08:00
Łukasz Magiera
76698fe2db
jsonrpc: Don't try to reconnect on the server side
2020-03-05 01:34:29 +01:00
Nate Walck
7db39115e8
Fixed ctx issue, changed to track failures instead of success
2020-02-27 23:43:52 -05:00
Nate Walck
353c5d8b12
Relocation opencensus metrics to its own package and add more node stats
2020-02-27 21:49:18 -05:00
Łukasz Magiera
2aeab13aae
zerocomm: 'Fix' the test
2020-02-27 01:56:09 +01:00
whyrusleeping
767392332e
WIP: update sectorbuilder
2020-02-26 14:54:34 -08:00
Łukasz Magiera
d787aa5007
Merge branch 'testnet/3' into feat/specs-actors
2020-02-24 18:32:02 +01:00
Łukasz Magiera
9f0e0ced5e
Merge pull request #1155 from jsign/issue127_2
...
fix issue #127
2020-02-24 17:22:58 +01:00
Łukasz Magiera
226685dc1c
Implement committed capacity sectors
2020-02-23 01:47:47 +01:00
Łukasz Magiera
1381baf088
Generate zero CommP table
2020-02-22 15:06:38 +01:00
Łukasz Magiera
b12482df89
move peermgr, tracing into lib
2020-02-22 12:36:22 +01:00
Łukasz Magiera
4e98f2e438
some test fixes
2020-02-21 20:28:01 +01:00
Łukasz Magiera
c544c2b5c5
Set hamt bitwidth
2020-02-14 15:14:39 +01:00
Łukasz Magiera
0d6cfc879d
Use specs-actors ignatures
2020-02-13 00:52:36 +01:00
Łukasz Magiera
fa2c6605c2
Fix compilation after dep updates
2020-02-11 02:11:58 +01:00
Łukasz Magiera
72c89ab89b
Merge pull request #1223 from filecoin-project/fix/squash-forks
...
squash forks and use correct amt library everywhere
2020-02-06 20:14:55 +01:00
whyrusleeping
faf05cafcf
squash forks and use correct amt library everywhere
2020-02-04 18:26:42 -08:00
Jakub Sztandera
5bc1cb2aa3
Fix CheckBlockSignature, add docks
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-02-04 15:12:10 +01:00
Jakub Sztandera
5e6ab42cb8
Don't depend on ffi
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-02-04 15:12:04 +01:00
Jakub Sztandera
70aaa8fc92
Revert "Fix small bug in RLE"
...
This reverts commit 6ed57ede6a
.
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-30 16:14:32 -08:00
Jakub Sztandera
6ed57ede6a
Fix small bug in RLE
...
Thanks @frrist
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-30 15:18:54 -08:00
jsign
3106f512b2
define method retry freq as a constant
...
Signed-off-by: jsign <jsign.uy@gmail.com>
2020-01-26 21:52:19 -03:00
jsign
54f2e6ea3a
extra fixes
...
Signed-off-by: jsign <jsign.uy@gmail.com>
2020-01-24 22:48:30 -03:00
jsign
dbd51ff8e7
fix issue #127
...
Signed-off-by: jsign <jsign.uy@gmail.com>
2020-01-24 21:15:49 -03:00
Jakub Sztandera
2256e62648
Improve warning
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-23 12:39:23 -08:00
Jakub Sztandera
6b42a78c3f
Cleanup
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-23 12:35:57 -08:00
Jakub Sztandera
cb35625a53
Remove log
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-22 16:04:33 -08:00
Jakub Sztandera
f5d061f34f
Add incremental timeouts to blocksync fetching
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-22 15:57:42 -08:00
Łukasz Magiera
cf153f89df
Merge pull request #1131 from filecoin-project/feat/soft-map-cbg
...
cbor-gen: Soft struct-map unmarshaling
2020-01-21 19:44:39 +01:00
Łukasz Magiera
d2401bc339
Update cbor-gen, error on unknown fields
2020-01-21 17:28:55 +01:00
Łukasz Magiera
2076cb106d
cobr-gen: Soft struct-map unmarshaling
2020-01-21 17:05:10 +01:00
Łukasz Magiera
fbc0330fa8
jsonrpc: Fix channel registration deadlock
2020-01-21 14:48:17 +01:00
Łukasz Magiera
d1f419c9d1
jsonrpc: Fix channel closing race
2020-01-20 19:21:16 +01:00
Łukasz Magiera
3886e050b0
lotuslog: don't override log levels
2020-01-19 21:18:35 +01:00
Łukasz Magiera
ffdd436b52
sealing: Handle seed changes more correctly
2020-01-16 02:25:49 +01:00
Łukasz Magiera
23472aa4f2
statemachine: don't force users to see reflect
2020-01-15 01:08:20 +01:00
Łukasz Magiera
2ef8c1ae0c
statemachine: Better naming
2020-01-13 18:44:59 +01:00
Łukasz Magiera
e06c19b51c
update deps
2020-01-13 17:39:54 +01:00
Łukasz Magiera
34abc3d023
Merge branch 'feat/testnet2' into feat/event-states
2020-01-13 15:52:43 +01:00
Łukasz Magiera
f6d41ee77d
Port sector state maching to evtsm
2020-01-10 20:24:15 +01:00
Łukasz Magiera
da2a11ed76
Event-based state machine
2020-01-09 22:23:31 +01:00
Łukasz Magiera
8cbcbbd7a4
Merge branch 'feat/testnet2' of github.com:filecoin-project/go-lotus into feat/testnet2
2020-01-08 22:44:54 +01:00
Jakub Sztandera
1ed62628a7
Update go-log to v2
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-08 20:22:31 +01:00
Łukasz Magiera
31173ff4b4
Set logging levels in a single place
2020-01-08 14:49:34 +01:00
laser
20321bb476
handle rebase
2020-01-07 08:18:35 -08:00
acruikshank
7873213b11
switch sectorbuilder from lib to external module
...
point to correct version of sectorbuilder + ensure go-datastore stays at 0.1.1
replace local address type with go-address
consume paramfetch.GetParams instead of local paramfetch.go
remove constants now defined in sectorbuilder
2020-01-07 07:48:43 -08:00
Łukasz Magiera
1e7f10e387
gofmt
2020-01-07 15:00:10 +01:00
hannahhoward
718acb0a86
refactor(cborutil): extract cborutil library
...
Use extracted cborutil library
2020-01-07 14:59:35 +01:00
hannahhoward
14ecd1929b
refactor(crypto): use extracted crypto library
2020-01-07 14:53:30 +01:00
hannahhoward
8418464d91
refactor(address): use extracted address library
...
Switch to using extracted address library
2020-01-07 14:53:27 +01:00
laser
6a740a6d67
consume newly-extracted paramfetch
2020-01-02 11:08:49 -08:00
Łukasz Magiera
2e95a53679
Wire up faults in fPoSt
2019-12-17 23:33:08 +01:00
Łukasz Magiera
4f7cc07df5
circle: buildall on macos
2019-12-17 15:28:31 +01:00
Łukasz Magiera
746e08e717
sectorbuilder: Improve not enough space error
2019-12-17 14:47:08 +01:00
Łukasz Magiera
aa4bf9ab46
sectorbuilder: fix getpath
2019-12-17 11:56:45 +01:00
dignifiedquire
32acb66269
fix(sectorbuilder): always cast fsstat.Bsize
...
fixes compilation issue under macos
2019-12-16 22:07:14 +01:00
Łukasz Magiera
1383bfa0eb
sectorbuilder: fs: address review
2019-12-16 20:19:26 +01:00
Łukasz Magiera
825e3a0774
sectorbuilder: check free space before creating sectors
2019-12-16 17:16:08 +01:00
Whyrusleeping
9eb1371896
Merge pull request #860 from filecoin-project/fix/soft-sectors-load-err
...
sectors: Handle sector state reload errors more gracefully
2019-12-11 15:48:45 +01:00
Łukasz Magiera
613bb25297
sectors: Handle sector state reload errors more gracefully
2019-12-11 15:17:38 +01:00
dtynn
1030229cb6
use actual symlink flag
2019-12-11 10:25:48 +08:00
Łukasz Magiera
94037395ff
sectorbuilder: Fix proving on RO filesystem
2019-12-10 20:27:57 +01:00
whyrusleeping
4d86a4bd4a
fixup
2019-12-10 09:32:50 -08:00
whyrusleeping
08cc689293
add option to symlink to presealed sectors
2019-12-10 18:11:59 +01:00
whyrusleeping
e27217c6a1
fix sync tests
2019-12-09 22:17:15 +01:00
Henri S
9e363f9266
fix target for ePoSt IsTicketWinner fn
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-09 18:34:15 +01:00
Łukasz Magiera
0de9991dcd
Merge pull request #816 from filecoin-project/feat/api-cleanup
...
Move api struct to a seprate pkg
2019-12-09 18:33:13 +01:00
Łukasz Magiera
c49dc28a04
Move api struct to a seprate pkg
2019-12-09 18:22:11 +01:00
Jakub Sztandera
1a2401a816
Add short tests
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-09 17:49:30 +01:00
Łukasz Magiera
17c112acc0
Merge pull request #796 from filecoin-project/feat/seed-aggregation
...
implement lotus-seed aggregation commands
2019-12-09 15:24:13 +01:00
whyrusleeping
0a68dba256
use a package
2019-12-08 22:53:48 +01:00
whyrusleeping
9c3177c6dc
support copying directories
2019-12-08 22:45:34 +01:00
whyrusleeping
39cd25afc7
this will pretty much always be nil
2019-12-08 22:34:46 +01:00
whyrusleeping
c3dd9c55e2
use that nice function i wrote
2019-12-08 22:30:17 +01:00
whyrusleeping
ce9be69d91
implement sector dir aggregator
2019-12-08 21:06:40 +01:00
Łukasz Magiera
7c2ce93981
Close files in ExtractTar
2019-12-08 18:39:24 +01:00
Łukasz Magiera
83924e6b97
sectorbuilder: Allow to restrict task types
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-07 19:05:15 +01:00
Jakub Sztandera
71b973f830
Some cleanup
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-07 16:20:30 +01:00
Jakub Sztandera
80dbc25b6d
Fix typo in overflow check
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-07 15:56:44 +01:00
Jakub Sztandera
32a1940c57
Replace rleplus with rlepluslazy
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-07 15:48:20 +01:00
Jakub Sztandera
353fef3ff6
Improve complex code and comment it
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2019-12-07 15:48:20 +01:00
Jakub Sztandera
794490c490
Remove old bitvector
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2019-12-07 15:48:20 +01:00
Jakub Sztandera
01c0a6ec9f
Optimize and start wrapping it up
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2019-12-07 15:48:20 +01:00
Jakub Sztandera
d3dfd8a73b
Add rle encoder
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2019-12-07 15:48:20 +01:00
Jakub Sztandera
3d6071ed3f
Improve benchmarks and fix bitvector iterator
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2019-12-07 15:48:20 +01:00
Jakub Sztandera
9bf871ee53
Improve bitvector performance
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2019-12-07 15:48:19 +01:00
Jakub Sztandera
e5b3c4757d
More iterative algorithms
...
- Add RunIterator and decoder from RLE
- Add BitIterator and BitsFromRuns
- Add BitsFromSlice
- Add RunsFromBits
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2019-12-07 15:48:19 +01:00
Jakub Sztandera
c557aa206f
Add lazy RLE+ decoding
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2019-12-07 15:48:19 +01:00
Łukasz Magiera
bbc61a8f86
Merge pull request #766 from filecoin-project/feat/holes
...
Pre-sealing holes
2019-12-07 10:29:17 +01:00
Jakub Sztandera
92e7b4afbf
Fix tests, circle and make ux nicer
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-06 22:49:44 +01:00
Łukasz Magiera
7ed63fb7f8
seed: Trim cache
2019-12-06 22:18:52 +01:00
Jakub Sztandera
80592a87cf
Pre-sealing holes
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-06 18:53:33 +01:00
Łukasz Magiera
969ef179ef
Fix AddPiece with disabled local workers
2019-12-05 16:53:29 +01:00
Łukasz Magiera
2ce56dbfcb
Allow no local sectorbuilder workers
2019-12-05 16:28:04 +01:00
Łukasz Magiera
6f024bee58
Merge pull request #736 from filecoin-project/feat/params-v20
...
Params v20
2019-12-05 14:03:37 +01:00
whyrusleeping
5aa7bf6123
there is no real correlation between challenge count and len(winners)
2019-12-05 13:13:45 +01:00
Łukasz Magiera
291fab74c1
sectorbuilder: update PoRepProofPartitions
2019-12-05 12:52:13 +01:00
whyrusleeping
b7a89b56b3
more statticcheck!
2019-12-04 21:14:19 -08:00
Łukasz Magiera
3daf9103a8
paramfetch: Only pull necessary params
2019-12-04 20:44:15 +01:00
Łukasz Magiera
b2001db9d5
worker: Fix rebaining bugs
2019-12-04 17:53:32 +01:00
Łukasz Magiera
28dde1a2d3
worker: Use system tar for moving cache around
2019-12-04 15:58:28 +01:00
Łukasz Magiera
160e11ce8c
Merge branch 'master' into feat/remote-workers
2019-12-03 03:24:00 +01:00
Łukasz Magiera
1cdf6a6f8d
use challangeCount as sampleRate in IsTicketWinner
2019-12-02 15:24:27 +01:00
Łukasz Magiera
d5b94884c8
Buch of lint fixes
2019-12-02 13:51:16 +01:00
Łukasz Magiera
c7cf20843e
actually set unsealed path in sectorbuilder
2019-12-01 22:22:39 +01:00
Łukasz Magiera
fd8f65248b
deals: Correctly set deal ID in provider states
2019-12-01 21:07:57 +01:00
Łukasz Magiera
a59d0f0f8c
Fix unsealing, sector based data refs
2019-12-01 18:58:31 +01:00
whyrusleeping
422e25c8e6
self review: some cleanup
2019-11-30 22:02:52 -06:00
whyrusleeping
59d9c681ad
Rework miner test setups to fix tests
2019-11-30 17:21:11 -06:00
Łukasz Magiera
89556819ae
seal-worker: Handle cache
2019-11-30 14:22:50 +01:00
Łukasz Magiera
ed9279cf0c
Some fixes and dev utils
2019-11-30 10:25:31 +01:00
Łukasz Magiera
8767d8c16b
Merge branch 'feat/election-post' into feat/remote-workers
2019-11-30 09:42:28 +01:00
Łukasz Magiera
466f1d8cb9
Use ProvingSet for GetSectorsForElectionPost
2019-11-28 19:52:28 +01:00
Łukasz Magiera
920fd3ba9b
storageminer: New fallback post scheduler
2019-11-28 18:44:57 +01:00
Łukasz Magiera
aefd432422
actors: Fallback post progress
2019-11-28 13:46:56 +01:00
whyrusleeping
45288b8810
WIP: uncomment out windowed post code, try to make it work
2019-11-27 21:36:34 -06:00
Łukasz Magiera
99b9dfe18d
filecoin-ffi master
2019-11-27 23:37:02 +01:00
Łukasz Magiera
5d30106f5a
More v18 updates
2019-11-27 18:10:34 +01:00
Łukasz Magiera
1ccfe7d8f7
update filecoin-ffi to v18 params
2019-11-27 16:00:04 +01:00
Łukasz Magiera
23e0008b81
Merge remote-tracking branch 'origin/master' into feat/election-post
2019-11-27 13:31:44 +01:00
laser
3623925f66
replace go-bls-sigs and go-sectorbuilder with filecoin-ffi
...
- remove old submodules and add new submodule
- update build tooling to consume new unified static library
- update consumers of old libs to use new package
2019-11-26 18:16:37 -08:00
whyrusleeping
249bd8389f
Copy over last sector ID key when migrating sectorbuilder
2019-11-26 19:39:07 -06:00
Łukasz Magiera
407f6fa6f8
sync: correct vrfBase for ticket check
2019-11-26 23:54:11 +01:00
Łukasz Magiera
d5a632f644
sectorbuilder: Drop stateful sectorbuilder refs
2019-11-26 23:13:01 +01:00
Łukasz Magiera
871c30d2a0
WIP trying to get election post to compute
2019-11-26 16:15:41 +01:00
Łukasz Magiera
86cd28fa7e
sectorbuilder: Measure thigs in TestSealAndVerify
2019-11-26 13:29:42 +01:00
whyrusleeping
a98295a747
use the correct sector sizes in places
2019-11-25 20:43:43 -06:00
Łukasz Magiera
7a3ffbf9fe
WIP getting post in sectorbuilder_test to work
2019-11-26 00:32:02 +01:00
Łukasz Magiera
df0be815ae
More correct challangeCount calc
2019-11-25 17:18:11 +01:00
whyrusleeping
a0588d513d
Add lotus-gen, rewire genesis mining
2019-11-24 22:45:13 -06:00
Jakub Sztandera
36b7c5a32a
Swtich to xerrors
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-11-22 10:20:56 -06:00
Łukasz Magiera
3281e9448a
fix rspco serialization
2019-11-22 16:48:02 +01:00
whyrusleeping
96482f456a
WIP: election post restructuring
2019-11-21 16:21:45 -06:00
Łukasz Magiera
b726b95298
WIP remote sector CommitSseal
2019-11-21 20:51:53 +01:00
Łukasz Magiera
d4197bbadc
Working remote PreCommit
2019-11-21 19:38:50 +01:00
Łukasz Magiera
98b1de33b6
Stats for remote workers
2019-11-21 17:23:42 +01:00
Łukasz Magiera
88bbcd80ea
support remote SealPreCommit
2019-11-21 17:10:09 +01:00
Łukasz Magiera
ba3ad75670
remote-worker: wire up storage miner endpoints
2019-11-21 15:10:51 +01:00
Łukasz Magiera
9725eb78bf
wip remote sectorbuilder workers
2019-11-21 01:53:06 +01:00
Łukasz Magiera
ca70ac05d7
sectorbuilder: Drop some unused functions
2019-11-20 20:59:10 +01:00
Łukasz Magiera
7690c2f3b7
sectorbuilder: open FD later in AddPiece
2019-11-20 18:28:14 +01:00
Łukasz Magiera
5381d10fe3
StateAPI: account for slashing in StateMinerPower
2019-11-15 02:01:53 +01:00
Łukasz Magiera
727ca2ccb4
Skip sectorbuilder tests on slow hardware
2019-11-14 23:39:00 +01:00
Łukasz Magiera
d5c620dc44
sectorbuilder: Call AcquireSectorId in sync
2019-11-14 23:00:21 +01:00
Łukasz Magiera
b88807b947
Merge remote-tracking branch 'origin/master' into wip/sbfixes-links
2019-11-14 19:31:52 +01:00
Łukasz Magiera
a2c01defab
Merge branch 'master' into wip/sbfixes-links
2019-11-14 19:27:53 +01:00
Łukasz Magiera
d64b21936f
parallel sectorbuilder test
2019-11-14 19:26:09 +01:00
Jakub Sztandera
383c5c0c6f
Rename to --include-test-params
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-11-14 17:43:33 +01:00
Jakub Sztandera
c7b82dbc40
Skip slow tests
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-11-13 23:43:16 +01:00
whyrusleeping
86624c8ed4
fix tests and add some more trace attributes
2019-11-12 22:44:29 -08:00
whyrusleeping
9e464a4b90
more tracing spans
2019-11-12 12:42:22 -08:00
Łukasz Magiera
56d902c1bd
storageminer: Throttle GeneratePieceCommitment in storeGarbage
2019-11-12 19:05:03 +01:00
Łukasz Magiera
73ab6c0c66
WorkerCount on storageminer config
2019-11-12 18:59:38 +01:00
Łukasz Magiera
81bd0bc517
Test to reproduce post error after restart
2019-11-09 11:42:36 +01:00
Łukasz Magiera
ed64e52e3a
sectorbuilder: apply some review suggestions
2019-11-09 00:21:04 +01:00
Łukasz Magiera
3d360167df
sectorbuilder: Call destroy in DI module
2019-11-08 21:30:50 +01:00
Łukasz Magiera
2c66e20a1e
padreader: Some more testcases
2019-11-08 20:55:03 +01:00
Łukasz Magiera
61505b6802
Use the same dir in TestAcquireID
2019-11-08 19:55:23 +01:00
Łukasz Magiera
c729cabef1
keep track of last used sector id across restarts
2019-11-08 19:49:36 +01:00
Łukasz Magiera
071f05fa95
Storage miner API improvements
2019-11-08 19:23:58 +01:00
Łukasz Magiera
34846c538e
sectorbuilder: Use StandaloneWriteWithAlignment
2019-11-07 21:43:57 +01:00
Łukasz Magiera
f6a49ab9f9
Wip fixing a thing
2019-11-07 20:54:24 +01:00
Łukasz Magiera
58c21b4a5e
sectorbuilder: Always create directories
2019-11-07 19:33:46 +01:00
Łukasz Magiera
69b4bd9fb4
sectorbuilder: Also test PoSt
2019-11-07 17:43:59 +01:00
Łukasz Magiera
3e39d6e445
sectorbuilder: use standalone methods
2019-11-07 17:39:27 +01:00
Łukasz Magiera
1549269773
Make multiple deals per almost work
2019-11-07 15:45:53 +01:00
Łukasz Magiera
3fbe0abb75
cborrpc -> cborutil
2019-11-07 15:11:39 +01:00
Łukasz Magiera
8ec37e8728
deals: cleanup client state machine
2019-11-07 14:29:43 +01:00
whyrusleeping
480e7899ef
fail test if deal errors
2019-11-07 00:39:34 +01:00
whyrusleeping
597dbe369c
Add method to query latest deal state
2019-11-07 00:39:34 +01:00
whyrusleeping
9863942fe2
WIP: trying to write a test to reproduce the storage deal error
2019-11-07 00:39:34 +01:00
Łukasz Magiera
f7651f180b
Create filler deals
2019-11-07 00:09:48 +01:00
Łukasz Magiera
68c2d4f58a
deals: Set correct Refs
2019-11-06 18:38:42 +01:00
Łukasz Magiera
cb3965bcf5
Improve errors around deal handling
2019-11-06 13:04:33 +01:00
Łukasz Magiera
630134486d
Mostly fix deals
2019-11-05 19:40:51 +01:00
Łukasz Magiera
3020f7a203
Fix statestore.List
2019-11-05 19:20:12 +01:00
Łukasz Magiera
ed5ccfd750
Merge remote-tracking branch 'origin/devnet/7' into feat/interactive-porep
2019-11-05 18:53:19 +01:00
Łukasz Magiera
6a802cc9db
WIP fixing tests
2019-11-05 18:09:42 +01:00
whyrusleeping
4321256992
fix retrieval protocol error by wrapping stream in peeker
2019-11-05 08:38:54 -08:00
Łukasz Magiera
eb28c45c00
events: Plumb context to callbacks
2019-11-05 15:03:59 +01:00
whyrusleeping
9a398c6260
Track down all the uses of cboripld and eliminate them
2019-11-04 19:42:13 -08:00
Łukasz Magiera
c76ce2a2eb
rate-limit some sectorbuilder ops
2019-11-04 18:36:29 +01:00
Łukasz Magiera
13da5a5966
Put WorkerThreads on sectorbuilder.Config
2019-11-04 17:47:08 +01:00
Łukasz Magiera
2a695611d5
Update sectorbuilder
2019-11-03 21:44:22 +01:00
Łukasz Magiera
c550e030b1
INTERACTIVE PROEP IS ALIVE
2019-11-02 16:07:26 +01:00
Łukasz Magiera
09e8cdc109
Merge pull request #504 from filcloud/fix/312-panic-close-miner
...
fix panic when close miner
2019-11-02 00:59:12 +01:00
Łukasz Magiera
1dcebece71
Some smaller fixes
2019-11-01 23:44:55 +01:00
Łukasz Magiera
82344649d3
Use state store for sectors
2019-11-01 15:06:49 +01:00
Łukasz Magiera
02c3be9099
statestore: More generic keys
2019-11-01 12:14:32 +01:00
Łukasz Magiera
2343ebc5b8
statestore: Use reflect for mutators
2019-11-01 12:07:05 +01:00
Łukasz Magiera
1583cf2593
Strip unused functionality from sectorstore
2019-11-01 11:05:48 +01:00
whyrusleeping
fc9091cc89
Get interactive porep sector sealing mostly working
2019-10-31 20:57:10 -07:00
Łukasz Magiera
3cde267a2a
Move statestore to lib
2019-10-31 22:01:44 +01:00
Łukasz Magiera
ba937cf859
Fix sectorbuilder.VerifySeal
2019-10-31 20:03:26 +01:00
whyrusleeping
4e478330a4
more refactoring for interactive porep scheduling
2019-10-31 09:55:35 -07:00
wanghui
2aa8eebb99
move select
2019-10-31 17:39:42 +08:00
wanghui
8cb14335c3
use reflect select
2019-10-31 13:11:10 +08:00
whyrusleeping
759094198c
Some more progress on interactive porep
2019-10-30 18:22:50 -07:00
Łukasz Magiera
7fa3e2db7a
WIP Interactive PoRep
2019-10-30 19:10:29 +01:00
wanghui
03ca08d9bf
fix panic when close miner
2019-10-30 18:23:13 +08:00
Łukasz Magiera
5a5c66600f
storageminer: More correct listing of sealed sectors
2019-10-30 10:57:00 +01:00
Łukasz Magiera
922d8a90a5
storageminer: Restart sealing on restart
2019-10-29 23:19:58 +01:00
Łukasz Magiera
169c285fb3
storageminer: Handle uncommited sectors on start
2019-10-29 20:46:32 +01:00
Łukasz Magiera
02b67ea6b2
Fix TestSealAndVerify
2019-10-27 12:58:15 +01:00
Łukasz Magiera
874be79958
very basic sector seal scheduling
2019-10-27 09:56:53 +01:00
whyrusleeping
5257b1cce1
should use the new parameters
2019-10-25 18:09:11 +02:00
whyrusleeping
874ab1456c
WIP: updating to new proofs code
2019-10-25 18:07:34 +02:00
Łukasz Magiera
76f1e6e207
on chain deals: Put dealIDs in CommitSector messages
2019-10-24 16:24:31 +02:00
Łukasz Magiera
fabd074165
on chain deals: Deals make it to the chain
2019-10-23 19:39:14 +02:00
Łukasz Magiera
213ac77d08
on chain deals: Expose more chain state in pond
2019-10-23 12:44:00 +02:00
Łukasz Magiera
64bfb38834
on chain deals: Get things to actually run!
2019-10-23 12:44:00 +02:00
Łukasz Magiera
aab3bd617a
REST file import endpoint
2019-10-23 11:39:44 +02:00
whyrusleeping
6e90066a20
dont hang requests if websockets server shuts down
2019-10-20 15:37:51 +09:00
Jakub Sztandera
1bf713cb0a
Cleanup imports after rename
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-10-18 13:47:41 +09:00
whyrusleeping
ab7eafe76c
remove empty const block
2019-10-15 09:56:40 +09:00
whyrusleeping
e8a1b54740
Add more info to storage-miner info command output
2019-10-14 11:32:32 +09:00
Jakub Sztandera
edd7085712
Update filebeat
...
Change log of rpc buffer as I want to set up alert when it goes to high
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-10-11 18:02:21 +02:00
Łukasz Magiera
b3a88a21ce
Merge pull request #299 from filecoin-project/feat/remove-vdfs
...
remove VDFs from tickets
2019-10-09 10:02:51 +02:00
whyrusleeping
19b16077fe
remove VDFs from tickets
2019-10-09 13:38:59 +09:00
Łukasz Magiera
752654ab03
Devnet 3; Builtin bootstrap; NAT Port Map
2019-10-09 05:16:35 +02:00
whyrusleeping
86deb7528c
fix websocket closing again
2019-10-08 17:29:37 +09:00
whyrusleeping
6dd8ed7d7a
pass those tests
2019-10-04 10:06:05 -06:00
whyrusleeping
697bed27a6
fix websocket closing
2019-10-04 10:06:05 -06:00
Łukasz Magiera
2874022251
jsonrpc: Channel buffeering
2019-09-27 13:37:44 +02:00
Łukasz Magiera
fe8e1fe1e4
Almost working new post code
2019-09-27 01:07:40 +02:00
Łukasz Magiera
182b754aa2
fix tests
2019-09-23 15:19:05 +02:00
Łukasz Magiera
9a990dbd8a
use new sectorbuilder file interfaces
2019-09-23 12:50:28 +02:00
Łukasz Magiera
d55e872135
Merge remote-tracking branch 'origin/master' into feat/post-schedule
2019-09-19 16:42:50 +02:00
Jakub Sztandera
9c02f7f839
Rought PoST method
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2019-09-18 17:10:03 +02:00
whyrusleeping
3e45088812
cleaning up a few types
2019-09-17 20:32:52 -07:00
Łukasz Magiera
5e2c100f4d
storageminer: Better context handling
2019-09-17 20:36:06 +02:00
Łukasz Magiera
f2ecb772fa
repo: Close datastore in Close
2019-09-17 16:34:22 +02:00