Raúl Kripalani
b0cbc932bd
consolidate all blockstores in blockstore package.
2021-01-29 20:01:00 +00:00
Łukasz Magiera
6d368179e1
Fix lint
2021-01-25 14:02:58 +01:00
dignifiedquire
3d9eb226fa
refactor: switch to filecoin-ffi bls api for bls signatures
2021-01-20 16:19:07 +01:00
Jakub Sztandera
cfcfd5d8fa
Fix race in blockstore test suite
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2021-01-05 20:34:28 +01:00
yaohcn
7c0b6f41d8
fix log format
2020-11-24 19:09:48 +08:00
hannahhoward
218f7c2c5d
feat(markets): update markets, extract commp
2020-11-20 13:29:14 -08:00
vyzo
ef444676c2
combine add and remove evts and use a single emitter
...
to reduce likelihood of races
2020-11-20 16:15:44 +02:00
vyzo
7aec500384
emit event for peer disconnectionsa and act upon them in the blocksync peer tracker
2020-11-20 15:58:27 +02:00
Peter Rabbitson
29817b6617
Remove all Chain GC wrappings/types
...
There is no practical way to do GC against the chainstore given the current
state of affairs: remove all GC-related types for the time being.
2020-11-12 06:49:53 +01:00
Peter Rabbitson
7be7a9b5e3
Stop referring to github.com/ipfs/go-ipfs-blockstore outside of lib
2020-11-12 06:01:35 +01:00
Raúl Kripalani
72547f9ec3
badger tests: fix fd leak.
2020-11-11 23:12:57 +00:00
Raúl Kripalani
04a866121e
badger/AllKeysChan(): respect context.
2020-11-11 23:12:16 +00:00
Aayush Rajasekaran
735c04f999
Merge pull request #4681 from filecoin-project/badger-viewable
...
move to native badger blockstore; leverage zero-copy View() to deserialize in-place
2020-11-10 18:08:12 -05:00
Raúl Kripalani
bc6965c86f
skip callers in badger log for useful line info.
2020-11-10 22:50:53 +00:00
Raúl Kripalani
659ceaabdd
fix comment.
2020-11-10 17:51:11 +00:00
Raúl Kripalani
d79ff24014
remove benchmark.
2020-11-10 17:50:21 +00:00
Raúl Kripalani
339391ecfb
Revert "(to be reverted) add debug.PrintStack."
...
This reverts commit f8c3756ac0
.
2020-11-10 16:08:41 +00:00
Raúl Kripalani
f8c3756ac0
(to be reverted) add debug.PrintStack.
2020-11-10 15:22:17 +00:00
Raúl Kripalani
360194b29b
fix comment.
2020-11-10 15:02:55 +00:00
Raúl Kripalani
6d78de95a1
remove unused and misleading cachebs store.
2020-11-10 13:34:56 +00:00
Raúl Kripalani
577476b8fe
import Viewable non-terminal blockstores.
2020-11-10 13:16:24 +00:00
Raúl Kripalani
54bf7c99d7
add the viewable trait to our gazillion blockstores.
2020-11-10 12:40:32 +00:00
少爷
e340996919
delete new context
2020-11-10 17:40:48 +08:00
少爷
de2637b4fa
async connect to bootstrappers
2020-11-10 17:23:46 +08:00
Raúl Kripalani
3577300aee
Merge branch 'master' into badger-viewable
2020-11-06 19:34:25 +00:00
Raúl Kripalani
7c442e1a98
godocs.
2020-11-06 18:55:13 +00:00
Raúl Kripalani
de4a0725f3
rename files.
2020-11-06 18:32:44 +00:00
Raúl Kripalani
b1aa43741a
remove file that sneaked in.
2020-11-05 13:34:41 +00:00
Łukasz Magiera
a1e1b03ca4
Optionally allow bitswap for chainstore
2020-11-03 23:44:44 +01:00
Łukasz Magiera
b0824ada15
bufbs: Get from write blockstore first
2020-11-03 23:02:01 +01:00
Raúl Kripalani
d1ebf3c769
introduce non-pooled StorageKey method.
2020-11-02 13:32:07 +00:00
Raúl Kripalani
7facdf63c9
support legacy keying: base32 multihashes *sigh*.
2020-11-02 12:55:56 +00:00
Raúl Kripalani
72e573d98d
fix lint.
2020-11-01 17:09:14 +00:00
Raúl Kripalani
9437136f84
fixup.
2020-11-01 13:01:38 +00:00
Raúl Kripalani
ce27b13076
add a native badger blockstore with View() method.
2020-11-01 12:55:49 +00:00
Łukasz Magiera
c3d00b0ac6
Merge pull request #4650 from jsign/jsign/offlinemode
...
make IPFS online mode configurable
2020-10-29 22:24:58 +01:00
Ignacio Hagopian
7d0f279353
make IPFS online mode configurable
...
Signed-off-by: Ignacio Hagopian <jsign.uy@gmail.com>
2020-10-29 15:16:45 -03:00
Łukasz Magiera
8c60069bb8
Merge pull request #4535 from filecoin-project/feat/clientdeal-cache-commd
...
client deal: Cache CommD when creating multiple deals
2020-10-27 03:58:25 +01:00
Łukasz Magiera
31a474a1ca
Move CommPWriter to lib/
2020-10-26 15:16:28 +01:00
Jakub Sztandera
9fbd2a50ff
Fix lint
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-10-23 20:50:17 +02:00
Jakub Sztandera
ea69386519
Fix flaky TestTimedBSSimple
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-10-23 20:46:06 +02:00
Jakub Sztandera
3a46c15c4a
Disable blockstore bloom filter
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-10-21 04:22:49 +02:00
Steven Allen
86e30729bf
give the TimeCacheBS tests a bit more time
...
Otherwise, they flake once in a while.
2020-10-14 16:51:26 -07:00
Steven Allen
811f1304e6
test timed cache blockstore
2020-10-14 16:17:55 -07:00
Steven Allen
15fe998c68
add an timed-cache blockstore
...
This blockstore lets us write to a temporary scratch location where blocks older
than the specified cache time are automatically cleared.
2020-10-14 14:43:58 -07:00
Steven Allen
4b38809c0b
in-memory blockstore
...
Instead of using an in-memory datastore and dealing with the overhead of
computing datastore keys, creating new blocks, etc, use an in-memory blockstore.
2020-10-14 14:43:58 -07:00
Łukasz Magiera
8cdf078999
backup: append checksum
2020-10-06 01:50:54 +02:00
Łukasz Magiera
d7ec5e3618
lotus-miner init restore
2020-10-01 17:55:48 +02:00
Łukasz Magiera
c8a3269c4b
shed: utils to read datastore backups
2020-10-01 17:55:47 +02:00
Łukasz Magiera
2dc9a1ee4e
lotus-miner backup command
2020-10-01 17:55:47 +02:00
Łukasz Magiera
4d4bab12eb
Improve miner sectors list UX
2020-09-30 13:34:05 +02:00
Jakub Sztandera
4fce0181ab
Ignore the linter
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-09-08 12:18:48 +02:00
Jakub Sztandera
74e577610a
Forward peers from hello to blocksync
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-09-08 10:18:51 +02:00
Aayush Rajasekaran
39755a294a
Update to specs v0.9.6
2020-09-07 15:48:41 -04:00
frrist
0d61e0d717
refactor(ctx): update to latest go-jsonrpc
2020-08-25 15:20:41 -07:00
Steven Allen
5733c71c50
Lint everything
...
We were ignoring quite a few error cases, and had one case where we weren't
actually updating state where we wanted to. Unfortunately, if the linter doesn't
pass, nobody has any reason to actually check lint failures in CI.
There are three remaining XXXs marked in the code for lint.
2020-08-20 20:46:36 -07:00
whyrusleeping
38a2f82f78
fix fd limit test
2020-08-20 18:43:43 -07:00
whyrusleeping
2010bf55b7
add a doc on environment variables that can be used to tweak lotus
2020-08-20 12:52:50 -07:00
Raúl Kripalani
862bafc63a
fix lint errors.
2020-08-17 14:39:33 +01:00
Raúl Kripalani
efdc428d5d
keep storage-fsm (renamed to storage-sealing) and sector-storage in extern.
2020-08-17 14:26:18 +01:00
Raúl Kripalani
fb0ccc9260
integrate extern/storage-fsm into lotus proper.
2020-08-16 10:42:13 +01:00
Łukasz Magiera
a52e406c0d
Fix AddPiece with data and multiple workers
2020-08-15 01:36:29 +02:00
Łukasz Magiera
4ca5fef0de
rpcenc: fix bug
2020-08-14 23:49:08 +02:00
Łukasz Magiera
42bb91c2e6
gofmt
2020-08-14 23:40:41 +02:00
Łukasz Magiera
aa611e49fd
rpcenc: Add timeout for readers
2020-08-14 23:12:55 +02:00
Łukasz Magiera
0c75dd3865
Support AddPiece on workers
2020-08-14 16:06:53 +02:00
Łukasz Magiera
e4f475ee59
gofmt
2020-08-04 19:07:31 +02:00
Łukasz Magiera
adee59c795
client cli: improve lit-deals output
2020-08-04 19:07:17 +02:00
Łukasz Magiera
4cb4e7c2c2
Merge remote-tracking branch 'origin/master' into next
2020-07-31 14:02:04 +02:00
Simon Peffers
78739d9417
Fixes for failed CI tests
2020-07-26 00:46:23 -04:00
Simon Peffers
0f3105a01f
Integrate blst signature library: https://github.com/supranational/blst
2020-07-25 21:38:18 -04:00
Steven Allen
b7a4dbb07f
Support inline CIDs
...
And use the new CidBuilder from the spec actors.
This patch does not switch over to inline CIDs by default, but paves the way.
2020-07-23 23:12:32 -07:00
Łukasz Magiera
774c6901a8
Merge remote-tracking branch 'origin/master' into next
2020-07-23 22:48:38 +02:00
Steven Allen
5fc83f4d05
Refactor to use actor adt types instead of directly using HAMTs and AMTs
...
This way there's a single source of truth. Preparation for fixing
https://github.com/filecoin-project/specs-actors/issues/517 (requires changing
HAMT parameters).
2020-07-23 09:34:57 -07:00
Łukasz Magiera
df801470ca
Return size in bufbs.GetSize
2020-07-23 10:23:44 +02:00
Hannah Howard
7b00bb1ffe
Merge pull request #2448 from filecoin-project/feat/payment-channel-settler
...
Submit vouchers automatically when payment channels settle
2020-07-22 18:03:48 -07:00
Aayush Rajasekaran
54c0ae17f4
Implement buffered blocktore GetSize()
2020-07-22 19:58:35 -04:00
Łukasz Magiera
67a1b3e382
Merge pull request #2530 from filecoin-project/master
...
Merge master into next
2020-07-22 21:24:37 +02:00
Łukasz Magiera
d70edbcb7c
Set things on syscallShim
2020-07-22 13:35:10 -04:00
lanzafame
6f04b1dbd8
change debug to debugf
2020-07-22 10:40:41 +10:00
Anton Evangelatov
d16529dacb
shutdown for peermgr
2020-07-20 17:45:46 +02:00
Ignacio Hagopian
fd2262f51f
ipbsbstore: offlinemode, and Has() fix
...
Signed-off-by: Ignacio Hagopian <jsign.uy@gmail.com>
2020-07-17 18:02:12 -03:00
Łukasz Magiera
c1233291bc
Merge remote-tracking branch 'origin/master' into next
2020-07-15 19:47:27 +02:00
Whyrusleeping
62a503d686
Merge pull request #1563 from filecoin-project/feat/cache-bs
...
add an lru caching blockstore
2020-07-13 16:20:43 -07:00
Raúl Kripalani
973dbd6a13
Merge branch 'next' into mock-clock
2020-07-13 11:29:53 +01:00
Łukasz Magiera
8ce35e30dd
Merge remote-tracking branch 'origin/master' into next
2020-07-10 21:50:38 +02:00
Raúl Kripalani
13de81b3b2
introduce the ability to mock time.
2020-07-10 15:51:45 +01:00
Jakub Sztandera
b0cf3d3228
Mute RtRefreshManager logs as they break terminal emulation
...
RtRefreshManager logs random binary strings, which somtimes might be
partial multi-byte Unicode or ASCI escape codes.
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-07-09 16:21:55 +02:00
Jakub Sztandera
9936439608
Merge remote-tracking branch 'origin/master' into next
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-07-03 14:56:06 +02:00
whyrusleeping
809a3ba07c
check underlying datastore for objects before putting to bufbstore
2020-07-02 16:48:14 -07:00
Łukasz Magiera
4c422c2d50
specs-actors v0.7.1
2020-07-01 13:47:40 +02:00
Łukasz Magiera
9030b559e8
Merge pull request #1470 from hunjixin/hunjixin/test/bls_benchmarks
...
add bench mark for bls sign and verify
2020-07-01 10:57:34 +02:00
Jakub Sztandera
2a78ebabd9
Use HashVerify
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-15 17:39:16 +02:00
Jakub Sztandera
96ade5f2dd
Cleanup more lint warnings
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-02 18:38:41 +02:00
Jakub Sztandera
5605aae269
Fix even more lint warnings
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-02 16:29:39 +02:00
Jeromy
bac1e3f901
put blocks in cache after get
2020-05-29 15:15:59 -07:00
Jeromy
94555ea8c1
delete block should delete from cache too
2020-05-29 15:13:18 -07:00
Jeromy
cc233c6956
add an lru caching blockstore
2020-05-29 15:13:18 -07:00
Łukasz Magiera
785eeb1eee
Merge pull request #1850 from filecoin-project/chore/lint
...
Cleanup many lint warnings
2020-05-29 18:06:06 +02:00
Jeromy
e2a554c2e6
update specs actors to version with batch porep verification
2020-05-28 13:19:18 -07:00
Ignacio Hagopian
de3edc2ec7
remote ipfs support & automatic env
...
Signed-off-by: Ignacio Hagopian <jsign.uy@gmail.com>
2020-05-28 22:11:49 +02:00
Jakub Sztandera
b372881e91
Fix more lint warnings
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-05-28 01:15:19 +02:00
Jakub Sztandera
d6615b6286
Cleanup many lint warnings
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-05-27 22:53:20 +02:00
Ignacio Hagopian
d5346f8326
remote ipfs support & automatic env
...
Signed-off-by: Ignacio Hagopian <jsign.uy@gmail.com>
2020-05-26 14:52:51 -03:00
Łukasz Magiera
f7325a69c1
Extract auth utils to go-jsonrpc
2020-05-20 20:37:45 +02:00
Łukasz Magiera
eeca031525
extract lib/jsonrpc to go-jsonrpc
2020-05-20 19:49:09 +02:00
Whyrusleeping
70657e35ba
Merge pull request #1708 from filecoin-project/feat/block-validator
...
Improved pubsub block validator
2020-05-15 11:26:26 -07:00
Jeromy
edae6a3ae8
fix the problem
2020-05-14 12:05:01 -07:00
Jeromy
987571dd8c
add test to demonstrate failure
2020-05-14 11:48:58 -07:00
vyzo
81bc159b3e
cache successful block signature validation
2020-05-14 20:48:40 +03:00
Jeromy
8d85aedeff
clean up output channel handling logic to prevent send on closed channels
2020-05-13 16:31:17 -07:00
Łukasz Magiera
35b1963eeb
gofmt
2020-05-01 21:51:31 +02:00
Łukasz Magiera
4014cbdb44
jsonrpc: Correctly cancel server-side contexts on lost connection
2020-05-01 21:50:34 +02:00
Łukasz Magiera
971282a9a5
jsonrpc: Test hanging ctx on unclean disconnect
2020-05-01 21:30:32 +02:00
Łukasz Magiera
9f2df68906
workers: handle disconnecting workers more gracefully
2020-05-01 20:15:06 +02:00
Łukasz Magiera
6077edb3d0
jsonrpc: Test channel closing on when connection drops
2020-05-01 16:52:05 +02:00
Łukasz Magiera
0d4bf2e980
Merge branch 'testnet/3' into feat/ipfsclient
2020-04-30 13:09:47 +02:00
Łukasz Magiera
be439d3b13
Merge remote-tracking branch 'origin/master' into testnet/3
2020-04-30 13:03:08 +02:00
Łukasz Magiera
5ec76d4b7b
support making deals with data directly from IPFS nodes
2020-04-30 01:56:45 +02:00
Jeromy
bfa93bb933
add script to run a local devnet, and helper command
2020-04-27 15:26:46 -07:00
Jeromy
f4948dcba0
remove api dependency on sealing fsm package
2020-04-23 15:33:59 -07:00
Jeromy
216072468f
handle websocket clients disconnecting more properly
2020-04-20 09:52:16 -07:00
Jakub Sztandera
f1c890ca54
Tests pass
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-04-08 18:31:16 +02:00
Łukasz Magiera
0417e4bd0c
pond: Use tipestKeys for state calls
2020-04-03 01:09:31 +02:00
Łukasz Magiera
f15eb8b172
Merge pull request #1487 from filecoin-project/fix/partial-sync-responses
...
properly handle partial sync responses
2020-04-02 00:03:25 +02:00
Łukasz Magiera
f727f1db26
bufbs: Env var to disable blockstore buffering
2020-04-01 22:37:34 +02:00
Jeromy
27d57264d9
properly handle partial sync responses
2020-04-01 11:35:09 -07:00
lijunlong
8c05251cce
simplify code
2020-04-01 09:41:26 +08:00
lijunlong
7c15d1e8c3
add bench mark for bls sign and verify
2020-03-28 12:34:12 +08:00
Łukasz Magiera
c66d3dfad7
sectorstorage: Untangle from lotus deps
2020-03-27 22:35:33 +01:00
Łukasz Magiera
cd618dfdbd
gofmt
2020-03-22 22:39:27 +01:00
Łukasz Magiera
df9aa0e357
storagemitner: manage ulimit on start
2020-03-22 22:08:22 +01:00
Łukasz Magiera
1ed7779701
Merge remote-tracking branch 'origin/testnet/3' into feat/new-workers
2020-03-19 03:28:55 +01:00
Łukasz Magiera
94ebbd9d90
workers: Actually register in miner
2020-03-19 00:23:32 +01:00
Jakub Sztandera
06ce4f21c5
Warn on non zero result with error
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-03-14 15:08:24 +01:00
Jim Pick
b6d5ea629b
Make websocket connection upgrade header check case-insensitive
...
I was having troubles configuring an nginx reverse-proxy when
using Websockets.
It turns out my configuration was sending a "Connection: upgrade"
header, but Lotus expected "Connection: Upgrade".
This commit converts the check to be case-insensitive.
Some of the examples on the MDN page show lower-case "upgrade",
so I think it's not unusual for the usage to vary.
2020-03-13 13:07:39 -07:00
Jakub Sztandera
21b34ba133
Fix chan handling
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-03-11 19:14:49 +01:00
Jakub Sztandera
8d870a03b5
Fix Error and Result being returne at the same time in JSON-RPC
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-03-11 18:48:02 +01:00
whyrusleeping
baca881473
dont panic when replay fails to find a message
2020-03-10 12:44:50 -07:00
whyrusleeping
24bf720a9a
Merge branch 'master' into testnet/3
2020-03-07 16:46:12 -08:00
Łukasz Magiera
3d1a5f4bf3
libs: Use go-statemachine
2020-03-06 20:01:03 +01:00
Łukasz Magiera
79237a9309
libs: Remove rlepluslazy (using specs-actors everywhere)
2020-03-06 19:52:38 +01:00
Łukasz Magiera
e51fa5c9ac
libs: Use zerocomm from sectorbuilder
2020-03-06 19:50:41 +01:00
whyrusleeping
16096e2c71
some go vet fixes
2020-03-05 22:46:07 -08:00
Łukasz Magiera
76698fe2db
jsonrpc: Don't try to reconnect on the server side
2020-03-05 01:34:29 +01:00
Nate Walck
7db39115e8
Fixed ctx issue, changed to track failures instead of success
2020-02-27 23:43:52 -05:00
Nate Walck
353c5d8b12
Relocation opencensus metrics to its own package and add more node stats
2020-02-27 21:49:18 -05:00
Łukasz Magiera
2aeab13aae
zerocomm: 'Fix' the test
2020-02-27 01:56:09 +01:00
whyrusleeping
767392332e
WIP: update sectorbuilder
2020-02-26 14:54:34 -08:00
Łukasz Magiera
d787aa5007
Merge branch 'testnet/3' into feat/specs-actors
2020-02-24 18:32:02 +01:00