cerc-io/lotus
16
0
Fork 0
Code Issues Pull Requests Packages Projects Releases 27 Wiki Activity
21,268 Commits 24 Branches 342 Tags 314 MiB
01ec229749
Commit Graph

777 Commits

Author SHA1 Message Date
Shrenuj Bansal
4171be0b98 Few more changes 2022-09-12 16:37:24 -04:00
Shrenuj Bansal
a1f2fdb706 Merge branch 'master' into sbansal/nonce-coordination-and-consensus-for-chain-nodes 2022-09-12 16:23:24 -04:00
Shrenuj Bansal
8f1b1bb1ff WIP: Raft consensus for lotus nodes in a cluster 2022-09-12 16:10:15 -04:00
Eng Zer Jun
abef90423d
refactor: use os.ReadDir for lightweight directory reading 
`os.ReadDir` was added in Go 1.16 as part of the deprecation of `ioutil`
package. It is a more efficient implementation than `ioutil.ReadDir`.

Reference: https://pkg.go.dev/io/ioutil#ReadDir
Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>
 2022-09-09 19:53:40 +08:00
Łukasz Magiera
08b22edd89 fix make gen 2022-08-29 16:25:30 +02:00
Shrenuj Bansal
b3175f0b5c Merge branch 'master' into 9171-add-retries-to-mpool-push-message 2022-08-26 12:31:35 -04:00
Shrenuj Bansal
217cc846c3 Address more comments 2022-08-26 11:55:20 -04:00
Łukasz Magiera
45d1bd61ce
Merge pull request #9183 from filecoin-project/feat/sectornum-mgmt 
feat: sealing: Use bitfields to manage sector numbers
 2022-08-26 10:59:24 -04:00
Łukasz Magiera
2086b219d2 Don't use go-libp2p-core 2022-08-25 14:20:41 -04:00
Łukasz Magiera
70f0edd041 strle, sealing: address review 2022-08-25 10:19:39 -04:00
Łukasz Magiera
335f5df3ec numassigner: SectorNumReserveCount 2022-08-24 11:25:37 -04:00
Shrenuj Bansal
b972e079b8 Address comments 2022-08-22 17:32:43 -04:00
Shrenuj Bansal
5a12e58c0c Return error for non retryable errors 2022-08-19 11:33:37 -04:00
Shrenuj Bansal
7c404d8b5e fix error type comparison 2022-08-18 17:55:56 -04:00
Shrenuj Bansal
00975237b1 Add retries for specific types of errors 2022-08-18 15:57:59 -04:00
Shrenuj Bansal
a59f977db1 Add retries to mpool push message from lotus miner 2022-08-17 14:22:31 -04:00
Aayush
0c34699f23 unbreak itests 2022-06-29 14:55:35 -04:00
Łukasz Magiera
05cdeb80c3 chore: remove redundant import prefixes 2022-06-15 12:06:22 +02:00
Łukasz Magiera
98a48a47f8 storage: Move extern/storage-sealing to storage/pipeline 2022-06-14 19:41:59 +02:00
Łukasz Magiera
6afb43afbb wallet: Move key.go into separate pkg to avoid import loops 2022-06-14 19:21:40 +02:00
Łukasz Magiera
e65fae28de chore: fix imports 2022-06-14 17:00:51 +02:00
Łukasz Magiera
b53db68bda fix lint 2022-05-24 16:22:52 +02:00
Łukasz Magiera
6095aba4dd lib: support http readers passing over jsonrpc 2022-05-24 15:47:23 +02:00
Geoff Stuart
ebf5eb6e28 Update lib/rpcenc/reader.go 
Co-authored-by: Łukasz Magiera <magik6k@users.noreply.github.com>
 2022-05-02 09:59:41 -04:00
Geoff Stuart
b2a6d308ba Consolidate nullreader files 2022-05-02 09:59:41 -04:00
Łukasz Magiera
43436f7bc8 rpcenc: Fix double read at eof 2022-04-28 11:50:51 +02:00
Anton Evangelatov
0ed8647b6f extract unixfs filestore into lib 2022-03-21 10:48:52 +01:00
Łukasz Magiera
037e80c70c
gofmt 2022-03-17 12:10:24 +01:00
Łukasz Magiera
1c055fe83b
Merge branch 'master' into test/t.TempDir 2022-03-17 12:06:52 +01:00
Darko Brdareski
79453663b3
feat: Add additional test annotations (#8272) 
* Annotate api,proxy_util,blockstore_badger, policy tests

* Annotate splitstore: bsbadger / markset

* Annotate splitstore feature

* Annotate union/timed blockstore tests

* Annotate openrpc, diff_adt tests

* Annotate error,drand,events tests

* Annotate predicates_test

* Fix annotations

* Annotate tscache, gen tests

* Annotate fundmanager test

* Annotate repub and selection tests

* Annotate statetree_test

* Annotate forks_test

* Annotate searchwait_test.go

* Fix duplicated @@ symbols

* Annotate chain stmgr/store tests

* Annotate more (types) tests

* More tests annotated

* Annotate conformance chaos actor tests

* Annotate more integration tests

* Annotate journal system tests

* Annotate more tests.

* Annotate gas,head buffer behaviors

* Fix markset annotations

* doc: test annotations for the markets dagstore wrapper

* Annotate miner_api test in dagstore

* Annotate more test files

* Remove bad annotations from fsrepo

* Annotate wdpost system

* Remove bad annotations

* Renamce "conformance" to "chaos_actor" tests

* doc: stm annotations for blockheader & election proof tests

* Annotate remaining "A" tests

* annotate: stm for error_test

* memrepo_test.go

* Annotate "b" file tests

* message_test.go

* doc: stm annotate for fsrepo_test

* Annotate "c" file tests

* Annotate "D" test files

* message_test.go

* doc: stm annotate for chain, node/config & client

* docs: stm annotate node_test

* Annotate u,v,wl tests

* doc: stm annotations for various test files

* Annotate "T" test files

* doc: stm annotate for proxy_util_test & policy_test

* doc: stm annotate for various tests

* doc: final few stm annotations

* Add mempool unit tests

* Add two more memPool Add tests

* Update submodules

* Add check function tests

* Add stm annotations, refactor test helper

* Annotate api,proxy_util,blockstore_badger, policy tests

* Annotate splitstore: bsbadger / markset

solving merge conflicts

* Annotate splitstore feature

* Annotate union/timed blockstore tests

* Annotate openrpc, diff_adt tests

* Annotate error,drand,events tests

* Annotate predicates_test

* Fix annotations

* Annotate tscache, gen tests

* Annotate fundmanager test

* Annotate statetree_test

* Annotate forks_test

* Annotate searchwait_test.go

* Fix duplicated @@ symbols

* Annotate chain stmgr/store tests

* Annotate more (types) tests

* More tests annotated

* Annotate conformance chaos actor tests

* Annotate more integration tests

* Annotate journal system tests

* Annotate more tests.

* Annotate gas,head buffer behaviors

solve merge conflict

* Fix markset annotations

* Annotate miner_api test in dagstore

* Annotate more test files

* doc: test annotations for the markets dagstore wrapper

* Annotate wdpost system

* Renamce "conformance" to "chaos_actor" tests

* Annotate remaining "A" tests

* doc: stm annotations for blockheader & election proof tests

* annotate: stm for error_test

* Annotate "b" file tests

* memrepo_test.go

* Annotate "c" file tests

* message_test.go

* Annotate "D" test files

* doc: stm annotate for fsrepo_test

* Annotate u,v,wl tests

* message_test.go

* doc: stm annotate for chain, node/config & client

* docs: stm annotate node_test

* Annotate "T" test files

* doc: stm annotations for various test files

* Add mempool unit tests

solve merge conflict

* doc: stm annotate for proxy_util_test & policy_test

* doc: stm annotate for various tests

* doc: final few stm annotations

* Add two more memPool Add tests

* Update submodules

* Add check function tests

solve conflict

* Add stm annotations, refactor test helper

solve merge conflict

* Change CLI test kinds to "unit"

* Fix double merged test

* Fix ccupgrade_test merge

* Fix lint issues

* Add stm annotation to types_Test

* Test vectors submodule

* Add file annotation to burn_test

Co-authored-by: Nikola Divic <divicnikola@gmail.com>
Co-authored-by: TheMenko <themenkoprojects@gmail.com>
 2022-03-16 18:37:34 +01:00
Eng Zer Jun
c229842f57
test: use T.TempDir to create temporary test directory 
The directory created by `T.TempDir` is automatically removed when the
test and all its subtests complete.

Reference: https://pkg.go.dev/testing#T.TempDir
Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>
 2022-03-15 00:21:31 +08:00
Łukasz Magiera
4421bf2fa1 feat: config: Persistent subsystem log level config 2022-03-10 14:44:56 +01:00
Łukasz Magiera
7dcfeee0ea use old go-path 2022-03-03 14:17:25 +00:00
Aayush Rajasekaran
0e2278cc76 Merge branch 'master' into deps/update-ctx-dsbs 2021-12-14 18:08:29 -05:00
hannahhoward
8e376c84cf feat(tracing): setup logging 2021-12-10 13:50:12 -08:00
whyrusleeping
072297e661 WIP: updating to new datastore/blockstore code with contexts 2021-12-09 14:12:25 +02:00
hannahhoward
f3b691d618 feat(tracing): switch to OpenTelemetry 
Switch the underlying tracing library to OpenTelemetry, with a bridge to OpenCensus for
compatibility
 2021-12-01 16:19:47 -08:00
Łukasz Magiera
30fccaa0bd fix lint 2021-09-02 18:45:18 +02:00
Łukasz Magiera
95b128b7bc chain: Cleanup consensus logic 2021-09-02 18:09:37 +02:00
Steven Allen
1cf556c3a2 feat: expose ChainGetPath on the gateway 2021-08-30 16:43:21 -07:00
Łukasz Magiera
1ba427f638 alerting: Address review 2021-08-26 16:09:18 +02:00
Łukasz Magiera
81b1dd12f8 Simple alert system; FD limit alerts 2021-08-26 15:44:45 +02:00
Łukasz Magiera
8426a62d15 rpcenc: Test early close, add reader.MustRedirect 2021-07-30 13:35:16 +02:00
Łukasz Magiera
555c402ba3 rpcenc: Fix POST read 2021-07-30 13:03:31 +02:00
Łukasz Magiera
0c809d3a5f rpcenc: Support reader redirect 2021-07-30 12:58:35 +02:00
Raúl Kripalani
8413c080e3 add godocs. 2021-07-20 15:43:03 -07:00
Anton Evangelatov
cd4571f0b0 wrap close(wait) with sync.Once to avoid panic 2021-07-20 15:43:03 -07:00
Jakub Sztandera
7dd58efb84 Add quantiles and histogram 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2021-06-18 15:44:36 -07:00
Cory Schwartz
e24f24bc71 Remove log line when tracing is not configured 2021-05-26 10:45:04 -07:00
Cory Schwartz
d50b59b4c7 don't scare the gosec linter 2021-05-25 23:55:46 -07:00
Cory Schwartz
273368ed6a separate tracing environment variables 2021-05-25 01:23:33 -07:00
Łukasz Magiera
e006310c6f sigs: vector tests for bls 2021-04-15 23:02:21 +02:00
Peter Rabbitson
25a77d905d Centralize everything on ipfs/go-log/v2 
I am not entirely sure this is right, but everything seems to build...
 2021-04-06 15:04:32 +02:00
Łukasz Magiera
b68eed906a fix lint 2021-04-02 12:37:20 +02:00
Łukasz Magiera
411f561db6 backupds: Improve truncated log handling 2021-03-27 10:05:12 +01:00
Łukasz Magiera
924c419e61 backupds: handle log bool in shed 2021-03-24 21:26:24 +01:00
Łukasz Magiera
bb79eba74c backupds: Compact log on restart 2021-03-24 21:16:42 +01:00
Łukasz Magiera
a2ac26c4f6 backupds: Add unit tests 2021-03-12 16:20:27 +01:00
Łukasz Magiera
31154ed294 fix lint 2021-03-11 12:05:32 +01:00
Łukasz Magiera
ea58bee3f5 backupds: Allow larger values in write log 2021-03-11 12:03:24 +01:00
Łukasz Magiera
3f1054daf4 backupds kvlog: Address review 2021-03-10 13:58:41 +01:00
Łukasz Magiera
2b380c96a5 Exit from the kvlog goroutine when closing 2021-03-10 11:24:19 +01:00
Łukasz Magiera
d4a981f327 fix lint 2021-03-09 23:38:28 +01:00
Łukasz Magiera
b4eefd7220 backupds: make sure logfile matches datastore 2021-03-09 23:00:05 +01:00
Łukasz Magiera
9f7d3ed340 gofmt 2021-03-09 22:33:12 +01:00
Łukasz Magiera
ca7e70bf3a Metadata datastore log 2021-03-09 22:33:01 +01:00
Raúl Kripalani
b0cbc932bd consolidate all blockstores in blockstore package. 2021-01-29 20:01:00 +00:00
Łukasz Magiera
6d368179e1 Fix lint 2021-01-25 14:02:58 +01:00
dignifiedquire
3d9eb226fa refactor: switch to filecoin-ffi bls api for bls signatures 2021-01-20 16:19:07 +01:00
Jakub Sztandera
cfcfd5d8fa
Fix race in blockstore test suite 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2021-01-05 20:34:28 +01:00
yaohcn
7c0b6f41d8 fix log format 2020-11-24 19:09:48 +08:00
hannahhoward
218f7c2c5d feat(markets): update markets, extract commp 2020-11-20 13:29:14 -08:00
vyzo
ef444676c2 combine add and remove evts and use a single emitter 
to reduce likelihood of races
 2020-11-20 16:15:44 +02:00
vyzo
7aec500384 emit event for peer disconnectionsa and act upon them in the blocksync peer tracker 2020-11-20 15:58:27 +02:00
Peter Rabbitson
29817b6617 Remove all Chain GC wrappings/types 
There is no practical way to do GC against the chainstore given the current
state of affairs: remove all GC-related types for the time being.
 2020-11-12 06:49:53 +01:00
Peter Rabbitson
7be7a9b5e3 Stop referring to github.com/ipfs/go-ipfs-blockstore outside of lib 2020-11-12 06:01:35 +01:00
Raúl Kripalani
72547f9ec3 badger tests: fix fd leak. 2020-11-11 23:12:57 +00:00
Raúl Kripalani
04a866121e badger/AllKeysChan(): respect context. 2020-11-11 23:12:16 +00:00
Aayush Rajasekaran
735c04f999
Merge pull request #4681 from filecoin-project/badger-viewable 
move to native badger blockstore; leverage zero-copy View() to deserialize in-place
 2020-11-10 18:08:12 -05:00
Raúl Kripalani
bc6965c86f skip callers in badger log for useful line info. 2020-11-10 22:50:53 +00:00
Raúl Kripalani
659ceaabdd fix comment. 2020-11-10 17:51:11 +00:00
Raúl Kripalani
d79ff24014 remove benchmark. 2020-11-10 17:50:21 +00:00
Raúl Kripalani
339391ecfb Revert "(to be reverted) add debug.PrintStack." 
This reverts commit f8c3756ac0.
 2020-11-10 16:08:41 +00:00
Raúl Kripalani
f8c3756ac0 (to be reverted) add debug.PrintStack. 2020-11-10 15:22:17 +00:00
Raúl Kripalani
360194b29b fix comment. 2020-11-10 15:02:55 +00:00
Raúl Kripalani
6d78de95a1 remove unused and misleading cachebs store. 2020-11-10 13:34:56 +00:00
Raúl Kripalani
577476b8fe import Viewable non-terminal blockstores. 2020-11-10 13:16:24 +00:00
Raúl Kripalani
54bf7c99d7 add the viewable trait to our gazillion blockstores. 2020-11-10 12:40:32 +00:00
少爷
e340996919 delete new context 2020-11-10 17:40:48 +08:00
少爷
de2637b4fa async connect to bootstrappers 2020-11-10 17:23:46 +08:00
Raúl Kripalani
3577300aee Merge branch 'master' into badger-viewable 2020-11-06 19:34:25 +00:00
Raúl Kripalani
7c442e1a98 godocs. 2020-11-06 18:55:13 +00:00
Raúl Kripalani
de4a0725f3 rename files. 2020-11-06 18:32:44 +00:00
Raúl Kripalani
b1aa43741a remove file that sneaked in. 2020-11-05 13:34:41 +00:00
Łukasz Magiera
a1e1b03ca4 Optionally allow bitswap for chainstore 2020-11-03 23:44:44 +01:00
Łukasz Magiera
b0824ada15 bufbs: Get from write blockstore first 2020-11-03 23:02:01 +01:00
Raúl Kripalani
d1ebf3c769 introduce non-pooled StorageKey method. 2020-11-02 13:32:07 +00:00
Raúl Kripalani
7facdf63c9 support legacy keying: base32 multihashes *sigh*. 2020-11-02 12:55:56 +00:00
Raúl Kripalani
72e573d98d fix lint. 2020-11-01 17:09:14 +00:00
Raúl Kripalani
9437136f84 fixup. 2020-11-01 13:01:38 +00:00
Raúl Kripalani
ce27b13076 add a native badger blockstore with View() method. 2020-11-01 12:55:49 +00:00
Łukasz Magiera
c3d00b0ac6
Merge pull request #4650 from jsign/jsign/offlinemode 
make IPFS online mode configurable
 2020-10-29 22:24:58 +01:00
Ignacio Hagopian
7d0f279353
make IPFS online mode configurable 
Signed-off-by: Ignacio Hagopian <jsign.uy@gmail.com>
 2020-10-29 15:16:45 -03:00
Łukasz Magiera
8c60069bb8
Merge pull request #4535 from filecoin-project/feat/clientdeal-cache-commd 
client deal: Cache CommD when creating multiple deals
 2020-10-27 03:58:25 +01:00
Łukasz Magiera
31a474a1ca Move CommPWriter to lib/ 2020-10-26 15:16:28 +01:00
Jakub Sztandera
9fbd2a50ff
Fix lint 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-10-23 20:50:17 +02:00
Jakub Sztandera
ea69386519
Fix flaky TestTimedBSSimple 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-10-23 20:46:06 +02:00
Jakub Sztandera
3a46c15c4a
Disable blockstore bloom filter 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-10-21 04:22:49 +02:00
Steven Allen
86e30729bf give the TimeCacheBS tests a bit more time 
Otherwise, they flake once in a while.
 2020-10-14 16:51:26 -07:00
Steven Allen
811f1304e6 test timed cache blockstore 2020-10-14 16:17:55 -07:00
Steven Allen
15fe998c68 add an timed-cache blockstore 
This blockstore lets us write to a temporary scratch location where blocks older
than the specified cache time are automatically cleared.
 2020-10-14 14:43:58 -07:00
Steven Allen
4b38809c0b in-memory blockstore 
Instead of using an in-memory datastore and dealing with the overhead of
computing datastore keys, creating new blocks, etc, use an in-memory blockstore.
 2020-10-14 14:43:58 -07:00
Łukasz Magiera
8cdf078999 backup: append checksum 2020-10-06 01:50:54 +02:00
Łukasz Magiera
d7ec5e3618 lotus-miner init restore 2020-10-01 17:55:48 +02:00
Łukasz Magiera
c8a3269c4b shed: utils to read datastore backups 2020-10-01 17:55:47 +02:00
Łukasz Magiera
2dc9a1ee4e lotus-miner backup command 2020-10-01 17:55:47 +02:00
Łukasz Magiera
4d4bab12eb Improve miner sectors list UX 2020-09-30 13:34:05 +02:00
Jakub Sztandera
4fce0181ab
Ignore the linter 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-09-08 12:18:48 +02:00
Jakub Sztandera
74e577610a
Forward peers from hello to blocksync 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-09-08 10:18:51 +02:00
Aayush Rajasekaran
39755a294a Update to specs v0.9.6 2020-09-07 15:48:41 -04:00
frrist
0d61e0d717 refactor(ctx): update to latest go-jsonrpc 2020-08-25 15:20:41 -07:00
Steven Allen
5733c71c50 Lint everything 
We were ignoring quite a few error cases, and had one case where we weren't
actually updating state where we wanted to. Unfortunately, if the linter doesn't
pass, nobody has any reason to actually check lint failures in CI.

There are three remaining XXXs marked in the code for lint.
 2020-08-20 20:46:36 -07:00
whyrusleeping
38a2f82f78 fix fd limit test 2020-08-20 18:43:43 -07:00
whyrusleeping
2010bf55b7 add a doc on environment variables that can be used to tweak lotus 2020-08-20 12:52:50 -07:00
Raúl Kripalani
862bafc63a fix lint errors. 2020-08-17 14:39:33 +01:00
Raúl Kripalani
efdc428d5d keep storage-fsm (renamed to storage-sealing) and sector-storage in extern. 2020-08-17 14:26:18 +01:00
Raúl Kripalani
fb0ccc9260 integrate extern/storage-fsm into lotus proper. 2020-08-16 10:42:13 +01:00
Łukasz Magiera
a52e406c0d Fix AddPiece with data and multiple workers 2020-08-15 01:36:29 +02:00
Łukasz Magiera
4ca5fef0de rpcenc: fix bug 2020-08-14 23:49:08 +02:00
Łukasz Magiera
42bb91c2e6 gofmt 2020-08-14 23:40:41 +02:00
Łukasz Magiera
aa611e49fd rpcenc: Add timeout for readers 2020-08-14 23:12:55 +02:00
Łukasz Magiera
0c75dd3865 Support AddPiece on workers 2020-08-14 16:06:53 +02:00
Łukasz Magiera
e4f475ee59 gofmt 2020-08-04 19:07:31 +02:00
Łukasz Magiera
adee59c795 client cli: improve lit-deals output 2020-08-04 19:07:17 +02:00
Łukasz Magiera
4cb4e7c2c2 Merge remote-tracking branch 'origin/master' into next 2020-07-31 14:02:04 +02:00
Simon Peffers
78739d9417 Fixes for failed CI tests 2020-07-26 00:46:23 -04:00
Simon Peffers
0f3105a01f Integrate blst signature library: https://github.com/supranational/blst 2020-07-25 21:38:18 -04:00
Steven Allen
b7a4dbb07f Support inline CIDs 
And use the new CidBuilder from the spec actors.

This patch does not switch over to inline CIDs by default, but paves the way.
 2020-07-23 23:12:32 -07:00
Łukasz Magiera
774c6901a8 Merge remote-tracking branch 'origin/master' into next 2020-07-23 22:48:38 +02:00
Steven Allen
5fc83f4d05 Refactor to use actor adt types instead of directly using HAMTs and AMTs 
This way there's a single source of truth. Preparation for fixing
https://github.com/filecoin-project/specs-actors/issues/517 (requires changing
HAMT parameters).
 2020-07-23 09:34:57 -07:00
Łukasz Magiera
df801470ca
Return size in bufbs.GetSize 2020-07-23 10:23:44 +02:00
Hannah Howard
7b00bb1ffe
Merge pull request #2448 from filecoin-project/feat/payment-channel-settler 
Submit vouchers automatically when payment channels settle
 2020-07-22 18:03:48 -07:00
Aayush Rajasekaran
54c0ae17f4 Implement buffered blocktore GetSize() 2020-07-22 19:58:35 -04:00
Łukasz Magiera
67a1b3e382
Merge pull request #2530 from filecoin-project/master 
Merge master into next
 2020-07-22 21:24:37 +02:00
Łukasz Magiera
d70edbcb7c Set things on syscallShim 2020-07-22 13:35:10 -04:00
lanzafame
6f04b1dbd8 change debug to debugf 2020-07-22 10:40:41 +10:00
Anton Evangelatov
d16529dacb shutdown for peermgr 2020-07-20 17:45:46 +02:00
Ignacio Hagopian
fd2262f51f
ipbsbstore: offlinemode, and Has() fix 
Signed-off-by: Ignacio Hagopian <jsign.uy@gmail.com>
 2020-07-17 18:02:12 -03:00
Łukasz Magiera
c1233291bc Merge remote-tracking branch 'origin/master' into next 2020-07-15 19:47:27 +02:00
Whyrusleeping
62a503d686
Merge pull request #1563 from filecoin-project/feat/cache-bs 
add an lru caching blockstore
 2020-07-13 16:20:43 -07:00
Raúl Kripalani
973dbd6a13 Merge branch 'next' into mock-clock 2020-07-13 11:29:53 +01:00
Łukasz Magiera
8ce35e30dd Merge remote-tracking branch 'origin/master' into next 2020-07-10 21:50:38 +02:00
Raúl Kripalani
13de81b3b2 introduce the ability to mock time. 2020-07-10 15:51:45 +01:00
Jakub Sztandera
b0cf3d3228
Mute RtRefreshManager logs as they break terminal emulation 
RtRefreshManager logs random binary strings, which somtimes might be
partial multi-byte Unicode or ASCI escape codes.

Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-09 16:21:55 +02:00
Jakub Sztandera
9936439608
Merge remote-tracking branch 'origin/master' into next 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-03 14:56:06 +02:00
whyrusleeping
809a3ba07c check underlying datastore for objects before putting to bufbstore 2020-07-02 16:48:14 -07:00
Łukasz Magiera
4c422c2d50 specs-actors v0.7.1 2020-07-01 13:47:40 +02:00
Łukasz Magiera
9030b559e8
Merge pull request #1470 from hunjixin/hunjixin/test/bls_benchmarks 
add bench mark for bls sign and verify
 2020-07-01 10:57:34 +02:00
Jakub Sztandera
2a78ebabd9
Use HashVerify 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-06-15 17:39:16 +02:00
Jakub Sztandera
96ade5f2dd
Cleanup more lint warnings 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-06-02 18:38:41 +02:00
Jakub Sztandera
5605aae269
Fix even more lint warnings 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-06-02 16:29:39 +02:00
Jeromy
bac1e3f901 put blocks in cache after get 2020-05-29 15:15:59 -07:00
Jeromy
94555ea8c1 delete block should delete from cache too 2020-05-29 15:13:18 -07:00
Jeromy
cc233c6956 add an lru caching blockstore 2020-05-29 15:13:18 -07:00
Łukasz Magiera
785eeb1eee
Merge pull request #1850 from filecoin-project/chore/lint 
Cleanup many lint warnings
 2020-05-29 18:06:06 +02:00
Jeromy
e2a554c2e6 update specs actors to version with batch porep verification 2020-05-28 13:19:18 -07:00
Ignacio Hagopian
de3edc2ec7 remote ipfs support & automatic env 
Signed-off-by: Ignacio Hagopian <jsign.uy@gmail.com>
 2020-05-28 22:11:49 +02:00
Jakub Sztandera
b372881e91
Fix more lint warnings 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-05-28 01:15:19 +02:00
Jakub Sztandera
d6615b6286
Cleanup many lint warnings 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-05-27 22:53:20 +02:00
Ignacio Hagopian
d5346f8326
remote ipfs support & automatic env 
Signed-off-by: Ignacio Hagopian <jsign.uy@gmail.com>
 2020-05-26 14:52:51 -03:00
Łukasz Magiera
f7325a69c1 Extract auth utils to go-jsonrpc 2020-05-20 20:37:45 +02:00
Łukasz Magiera
eeca031525 extract lib/jsonrpc to go-jsonrpc 2020-05-20 19:49:09 +02:00
Whyrusleeping
70657e35ba
Merge pull request #1708 from filecoin-project/feat/block-validator 
Improved pubsub block validator
 2020-05-15 11:26:26 -07:00
Jeromy
edae6a3ae8 fix the problem 2020-05-14 12:05:01 -07:00
Jeromy
987571dd8c add test to demonstrate failure 2020-05-14 11:48:58 -07:00
vyzo
81bc159b3e cache successful block signature validation 2020-05-14 20:48:40 +03:00
Jeromy
8d85aedeff clean up output channel handling logic to prevent send on closed channels 2020-05-13 16:31:17 -07:00
Łukasz Magiera
35b1963eeb gofmt 2020-05-01 21:51:31 +02:00
Łukasz Magiera
4014cbdb44 jsonrpc: Correctly cancel server-side contexts on lost connection 2020-05-01 21:50:34 +02:00
Łukasz Magiera
971282a9a5 jsonrpc: Test hanging ctx on unclean disconnect 2020-05-01 21:30:32 +02:00
Łukasz Magiera
9f2df68906 workers: handle disconnecting workers more gracefully 2020-05-01 20:15:06 +02:00
Łukasz Magiera
6077edb3d0 jsonrpc: Test channel closing on when connection drops 2020-05-01 16:52:05 +02:00
Łukasz Magiera
0d4bf2e980 Merge branch 'testnet/3' into feat/ipfsclient 2020-04-30 13:09:47 +02:00
Łukasz Magiera
be439d3b13 Merge remote-tracking branch 'origin/master' into testnet/3 2020-04-30 13:03:08 +02:00
Łukasz Magiera
5ec76d4b7b support making deals with data directly from IPFS nodes 2020-04-30 01:56:45 +02:00
Jeromy
bfa93bb933 add script to run a local devnet, and helper command 2020-04-27 15:26:46 -07:00
Jeromy
f4948dcba0 remove api dependency on sealing fsm package 2020-04-23 15:33:59 -07:00
Jeromy
216072468f handle websocket clients disconnecting more properly 2020-04-20 09:52:16 -07:00
Jakub Sztandera
f1c890ca54 Tests pass 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-04-08 18:31:16 +02:00
Łukasz Magiera
0417e4bd0c pond: Use tipestKeys for state calls 2020-04-03 01:09:31 +02:00
Łukasz Magiera
f15eb8b172 Merge pull request #1487 from filecoin-project/fix/partial-sync-responses 
properly handle partial sync responses
 2020-04-02 00:03:25 +02:00
Łukasz Magiera
f727f1db26 bufbs: Env var to disable blockstore buffering 2020-04-01 22:37:34 +02:00
Jeromy
27d57264d9 properly handle partial sync responses 2020-04-01 11:35:09 -07:00
lijunlong
8c05251cce simplify code 2020-04-01 09:41:26 +08:00
lijunlong
7c15d1e8c3 add bench mark for bls sign and verify 2020-03-28 12:34:12 +08:00
Łukasz Magiera
c66d3dfad7 sectorstorage: Untangle from lotus deps 2020-03-27 22:35:33 +01:00
Łukasz Magiera
cd618dfdbd gofmt 2020-03-22 22:39:27 +01:00
Łukasz Magiera
df9aa0e357 storagemitner: manage ulimit on start 2020-03-22 22:08:22 +01:00
Łukasz Magiera
1ed7779701 Merge remote-tracking branch 'origin/testnet/3' into feat/new-workers 2020-03-19 03:28:55 +01:00
Łukasz Magiera
94ebbd9d90 workers: Actually register in miner 2020-03-19 00:23:32 +01:00
Jakub Sztandera
06ce4f21c5 Warn on non zero result with error 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-03-14 15:08:24 +01:00
Jim Pick
b6d5ea629b Make websocket connection upgrade header check case-insensitive 
I was having troubles configuring an nginx reverse-proxy when
using Websockets.

It turns out my configuration was sending a "Connection: upgrade"
header, but Lotus expected "Connection: Upgrade".

This commit converts the check to be case-insensitive.

Some of the examples on the MDN page show lower-case "upgrade",
so I think it's not unusual for the usage to vary.
 2020-03-13 13:07:39 -07:00
Jakub Sztandera
21b34ba133 Fix chan handling 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-03-11 19:14:49 +01:00
Jakub Sztandera
8d870a03b5 Fix Error and Result being returne at the same time in JSON-RPC 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-03-11 18:48:02 +01:00
whyrusleeping
baca881473 dont panic when replay fails to find a message 2020-03-10 12:44:50 -07:00
whyrusleeping
24bf720a9a Merge branch 'master' into testnet/3 2020-03-07 16:46:12 -08:00
Łukasz Magiera
3d1a5f4bf3 libs: Use go-statemachine 2020-03-06 20:01:03 +01:00
Łukasz Magiera
79237a9309 libs: Remove rlepluslazy (using specs-actors everywhere) 2020-03-06 19:52:38 +01:00
Łukasz Magiera
e51fa5c9ac libs: Use zerocomm from sectorbuilder 2020-03-06 19:50:41 +01:00
whyrusleeping
16096e2c71 some go vet fixes 2020-03-05 22:46:07 -08:00
Łukasz Magiera
76698fe2db jsonrpc: Don't try to reconnect on the server side 2020-03-05 01:34:29 +01:00
Nate Walck
7db39115e8 Fixed ctx issue, changed to track failures instead of success 2020-02-27 23:43:52 -05:00
Nate Walck
353c5d8b12 Relocation opencensus metrics to its own package and add more node stats 2020-02-27 21:49:18 -05:00
Łukasz Magiera
2aeab13aae zerocomm: 'Fix' the test 2020-02-27 01:56:09 +01:00
whyrusleeping
767392332e WIP: update sectorbuilder 2020-02-26 14:54:34 -08:00
Łukasz Magiera
d787aa5007 Merge branch 'testnet/3' into feat/specs-actors 2020-02-24 18:32:02 +01:00
Łukasz Magiera
9f0e0ced5e Merge pull request #1155 from jsign/issue127_2 
fix issue #127
 2020-02-24 17:22:58 +01:00
Łukasz Magiera
226685dc1c Implement committed capacity sectors 2020-02-23 01:47:47 +01:00
Łukasz Magiera
1381baf088 Generate zero CommP table 2020-02-22 15:06:38 +01:00
Łukasz Magiera
b12482df89 move peermgr, tracing into lib 2020-02-22 12:36:22 +01:00
Łukasz Magiera
4e98f2e438 some test fixes 2020-02-21 20:28:01 +01:00
Łukasz Magiera
c544c2b5c5 Set hamt bitwidth 2020-02-14 15:14:39 +01:00
Łukasz Magiera
0d6cfc879d Use specs-actors ignatures 2020-02-13 00:52:36 +01:00
Łukasz Magiera
fa2c6605c2 Fix compilation after dep updates 2020-02-11 02:11:58 +01:00
Łukasz Magiera
72c89ab89b Merge pull request #1223 from filecoin-project/fix/squash-forks 
squash forks and use correct amt library everywhere
 2020-02-06 20:14:55 +01:00
whyrusleeping
faf05cafcf squash forks and use correct amt library everywhere 2020-02-04 18:26:42 -08:00
Jakub Sztandera
5bc1cb2aa3
Fix CheckBlockSignature, add docks 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-02-04 15:12:10 +01:00
Jakub Sztandera
5e6ab42cb8
Don't depend on ffi 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-02-04 15:12:04 +01:00
Jakub Sztandera
70aaa8fc92
Revert "Fix small bug in RLE" 
This reverts commit 6ed57ede6a.

Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-01-30 16:14:32 -08:00
Jakub Sztandera
6ed57ede6a
Fix small bug in RLE 
Thanks @frrist

Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-01-30 15:18:54 -08:00
jsign
3106f512b2 define method retry freq as a constant 
Signed-off-by: jsign <jsign.uy@gmail.com>
 2020-01-26 21:52:19 -03:00
jsign
54f2e6ea3a extra fixes 
Signed-off-by: jsign <jsign.uy@gmail.com>
 2020-01-24 22:48:30 -03:00
jsign
dbd51ff8e7 fix issue #127 
Signed-off-by: jsign <jsign.uy@gmail.com>
 2020-01-24 21:15:49 -03:00
Jakub Sztandera
2256e62648
Improve warning 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-01-23 12:39:23 -08:00
Jakub Sztandera
6b42a78c3f
Cleanup 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-01-23 12:35:57 -08:00
Jakub Sztandera
cb35625a53
Remove log 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-01-22 16:04:33 -08:00
Jakub Sztandera
f5d061f34f
Add incremental timeouts to blocksync fetching 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-01-22 15:57:42 -08:00
Łukasz Magiera
cf153f89df
Merge pull request #1131 from filecoin-project/feat/soft-map-cbg 
cbor-gen: Soft struct-map unmarshaling
 2020-01-21 19:44:39 +01:00
Łukasz Magiera
d2401bc339 Update cbor-gen, error on unknown fields 2020-01-21 17:28:55 +01:00
Łukasz Magiera
2076cb106d cobr-gen: Soft struct-map unmarshaling 2020-01-21 17:05:10 +01:00
Łukasz Magiera
fbc0330fa8 jsonrpc: Fix channel registration deadlock 2020-01-21 14:48:17 +01:00
Łukasz Magiera
d1f419c9d1 jsonrpc: Fix channel closing race 2020-01-20 19:21:16 +01:00
Łukasz Magiera
3886e050b0 lotuslog: don't override log levels 2020-01-19 21:18:35 +01:00
Łukasz Magiera
ffdd436b52 sealing: Handle seed changes more correctly 2020-01-16 02:25:49 +01:00
Łukasz Magiera
23472aa4f2 statemachine: don't force users to see reflect 2020-01-15 01:08:20 +01:00
Łukasz Magiera
2ef8c1ae0c statemachine: Better naming 2020-01-13 18:44:59 +01:00
Łukasz Magiera
e06c19b51c update deps 2020-01-13 17:39:54 +01:00
Łukasz Magiera
34abc3d023 Merge branch 'feat/testnet2' into feat/event-states 2020-01-13 15:52:43 +01:00
Łukasz Magiera
f6d41ee77d Port sector state maching to evtsm 2020-01-10 20:24:15 +01:00
Łukasz Magiera
da2a11ed76 Event-based state machine 2020-01-09 22:23:31 +01:00
Łukasz Magiera
8cbcbbd7a4 Merge branch 'feat/testnet2' of github.com:filecoin-project/go-lotus into feat/testnet2 2020-01-08 22:44:54 +01:00
Jakub Sztandera
1ed62628a7
Update go-log to v2 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-01-08 20:22:31 +01:00
Łukasz Magiera
31173ff4b4 Set logging levels in a single place 2020-01-08 14:49:34 +01:00
laser
20321bb476 handle rebase 2020-01-07 08:18:35 -08:00
acruikshank
7873213b11 switch sectorbuilder from lib to external module 
point to correct version of sectorbuilder + ensure go-datastore stays at 0.1.1

replace local address type with go-address

consume paramfetch.GetParams instead of local paramfetch.go

remove constants now defined in sectorbuilder
 2020-01-07 07:48:43 -08:00
Łukasz Magiera
1e7f10e387 gofmt 2020-01-07 15:00:10 +01:00
hannahhoward
718acb0a86 refactor(cborutil): extract cborutil library 
Use extracted cborutil library
 2020-01-07 14:59:35 +01:00
hannahhoward
14ecd1929b refactor(crypto): use extracted crypto library 2020-01-07 14:53:30 +01:00
hannahhoward
8418464d91 refactor(address): use extracted address library 
Switch to using extracted address library
 2020-01-07 14:53:27 +01:00
laser
6a740a6d67 consume newly-extracted paramfetch 2020-01-02 11:08:49 -08:00
Łukasz Magiera
2e95a53679 Wire up faults in fPoSt 2019-12-17 23:33:08 +01:00
Łukasz Magiera
4f7cc07df5 circle: buildall on macos 2019-12-17 15:28:31 +01:00
Łukasz Magiera
746e08e717 sectorbuilder: Improve not enough space error 2019-12-17 14:47:08 +01:00
Łukasz Magiera
aa4bf9ab46 sectorbuilder: fix getpath 2019-12-17 11:56:45 +01:00
dignifiedquire
32acb66269 fix(sectorbuilder): always cast fsstat.Bsize 
fixes compilation issue under macos
 2019-12-16 22:07:14 +01:00
Łukasz Magiera
1383bfa0eb sectorbuilder: fs: address review 2019-12-16 20:19:26 +01:00
Łukasz Magiera
825e3a0774 sectorbuilder: check free space before creating sectors 2019-12-16 17:16:08 +01:00
Whyrusleeping
9eb1371896
Merge pull request #860 from filecoin-project/fix/soft-sectors-load-err 
sectors: Handle sector state reload errors more gracefully
 2019-12-11 15:48:45 +01:00
Łukasz Magiera
613bb25297 sectors: Handle sector state reload errors more gracefully 2019-12-11 15:17:38 +01:00
dtynn
1030229cb6 use actual symlink flag 2019-12-11 10:25:48 +08:00
Łukasz Magiera
94037395ff sectorbuilder: Fix proving on RO filesystem 2019-12-10 20:27:57 +01:00
whyrusleeping
4d86a4bd4a fixup 2019-12-10 09:32:50 -08:00
whyrusleeping
08cc689293 add option to symlink to presealed sectors 2019-12-10 18:11:59 +01:00
whyrusleeping
e27217c6a1 fix sync tests 2019-12-09 22:17:15 +01:00
Henri S
9e363f9266
fix target for ePoSt IsTicketWinner fn 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-12-09 18:34:15 +01:00
Łukasz Magiera
0de9991dcd
Merge pull request #816 from filecoin-project/feat/api-cleanup 
Move api struct to a seprate pkg
 2019-12-09 18:33:13 +01:00
Łukasz Magiera
c49dc28a04 Move api struct to a seprate pkg 2019-12-09 18:22:11 +01:00
Jakub Sztandera
1a2401a816
Add short tests 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-12-09 17:49:30 +01:00
Łukasz Magiera
17c112acc0
Merge pull request #796 from filecoin-project/feat/seed-aggregation 
implement lotus-seed aggregation commands
 2019-12-09 15:24:13 +01:00
whyrusleeping
0a68dba256 use a package 2019-12-08 22:53:48 +01:00
whyrusleeping
9c3177c6dc support copying directories 2019-12-08 22:45:34 +01:00
whyrusleeping
39cd25afc7 this will pretty much always be nil 2019-12-08 22:34:46 +01:00
whyrusleeping
c3dd9c55e2 use that nice function i wrote 2019-12-08 22:30:17 +01:00
whyrusleeping
ce9be69d91 implement sector dir aggregator 2019-12-08 21:06:40 +01:00
Łukasz Magiera
7c2ce93981 Close files in ExtractTar 2019-12-08 18:39:24 +01:00
Łukasz Magiera
83924e6b97
sectorbuilder: Allow to restrict task types 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-12-07 19:05:15 +01:00
Jakub Sztandera
71b973f830
Some cleanup 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-12-07 16:20:30 +01:00
Jakub Sztandera
80dbc25b6d
Fix typo in overflow check 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-12-07 15:56:44 +01:00
Jakub Sztandera
32a1940c57
Replace rleplus with rlepluslazy 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-12-07 15:48:20 +01:00
Jakub Sztandera
353fef3ff6
Improve complex code and comment it 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
 2019-12-07 15:48:20 +01:00
Jakub Sztandera
794490c490
Remove old bitvector 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
 2019-12-07 15:48:20 +01:00
Jakub Sztandera
01c0a6ec9f
Optimize and start wrapping it up 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
 2019-12-07 15:48:20 +01:00
Jakub Sztandera
d3dfd8a73b
Add rle encoder 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
 2019-12-07 15:48:20 +01:00
Jakub Sztandera
3d6071ed3f
Improve benchmarks and fix bitvector iterator 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
 2019-12-07 15:48:20 +01:00
Jakub Sztandera
9bf871ee53
Improve bitvector performance 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
 2019-12-07 15:48:19 +01:00
Jakub Sztandera
e5b3c4757d
More iterative algorithms 
- Add RunIterator and decoder from RLE
 - Add BitIterator and BitsFromRuns
 - Add BitsFromSlice
 - Add RunsFromBits

License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
 2019-12-07 15:48:19 +01:00
Jakub Sztandera
c557aa206f
Add lazy RLE+ decoding 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
 2019-12-07 15:48:19 +01:00
Łukasz Magiera
bbc61a8f86
Merge pull request #766 from filecoin-project/feat/holes 
Pre-sealing holes
 2019-12-07 10:29:17 +01:00
Jakub Sztandera
92e7b4afbf
Fix tests, circle and make ux nicer 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-12-06 22:49:44 +01:00
Łukasz Magiera
7ed63fb7f8 seed: Trim cache 2019-12-06 22:18:52 +01:00