Commit Graph

1260 Commits

Author SHA1 Message Date
Łukasz Magiera
d557c407c6
Merge pull request #2608 from filecoin-project/feat/storage-remote-improvements
Update sector-storage, sealing sched-diag
2020-07-27 15:17:38 +02:00
Łukasz Magiera
135b77dab5 Update sector-storage, sealing sched-diag 2020-07-27 13:23:43 +02:00
Simon Peffers
78739d9417 Fixes for failed CI tests 2020-07-26 00:46:23 -04:00
Simon Peffers
0f3105a01f Integrate blst signature library: https://github.com/supranational/blst 2020-07-25 21:38:18 -04:00
Łukasz Magiera
8227b7d16f
Merge pull request #2573 from filecoin-project/feat/storage-remote-improvements
Update sector-storage, parallel fetch limit
2020-07-25 23:36:22 +02:00
hannahhoward
dd885b7302 feat(multistore): extract multistore code to repo
Extract multistore + multiread blockstore to a seperate repo
2020-07-24 14:47:22 -07:00
Whyrusleeping
f69cce4089
Merge pull request #2576 from filecoin-project/fix/testnet-compat
pull in specs actors fix for testnet
2020-07-24 13:17:41 -07:00
Łukasz Magiera
958cc8b947 Update sector-storage, parallel fetch limit 2020-07-24 22:11:11 +02:00
whyrusleeping
cda0326cc3 go mod tidy 2020-07-24 13:09:19 -07:00
whyrusleeping
3bdcae9a59 dont update go-fil-commcid 2020-07-24 12:41:23 -07:00
whyrusleeping
1163d36b02 hardcode legacy multihash types for backward compat 2020-07-24 12:33:04 -07:00
whyrusleeping
d764d86e89 pull in specs actors fix for testnet 2020-07-24 11:36:19 -07:00
Steven Allen
b7a4dbb07f Support inline CIDs
And use the new CidBuilder from the spec actors.

This patch does not switch over to inline CIDs by default, but paves the way.
2020-07-23 23:12:32 -07:00
Aayush Rajasekaran
bac42c5121 Update specs-actors 2020-07-23 21:53:15 -04:00
Łukasz Magiera
b0b2e02248 Merge remote-tracking branch 'origin/next' into feat/storage-gas 2020-07-23 23:19:42 +02:00
Aayush Rajasekaran
4351d033f3 Update CV 2020-07-23 17:13:04 -04:00
Łukasz Magiera
062eaa9eac
Merge pull request #2558 from filecoin-project/feat/upgrade-markets-0.5.1
Update to markets 0.5.1
2020-07-23 23:05:58 +02:00
hannahhoward
5b8d3068f7 feat(markets): update to markets 0.5.1
update to markets 0.5.1, pass on params v1 correctly for retrieval
2020-07-23 14:01:34 -07:00
Jakub Sztandera
673c5ac851
Update specs actors
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-07-23 23:01:05 +02:00
Aayush Rajasekaran
e8837688a2 update specs actors 2020-07-23 16:44:09 -04:00
Łukasz Magiera
7caea34671
Merge pull request #2546 from filecoin-project/fix/post-skip-partitions
wdpost: Correctly skip partitions with no sectors
2020-07-23 22:34:20 +02:00
Łukasz Magiera
824c9dae32 Update sector-storage more 2020-07-23 22:11:25 +02:00
Łukasz Magiera
f9ef83b4bf wdpost: Test sector/partition faulting 2020-07-23 19:23:21 +02:00
Steven Allen
5fc83f4d05 Refactor to use actor adt types instead of directly using HAMTs and AMTs
This way there's a single source of truth. Preparation for fixing
https://github.com/filecoin-project/specs-actors/issues/517 (requires changing
HAMT parameters).
2020-07-23 09:34:57 -07:00
Łukasz Magiera
2633bdd838 miner: sealing jobs command 2020-07-21 20:08:03 +02:00
Łukasz Magiera
b1eb2cf3a7 Update storage-fsm 2020-07-21 01:21:44 +02:00
Łukasz Magiera
5301aa4db2 Update specs-actor with unsafa param fixes 2020-07-20 14:31:18 +02:00
Łukasz Magiera
b41ed492df Update chain-val 2020-07-20 11:37:25 +02:00
Aayush Rajasekaran
34c7acf022 Update specs-actors 2020-07-20 02:15:45 -04:00
Łukasz Magiera
d266c665b0 Update sector-storage with windowed scheduler 2020-07-18 00:38:02 +02:00
Łukasz Magiera
76ff938e00 Update chain-val 2020-07-18 00:27:17 +02:00
Łukasz Magiera
956f4d5e14 update specs-actors more 2020-07-17 22:58:04 +02:00
Mike Greenberg
d30e120608 Merge branch 'master' into fix/master-merge
* master:
  fix(chainwatch): Parallel reward persistence; Tighten rpc logging
  fix(chainwatch): Remove --front switch
  feat(chainwatch): Add miner index on top_miners_by_base_reward view
  fix(chainwatch): Backoff processor when no work exists to process
  fix(log): Move metrics and stage updates to debug; Add --log-level switch
  fix(chainwatch): Correct index name on state_height view
  feat(chainwatch): Capture base_block_reward per epoch; Top miner by reward view
  SwapSigner API methods
  refactor: remove unused code
  refactor: wire up new processor and syncer
  refactor: implement processor and syncer

 Conflicts:
        Makefile
        cmd/lotus-chainwatch/storage.go
        cmd/lotus-chainwatch/sync.go
2020-07-17 15:18:33 -04:00
Łukasz Magiera
0a471bb12c Update chain-val 2020-07-17 15:59:03 +02:00
Łukasz Magiera
cb6767a02b Merge remote-tracking branch 'origin/next' into feat/actors-miner-refactor 2020-07-17 15:18:11 +02:00
Łukasz Magiera
b026de2feb Use specs-actors master 2020-07-17 15:03:59 +02:00
Łukasz Magiera
389d148a60
Merge pull request #2447 from filecoin-project/dep/badger
Update badger
2020-07-17 01:48:57 +02:00
Peter Rabbitson
e266f3b955 Bump fil-commcid and filecoin-ffi deps
Propagates correct on-chain commX CIDs
2020-07-17 00:38:42 +02:00
Jakub Sztandera
2b0492c6d6
Update badger
Replace is needed as badger master's latest tag is v2.0.1

Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-07-17 00:14:51 +02:00
Łukasz Magiera
19f7fd304d Update sector-storage, fixes #1950 2020-07-16 18:30:42 +02:00
Łukasz Magiera
9b6afd82aa
Merge pull request #2422 from filecoin-project/feat/upgrade-retrieval
Update markets with new retrieval
2020-07-15 23:10:20 +02:00
hannahhoward
61f120222f feat(markets): update markets with new retrieval 2020-07-15 14:04:31 -07:00
Jakub Sztandera
399c171f03
Update gas limits, update storage-fsm
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-07-15 21:21:53 +02:00
frrist
41f4f1fd83 refactor: implement processor and syncer
- When chainwatch is ran it will first start a Syncer that continuously collects blocks from the
ChainNotify channel and persists them to the blocks_synced table. Once the Syncer has caught the
blocks_synced table up to the lotus daemons current head a Processor is started. The Processor
selects a batch of contiguous blocks and extracts and stores their data. It attempts to do as much
work as it can in parallel. When the blocks are done being processed their corresponding
processed_at and is_processed fields in the blocks_synced table are filled out.
2020-07-15 11:42:19 -07:00
Jakub Sztandera
61156afd90
Update chain val
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-07-15 20:01:57 +02:00
Jakub Sztandera
347c2ed498
Update chain-val to new gas values
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-07-15 20:01:57 +02:00
Łukasz Magiera
1efb8b4cc0 update cbor-gen 2020-07-15 16:54:29 +02:00
Raúl Kripalani
a44e80c829 Merge branch 'next' into mock-clock 2020-07-15 15:51:11 +01:00
Jakub Sztandera
6ecc96d193
Update to drand devnet
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-07-14 21:16:26 +02:00
Raúl Kripalani
0484496d92 Merge branch 'next' into mock-clock 2020-07-14 18:08:26 +01:00
Łukasz Magiera
faebc4c948 WIP Integrating specs-actors with refactored miner state 2020-07-14 13:45:45 +02:00
Łukasz Magiera
896f0c69fc gomod: Use chain-val master 2020-07-13 12:27:35 +02:00
Aayush Rajasekaran
6504b914ba Update chain-val and storage-fsm to temp commits 2020-07-12 01:15:47 -04:00
Aayush Rajasekaran
7e9f9106c9 Update specs actors 2020-07-12 00:30:42 -04:00
Raúl Kripalani
13de81b3b2 introduce the ability to mock time. 2020-07-10 15:51:45 +01:00
Łukasz Magiera
c3b208869a Fix osx build 2020-07-09 20:49:59 +02:00
Łukasz Magiera
5ca1be567d
Merge pull request #2323 from filecoin-project/feat/fastretrieval
Support fast-retrieval deals
2020-07-08 21:54:46 +02:00
Łukasz Magiera
b1bd8a4394 Use sector-storage next branch 2020-07-08 21:53:50 +02:00
Łukasz Magiera
2c00b92325 Merge remote-tracking branch 'origin/master' into next 2020-07-08 21:47:05 +02:00
Jakub Sztandera
0e7b7c9fdb
Update go-ds-badger2
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-07-08 21:08:23 +02:00
Łukasz Magiera
99796220f9 Support fast-retrieval deals 2020-07-08 20:42:07 +02:00
Jakub Sztandera
40286e4192
Use mostly defaults for badger options
This options are the defults in badger `master` now.
We should update to next badger version as soon as it is stable, it has
some nice improvments.

Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-07-08 17:54:33 +02:00
hannahhoward
aff1d02046 feat(markets): use tagged go-fil-markets 2020-07-08 02:12:18 -07:00
hannahhoward
124de31055 fix(markets): revert storage fsm changes 2020-07-08 02:05:15 -07:00
hannahhoward
24e3a4218b feat(markets): upgrade to latest
upgrade to latest markets with fast retrieval, underlying data transfer upgrade
2020-07-08 01:35:50 -07:00
Aayush Rajasekaran
411c82ae8f Update storage-FSM, add API to set sector seal delay 2020-07-07 15:23:23 -04:00
Jakub Sztandera
3e4b80e7f6
Update specs actors
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-07-02 21:52:55 +02:00
hannahhoward
7e1e9bcd60 fix(markets): upgrade markets to 0.3.1.1
upgrade to 0.3.1.1 to get critical node restart fixes and retrieval map access fix
2020-07-02 08:03:10 -07:00
Łukasz Magiera
746669046a Use fsm next branch 2020-07-02 00:45:16 +02:00
Łukasz Magiera
0770b77336 Merge remote-tracking branch 'origin/next' into feat/cc-upgrade 2020-07-01 21:10:56 +02:00
Łukasz Magiera
4346f7d59d
Merge pull request #2215 from filecoin-project/feat/specs-actors-v0.7.1
specs actors v0.7.1
2020-07-01 21:08:22 +02:00
Aayush Rajasekaran
7b0b1b5977 Update chain-validation 2020-07-01 13:00:42 -04:00
Łukasz Magiera
5946aa7a3a Merge remote-tracking branch 'origin/master' into next 2020-07-01 17:32:27 +02:00
Łukasz Magiera
02c3f8ed80 Update paramfetch 2020-07-01 17:23:50 +02:00
Łukasz Magiera
82e2cd4746 Basic CC Upgrade support 2020-07-01 17:01:06 +02:00
Łukasz Magiera
4c422c2d50 specs-actors v0.7.1 2020-07-01 13:47:40 +02:00
hannahhoward
be29f3bd99 feat(markets): update to markets v0.3.2
Update to markets v0.3.2, which neccesitates merging master & adding one more node function
2020-07-01 12:06:29 +02:00
Łukasz Magiera
cfdbc2312d Merge branch 'master' into next 2020-07-01 11:22:57 +02:00
Łukasz Magiera
e1799f1524
Merge pull request #2155 from filecoin-project/feat/ffi-0.30.1
Update FFI to 0.30.1
2020-07-01 11:17:18 +02:00
Łukasz Magiera
6927a532cf Update sector-storage with lower resource requirements 2020-06-30 21:03:44 +02:00
Jakub Sztandera
c811133aac
Update go-log
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-30 19:39:13 +02:00
Łukasz Magiera
24529bf35d Merge branch 'next' into feat/specs-actors-v0.7.0 2020-06-29 22:45:50 +02:00
hannahhoward
4e32c7edb3 feat(markets): update to markets 0.3.1
Update to markets 0.3.1 with multiaddr support for miners
2020-06-29 10:24:23 -07:00
Łukasz Magiera
2bab5d1ddd Merge remote-tracking branch 'origin/master' into next 2020-06-29 17:45:58 +02:00
Łukasz Magiera
90a470ed78 Update go-bitfield with fixed empty marshaling 2020-06-29 16:06:57 +02:00
Aayush Rajasekaran
1f57d9462c Don't return nil interfaces from runtime.Send() 2020-06-29 01:13:45 -04:00
Łukasz Magiera
0118a78967
Merge pull request #2050 from filecoin-project/asr/api-bitfield
Return sector numbers, not bitfields from API
2020-06-27 00:51:52 +02:00
Aayush Rajasekaran
73e973c29b Update chain-val, using temp commits 2020-06-26 14:28:33 -04:00
Łukasz Magiera
5d6fcbeccf Change initial pledge calc to PrecommitInfo 2020-06-26 18:00:50 +02:00
Łukasz Magiera
a6d1323eba Update specs-actors to v0.7.0; More correct genesis sector import 2020-06-26 15:08:12 +02:00
Łukasz Magiera
8f585713fa Update storage, FSM 2020-06-26 13:11:34 +02:00
Łukasz Magiera
d27ff60ae2 Merge remote-tracking branch 'origin/master' into next 2020-06-26 13:08:37 +02:00
Rob Quist
3d3e384d5c
Merge pull request #2 from RobQuistNL/patch-2
Update makefile
2020-06-26 02:10:53 +02:00
Aayush Rajasekaran
50aa1e6baa Update bitfield 2020-06-25 13:49:15 -04:00
Łukasz Magiera
7e342e60d1 sealing: Give priority to sectors with deals 2020-06-25 18:13:45 +02:00
Jakub Sztandera
008a2969b2
Fix two races in events
Also race fix: depends on https://github.com/ipfs/go-blockservice/pull/65
Resolves #2092, #2099, #2108, #1930, #2110

Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-24 17:05:24 +02:00
Łukasz Magiera
11c53c26ff Update sector-storage to fix #2080 and #1917 2020-06-24 00:47:47 +02:00
Łukasz Magiera
a7d662a7d8 Update to actually working sector-storage 2020-06-24 00:23:39 +02:00
Łukasz Magiera
6f8c464393 Merge remote-tracking branch 'origin/master' into feat/sector-remove 2020-06-23 23:54:27 +02:00
Łukasz Magiera
69559bcf4f Use fsm, sector-storage master 2020-06-23 23:32:12 +02:00
Jakub Sztandera
d7f710806b
Implement golden tests for Poisson distribution
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-23 16:24:02 +02:00
Łukasz Magiera
abd400801c mod tidy 2020-06-23 11:46:20 +02:00
whyrusleeping
3752311f44 update to latest libp2p release 2020-06-22 16:25:41 -07:00
Łukasz Magiera
101ba0b796 Update deps to support removing sectors 2020-06-22 19:03:35 +02:00
Łukasz Magiera
324b659d33 Update sector-storage with 32G checkFiles fix 2020-06-18 09:34:28 +02:00
Łukasz Magiera
290512ee68 Update storage FSM with a bunch of fixes 2020-06-17 20:42:08 +02:00
Jakub Sztandera
b91e7a9860
Update to specs actors with ChargeGas interface
Based on `lotus-0.6.1-chargegas` in specs-actors.

Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-17 20:00:30 +02:00
RobQuistNL
20503de3ba Merge branch 'next' of github.com:filecoin-project/lotus into patch-3 2020-06-17 09:08:16 +02:00
Łukasz Magiera
6bff52483b
Merge pull request #1973 from filecoin-project/feat/drand-upd
Update to new drand
2020-06-16 15:30:40 +02:00
Jakub Sztandera
fd6c8769dd
Update to new drand
WIP

Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-16 14:46:30 +02:00
Łukasz Magiera
bac6a47c67 specs-actors v0.6.1 2020-06-16 12:30:54 +02:00
hannahhoward
a422647819 fix(lint): fix lint error
fix lint error and update to tagged package
2020-06-15 15:53:39 -07:00
hannahhoward
9262661135 chore(deps): update to fil-markets 0.3.0
Updates to latest fil markets with resumability and other fixes
2020-06-15 15:43:47 -07:00
Łukasz Magiera
f8669d4e95 Update chain-val and sector-storage 2020-06-15 21:21:40 +02:00
Łukasz Magiera
c832c0bf3f mod tidy 2020-06-15 18:31:59 +02:00
Łukasz Magiera
907364ce67 Update deps, fix more tests 2020-06-15 18:30:49 +02:00
Łukasz Magiera
464f6a6b08 Update specs-actors to v0.6 2020-06-15 14:49:18 +02:00
RobQuistNL
159a1a4645 Update other docs + bump go.mod version 2020-06-10 10:29:57 +02:00
Łukasz Magiera
6f501119bf
Merge pull request #1957 from filecoin-project/feat/v27
v27 parameters
2020-06-10 02:04:59 +02:00
Łukasz Magiera
a00df0da90 FFI v27 2020-06-10 01:44:14 +02:00
Jakub Sztandera
81bc8471e3
Merge pull request #1963 from filecoin-project/chore/upd-log
Update go-log to master
2020-06-09 23:27:02 +02:00
Jakub Sztandera
5feea2e0f8
Update go-log to master
It restores line informations in log messages

Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-09 23:06:40 +02:00
Łukasz Magiera
28f895cec2 Update sector-storage with better post faults 2020-06-08 23:20:19 +02:00
Łukasz Magiera
baa69c3c81 Update specs-actors to v0.5.6 2020-06-06 19:51:10 +02:00
Jakub Sztandera
94da339622
Fix protobuf panic by updating protobuf to 1.4.2
The panic is caused by usage of internal protobuf interface.
It was changed in protobuf 1.4.0 and reluctantly fixed in 1.4.2

Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-06 02:47:29 +02:00
Łukasz Magiera
163c2b2544 Merge remote-tracking branch 'origin/master' into next 2020-06-06 00:58:24 +02:00
Łukasz Magiera
9e2603c1bf
Merge pull request #1937 from laser/bugs/916-standardize-cid-base32
print "client"-command CIDs as base32-encoded strs
2020-06-06 00:53:07 +02:00
Aayush Rajasekaran
2571480bb6 Update chain-val, use tagged specs-actors 2020-06-05 18:13:30 -04:00
Jeromy
fb09d1ad2b update to new hamt code with improved perf 2020-06-05 14:13:08 -07:00
laser
b167e73acb allow CLI consumer to specify CID encoding for output 2020-06-05 13:33:45 -07:00
laser
28e454fd4a go mod tidy 2020-06-05 13:13:53 -07:00
Łukasz Magiera
3f81ff3507 Update specs-actors 2020-06-05 22:06:11 +02:00
Łukasz Magiera
cd6670205c Update sector-storage 2020-06-05 21:31:57 +02:00
laser
4855045ea2 pass context to paramfetch.GetParams
Fixes #1209
2020-06-05 10:28:00 -07:00
Łukasz Magiera
7ae9d26cd1 Merge remote-tracking branch 'origin/next' into fix/sealing-betterering 2020-06-05 14:00:47 +02:00
Łukasz Magiera
9e5cc7c910 Update fsm, sector-storage 2020-06-05 10:46:45 +02:00
Jakub Sztandera
7bee5b3abc
Merge remote-tracking branch 'origin/master' into next
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-05 00:33:43 +02:00
vyzo
3719938849 gomod: update go-maddr-filter 2020-06-04 22:35:33 +03:00
vyzo
6420990007 gomod: update go-libp2p-quic-transport 2020-06-04 22:34:07 +03:00
vyzo
1fab24b9bc gomod: update go-libp2p-kad-dht 2020-06-04 22:32:11 +03:00
vyzo
b339750757 gomod: update go-libp2p-yamux 2020-06-04 21:34:01 +03:00
vyzo
954a20ff4c gomod: update go-libp2p to v0.9.4 2020-06-04 14:25:17 +03:00
vyzo
8057b994cf go.mod: remove unecessary (and harmful) replace directive for go-systemd 2020-06-04 14:23:59 +03:00
Jakub Sztandera
29dbc26dbd
Update cli
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-04 01:01:41 +02:00
vyzo
aded0706be gomod: update go-libp2p@v0.9.3 and go-libp2p-pubsub@v0.3.2 2020-06-04 00:02:54 +03:00
Jakub Sztandera
673a972fe9
Merge remote-tracking branch 'origin/master' into next
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-02 22:49:27 +02:00
Jeromy
1968195da9 update to fixed jsonrpc library 2020-06-02 11:21:54 -07:00
Łukasz Magiera
c73326e96d fsrepo: Use LevelDB for metadata datastore 2020-06-01 20:13:07 +02:00
Łukasz Magiera
f7a71f4be7
Merge pull request #1837 from filecoin-project/feat/secstor-unseal
Update sector-storage with ReadPiece impl
2020-05-29 20:36:40 +02:00
Łukasz Magiera
e5c24ff32b Update sector-storage with ReadPiece impl 2020-05-29 19:53:35 +02:00
Aayush Rajasekaran
7dd25c3ac5 Correctly handle transfers with sender = receiver 2020-05-29 12:15:41 -04:00
Jakub Sztandera
241c3fa673
Merge pull request #1869 from filecoin-project/feat/drand-pubsub
Add pubsub support to drand beacon
2020-05-29 18:06:38 +02:00
Łukasz Magiera
785eeb1eee
Merge pull request #1850 from filecoin-project/chore/lint
Cleanup many lint warnings
2020-05-29 18:06:06 +02:00
Jakub Sztandera
71eb41b9aa
Add pubsub support to drand beacon
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-05-29 17:55:17 +02:00
Aayush Rajasekaran
fa69adf45c update chain-validation 2020-05-28 13:21:12 -07:00
Aayush Rajasekaran
fa04da2995 Update specs-actors and storage-fsm 2020-05-28 13:19:36 -07:00
Jeromy
e2a554c2e6 update specs actors to version with batch porep verification 2020-05-28 13:19:18 -07:00
frrist
9f8ecb0ac4 update chain-validation
- has new syscalls
2020-05-28 22:11:49 +02:00
vyzo
495554e565 gomod: update go-libp2p-pubsub@v0.3.1 2020-05-28 22:11:49 +02:00
Ignacio Hagopian
de3edc2ec7 remote ipfs support & automatic env
Signed-off-by: Ignacio Hagopian <jsign.uy@gmail.com>
2020-05-28 22:11:49 +02:00
Jakub Sztandera
8639409f74
go mod tidy
,
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-05-28 01:16:01 +02:00
Whyrusleeping
75041b96e4
Merge pull request #1815 from filecoin-project/frrist/new-chainval-syscalls
update chain-val syscalls interface
2020-05-27 11:00:16 -07:00
Whyrusleeping
745fba7d1f
Merge pull request #1841 from filecoin-project/gomod/update-pubsub
Update go-libp2p-pubsub to v0.3.1
2020-05-27 10:50:19 -07:00
Jakub Sztandera
3f9cde28fc
Update go-log, reduce drand entry log level, add TAG env for dev scripts
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-05-27 16:19:21 +02:00
Jakub Sztandera
b06b0147a9
Switch to new drand client
This is a preview of a change to new drand client.

Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-05-27 13:52:33 +02:00
Ignacio Hagopian
d5346f8326
remote ipfs support & automatic env
Signed-off-by: Ignacio Hagopian <jsign.uy@gmail.com>
2020-05-26 14:52:51 -03:00
frrist
8ce6921b18 update chain-validation
- has new syscalls
2020-05-26 10:51:19 -07:00
vyzo
3cd3785385 gomod: update go-libp2p-pubsub@v0.3.1 2020-05-26 20:47:00 +03:00
Łukasz Magiera
9089aadbbf
Merge pull request #1821 from filecoin-project/deps/update-ffi
update to latest ffi
2020-05-26 19:34:02 +02:00
Łukasz Magiera
02ca1937f8 mod tidy 2020-05-26 19:07:21 +02:00
vyzo
ba6217cc2c go mod tidy 2020-05-25 13:46:53 +03:00
Jeromy
646800b8a8 update to latest ffi 2020-05-22 09:26:14 -07:00
Whyrusleeping
83436842c5
Merge pull request #1802 from filecoin-project/feat/gfm-v0.2.7
Use latest go-fil-markets
2020-05-21 10:05:54 -07:00
vyzo
24cebb8b2f gomod: update go-libp2p@v0.9.2 2020-05-21 12:13:14 +03:00
vyzo
3e383d909a gomod: update go-libp2p-pubsub@v0.3.0 2020-05-21 12:08:13 +03:00
hannahhoward
3264a9faad feat(deps): update to latest go-fil-markets
update to go-fil-markets v0.2.7 with latest changes, modify constructors as needed to accomodate new
DS Prefix customization
2020-05-20 16:01:03 -07:00
hannahhoward
c52b75d59e fix(deps): update to new 0.2.7 2020-05-20 16:00:03 -07:00
shannonwells
652c257763 passing w/ new namespace wraps 2020-05-20 15:58:59 -07:00
shannonwells
060f23d748 mod tidy 2020-05-20 15:56:58 -07:00
shannonwells
e68ab286f6 upgrade lotus to go-fil-markets v0.2.5 2020-05-20 15:56:58 -07:00
Łukasz Magiera
f7325a69c1 Extract auth utils to go-jsonrpc 2020-05-20 20:37:45 +02:00
Łukasz Magiera
eeca031525 extract lib/jsonrpc to go-jsonrpc 2020-05-20 19:49:09 +02:00
Łukasz Magiera
ae60001dcc post: Handle Recovering sectors 2020-05-20 18:41:20 +02:00
frrist
fc9e046ca7 update chain-validation 2020-05-18 12:50:36 -07:00
Jakub Sztandera
8d637c515a
Change drand to one without metrics
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-05-18 19:00:30 +02:00
Whyrusleeping
70657e35ba
Merge pull request #1708 from filecoin-project/feat/block-validator
Improved pubsub block validator
2020-05-15 11:26:26 -07:00
Łukasz Magiera
ad108d6051 Update sector-storage with relaxed commit2 resource numbers 2020-05-15 16:00:14 +02:00
vyzo
6933df918a gomod: update go-libp2p-pubsub@master 2020-05-14 20:45:25 +03:00
Jeromy
50fae56baf Verify data for presealed data 2020-05-13 19:35:44 -07:00
Łukasz Magiera
9a21b75c66 Update sector-storage 2020-05-13 21:12:15 +02:00
Jeromy
01192105b1 update to specs actors 0.5.2 2020-05-12 20:42:53 -07:00
Aayush Rajasekaran
aec168e05f Update specs-actors, re-enable full chain validation 2020-05-12 19:52:33 -04:00
Łukasz Magiera
dcd42eec11 Update sector-storage 2020-05-12 20:33:46 +02:00
Łukasz Magiera
d7b8cc6ef9 mod tidy 2020-05-12 20:23:10 +02:00
Aayush Rajasekaran
46fb5f8602 update CV, skip nested sends test 2020-05-12 14:14:00 -04:00
Łukasz Magiera
6056a52978 Update specs-actors to pre v0.5 2020-05-12 18:58:43 +02:00
hannahhoward
ecd180ecf4 feat(deps): update markets 0.2.3 2020-05-11 16:33:30 -07:00
Łukasz Magiera
0704ac4636 Merge remote-tracking branch 'origin/testnet/3' into feat/64g 2020-05-11 22:36:52 +02:00
Łukasz Magiera
6002e359ae Updates for 64G sectors 2020-05-11 22:24:42 +02:00
hannahhoward
fc2d61a55b fix(deps): update markets v0.2.2 2020-05-08 22:06:11 -07:00
hannahhoward
581e7e6fde chore(deps): update to fil-markets 0.2.1
Update fil-markets to 0.2.1 that no longer keeps streams open
2020-05-08 14:11:40 -07:00
Łukasz Magiera
66d67f66a7 Merge pull request #1685 from filecoin-project/feat/v26
v26 proofs
2020-05-08 22:14:41 +02:00
Łukasz Magiera
7747c3eb40 Update sector-storage 2020-05-08 21:28:14 +02:00
Łukasz Magiera
c36bfb36e5 Update sector-storage 2020-05-08 02:12:54 +02:00
Aayush Rajasekaran
dd79c66d41 Update and re-enable chain-validation 2020-05-06 21:44:09 -04:00
Jeromy
b76e229f8e upgrade to v0.4.0 specs actors 2020-05-06 10:47:10 -07:00
Jeromy
fa59cdc2ad update to specs-actors code with faster publish deals 2020-05-05 17:06:32 -07:00
Łukasz Magiera
523a7a9d8d Merge pull request #1670 from filecoin-project/feat/update-markets-0.2.0
Update go-fil-markets
2020-05-06 01:45:33 +02:00
hannahhoward
ed117719aa fix(deps): update to tagged go-fil-markets 2020-05-05 14:44:03 -07:00
ognots
397efddbc6 fetch groth parameters from proofs.filecoin.io
proof parameters are no longer pinned to IPFS public gateways, but on collab IPFS Cluster instead
change default gateway url to proofs.filecoin.io
2020-05-05 17:27:44 -04:00
vyzo
486fda17a2 gomod: update go-libp2p-pubsub@master 2020-05-05 21:12:16 +03:00
Whyrusleeping
1cd932fedd Merge pull request #1661 from filecoin-project/feat/better-pubsub-integration
Improved pubsub integration
2020-05-05 10:41:51 -07:00
hannahhoward
a9866c757e feat(deps): update go-fil-markets
Update to latest 0.2.0 release of go-fil-markets with less-blocking node io
2020-05-04 18:36:51 -07:00
Jeromy
1bd88b24d4 upgrade go-address 2020-05-04 15:23:07 -07:00
Jeromy
d7af5c67e9 update to latest cbor-gen 2020-05-04 15:19:48 -07:00
Łukasz Magiera
51f92b6ed0 mod tidy 2020-05-04 20:13:43 +02:00
vyzo
1b6f6b295b gomod: update go-libp2p-pubsub@master 2020-05-04 19:07:49 +03:00
vyzo
cfcf946556 gomod: update go-libp2p-pubsub@master 2020-05-04 18:13:54 +03:00
Łukasz Magiera
c616e5e14e Merge remote-tracking branch 'origin/testnet/3' into fix/worker-disconnect 2020-05-01 20:33:11 +02:00
Łukasz Magiera
9f2df68906 workers: handle disconnecting workers more gracefully 2020-05-01 20:15:06 +02:00
Łukasz Magiera
d9acd484c0 storageminer: Improve CLI UX 2020-05-01 14:06:19 +02:00
Aayush Rajasekaran
d096c75c6e Update HAMT and cbor gen 2020-04-30 22:08:47 -04:00
Aayush Rajasekaran
441734647d Update hamt 2020-04-30 16:11:23 -04:00
Łukasz Magiera
847a916cd7 Merge pull request #1626 from filecoin-project/feat/storage-better-fetch
Update sector-storage with better fetch logic
2020-04-30 22:00:50 +02:00
Łukasz Magiera
ed500dbbdf Merge remote-tracking branch 'origin/testnet/3' into asr/createactor 2020-04-30 21:29:04 +02:00
Łukasz Magiera
5026091623 Merge remote-tracking branch 'origin/testnet/3' into feat/storage-better-fetch 2020-04-30 20:56:52 +02:00
Aayush Rajasekaran
6cd3e7f7cb Update chain validation 2020-04-30 14:21:36 -04:00
Travis Person
59dcbe93a4 Update drand to v0.8.1 2020-04-30 11:07:00 -07:00
Whyrusleeping
ae420fc9f4 Merge branch 'testnet/3' into feat/gossipsub-v1.1 2020-04-30 10:19:42 -07:00
Łukasz Magiera
0d4bf2e980 Merge branch 'testnet/3' into feat/ipfsclient 2020-04-30 13:09:47 +02:00
Łukasz Magiera
5ec76d4b7b support making deals with data directly from IPFS nodes 2020-04-30 01:56:45 +02:00
Aayush Rajasekaran
35fcf04d3d update chain validation to point to commit in master 2020-04-29 19:05:18 -04:00
vyzo
426bd4cfed gomod: update go-libp2p-pubsub 2020-04-29 22:49:24 +03:00
Łukasz Magiera
89b19af43f specs-actors v0.3 2020-04-29 20:06:05 +02:00
Łukasz Magiera
ba12b9ac3f Update sector-storage with scheduling improvements 2020-04-29 18:03:59 +02:00
vyzo
c7939ff580 gomod: use go-libp2p-pubsub@master 2020-04-29 14:40:01 +03:00
Łukasz Magiera
068e9a29d2 Merge remote-tracking branch 'origin/testnet/3' into feat/storage-better-fetch 2020-04-29 13:27:49 +02:00
Aayush Rajasekaran
cf8691ed87 update chain validation 2020-04-28 20:31:41 -04:00
Łukasz Magiera
ac6573cca7 Merge pull request #1629 from filecoin-project/deps/update-specs-actors
WIP: updating to specs actors v0.2.0
2020-04-28 22:56:47 +02:00
Jeromy
6a27c65201 updating to specs actors v0.2.0 2020-04-28 13:52:07 -07:00
Jeromy
33076d5b43 fix replace directive 2020-04-28 10:35:07 -07:00
Łukasz Magiera
9dcb42328e gofmt 2020-04-28 19:27:13 +02:00
Łukasz Magiera
8d35aacd31 Update sector-storage with better fetch logic 2020-04-28 14:57:53 +02:00
Łukasz Magiera
e38484a109 Merge remote-tracking branch 'origin/testnet/3' into feat/chainwatch-updates 2020-04-25 00:27:59 +02:00
Łukasz Magiera
1947f26cdb Update specs-actors 2020-04-25 00:25:03 +02:00
Frrist
0f0589bcf5 Update validation driver to match latest in chain-validation (#1532)
* update driver to match new chain-validation interfaces

* update chain-validation

* update filecoin-ffi

* gofmt

* update chain-validation again
2020-04-24 15:08:16 -07:00
Jeromy
360d87cbab update to specs actors with sectors fixes 2020-04-24 10:51:47 -07:00
Łukasz Magiera
55f7c81aaf specs-actors: Fix miner cron on null blocks 2020-04-24 19:12:30 +02:00
Jakub Sztandera
36cd9826aa Update badger
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-04-24 16:29:34 +02:00
Jeromy
e34ae07b9a update badger 2020-04-23 17:44:58 -07:00
Łukasz Magiera
da7db5fa98 Merge remote-tracking branch 'origin/testnet/3' into feat/check-deps 2020-04-24 00:59:15 +02:00
Łukasz Magiera
e6ce6211de Merge remote-tracking branch 'origin/testnet/3' into feat/dht-upgrade 2020-04-24 00:50:23 +02:00
Łukasz Magiera
309f54aa0c Update sector-storage 2020-04-23 15:29:31 -07:00
Whyrusleeping
faa9002cce working on sector pledge requirements after specs-actors 1.0.0 (#1584)
* WIP: working on sector pledge requirements after specs-actors 1.0.0

* update storage-fsm with pledge collateral logic

* Set bigger balances for miners

* Return only additional required pledge

* split collateral methods into two methods

Co-authored-by: Łukasz Magiera <magik6k@gmail.com>
2020-04-23 12:39:34 -07:00
Łukasz Magiera
93b30ab865 Merge pull request #1565 from filecoin-project/feat/retrieval-market-#1552
Feat/retrieval market #1552
2020-04-22 23:10:04 +02:00
Jeromy
9c704db12b mod tidy 2020-04-22 11:17:21 -07:00
Adin Schmahmann
744a02eb5a update DHT options and use automatic DHT mode switching 2020-04-22 11:13:25 -07:00
Adin Schmahmann
83ad29648e update dht deps 2020-04-22 11:12:23 -07:00
Travis Person
8f500046ac deps: update specs-actors due to lost commit during squash 2020-04-22 02:38:56 +00:00
shannonwells
fd7f4ef080 begin implementing funcs to support latest go-fil-markest retrieval market API 2020-04-21 16:19:40 -07:00
Łukasz Magiera
8be9494672 windowed post: Get correct sector set 2020-04-21 19:22:53 +02:00
Łukasz Magiera
f43ce74604 Update specs-actors 2020-04-21 16:32:17 +02:00
Łukasz Magiera
b941b29fe5 miner: Use correct randomness for sealing 2020-04-20 20:33:53 +02:00
Łukasz Magiera
a86595bc88 Use nicer DeadlineInfo struct 2020-04-20 19:34:08 +02:00
Łukasz Magiera
ba73b9d3c4 Fix DealFlow test 2020-04-18 01:01:11 +02:00
Łukasz Magiera
3b7ae0d6d9 mod tidy, gofmt 2020-04-18 00:02:43 +02:00
Łukasz Magiera
e6270e4291 Update fsm; get sectorset form correct ts 2020-04-17 21:49:32 +02:00
Łukasz Magiera
93b2b6d65d Merge branch 'testnet/3' into feat/windowed-post 2020-04-17 18:38:20 +02:00
Łukasz Magiera
ebc2895d15 gofmt, mod tidy 2020-04-17 18:27:11 +02:00
Łukasz Magiera
bab352fb44 Wireup WinningPost validation 2020-04-17 16:47:19 +02:00
Łukasz Magiera
15a4565714 Fix deal publishing 2020-04-16 23:43:39 +02:00
Łukasz Magiera
98f3cab24e Update specs-actors 2020-04-16 18:41:45 +02:00
Łukasz Magiera
f88e400d74 make things build 2020-04-16 00:17:39 +02:00
Łukasz Magiera
149bb56b8e wip updates to sector set handling 2020-04-15 21:59:11 +02:00
Jakub Sztandera
c2db85b99b mod tidy
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-04-15 16:36:21 +02:00
Jeromy
674be39af1 real drand network integration 2020-04-13 20:06:10 -07:00
Łukasz Magiera
ff5494af4e Cleanup gohacks, use ffi master 2020-04-13 22:21:13 +02:00
Łukasz Magiera
a2554952d1 Some electionPoSt -> winningPoSt renaming 2020-04-11 00:22:45 +02:00
Łukasz Magiera
d3ffe48fcb Get things to mostly build 2020-04-10 23:29:05 +02:00
Łukasz Magiera
e053cd6b9c Merge remote-tracking branch 'origin/testnet/3' into feat/windowed-post 2020-04-10 23:09:01 +02:00
Łukasz Magiera
3426611340 Merge pull request #1526 from filecoin-project/feat/pass-deal-schedule-for-pre-commit-expiry-scheduling
provide deal scheduling info to FSM so that it can set pre-commit expiry
2020-04-10 23:05:50 +02:00
Łukasz Magiera
1c75bf30ac genesis: Try updating for QA power 2020-04-10 22:04:04 +02:00
Łukasz Magiera
072dd8b744 Merge remote-tracking branch 'origin/testnet/3' into feat/windowed-post 2020-04-10 20:38:25 +02:00
Łukasz Magiera
0f0015f45c Merge pull request #1520 from filecoin-project/feat/graphsync-chainsync-extension
Update to latest go-fil-markets w/ enhanced Graphsync
2020-04-10 20:27:05 +02:00
laser
6dffe9377f provide deal scheduling info to FSM so that it can set pre-commit expiry 2020-04-10 08:22:28 -07:00
Łukasz Magiera
b0fe8b8b4c v25: get bench to almost work 2020-04-10 14:19:06 +02:00
Łukasz Magiera
37e7c512e6 Update ffi (v25 proofs) 2020-04-09 23:17:23 +02:00
Jeromy
1a3ab63e47 WIP: drand client integration 2020-04-08 19:55:17 -07:00
hannahhoward
cda2be93f5 fix(deps): update gs/data-transfer/markets to master 2020-04-07 23:27:41 -07:00
hannahhoward
00cd89750d feat(deps): update fil-markets, graphsync
Updates dependencies for graphsync, fil-markets, data-transfer. Moves to new graphsync blockstore
swapping capabilities, and also locks down graphsync impl so it does not accept arbitrary requests
2020-04-07 23:25:29 -07:00
laser
110c869dd3 cut over to storage-fsm, deleting local sealing package 2020-04-07 09:34:09 -07:00
laser
c268b5b7ac use latest sector-storage 2020-04-06 13:42:27 -07:00
laser
2781e16ef4 go mod tidy 2020-04-06 13:27:27 -07:00
laser
dcd9e7da27 miscellaneous fixes post-rebase 2020-04-06 13:23:37 -07:00
Łukasz Magiera
13f2c21e1d Get network name from genesis 2020-04-01 01:15:49 +02:00
Aayush Rajasekaran
8ec19812e3 Update chain-validation, enable state root validation 2020-03-31 03:09:42 -04:00
Łukasz Magiera
95ee1c1cde Extract sector-storage 2020-03-28 01:32:39 +01:00
Łukasz Magiera
de1f2be505 Merge pull request #1458 from filecoin-project/feat/merge-sectorbuilder
Merge sectorbuilder into sectorstorage
2020-03-27 18:53:58 +01:00
Travis Person
59e77ba6c8 Merge pull request #1457 from filecoin-project/feat/exitcodes
Update to new sepcs actors, more debug
2020-03-26 17:54:25 -07:00
Łukasz Magiera
e050e0307e Cleanup after dropping sectorbuilder 2020-03-26 20:35:16 +01:00
Aayush Rajasekaran
dc5159ce74 Update chain-validation, make necessary changes 2020-03-26 06:41:02 -04:00
Łukasz Magiera
4be54a976c Merge sectorbuilder into sectorstorage 2020-03-26 03:51:06 +01:00
Łukasz Magiera
6399499e9b Fix sealing sectors with multiple pieces 2020-03-26 02:18:13 +01:00
Jakub Sztandera
300c89f541 Update to new sepcs actors, more debug
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-03-26 01:02:13 +01:00
Łukasz Magiera
201d0a4b19 Merge remote-tracking branch 'origin/testnet/3' into feat/new-workers 2020-03-25 01:02:23 +01:00
Jeromy
ec0d0a51db chain validation nil return values should be []byte{} 2020-03-24 13:09:04 -07:00
Łukasz Magiera
66a682b55d Merge remote-tracking branch 'origin/testnet/3' into feat/new-workers 2020-03-24 19:09:02 +01:00
Aayush Rajasekaran
753e8ff7f5 Award gas fees to miners correctly 2020-03-24 03:35:58 -04:00
Jeromy
1c55c6afba update to anorths chainval PR 2020-03-23 18:50:28 -07:00
Jeromy
8bc4195b7a WIP: updating and getting chainval tests passing 2020-03-23 18:50:18 -07:00
Whyrusleeping
d74ede5a79 Merge pull request #1428 from filecoin-project/feat/graphsync-fetching
WIP: integrate graphsync for chainsync requests
2020-03-23 18:47:17 -07:00
Łukasz Magiera
df9aa0e357 storagemitner: manage ulimit on start 2020-03-22 22:08:22 +01:00
Jeromy
f3781e8329 update and rerun cbor gen 2020-03-21 14:17:01 -07:00
whyrusleeping
1076a1a89d WIP: integrate graphsync for chainsync requests 2020-03-20 21:30:24 -07:00
Jeromy
6fcfd0a4f0 add a test to roundtrip export/import a chain 2020-03-20 18:22:24 -07:00
Łukasz Magiera
709fd034b4 mod tidy 2020-03-20 23:43:20 +01:00
Łukasz Magiera
e6aa01653a Merge remote-tracking branch 'origin/testnet/3' into feat/new-workers 2020-03-20 23:42:46 +01:00
Łukasz Magiera
c57c0e7f55 workers: Memory based scheduling 2020-03-20 23:30:17 +01:00
Jeromy
588a55c9d7 update chain validation 2020-03-20 14:08:47 -07:00
Jakub Sztandera
ac09a6432c Skip failing tests, update chain-validation
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-03-20 18:21:13 +01:00
Jakub Sztandera
ae40654907 Rework gas charging 2020-03-20 03:26:40 -04:00
Łukasz Magiera
1ed7779701 Merge remote-tracking branch 'origin/testnet/3' into feat/new-workers 2020-03-19 03:28:55 +01:00
whyrusleeping
f1327b75c3 update to latest specs actors code 2020-03-18 15:16:50 -07:00
laser
4458d090b3 tidy 2020-03-18 11:57:32 -07:00
laser
eacf991bb2 update go-fil-markets dependency 2020-03-18 10:21:50 -07:00
Aayush Rajasekaran
993505b461 Enable full validation tests 2020-03-18 02:57:11 -04:00
Whyrusleeping
8d0b2947d6 Merge pull request #1409 from filecoin-project/feat/proofs-v24
Update to v24 params
2020-03-17 22:24:52 -07:00
Łukasz Magiera
5f2caffb51 Fix tests after specs-storage changes 2020-03-18 02:08:11 +01:00
hannahhoward
f259bc6a09 feat(graphsync): unified graphsync instance
setup a single graphsync that loads from both the chainstore & client blockstore
2020-03-17 17:25:12 -07:00
Łukasz Magiera
d8ce5078d9 Use new specs-storage interface 2020-03-17 21:19:52 +01:00
Łukasz Magiera
7e997e40f3 workers: Simple storage diagnostics 2020-03-16 18:50:07 +01:00
Łukasz Magiera
1bc55714ed Update to v24 params 2020-03-14 03:45:44 +01:00
Frrist
7371274ea7 update chain-validation: adds miner workflow test (#1403)
* update chain-validation. adds miner workflow test
* replace real sealing with mocked impl
2020-03-12 10:22:45 -07:00
whyrusleeping
3971bf0c99 update specs actors with post and cron fixes 2020-03-11 00:08:51 -07:00
whyrusleeping
bccec5af95 update to latest specs-actors 2020-03-09 22:43:43 -07:00
Łukasz Magiera
fe85c4111a update sectorbuilder with precommit1 mkdir fix 2020-03-09 22:13:13 +01:00
whyrusleeping
bf6948f8d6 update to latest specs-actors 2020-03-08 21:21:46 -07:00
whyrusleeping
ab51c7e2d2 Fix fallback post scheduling to hopefully do the right thing 2020-03-08 00:19:38 -08:00
whyrusleeping
24bf720a9a Merge branch 'master' into testnet/3 2020-03-07 16:46:12 -08:00
Whyrusleeping
f17962182f Merge pull request #1343 from filecoin-project/feat/sb-pc1-mkdir-fix
Update sectorbuilder to fix the mkdir bug in precommit1
2020-03-06 14:38:32 -08:00
Łukasz Magiera
a962479ce7 Update sectorbuilder to fix the mkdir bug in precommit1 2020-03-06 23:26:22 +01:00
hannahhoward
eef48c4be3 feat(client): support car to filestore
Store filestore reference for CAR files
2020-03-06 13:14:02 -08:00
Łukasz Magiera
3cab8bd5d1 gofmt 2020-03-06 20:01:28 +01:00
Łukasz Magiera
3d1a5f4bf3 libs: Use go-statemachine 2020-03-06 20:01:03 +01:00
Łukasz Magiera
38241d66cb Merge branch 'testnet/3' into feat/miner-rewards-cmd 2020-03-06 19:04:36 +01:00
Łukasz Magiera
7d3e16986c sectorbuilder type updates 2020-03-06 06:38:59 +01:00
whyrusleeping
1183e082af add command to inspect and redeem block rewards 2020-03-05 21:32:52 -08:00
Łukasz Magiera
ec00636b52 Update FFI 2020-03-06 05:54:43 +01:00
Steven Allen
6992fd4dba chore(dep): update dependencies
Updates:

* cid, multihash, and multiaddr to ensure that minimal varints are used.
* log to deduplicate some code between version 2 and version 1.
* multistream to avoid writing from multiple threads.
* badger/datastore to harden prefix handling in queries.
* libp2p to 0.5.2

BREAKING:

The new libp2p version now formats addresses with /p2p instead of /ipfs. /ipfs
multiaddrs are still supported.
2020-03-05 16:28:42 -08:00
whyrusleeping
8a7f249aaa update to latest specs-actors 2020-03-05 16:20:57 -08:00
Łukasz Magiera
1c052b7c81 Merge remote-tracking branch 'origin/testnet/3' into feat/4stage-seal 2020-03-06 00:59:12 +01:00
Łukasz Magiera
a5c6d83cd9 gofmt; mod tidy 2020-03-05 23:43:41 +01:00
frrist
b8394c3573 update, you guessed it, chain-validation 2020-03-05 13:41:35 -08:00
Frrist
e4728eb719 update chain-val with latest tests (#1325)
* update chain-val with latest tests
2020-03-05 13:39:28 -08:00
whyrusleeping
2cd06e3ea0 update to latest specs-actors 2020-03-05 13:02:33 -08:00
Łukasz Magiera
fa5bc3a5a9 Merge remote-tracking branch 'origin/testnet/3' into feat/4stage-seal 2020-03-05 20:20:47 +01:00
whyrusleeping
4e9e3f3dc3 make state tree snapshots properly stack based 2020-03-04 17:19:15 -08:00
whyrusleeping
5076b2b950 fix reward actor and block reward application 2020-03-04 13:21:24 -08:00
Łukasz Magiera
799ff17c7c Merge remote-tracking branch 'origin/testnet/3' into feat/4stage-seal 2020-03-04 06:37:11 +01:00
Łukasz Magiera
f50e26e5dd update sectorbuilder 2020-03-04 06:32:13 +01:00
Łukasz Magiera
4e46d00eb6 Merge remote-tracking branch 'origin/testnet/3' into feat/4stage-seal 2020-03-04 04:01:13 +01:00
Łukasz Magiera
12d870e274 sealmgr: Read only multi-path file manager 2020-03-04 03:24:08 +01:00
whyrusleeping
52acfb88ee use proper manual piece and size setting 2020-03-03 18:19:28 -08:00
whyrusleeping
99c842e027 integrate client interface to allow for offline deals 2020-03-03 16:18:08 -08:00
whyrusleeping
7b11224130 go mod updates, and a couple small fixes 2020-03-03 16:07:27 -08:00
whyrusleeping
0da2f81252 get most of the chain validation tests passing 2020-03-03 16:06:41 -08:00
frrist
dfad346cff add test skipper and update chain-validation 2020-03-03 16:06:41 -08:00
frrist
72132c851b update chain-validation version for miner creation 2020-03-03 16:06:41 -08:00
frrist
b60458d236 implement chain-validation driver 2020-03-03 16:06:41 -08:00
whyrusleeping
c51a83b404 fix a few libp2p related problems 2020-03-02 20:55:25 -08:00
hannahhoward
9beacabd66 fix(paychmgr): Fix issues with payment channels
Load full addresses for payment channels so they can be signed, fixes bugs with saving vouchers and
catching duplicates, updates to version of go-fil-markets that solves a retrieval bug to complete
retrieval deal
2020-03-02 18:15:32 -08:00
whyrusleeping
ca882725ce fixup imports 2020-03-01 17:15:18 -08:00
whyrusleeping
60b19c51ef more misc fixes 2020-03-01 17:09:38 -08:00
hannahhoward
fed548623d fix(deps): update go-fil-markets 2020-02-28 19:32:33 -08:00
Łukasz Magiera
9794c04b94 Update sectorbuilder with Fr fix 2020-02-29 03:31:14 +01:00
Łukasz Magiera
f54a555aa8 Merge remote-tracking branch 'origin/testnet/3' into feat/4stage-seal 2020-02-29 03:21:01 +01:00
whyrusleeping
1a07cb7bbf a few more fixes 2020-02-28 17:12:47 -08:00
whyrusleeping
cf2eefdfbe Fix up client storage deal matcher 2020-02-28 16:05:56 -08:00
whyrusleeping
713059275d progress is made incrementally 2020-02-28 14:00:34 -08:00
whyrusleeping
b03d2e2f9e un go-mod hack things, integrate newly merged fixes 2020-02-28 11:31:28 -08:00
whyrusleeping
0945d8725e fixing miner logic to make more tests pass 2020-02-28 11:31:28 -08:00
Łukasz Magiera
d5b8defcbb Begin work on integrating new sectorbuilder interfaces 2020-02-28 18:17:40 +01:00
whyrusleeping
00efd097c7 implement basic message filtering 2020-02-27 17:40:16 -08:00
whyrusleeping
df6e3e83bf make it all build finally 2020-02-27 13:45:31 -08:00
whyrusleeping
6c12068fb7 more fixes for random garbage 2020-02-26 16:42:39 -08:00
whyrusleeping
767392332e WIP: update sectorbuilder 2020-02-26 14:54:34 -08:00
Nate Walck
f9dac3a291 Swap to opencensus for publishing data to prometheus 2020-02-25 19:40:07 -05:00
Łukasz Magiera
d787aa5007 Merge branch 'testnet/3' into feat/specs-actors 2020-02-24 18:32:02 +01:00
Łukasz Magiera
def0e0a7a1 Merge remote-tracking branch 'origin/master' into testnet/3 2020-02-24 17:30:46 +01:00
Nate Walck
c0ef65f442 Enable Prometheus metrics endpoint and add lotus version 2020-02-23 17:35:29 -05:00
Łukasz Magiera
917df9a5b8 More unified randomness handling 2020-02-23 21:00:47 +01:00
Łukasz Magiera
a82d156ccb Deal flow fixes 2020-02-23 16:50:36 +01:00
Łukasz Magiera
226685dc1c Implement committed capacity sectors 2020-02-23 01:47:47 +01:00
Łukasz Magiera
111d35deef seed: New genesis creation commands 2020-02-21 21:57:00 +01:00
Łukasz Magiera
18627e77ff gofmt; mod tidy 2020-02-21 20:28:20 +01:00
Łukasz Magiera
d6dffed203 Fix genesis car generation 2020-02-21 20:27:29 +01:00
Łukasz Magiera
104871d6c9 paych: Lanes are back to u64 2020-02-21 18:26:44 +01:00
Łukasz Magiera
c744dc06c6 Fix implicit account creation 2020-02-21 18:13:50 +01:00
Łukasz Magiera
57c43183e6 update specs-actors 2020-02-21 17:57:40 +01:00
Łukasz Magiera
69ec3c205a Merge remote-tracking branch 'origin/master' into testnet/3 2020-02-19 22:10:14 +01:00
Łukasz Magiera
9c31f61db4 sectorset updates 2020-02-19 20:26:11 +01:00
Łukasz Magiera
e9019c8bcc Working Genesis Generator 2020-02-18 22:38:08 +01:00
Whyrusleeping
6afeb2e72b
Merge pull request #1268 from filecoin-project/feat/simple-spam-protection
basic gossip spam protection logic
2020-02-18 10:39:36 -08:00
whyrusleeping
6d0eec6395 working towards a working genesis generator 2020-02-17 23:15:30 -08:00
Łukasz Magiera
4ad160ef80 specs-actors: Update cbor-gen 2020-02-17 22:42:15 +01:00
Łukasz Magiera
140187dc2a vm: Fix Commit 2020-02-17 19:00:20 +01:00
Łukasz Magiera
3e4ebd6c9d actors: fix miner constructor 2020-02-17 18:19:06 +01:00
Łukasz Magiera
4ad63d9b63 update specs-actors; update GetRandomness 2020-02-17 09:46:12 +01:00
whyrusleeping
1dafcf24f1 basic gossip spam protection logic 2020-02-16 21:51:18 -08:00
Łukasz Magiera
a92099258b genesis: Register system actor 2020-02-14 22:38:18 +01:00
Łukasz Magiera
d5027bfbb2 Fix amt bug 2020-02-14 21:33:41 +01:00
Łukasz Magiera
48c5494cf9 use specs-actors birfields 2020-02-14 01:24:24 +01:00
Łukasz Magiera
74bf9119cc spects-actors: More type propagation 2020-02-13 04:50:45 +01:00
Łukasz Magiera
36aed6f871 Update cbor-gen 2020-02-13 02:37:28 +01:00
Łukasz Magiera
91b2d2c2fe cbor-gen fixes 2020-02-13 01:10:07 +01:00
hannahhoward
720e29848b feat(markets): use non-custom go-fil-markets, from master 2020-02-12 14:32:26 -08:00
Jakub Sztandera
14580b6144
Import go-systemd properly
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-02-12 20:44:35 +01:00
Jakub Sztandera
50702f309f Use new hello protocol
Using map encoder.
Types in LatencyMessage are int64 in spec, butl 1. tupled generator
does not support int64 right now; 2. there is no harm in using uint64 here.

Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-02-12 19:08:49 +01:00
Łukasz Magiera
a4f6b739be genesis: Change template types 2020-02-12 01:58:55 +01:00
Łukasz Magiera
fa2c6605c2 Fix compilation after dep updates 2020-02-11 02:11:58 +01:00
Łukasz Magiera
a593a4f6f4 update ffi 2020-02-11 01:44:39 +01:00
Łukasz Magiera
6dce181314 Update specs-actors 2020-02-10 22:25:22 +01:00
Łukasz Magiera
13435aebdc Spec Actors integration 2020-02-08 03:18:32 +01:00
Łukasz Magiera
1d0d429435 actors: Drop refs to multisig_actor.go 2020-02-06 20:49:21 +01:00
hannahhoward
d2c5d81e59 fix(deps): update go-fil-markets
update go-fil-markets to latest to solve an issue with retrieval
2020-02-05 18:48:47 -08:00
hannahhoward
d42cd6a5e2 fix(deps): mod tidy 2020-02-04 20:10:58 -08:00
hannahhoward
97b645cd55 fix(go-fil-markets): fix integration
remove broken aspects of go-fil-markets integration and update versins
2020-02-04 20:08:08 -08:00
whyrusleeping
faf05cafcf squash forks and use correct amt library everywhere 2020-02-04 18:26:42 -08:00
Łukasz Magiera
c013ef3b30 Merge pull request #1219 from filecoin-project/feat/auto-shim
Make it all build
2020-02-05 00:01:41 +01:00
whyrusleeping
028a113737 Make it all build 2020-02-04 14:19:05 -08:00
Łukasz Magiera
d9f3b6c121 Merge pull request #1148 from filecoin-project/feat/msig-integration
DO NOT MERGE: Feat/msig integration
2020-02-04 07:19:49 +01:00
Łukasz Magiera
0e81c1cf7e Merge branch 'testnet/3' into feat/update-markets 2020-02-04 07:17:22 +01:00
whyrusleeping
cd976ad79f tests are mostly passing! 2020-02-03 18:52:18 -08:00
whyrusleeping
c73c5987c7 WIP: integrate multisig actor from specs-actors 2020-02-03 18:52:18 -08:00
whyrusleeping
dfe87c9f6f update to latest hamt changes 2020-02-03 18:52:18 -08:00
Łukasz Magiera
ff77198a08 Update sectorbuilder with later cache mkdir 2020-02-03 18:37:40 +01:00
Łukasz Magiera
ee9060aa14 Update sectorbuilder 2020-01-31 02:18:48 +01:00
Łukasz Magiera
5af64c53b6 initial sectorbuilder FS refactor integration 2020-01-29 00:08:02 +01:00
hannahhoward
433f9ff211 fix(markets): update version, pass payment interval params 2020-01-28 14:08:13 -08:00
hannahhoward
1a2c3adb2f fix(deps): update go-fil-markets 2020-01-28 14:08:13 -08:00
hannahhoward
71289b58ff feat(markets): update to support car files
Upgrades lotus version of go-fil-markets to its head, which supports car files and handles tracking
of pieces, reducing the size of sectorBlocks
2020-01-28 14:08:13 -08:00
Łukasz Magiera
9fc5f0cd9d
Merge pull request #1124 from filecoin-project/feat/sector-recovery
sealing: Implement some common error states
2020-01-24 21:25:03 +01:00
Jakub Sztandera
23b46a05f7
Update badger
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-23 12:46:32 -08:00
Łukasz Magiera
558e4c7669 Fix tests after sectorbuilder update 2020-01-23 15:33:28 +01:00
Łukasz Magiera
c3a5da8586 storageminer: log flag for sector status 2020-01-23 15:18:05 +01:00
Jakub Sztandera
a404d535ee
Make it buld without cgo
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-22 12:03:12 -08:00
Łukasz Magiera
d2401bc339 Update cbor-gen, error on unknown fields 2020-01-21 17:28:55 +01:00
Łukasz Magiera
2076cb106d cobr-gen: Soft struct-map unmarshaling 2020-01-21 17:05:10 +01:00
whyrusleeping
955b755055 wire up importing 2020-01-20 17:53:55 -08:00
whyrusleeping
62f05d4c14 WIP: chain export 2020-01-20 15:51:28 -08:00
Jakub Sztandera
84de47377c
Intoroduce AMT v2 and amtFsck
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-16 23:21:16 +01:00
ognots
d8d8ce7526 health agent to monitor lotus
watch if chain head changes in a given window of api polls
allows setting a threshold of how many times the chain head can remain
unchanged before failing health check
also can set interval for polling chain head
on failure, restarts systemd unit
2020-01-14 12:18:45 -05:00
Łukasz Magiera
11ac026b62 Merge branch 'feat/testnet2' into feat/chainwatch-pg 2020-01-14 04:20:39 +01:00
Łukasz Magiera
69752b419d Update sectorbuilder 2020-01-14 03:09:34 +01:00
Łukasz Magiera
94a21e3aeb Update deps 2020-01-14 03:05:46 +01:00
Łukasz Magiera
a2bcc1fec2 Mostly functional mock sectorbuilder 2020-01-14 03:05:35 +01:00
Łukasz Magiera
85f0f0bf81 mod tidy 2020-01-14 00:38:08 +01:00
Łukasz Magiera
b6fda30719
Merge pull request #1057 from filecoin-project/feat/markets-extraction
Markets Extraction
2020-01-10 20:49:09 +01:00
hannahhoward
0ce1bf706b refactor(markets): reorg file structure 2020-01-10 10:33:26 -08:00
hannahhoward
65ecb33630 feat(storagemarket): extract storage market
remove all shared components, point at go-fil-components repo
2020-01-10 09:49:07 -08:00
hannahhoward
0a4eeb7cb1 refactor(retrievalmarket): switch to go-fil-markets repo
Switch go-fil-components to go-fil-markets
2020-01-10 09:13:12 -08:00
Łukasz Magiera
469136ee86
Merge pull request #1040 from filecoin-project/feat/fork-signaling
Add fork signaling to blockheader
2020-01-10 13:33:29 +01:00
hannahhoward
ccf359d057 feat(retrieval): extract retrievalmarket
Extract retrieval market and modify shared types
2020-01-09 19:46:07 -08:00
whyrusleeping
7534ac1e1a add ability to control seal operations completion time 2020-01-09 12:50:45 -08:00
Łukasz Magiera
8cbcbbd7a4 Merge branch 'feat/testnet2' of github.com:filecoin-project/go-lotus into feat/testnet2 2020-01-08 22:44:54 +01:00
Łukasz Magiera
36a5c7d8f5 Merge branch 'master' into feat/testnet2 2020-01-08 22:38:45 +01:00
Łukasz Magiera
da38822dfd paramfetch: bring parameters.json back to this repo 2020-01-08 21:31:35 +01:00
Jakub Sztandera
8cfb4aafcd
Add fork signaling to blockheader
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-08 20:31:08 +01:00
Jakub Sztandera
1ed62628a7
Update go-log to v2
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-08 20:22:31 +01:00
Jakub Sztandera
b5328d01cf
Update to go-log v1.0.1
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-08 20:20:56 +01:00
Jakub Sztandera
886898b137
Update to badger v2
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-08 19:56:45 +01:00
Łukasz Magiera
855fb26a81 mod tidy 2020-01-08 15:18:13 +01:00
Łukasz Magiera
ab922ed1ba Merge remote-tracking branch 'origin/master' into feat/chainwatch-pg 2020-01-08 15:08:34 +01:00
hannahhoward
5312340bf9 refactor(datatransfer): use independent repo
Use independent repo for go-data-transfer
2020-01-08 14:20:31 +01:00
hannahhoward
61e2568b8d feat(datatransfer): implement and extract
feat(datatransfer): setup implementation path

Sets up a path to implementation, offering both the dagservice implementation and a future graphsync
implement, establishes message interfaces and network layer, and isolates the datatransfer module
from the app

WIP using CBOR encoding for dataxfermsg

* Bring cbor-gen stuff into datatransfer package
* make transferRequest private struct
* add transferResponse + funcs
* Rename VoucherID to VoucherType
* more tests passing

WIP trying out some stuff
* Embed request/response in message so all the interfaces work AND the CBOR unmarshaling works: this is more like the spec anyway
* get rid of pb stuff

all message tests passing, some others in datatransfer

Some cleanup for PR

Cleanup for PR, clarifying and additional comments

mod tidy

Respond to PR comments:
* Make DataTransferRequest/Response be returned in from Net
* Regenerate cbor_gen and fix the generator caller so it works better
* Please the linters

Fix tests

Initiate push and pull requests (#536)

* add issue link for data TransferID generation
* comment out failing but not relevant tests
* finish voucher rename from Identifier --> Type

tests passing

cleanup for PR

remove unused fmt import in graphsync_test

a better reflection

send data transfer response

other tests passing

feat(datatransfer): milestone 2 infrastructure

Setup test path for all tickets for milestone 2

responses alert subscribers when request is not accepted (#607)

Graphsync response is scheduled when a valid push request is received (#625)

fix(datatransfer): fix tests

fix an error with read buffers in tests

fix(deps): fix go.sum

Feat/dt graphsync pullreqs (#627)

* graphsync responses to pull requests

Feat/dt initiator cleanup (#645)

* ChannelID.To --> ChannelID.Initiator
* We now store our peer ID (from host.ID()) so it can be used when creating ChannelIDs.
* InProgressChannels returns all of impl.channels, currently just for testing
* Implements go-data-transfer issue
* Some assertions were changed based on the above.
* Renamed some variables and added some assertions based on the new understanding
* Updated SHA for graphsync module
* Updated fakeGraphSync test structs to use new interfaces from new SHA above

Techdebt/dt split graphsync impl receiver (#651)

* Split up graphsyncImpl and graphsyncReceiver
* rename graphsync to utils

DTM sends data over graphsync for validated push requests (#665)

* create channels when a request is received. register push request hook with graphsync. fix tests.
* better NewReaders
* use mutex lock around impl.channels access
* fix(datatransfer): fix test uncertainty
* fix a data race and also don't use random bytes in basic block which can fail
* privatize 3 funcs

with @hannahhoward

Feat/dt gs pullrequests (#693)

* Implements DTM Sends Data Over Graphsync For Validated Pull Requests
* rename a field in a test struct
* refactor a couple of private functions (one was refactored out of existence)

Feat/dt subscribe, file Xfer round trip (#720)

Implements the rest of Subscriber Is Notified When Request Completed #24:
* send a graphsync message within a go func and consume responses until error or transfer is complete.
* notify subscribers of results.
* Rename datatransfer.Event to EventCode.
* datatransfer.Event is now a struct that includes a message and a timestamp as well as the Event.Code int, formerly Event, update all uses
* Add extension data to graphsync request hook, gsReq
* rename sendRequest to sendDtRequest, to distinguish it from sendGsRequest, where Dt = datatransfer, Gs = graphsync
* use a mutex lock for last transfer ID
* obey the linter

Don't respond with error in gsReqRcdHook when we can't find the datatransfer extension. (#754)

* update to correct graphsync version, update tests & code to call the new graphsync hooks
* getExtensionData returns an empty struct + nil if we can't find our extension
* Don't respond with error when we can't find the extension.
* Test for same
* mod tidy

minor fix to go.sum

feat(datatransfer): switch to graphsync implementation

Move over to real graphsync implementation of data transfer, add constructors for graphsync
instances on client and miner side

fix(datatransfer): Fix validators

Validators were checking payload cid against commP -- which are not the same any more. Added a
payloadCid to client deal to maintain the record, fixed validator logic

Feat/dt extraction use go-fil-components/datatransfer (#770)

* Initial commit after changing to go-fil-components/datatransfer
* blow away the datatransfer dir
* use go-fil-components master after its PR #1 was merged
* go mod tidy

use a package

updates after rebase with master
2020-01-08 14:19:28 +01:00
Łukasz Magiera
1392dcc273 Merge remote-tracking branch 'origin/master' into feat/testnet2 2020-01-08 13:53:01 +01:00
whyrusleeping
80c19df4bb go mod tidy 2020-01-07 21:45:10 -08:00
Jakub Sztandera
a63c34a902
Handle faults in ss and pss correctly
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-07 23:03:18 +01:00
laser
0ffec0a9ad go mod tidy 2020-01-07 08:27:08 -08:00
laser
20321bb476 handle rebase 2020-01-07 08:18:35 -08:00
laser
4bbc693d9c go mod tidy 2020-01-07 07:52:19 -08:00
laser
3ae1bd5b78 add paramfetch import to lotus-bench 2020-01-07 07:52:06 -08:00
laser
ce837da935 point go-sectorbuilder to head of master 2020-01-07 07:48:53 -08:00
acruikshank
7873213b11 switch sectorbuilder from lib to external module
point to correct version of sectorbuilder + ensure go-datastore stays at 0.1.1

replace local address type with go-address

consume paramfetch.GetParams instead of local paramfetch.go

remove constants now defined in sectorbuilder
2020-01-07 07:48:43 -08:00
hannahhoward
718acb0a86 refactor(cborutil): extract cborutil library
Use extracted cborutil library
2020-01-07 14:59:35 +01:00
hannahhoward
14ecd1929b refactor(crypto): use extracted crypto library 2020-01-07 14:53:30 +01:00
hannahhoward
8418464d91 refactor(address): use extracted address library
Switch to using extracted address library
2020-01-07 14:53:27 +01:00
laser
6a740a6d67 consume newly-extracted paramfetch 2020-01-02 11:08:49 -08:00
Łukasz Magiera
f7604b84f7
Merge pull request #965 from filecoin-project/feat/no-fatal-serialization
make serialization error non-fatal
2019-12-19 22:04:27 +01:00
Łukasz Magiera
81233b894d Implement 'chain get' for easier ipld digging 2019-12-19 17:58:02 +01:00
whyrusleeping
897d4c7d24 make serialization error non-fatal 2019-12-17 19:41:58 -08:00
whyrusleeping
fda3811dcf Update cbor-gen to latest master 2019-12-17 19:06:06 -08:00
Łukasz Magiera
8d0d2b2fae mod tidy 2019-12-17 17:26:33 +01:00
whyrusleeping
7dcc528cd1 tag peers who propagate good blocks to us 2019-12-16 23:06:48 -08:00
whyrusleeping
022581d50b add routine to tag miners peer IDs as high value in connection manager 2019-12-16 22:51:41 -08:00
Whyrusleeping
7293f7415d
Merge pull request #715 from filecoin-project/frrist/chainval-multisig
chainval | multisig tests
2019-12-16 02:58:30 +01:00
Steven Allen
2b1a7975e2 chore(dep): update go-cid, go-datastore, go-ipfs-blockstore
Lots of bug fixes.
2019-12-14 18:04:02 +01:00
Łukasz Magiera
165ac1d556 Merge remote-tracking branch 'origin/master' into feat/chainwatch-pg 2019-12-13 10:34:24 +01:00
whyrusleeping
28a325efe6 soft fail messages that cause precomitted sectors map to become too large 2019-12-13 00:00:20 +01:00
Łukasz Magiera
830f2cbdd3 Merge branch 'master' into feat/chainwatch-pg 2019-12-11 22:13:08 +01:00
Łukasz Magiera
43f5ba1eb4
Merge pull request #847 from lanzafame/feat/accept-human-sizes
accept humanized size values to cli flags
2019-12-11 13:18:05 +01:00
lanzafame
1888b68e38 accept humanized size values to cli flags 2019-12-11 12:06:28 +10:00
Łukasz Magiera
b6b06f67dc chainwatch: Postgres 2019-12-11 00:42:36 +01:00
frrist
b6b91372cb add multisig test calls and update to v0.0.3 2019-12-09 09:55:24 -08:00
Łukasz Magiera
94df2c656e Use map encoders for some structs 2019-12-09 17:40:15 +01:00
Łukasz Magiera
0b4db5530c
Merge pull request #804 from filecoin-project/fix/retrieve-large
Fix retrieval of large files
2019-12-09 16:28:47 +01:00
Łukasz Magiera
d5103a7fbd Fix rterieval of large files 2019-12-09 13:15:05 +01:00
whyrusleeping
0a68dba256 use a package 2019-12-08 22:53:48 +01:00
Łukasz Magiera
311cf832d6 mod tidy 2019-12-05 14:08:58 +01:00
whyrusleeping
43f2286890 Set maximum sector ID to 2^48-1 2019-12-04 17:32:34 -08:00
Whyrusleeping
67a12d3059
Merge pull request #695 from filecoin-project/frrist/chainval-type-serialization
chainval | type serialization
2019-12-04 17:11:32 -08:00
frrist
e1e295d47b update to work with chain-validation refactor 2019-12-04 15:28:12 -08:00
Łukasz Magiera
edd30c7aa1 Merge branch 'master' into feat/remote-workers 2019-12-04 14:10:15 +01:00
whyrusleeping
4ad0db0ecd update go-amt-ipld code to fix infinite loop issue 2019-12-02 23:35:29 -08:00
Łukasz Magiera
160e11ce8c Merge branch 'master' into feat/remote-workers 2019-12-03 03:24:00 +01:00
Łukasz Magiera
a47fbfa799 Merge branch 'devnet/9' into feat/election-post 2019-12-02 12:25:23 +01:00
Jakub Sztandera
9959234858
Remove usage of go-leb128
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-01 01:13:23 +01:00
Jakub Sztandera
c8b21b30ab
Fix id address decoding
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-11-30 13:46:00 +01:00
Łukasz Magiera
8767d8c16b Merge branch 'feat/election-post' into feat/remote-workers 2019-11-30 09:42:28 +01:00
Łukasz Magiera
23e0008b81 Merge remote-tracking branch 'origin/master' into feat/election-post 2019-11-27 13:31:44 +01:00
laser
3623925f66 replace go-bls-sigs and go-sectorbuilder with filecoin-ffi
- remove old submodules and add new submodule
- update build tooling to consume new unified static library
- update consumers of old libs to use new package
2019-11-26 18:16:37 -08:00
whyrusleeping
a0588d513d Add lotus-gen, rewire genesis mining 2019-11-24 22:45:13 -06:00
Łukasz Magiera
2deae35dcc
Merge pull request #672 from filecoin-project/feat/no-pkg-error
Swtich to xerrors
2019-11-22 12:40:59 -06:00
whyrusleeping
f03198c8a0 sync tests passing, still no vm integration 2019-11-22 10:41:09 -06:00
Jakub Sztandera
cfd3750bf6
Mod tidy
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-11-22 10:29:09 -06:00
Jakub Sztandera
36b7c5a32a
Swtich to xerrors
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-11-22 10:20:56 -06:00
Łukasz Magiera
ba3ad75670 remote-worker: wire up storage miner endpoints 2019-11-21 15:10:51 +01:00
Łukasz Magiera
4815dd619e
Merge pull request #648 from filecoin-project/feat/pubsub-tracer
pubsub tracing
2019-11-21 07:05:49 -06:00
vyzo
5c8cc1a540 go mod: update go-ws-transport 2019-11-21 06:10:30 +02:00
vyzo
afe5347b9f go mod: update go-multiaddr-dns 2019-11-21 06:04:47 +02:00
Łukasz Magiera
70956589ef Begin implementing ChainWatch 2019-11-20 17:45:02 +01:00
vyzo
c7c02e0028 go mod: update pubsub dependency etc 2019-11-20 01:31:03 +02:00
whyrusleeping
ab2e722811 use fast cbor-gen method for extracting links from objects 2019-11-16 11:24:11 -08:00
anorth
36d57385ab Upgrade go-cid and drop superfluous envelope bytes in TipSetKey 2019-11-13 15:26:51 +11:00
frrist
d0a2ba82b2 fixup! first pass at integrating chain-validation 2019-11-12 11:24:06 -08:00
anorth
60a19a1155 first pass at integrating chain-validation 2019-11-12 11:06:16 -08:00
Łukasz Magiera
aafccaf021
Merge pull request #488 from filecoin-project/feat/dt-skeleton
Data Transfer Integration For Storage Deals (w/ Skeleton Module)
2019-11-11 22:52:23 +01:00
Łukasz Magiera
b72463e6fc mod tidy 2019-11-11 21:12:06 +01:00
hannahhoward
905259e192 feat(datatransfer): integration w/ simple merkledag
Integrates the data transfer module with a mock version of the module that just calls the dag
service
2019-11-11 11:07:15 -08:00
hannahhoward
e1be257b28 feat(datatransfer): add data transfer types
Add types and interfaces for data transfer
2019-11-11 11:07:15 -08:00
Łukasz Magiera
6fe5921bb6 Merge remote-tracking branch 'origin/master' into feat/async-validateblk 2019-11-11 18:44:45 +01:00
whyrusleeping
c74f87fd51 split files, implement peer tracker 2019-11-10 11:33:08 -08:00
whyrusleeping
904fdad4c6 extract blocksync into its own package 2019-11-09 15:00:22 -08:00
whyrusleeping
af2789c3d8 fix non-deterministic map serialization 2019-11-07 14:55:24 -08:00
whyrusleeping
9a398c6260 Track down all the uses of cboripld and eliminate them 2019-11-04 19:42:13 -08:00
whyrusleeping
83868d3eed fix serialization of paych vouchers 2019-11-04 11:07:11 -08:00
whyrusleeping
a954ebc6b6 Add command to unregister miner from full node manually 2019-10-31 15:04:13 -07:00
Jakub Sztandera
563c0e494e
Use div-free EC power selection function
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-10-28 20:01:10 +01:00
Łukasz Magiera
117ec636c5 paramfetch: check checksums in parallel 2019-10-27 10:18:27 +01:00
Łukasz Magiera
d753c39133 Add rate limits to the fountain by @travisperson 2019-10-25 17:42:14 +02:00
Łukasz Magiera
187317a004 sync: Do some things in parallel in ValidateBlock 2019-10-23 16:45:03 +02:00
Travis Person
0b2718a4af
Add chain stats tool
Simple chain stats tool for graphing the chain using influxdb and
grafana.

License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-10-18 20:53:08 +09:00
Jakub Sztandera
1bf713cb0a
Cleanup imports after rename
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-10-18 13:47:41 +09:00
Jakub Sztandera
b8c3eeccfa
Update build scripts
Remove outdated

License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-10-17 16:52:29 +09:00
Jakub Sztandera
530dc64e82
Update go-log
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-10-11 00:24:54 +02:00
whyrusleeping
b333247fab switch to a bounded cache 2019-10-09 21:23:45 +09:00
Jakub Sztandera
9e74b19da0
Improve logs
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-10-05 17:59:35 +02:00
Łukasz Magiera
05878f4320 Built in paramfetch 2019-10-02 19:20:30 +02:00
whyrusleeping
74ad58881b use new cbor-gen code with better errors 2019-10-01 09:53:39 -06:00
Łukasz Magiera
b79b826805 miner: fix required collateral check 2019-09-23 13:41:26 +02:00
whyrusleeping
86fd132cf7 add deleting done sectors 2019-09-18 21:56:40 -07:00
Jakub Sztandera
9c02f7f839 Rought PoST method
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2019-09-18 17:10:03 +02:00
Whyrusleeping
0f92df7b06
Merge pull request #199 from filecoin-project/feat/serialization-3
final chain serialization bits
2019-09-18 04:21:55 +10:00
whyrusleeping
2ab9a0a4b3 mod tidy 2019-09-16 18:57:49 -07:00
whyrusleeping
8d2bcc5e3d final chain serialization bits 2019-09-16 18:56:37 -07:00
Łukasz Magiera
4d543589c5 gomod: Hack around broken golangci-lint dep 2019-09-16 20:39:35 +02:00
Jakub Sztandera
4107d701c1 Add rleplus
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2019-09-16 14:10:51 +02:00
whyrusleeping
a47969c76b finish up making the new serializations work 2019-09-10 16:03:17 -07:00
whyrusleeping
2f019158d0 more switching over to correct cbor marshaling 2019-09-10 12:58:45 -07:00
whyrusleeping
1f1bbc9b8d cbor gen types and cleaning up after 2019-09-09 19:53:18 -07:00
whyrusleeping
b5bd1820d9 WIP: vm perf improvements 2019-09-09 19:53:17 -07:00
whyrusleeping
74f68dc630 perform tipset expansion on sync and fix tipset comparison 2019-09-09 19:14:27 -07:00
whyrusleeping
3d8e5cf0fb update to cbor-gen code with deferred map marshaling 2019-09-06 16:57:35 -07:00
Łukasz Magiera
0b87411c7d Use AMT in StorageMinerActor ctor 2019-09-07 00:42:01 +02:00
Steven Allen
b5148ac61a mod: fix versions for go 1.13
Go 1.13 is much pickier about versions. This patch also updates go-log the
latest master (where zap has been merged) and updates go-bitswap to
master (where the custom protocol patches have been merged).
2019-09-05 14:27:03 -07:00
Jakub Sztandera
2e9d4301e1 Cleanup benchmarks
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2019-08-30 15:47:55 -07:00
Łukasz Magiera
711c61cba1 Merge remote-tracking branch 'origin/master' into feat/retrieval 2019-08-29 20:59:03 +02:00
Łukasz Magiera
f79b755c58 retrieval: Make types more spec complaiant 2019-08-29 17:54:35 +02:00
Łukasz Magiera
985ca7d439 remove gohacks from gomod 2019-08-29 17:51:52 +02:00
Łukasz Magiera
60eedb699e retrieval: Client impl 2019-08-29 17:48:58 +02:00
Łukasz Magiera
9691211df1 Sealed blockstore 2019-08-29 17:48:19 +02:00
whyrusleeping
2013db604a switch to using AMT for sector set 2019-08-28 17:01:46 -07:00
whyrusleeping
ccdc1575d6 add signatures to blocks 2019-08-26 17:46:39 -07:00
whyrusleeping
80cad55ae4 go mod tidy 2019-08-22 13:34:11 -07:00
whyrusleeping
7eb89f90d1 Replace most marshaling with codegen 2019-08-22 12:53:32 -07:00
whyrusleeping
53be71fb73 Start using codegen 2019-08-22 12:53:32 -07:00
whyrusleeping
357c49eed8 Add cbor marshaling fastpath methods on several types 2019-08-21 18:29:56 -07:00
Łukasz Magiera
6ec6c273cb lint fixes 2019-08-20 00:38:32 +02:00
whyrusleeping
e9d1f3e7c9 WIP: base mining on power and VRFs 2019-08-16 12:39:12 -07:00
Jakub Sztandera
27057ee222 initial gas charning
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2019-08-15 18:24:06 +02:00
whyrusleeping
ae34757e2a pull chain call into its own method and fix paych module 2019-08-12 11:30:20 -07:00
whyrusleeping
6979c28e05 Add API interface for payment channels and a few tests 2019-08-12 10:12:51 -07:00
Łukasz Magiera
b39a3cafb7 mod tidy 2019-08-12 15:31:20 +02:00
whyrusleeping
959fe371b0 move storage miner keys to full node 2019-08-08 10:56:14 -07:00
Łukasz Magiera
05a4c7d4d3 mod tidy 2019-08-08 19:20:52 +02:00
Łukasz Magiera
b2c3434bcd deals: Upstream bitswap changes 2019-08-08 19:16:41 +02:00
whyrusleeping
998597f314 fix build failures after rebase 2019-08-07 20:30:50 -07:00
Łukasz Magiera
8f958d58e0 mod tidy 2019-08-07 20:20:04 -07:00
Łukasz Magiera
9127bc2841 deals: Some lint fixes 2019-08-07 20:01:51 -07:00
Łukasz Magiera
c79cb7bf31 deals: Almost sealing client data 2019-08-07 20:01:51 -07:00
whyrusleeping
5c32725510 sector commitments make it all the way to the chain 2019-08-07 16:22:35 -07:00
whyrusleeping
b7c6333fef implement sector commitments and proof verification 2019-08-06 23:35:57 -07:00
whyrusleeping
a8b434a708 fix the most annoying bug ever 2019-07-31 10:43:57 -07:00
whyrusleeping
2576853426 begin work on storage miner processes 2019-07-29 14:01:31 -07:00
whyrusleeping
f1432826d5 start integrating sector builder 2019-07-29 12:08:05 -07:00
whyrusleeping
03f653b88e expose head change notifications through api 2019-07-28 12:19:33 -07:00
whyrusleeping
4058885df9 switch over to new sector builder library 2019-07-26 15:29:18 -07:00
Jakub Sztandera
81b5f46062 Implement RPC tracing
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2019-07-26 08:50:21 +02:00
Łukasz Magiera
5559827ae6 mod tidy 2019-07-26 03:58:28 +02:00
Łukasz Magiera
a565598b25 Merge remote-tracking branch 'origin/master' into feat/pond 2019-07-26 03:58:13 +02:00
Łukasz Magiera
fcd9892efd mod tidy 2019-07-26 03:56:58 +02:00
whyrusleeping
501b2e4640 update to and use fixed cbor rpc code 2019-07-25 17:49:27 -07:00
whyrusleeping
e09ad3d65c Refactor out more types into types package, and pull genesis block code into gen package 2019-07-25 16:35:47 -07:00
Whyrusleeping
663cdbe167
Merge pull request #74 from filecoin-project/feat/payment-channels
implement initial payment channel actor
2019-07-25 13:49:52 -07:00
Łukasz Magiera
515fbd41c2 Use go-car for genesis file 2019-07-25 13:46:48 +02:00
whyrusleeping
859471aeaf implement initial payment channel actor 2019-07-24 15:45:12 -07:00
Łukasz Magiera
16d5f144c4 mod tidy 2019-07-24 00:46:40 +02:00
Łukasz Magiera
265302f4aa Implement API-level auth 2019-07-24 00:36:19 +02:00
whyrusleeping
5fb59c06bd add a getblock command 2019-07-22 17:54:27 -07:00
Whyrusleeping
19979a5ab7
Merge pull request #48 from filecoin-project/feat/create-miner
create miner command, stubbed out methods
2019-07-22 12:13:11 -07:00
Whyrusleeping
e920192e04
Merge pull request #64 from filecoin-project/feat/go-bls-sigs
Switch to go-bls-sigs
2019-07-22 11:10:40 -07:00
whyrusleeping
cfbb193079 go mod tidy 2019-07-22 10:21:27 -07:00
whyrusleeping
9a7823ab84 WIP: create miner command, stubbed out methods 2019-07-20 16:37:37 -07:00
Jakub Sztandera
0f8a89adfd Update xerrors to fix build with Go 1.13
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2019-07-19 15:57:41 +02:00
Jakub Sztandera
d745fa1af1 Switch to go-bls-sigs
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2019-07-19 13:56:58 +02:00
Jakub Sztandera
5ee7ba8420 Fix tests
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2019-07-18 17:52:48 +02:00
Jakub Sztandera
710f87fdf4 Integrate keystore with chain/wallet
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2019-07-18 17:41:30 +02:00
Jakub Sztandera
902ea18686 Add keystore to the repo
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2019-07-18 16:01:39 +02:00
whyrusleeping
e7110ff68d handle copy over state tree and identity multihashes
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2019-07-16 18:44:46 +02:00
Whyrusleeping
35905cb3fe
Merge pull request #31 from filecoin-project/feat/wsrpc
JsonRPC over WebSockets
2019-07-16 09:36:32 -07:00
Łukasz Magiera
0fa47c6dfa Lint fixes 2019-07-16 18:07:08 +02:00
Łukasz Magiera
041598dbb6 Use extracted go-filestore 2019-07-15 17:08:18 +02:00
Łukasz Magiera
97c61d4ce5 Client import 2019-07-15 16:17:34 +02:00
Łukasz Magiera
0eb208e1d3 WS JsonRPC client 2019-07-12 17:29:41 +02:00
Łukasz Magiera
e639670195 cli: use repo api endpoint 2019-07-10 19:28:49 +02:00
Łukasz Magiera
1f8c3f4145 repo: update Datastore, Init 2019-07-10 19:09:57 +02:00
Jakub Sztandera
898454ca9a Introduce fsrepo
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2019-07-10 15:42:18 +02:00
Jakub Sztandera
53952e566b go mod tidy
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2019-07-09 20:14:03 +02:00
Jakub Sztandera
195cf4f84d Implement memrepo
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2019-07-09 19:50:48 +02:00
Łukasz Magiera
82890165de Fix gomod dep 2019-07-09 12:49:11 +02:00
Łukasz Magiera
cdca2ff2c7 Some net commands / apis 2019-07-08 21:07:16 +02:00
Jakub Sztandera
35f0699929 Hopefully now fix circle
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2019-07-08 16:41:29 +02:00
Łukasz Magiera
e162b5395c Construct enough to run hello 2019-07-08 15:36:53 +02:00
Łukasz Magiera
b3239d9b23 Drop old libp2p imports 2019-07-08 14:51:45 +02:00
Łukasz Magiera
f06d874a8a Fix build 2019-07-08 13:00:52 +02:00
Łukasz Magiera
67902da2eb Merge remote-tracking branch 'origin/master' into feat/f2-chain 2019-07-08 12:47:19 +02:00
Jakub Sztandera
200d8058b8 Cleanup after subtree go-filecoin/crypto
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2019-07-08 12:31:00 +02:00
Łukasz Magiera
83a09ce9f3 Fix some gomod stuff 2019-07-08 12:19:51 +02:00
Łukasz Magiera
2987d04efa chain: Fix most build errors 2019-07-05 16:47:03 +02:00
Łukasz Magiera
277b117d9f gofmt, mod tidy 2019-07-05 16:36:08 +02:00