Commit Graph

618 Commits

Author SHA1 Message Date
frrist
41f4f1fd83 refactor: implement processor and syncer
- When chainwatch is ran it will first start a Syncer that continuously collects blocks from the
ChainNotify channel and persists them to the blocks_synced table. Once the Syncer has caught the
blocks_synced table up to the lotus daemons current head a Processor is started. The Processor
selects a batch of contiguous blocks and extracts and stores their data. It attempts to do as much
work as it can in parallel. When the blocks are done being processed their corresponding
processed_at and is_processed fields in the blocks_synced table are filled out.
2020-07-15 11:42:19 -07:00
Jakub Sztandera
0e7b7c9fdb
Update go-ds-badger2
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-07-08 21:08:23 +02:00
Jakub Sztandera
40286e4192
Use mostly defaults for badger options
This options are the defults in badger `master` now.
We should update to next badger version as soon as it is stable, it has
some nice improvments.

Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-07-08 17:54:33 +02:00
Jakub Sztandera
cc02092aae
Go mod tidy
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-07-02 21:53:21 +02:00
Jakub Sztandera
3e4b80e7f6
Update specs actors
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-07-02 21:52:55 +02:00
hannahhoward
7e1e9bcd60 fix(markets): upgrade markets to 0.3.1.1
upgrade to 0.3.1.1 to get critical node restart fixes and retrieval map access fix
2020-07-02 08:03:10 -07:00
Łukasz Magiera
02c3f8ed80 Update paramfetch 2020-07-01 17:23:50 +02:00
Łukasz Magiera
e1799f1524
Merge pull request #2155 from filecoin-project/feat/ffi-0.30.1
Update FFI to 0.30.1
2020-07-01 11:17:18 +02:00
Łukasz Magiera
6927a532cf Update sector-storage with lower resource requirements 2020-06-30 21:03:44 +02:00
Jakub Sztandera
c811133aac
Update go-log
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-30 19:39:13 +02:00
Łukasz Magiera
77b3bf8bc2 Update FFI to 0.30.1 2020-06-29 20:24:27 +02:00
hannahhoward
4e32c7edb3 feat(markets): update to markets 0.3.1
Update to markets 0.3.1 with multiaddr support for miners
2020-06-29 10:24:23 -07:00
Łukasz Magiera
90a470ed78 Update go-bitfield with fixed empty marshaling 2020-06-29 16:06:57 +02:00
Aayush Rajasekaran
50aa1e6baa Update bitfield 2020-06-25 13:49:15 -04:00
Łukasz Magiera
7e342e60d1 sealing: Give priority to sectors with deals 2020-06-25 18:13:45 +02:00
Jakub Sztandera
008a2969b2
Fix two races in events
Also race fix: depends on https://github.com/ipfs/go-blockservice/pull/65
Resolves #2092, #2099, #2108, #1930, #2110

Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-24 17:05:24 +02:00
Łukasz Magiera
11c53c26ff Update sector-storage to fix #2080 and #1917 2020-06-24 00:47:47 +02:00
Łukasz Magiera
a7d662a7d8 Update to actually working sector-storage 2020-06-24 00:23:39 +02:00
Łukasz Magiera
6f8c464393 Merge remote-tracking branch 'origin/master' into feat/sector-remove 2020-06-23 23:54:27 +02:00
Łukasz Magiera
69559bcf4f Use fsm, sector-storage master 2020-06-23 23:32:12 +02:00
Łukasz Magiera
abd400801c mod tidy 2020-06-23 11:46:20 +02:00
whyrusleeping
3752311f44 update to latest libp2p release 2020-06-22 16:25:41 -07:00
Łukasz Magiera
101ba0b796 Update deps to support removing sectors 2020-06-22 19:03:35 +02:00
Łukasz Magiera
324b659d33 Update sector-storage with 32G checkFiles fix 2020-06-18 09:34:28 +02:00
Łukasz Magiera
cc179c5270
Merge pull request #2047 from filecoin-project/feat/parallel-sealing-bench
allow sealing bench to run parallel seals
2020-06-18 01:28:56 +02:00
Łukasz Magiera
290512ee68 Update storage FSM with a bunch of fixes 2020-06-17 20:42:08 +02:00
Jakub Sztandera
5c5a3f2264
go mod tidy
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-17 20:04:28 +02:00
Jeromy
d66c70d1e6 add configurable paralellism for sub portions of the sealing process 2020-06-17 11:02:48 -07:00
Jakub Sztandera
b91e7a9860
Update to specs actors with ChargeGas interface
Based on `lotus-0.6.1-chargegas` in specs-actors.

Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-17 20:00:30 +02:00
Jeromy
ec693008d7 allow sealing bench to run parallel seals 2020-06-16 17:39:51 -07:00
Łukasz Magiera
6bff52483b
Merge pull request #1973 from filecoin-project/feat/drand-upd
Update to new drand
2020-06-16 15:30:40 +02:00
Jakub Sztandera
fd6c8769dd
Update to new drand
WIP

Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-16 14:46:30 +02:00
Łukasz Magiera
bac6a47c67 specs-actors v0.6.1 2020-06-16 12:30:54 +02:00
hannahhoward
a422647819 fix(lint): fix lint error
fix lint error and update to tagged package
2020-06-15 15:53:39 -07:00
hannahhoward
9262661135 chore(deps): update to fil-markets 0.3.0
Updates to latest fil markets with resumability and other fixes
2020-06-15 15:43:47 -07:00
Łukasz Magiera
f8669d4e95 Update chain-val and sector-storage 2020-06-15 21:21:40 +02:00
Łukasz Magiera
c832c0bf3f mod tidy 2020-06-15 18:31:59 +02:00
Łukasz Magiera
907364ce67 Update deps, fix more tests 2020-06-15 18:30:49 +02:00
Łukasz Magiera
464f6a6b08 Update specs-actors to v0.6 2020-06-15 14:49:18 +02:00
Jakub Sztandera
c3f23ddce8
Refactor ExecutionResult to ExecutionTrace
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-11 15:53:47 +02:00
Łukasz Magiera
6f501119bf
Merge pull request #1957 from filecoin-project/feat/v27
v27 parameters
2020-06-10 02:04:59 +02:00
Łukasz Magiera
a00df0da90 FFI v27 2020-06-10 01:44:14 +02:00
Jakub Sztandera
81bc8471e3
Merge pull request #1963 from filecoin-project/chore/upd-log
Update go-log to master
2020-06-09 23:27:02 +02:00
Jakub Sztandera
5feea2e0f8
Update go-log to master
It restores line informations in log messages

Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-09 23:06:40 +02:00
Łukasz Magiera
28f895cec2 Update sector-storage with better post faults 2020-06-08 23:20:19 +02:00
Łukasz Magiera
baa69c3c81 Update specs-actors to v0.5.6 2020-06-06 19:51:10 +02:00
Jakub Sztandera
94da339622
Fix protobuf panic by updating protobuf to 1.4.2
The panic is caused by usage of internal protobuf interface.
It was changed in protobuf 1.4.0 and reluctantly fixed in 1.4.2

Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-06 02:47:29 +02:00
Łukasz Magiera
163c2b2544 Merge remote-tracking branch 'origin/master' into next 2020-06-06 00:58:24 +02:00
Łukasz Magiera
9e2603c1bf
Merge pull request #1937 from laser/bugs/916-standardize-cid-base32
print "client"-command CIDs as base32-encoded strs
2020-06-06 00:53:07 +02:00
Aayush Rajasekaran
2571480bb6 Update chain-val, use tagged specs-actors 2020-06-05 18:13:30 -04:00