Commit Graph

173 Commits

Author SHA1 Message Date
Mike Greenberg
c3cc2eea46 feat(chainwatch): Add miner index on top_miners_by_base_reward view 2020-07-16 11:36:52 -04:00
Mike Greenberg
7bfcff2c18 fix(chainwatch): Backoff processor when no work exists to process 2020-07-16 11:36:52 -04:00
Mike Greenberg
f2f797f088 fix(log): Move metrics and stage updates to debug; Add --log-level switch 2020-07-16 11:36:52 -04:00
Mike Greenberg
033cfa8f47 fix(chainwatch): Correct index name on state_height view 2020-07-16 11:36:52 -04:00
Mike Greenberg
0cfddae711 feat(chainwatch): Capture base_block_reward per epoch; Top miner by reward view 2020-07-16 11:36:52 -04:00
frrist
b4c9ba0a8b refactor: remove unused code 2020-07-15 11:43:04 -07:00
frrist
9a53bf8f83 refactor: wire up new processor and syncer 2020-07-15 11:42:19 -07:00
frrist
41f4f1fd83 refactor: implement processor and syncer
- When chainwatch is ran it will first start a Syncer that continuously collects blocks from the
ChainNotify channel and persists them to the blocks_synced table. Once the Syncer has caught the
blocks_synced table up to the lotus daemons current head a Processor is started. The Processor
selects a batch of contiguous blocks and extracts and stores their data. It attempts to do as much
work as it can in parallel. When the blocks are done being processed their corresponding
processed_at and is_processed fields in the blocks_synced table are filled out.
2020-07-15 11:42:19 -07:00
frrist
c9cb39d5a0 polish: update deal proposal table if slashed 2020-07-12 11:39:58 -07:00
frrist
f9d8b051f4 polish: track tipset height for processing 2020-07-10 15:01:55 -07:00
frrist
1e2e62bad6 polish: track unpadded piece size in deal prop 2020-07-10 15:01:55 -07:00
frrist
e13a251cc8 feat: add deal state and proposal tracking to cw 2020-07-10 15:01:55 -07:00
Mike Greenberg
ebd0e93a99 chainwatch: app exit with non-zero on error 2020-07-10 11:58:41 -04:00
Mike Greenberg
3332290626 fix: Logic bug; Schema column update stateroot -> state_root 2020-07-10 11:54:11 -04:00
Mike Greenberg
1081679360 feat(chainwatch): Capture miner_power data 2020-07-08 18:56:55 -04:00
Mike Greenberg
b9effac437 feat(chainwatch): Capture baseline power in chain_power 2020-07-08 18:40:09 -04:00
frrist
e1c29ca469 polish: wire up miner state predicate 2020-07-06 14:36:21 -07:00
Łukasz Magiera
abdafc8ee4
Merge pull request #2140 from filecoin-project/chainwatch/sector-info-schema
feat: define miner sector schema
2020-07-01 11:02:57 +02:00
frrist
e576c7a08e "feat": add logic to update miner sector table on term 2020-06-30 21:26:46 -07:00
frrist
8c54c09ab7 pair: work from pair with placer 2020-06-30 13:22:58 -07:00
Frrist
c16ea42fad
fix: update miner_head table with new miner fields (#2142) 2020-06-30 10:26:41 -07:00
frrist
6fe39ef065 fixup! feat: define miner sector schema 2020-06-25 17:03:28 -07:00
frrist
47c3e14d4b fixup! feat: define miner sector schema 2020-06-25 17:00:22 -07:00
frrist
d8b647cc3a fixup! feat: define miner sector schema 2020-06-25 16:07:43 -07:00
frrist
2c0a4914cf feat: define miner sector schema
- define a miner sector schema to store miner sector details at each tipset the miner experiences a
state change. This solution stores redundant data since a miner state change (head cid changes)
does not necessarily indicate its sectors changes.

- makes progress towards sentinel/issues/10
2020-06-25 13:16:50 -07:00
Aayush Rajasekaran
e3c897fb68 Change StateReadState to take an address, not an actor 2020-06-25 13:49:15 -04:00
frrist
a98c4038f4 fix: use tipset corresponding to stateroot
- Use te tipsetkey corresponding to the stateroot when fetching actor
data from the lotus api.
2020-06-24 11:01:25 -07:00
Łukasz Magiera
358b36bc66 chainwatch: state_heights_uindex is not unique 2020-06-24 14:34:53 +02:00
Łukasz Magiera
3b13397165 gofmt 2020-06-06 00:59:01 +02:00
Jakub Sztandera
29dbc26dbd
Update cli
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-04 01:01:41 +02:00
Jakub Sztandera
5605aae269
Fix even more lint warnings
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-02 16:29:39 +02:00
Łukasz Magiera
64f4e80446 Include build type in version 2020-06-01 20:49:39 +02:00
Łukasz Magiera
785eeb1eee
Merge pull request #1850 from filecoin-project/chore/lint
Cleanup many lint warnings
2020-05-29 18:06:06 +02:00
Jeromy
e2a554c2e6 update specs actors to version with batch porep verification 2020-05-28 13:19:18 -07:00
Jakub Sztandera
d6615b6286
Cleanup many lint warnings
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-05-27 22:53:20 +02:00
Łukasz Magiera
c4d01c04a4 chainwatch: don't crash with nil ticket 2020-05-15 19:06:52 +02:00
Łukasz Magiera
0522af155d chainwatch: Record drand entries 2020-04-25 00:25:33 +02:00
Travis Person
4e1dddab67 chainwatch: fix sql syntax error 2020-04-22 22:57:17 +00:00
Łukasz Magiera
fe6d666150 Get all tests to pass 2020-04-18 01:14:39 +02:00
Jeromy
c5c18659a4 address some review 2020-04-08 17:24:10 -07:00
Jakub Sztandera
f4f649acf4 Fix chainwatch
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-04-08 21:17:44 +02:00
whyrusleeping
ddf1beac6c change gas limit to be a normal int64 2020-03-18 13:45:37 -07:00
Łukasz Magiera
24956a49f4 gofmt 2020-03-09 22:47:58 +01:00
Łukasz Magiera
946fff39a6 chainwatch: Fix message index creation 2020-03-09 19:18:30 +01:00
Łukasz Magiera
5902daf3b5 chainwatch: Add to/from message indexes 2020-03-09 09:34:04 +01:00
Łukasz Magiera
c10142816e Merge pull request #1363 from filecoin-project/feat/cwatch-update
Update chainwatch
2020-03-09 07:16:40 +01:00
Łukasz Magiera
a46296d340 Update chainwatch 2020-03-09 06:43:32 +01:00
whyrusleeping
24bf720a9a Merge branch 'master' into testnet/3 2020-03-07 16:46:12 -08:00
Travis Person
9b98ef5de4 chainwatch: add stateroot index on miner_heads 2020-03-04 04:50:53 +00:00
whyrusleeping
194093469a fix subtool builds 2020-02-28 18:05:19 -08:00
whyrusleeping
767392332e WIP: update sectorbuilder 2020-02-26 14:54:34 -08:00
Łukasz Magiera
cb09e48e8c Some test fixes 2020-02-26 10:05:22 +01:00
Łukasz Magiera
0a9e0acc6f types: Drop some redundant alias types 2020-02-25 22:09:22 +01:00
Łukasz Magiera
d787aa5007 Merge branch 'testnet/3' into feat/specs-actors 2020-02-24 18:32:02 +01:00
Łukasz Magiera
def0e0a7a1 Merge remote-tracking branch 'origin/master' into testnet/3 2020-02-24 17:30:46 +01:00
Travis Person
837dd0d241 chainsync: make batch size configurable 2020-02-21 18:49:49 +00:00
Travis Person
ec50048a29 chainsync: add http debug 2020-02-21 18:49:21 +00:00
Travis Person
54315ce50f chainsync: move address map into batch cycle 2020-02-21 18:48:52 +00:00
Travis Person
28ec00500b chainwatch: reduce memory usage during large chain gaps 2020-02-20 03:06:41 +00:00
Łukasz Magiera
69ec3c205a Merge remote-tracking branch 'origin/master' into testnet/3 2020-02-19 22:10:14 +01:00
Aayush Rajasekaran
60970008c8 Re: #1250: API methods should receive TipSetKeys, not TipSets, as input 2020-02-17 19:53:43 -05:00
Łukasz Magiera
c0ed0dda8e specs-actors: Fis some test compilation errors 2020-02-10 20:16:36 +01:00
whyrusleeping
faf05cafcf squash forks and use correct amt library everywhere 2020-02-04 18:26:42 -08:00
Łukasz Magiera
5af64c53b6 initial sectorbuilder FS refactor integration 2020-01-29 00:08:02 +01:00
Jakub Sztandera
cf86bc6e23
fix insert
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-27 13:10:13 -08:00
Jakub Sztandera
af61dfd8cd
Fix order
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-27 13:09:00 -08:00
Jakub Sztandera
2a2a18a163
Add candidate
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-27 13:07:32 -08:00
Jakub Sztandera
29f3d6aa28
fix typo
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-27 13:03:09 -08:00
Jakub Sztandera
4379ff60f6
Create them table
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-27 13:01:24 -08:00
Jakub Sztandera
a55a37c17b
Pass the error
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-27 13:00:13 -08:00
Jakub Sztandera
5532093d58
Commit only once
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-27 12:59:07 -08:00
Jakub Sztandera
752be27815
Add all challenges to chainwatch
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-27 12:16:08 -08:00
Łukasz Magiera
4654d9c192 chainwatch: Util routines / views 2020-01-22 16:12:47 +01:00
Łukasz Magiera
52718e514c chainwatch: Track deal activations 2020-01-22 03:22:12 +01:00
Łukasz Magiera
a46a9bb42e chainwatch: Store deals 2020-01-20 01:49:52 +01:00
Łukasz Magiera
62d661f898 chainwatch: Store json states 2020-01-19 22:48:19 +01:00
whyrusleeping
f9ea6969c3 Catch cases where new old miners with bad code were getting made 2020-01-17 21:20:56 -08:00
Łukasz Magiera
14128819de Correctly handle multi parent blocks 2020-01-14 06:17:31 +01:00
Łukasz Magiera
11ac026b62 Merge branch 'feat/testnet2' into feat/chainwatch-pg 2020-01-14 04:20:39 +01:00
Łukasz Magiera
d78a5e0a9f Decimal types for some miner columns 2020-01-13 14:01:11 +01:00
Łukasz Magiera
719171faa3 Set smaller batch size 2020-01-13 00:46:54 +01:00
Jakub Sztandera
1ed62628a7
Update go-log to v2
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-08 20:22:31 +01:00
Łukasz Magiera
79028397ad chainwatch: sync in batches 2020-01-08 17:29:46 +01:00
Łukasz Magiera
1b5e1c4753 gofmt 2020-01-08 15:18:30 +01:00
Łukasz Magiera
ab922ed1ba Merge remote-tracking branch 'origin/master' into feat/chainwatch-pg 2020-01-08 15:08:34 +01:00
hannahhoward
8418464d91 refactor(address): use extracted address library
Switch to using extracted address library
2020-01-07 14:53:27 +01:00
Łukasz Magiera
81233b894d Implement 'chain get' for easier ipld digging 2019-12-19 17:58:02 +01:00
Łukasz Magiera
9f886a7eb0 chainwatch: show null blocks 2019-12-18 18:40:05 +01:00
Łukasz Magiera
d6f543ce87 gofmt 2019-12-16 13:00:43 +01:00
Łukasz Magiera
97cf3f70a5 chainwatch: sub to mpool/blocks afetr initial sync 2019-12-13 15:47:51 +01:00
Łukasz Magiera
2e9655a4e0 More fixes 2019-12-13 14:42:01 +01:00
Łukasz Magiera
3d666b3992 Merge branch 'feat/chainwatch-stuff' into feat/chainwatch-pg 2019-12-13 12:57:59 +01:00
Łukasz Magiera
a246be587e chainwatch: fix ui queries 2019-12-13 12:48:42 +01:00
Łukasz Magiera
f2ea12571f Optimise mpool update processing 2019-12-13 12:04:24 +01:00
Łukasz Magiera
1018999096 WIP fixing queries 2019-12-13 10:30:51 +01:00
Łukasz Magiera
04691a13da chainwatch: Fix postgres data import 2019-12-12 19:34:28 +01:00
Łukasz Magiera
e34e5b27ba Merge branch 'master' into feat/chainwatch-pg 2019-12-12 17:57:35 +01:00
Łukasz Magiera
cf9edae000
Merge pull request #878 from filecoin-project/feat/cw-sset-counts
chainwatch: Collect sector set sizes
2019-12-12 17:32:12 +01:00
Łukasz Magiera
7556d44b15 More data in chainwatch 2019-12-12 14:53:38 +01:00
Łukasz Magiera
fc6073d13b chainwatch: Collect sector set sizes 2019-12-12 00:32:09 +01:00