cerc-io/lotus
16
0
Fork 0
Code Issues Pull Requests Packages Projects Releases 27 Wiki Activity
6,929 Commits 24 Branches 342 Tags 314 MiB
3df85ca784
Commit Graph

166 Commits

Author SHA1 Message Date
frrist
41f4f1fd83 refactor: implement processor and syncer 
- When chainwatch is ran it will first start a Syncer that continuously collects blocks from the
ChainNotify channel and persists them to the blocks_synced table. Once the Syncer has caught the
blocks_synced table up to the lotus daemons current head a Processor is started. The Processor
selects a batch of contiguous blocks and extracts and stores their data. It attempts to do as much
work as it can in parallel. When the blocks are done being processed their corresponding
processed_at and is_processed fields in the blocks_synced table are filled out.
 2020-07-15 11:42:19 -07:00
frrist
c9cb39d5a0 polish: update deal proposal table if slashed 2020-07-12 11:39:58 -07:00
frrist
f9d8b051f4 polish: track tipset height for processing 2020-07-10 15:01:55 -07:00
frrist
1e2e62bad6 polish: track unpadded piece size in deal prop 2020-07-10 15:01:55 -07:00
frrist
e13a251cc8 feat: add deal state and proposal tracking to cw 2020-07-10 15:01:55 -07:00
Mike Greenberg
ebd0e93a99 chainwatch: app exit with non-zero on error 2020-07-10 11:58:41 -04:00
Mike Greenberg
3332290626 fix: Logic bug; Schema column update stateroot -> state_root 2020-07-10 11:54:11 -04:00
Mike Greenberg
1081679360 feat(chainwatch): Capture miner_power data 2020-07-08 18:56:55 -04:00
Mike Greenberg
b9effac437 feat(chainwatch): Capture baseline power in chain_power 2020-07-08 18:40:09 -04:00
frrist
e1c29ca469 polish: wire up miner state predicate 2020-07-06 14:36:21 -07:00
Łukasz Magiera
abdafc8ee4
Merge pull request #2140 from filecoin-project/chainwatch/sector-info-schema 
feat: define miner sector schema
 2020-07-01 11:02:57 +02:00
frrist
e576c7a08e "feat": add logic to update miner sector table on term 2020-06-30 21:26:46 -07:00
frrist
8c54c09ab7 pair: work from pair with placer 2020-06-30 13:22:58 -07:00
Frrist
c16ea42fad
fix: update miner_head table with new miner fields (#2142) 2020-06-30 10:26:41 -07:00
frrist
6fe39ef065 fixup! feat: define miner sector schema 2020-06-25 17:03:28 -07:00
frrist
47c3e14d4b fixup! feat: define miner sector schema 2020-06-25 17:00:22 -07:00
frrist
d8b647cc3a fixup! feat: define miner sector schema 2020-06-25 16:07:43 -07:00
frrist
2c0a4914cf feat: define miner sector schema 
- define a miner sector schema to store miner sector details at each tipset the miner experiences a
state change. This solution stores redundant data since a miner state change (head cid changes)
does not necessarily indicate its sectors changes.

- makes progress towards sentinel/issues/10
 2020-06-25 13:16:50 -07:00
Aayush Rajasekaran
e3c897fb68 Change StateReadState to take an address, not an actor 2020-06-25 13:49:15 -04:00
frrist
a98c4038f4 fix: use tipset corresponding to stateroot 
- Use te tipsetkey corresponding to the stateroot when fetching actor
data from the lotus api.
 2020-06-24 11:01:25 -07:00
Łukasz Magiera
358b36bc66 chainwatch: state_heights_uindex is not unique 2020-06-24 14:34:53 +02:00
Łukasz Magiera
3b13397165 gofmt 2020-06-06 00:59:01 +02:00
Jakub Sztandera
29dbc26dbd
Update cli 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-06-04 01:01:41 +02:00
Jakub Sztandera
5605aae269
Fix even more lint warnings 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-06-02 16:29:39 +02:00
Łukasz Magiera
64f4e80446 Include build type in version 2020-06-01 20:49:39 +02:00
Łukasz Magiera
785eeb1eee
Merge pull request #1850 from filecoin-project/chore/lint 
Cleanup many lint warnings
 2020-05-29 18:06:06 +02:00
Jeromy
e2a554c2e6 update specs actors to version with batch porep verification 2020-05-28 13:19:18 -07:00
Jakub Sztandera
d6615b6286
Cleanup many lint warnings 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-05-27 22:53:20 +02:00
Łukasz Magiera
c4d01c04a4 chainwatch: don't crash with nil ticket 2020-05-15 19:06:52 +02:00
Łukasz Magiera
0522af155d chainwatch: Record drand entries 2020-04-25 00:25:33 +02:00
Travis Person
4e1dddab67 chainwatch: fix sql syntax error 2020-04-22 22:57:17 +00:00
Łukasz Magiera
fe6d666150 Get all tests to pass 2020-04-18 01:14:39 +02:00
Jeromy
c5c18659a4 address some review 2020-04-08 17:24:10 -07:00
Jakub Sztandera
f4f649acf4 Fix chainwatch 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-04-08 21:17:44 +02:00
whyrusleeping
ddf1beac6c change gas limit to be a normal int64 2020-03-18 13:45:37 -07:00
Łukasz Magiera
24956a49f4 gofmt 2020-03-09 22:47:58 +01:00
Łukasz Magiera
946fff39a6 chainwatch: Fix message index creation 2020-03-09 19:18:30 +01:00
Łukasz Magiera
5902daf3b5 chainwatch: Add to/from message indexes 2020-03-09 09:34:04 +01:00
Łukasz Magiera
c10142816e Merge pull request #1363 from filecoin-project/feat/cwatch-update 
Update chainwatch
 2020-03-09 07:16:40 +01:00
Łukasz Magiera
a46296d340 Update chainwatch 2020-03-09 06:43:32 +01:00
whyrusleeping
24bf720a9a Merge branch 'master' into testnet/3 2020-03-07 16:46:12 -08:00
Travis Person
9b98ef5de4 chainwatch: add stateroot index on miner_heads 2020-03-04 04:50:53 +00:00
whyrusleeping
194093469a fix subtool builds 2020-02-28 18:05:19 -08:00
whyrusleeping
767392332e WIP: update sectorbuilder 2020-02-26 14:54:34 -08:00
Łukasz Magiera
cb09e48e8c Some test fixes 2020-02-26 10:05:22 +01:00
Łukasz Magiera
0a9e0acc6f types: Drop some redundant alias types 2020-02-25 22:09:22 +01:00
Łukasz Magiera
d787aa5007 Merge branch 'testnet/3' into feat/specs-actors 2020-02-24 18:32:02 +01:00
Łukasz Magiera
def0e0a7a1 Merge remote-tracking branch 'origin/master' into testnet/3 2020-02-24 17:30:46 +01:00
Travis Person
837dd0d241 chainsync: make batch size configurable 2020-02-21 18:49:49 +00:00
Travis Person
ec50048a29 chainsync: add http debug 2020-02-21 18:49:21 +00:00
Travis Person
54315ce50f chainsync: move address map into batch cycle 2020-02-21 18:48:52 +00:00
Travis Person
28ec00500b chainwatch: reduce memory usage during large chain gaps 2020-02-20 03:06:41 +00:00
Łukasz Magiera
69ec3c205a Merge remote-tracking branch 'origin/master' into testnet/3 2020-02-19 22:10:14 +01:00
Aayush Rajasekaran
60970008c8 Re: #1250: API methods should receive TipSetKeys, not TipSets, as input 2020-02-17 19:53:43 -05:00
Łukasz Magiera
c0ed0dda8e specs-actors: Fis some test compilation errors 2020-02-10 20:16:36 +01:00
whyrusleeping
faf05cafcf squash forks and use correct amt library everywhere 2020-02-04 18:26:42 -08:00
Łukasz Magiera
5af64c53b6 initial sectorbuilder FS refactor integration 2020-01-29 00:08:02 +01:00
Jakub Sztandera
cf86bc6e23
fix insert 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-01-27 13:10:13 -08:00
Jakub Sztandera
af61dfd8cd
Fix order 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-01-27 13:09:00 -08:00
Jakub Sztandera
2a2a18a163
Add candidate 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-01-27 13:07:32 -08:00
Jakub Sztandera
29f3d6aa28
fix typo 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-01-27 13:03:09 -08:00
Jakub Sztandera
4379ff60f6
Create them table 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-01-27 13:01:24 -08:00
Jakub Sztandera
a55a37c17b
Pass the error 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-01-27 13:00:13 -08:00
Jakub Sztandera
5532093d58
Commit only once 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-01-27 12:59:07 -08:00
Jakub Sztandera
752be27815
Add all challenges to chainwatch 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-01-27 12:16:08 -08:00
Łukasz Magiera
4654d9c192 chainwatch: Util routines / views 2020-01-22 16:12:47 +01:00
Łukasz Magiera
52718e514c chainwatch: Track deal activations 2020-01-22 03:22:12 +01:00
Łukasz Magiera
a46a9bb42e chainwatch: Store deals 2020-01-20 01:49:52 +01:00
Łukasz Magiera
62d661f898 chainwatch: Store json states 2020-01-19 22:48:19 +01:00
whyrusleeping
f9ea6969c3 Catch cases where new old miners with bad code were getting made 2020-01-17 21:20:56 -08:00
Łukasz Magiera
14128819de Correctly handle multi parent blocks 2020-01-14 06:17:31 +01:00
Łukasz Magiera
11ac026b62 Merge branch 'feat/testnet2' into feat/chainwatch-pg 2020-01-14 04:20:39 +01:00
Łukasz Magiera
d78a5e0a9f Decimal types for some miner columns 2020-01-13 14:01:11 +01:00
Łukasz Magiera
719171faa3 Set smaller batch size 2020-01-13 00:46:54 +01:00
Jakub Sztandera
1ed62628a7
Update go-log to v2 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-01-08 20:22:31 +01:00
Łukasz Magiera
79028397ad chainwatch: sync in batches 2020-01-08 17:29:46 +01:00
Łukasz Magiera
1b5e1c4753 gofmt 2020-01-08 15:18:30 +01:00
Łukasz Magiera
ab922ed1ba Merge remote-tracking branch 'origin/master' into feat/chainwatch-pg 2020-01-08 15:08:34 +01:00
hannahhoward
8418464d91 refactor(address): use extracted address library 
Switch to using extracted address library
 2020-01-07 14:53:27 +01:00
Łukasz Magiera
81233b894d Implement 'chain get' for easier ipld digging 2019-12-19 17:58:02 +01:00
Łukasz Magiera
9f886a7eb0 chainwatch: show null blocks 2019-12-18 18:40:05 +01:00
Łukasz Magiera
d6f543ce87 gofmt 2019-12-16 13:00:43 +01:00
Łukasz Magiera
97cf3f70a5 chainwatch: sub to mpool/blocks afetr initial sync 2019-12-13 15:47:51 +01:00
Łukasz Magiera
2e9655a4e0 More fixes 2019-12-13 14:42:01 +01:00
Łukasz Magiera
3d666b3992 Merge branch 'feat/chainwatch-stuff' into feat/chainwatch-pg 2019-12-13 12:57:59 +01:00
Łukasz Magiera
a246be587e chainwatch: fix ui queries 2019-12-13 12:48:42 +01:00
Łukasz Magiera
f2ea12571f Optimise mpool update processing 2019-12-13 12:04:24 +01:00
Łukasz Magiera
1018999096 WIP fixing queries 2019-12-13 10:30:51 +01:00
Łukasz Magiera
04691a13da chainwatch: Fix postgres data import 2019-12-12 19:34:28 +01:00
Łukasz Magiera
e34e5b27ba Merge branch 'master' into feat/chainwatch-pg 2019-12-12 17:57:35 +01:00
Łukasz Magiera
cf9edae000
Merge pull request #878 from filecoin-project/feat/cw-sset-counts 
chainwatch: Collect sector set sizes
 2019-12-12 17:32:12 +01:00
Łukasz Magiera
7556d44b15 More data in chainwatch 2019-12-12 14:53:38 +01:00
Łukasz Magiera
fc6073d13b chainwatch: Collect sector set sizes 2019-12-12 00:32:09 +01:00
Łukasz Magiera
66ee9d209d wip 2019-12-11 23:17:44 +01:00
Jakub Sztandera
9589fc0762
Add version commit string 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-12-11 23:00:39 +01:00
Łukasz Magiera
b6b06f67dc chainwatch: Postgres 2019-12-11 00:42:36 +01:00
Łukasz Magiera
7dcee8c1e3 chainwatch: Collect incoming block tstamps 2019-12-08 16:49:13 +01:00
Łukasz Magiera
3edc93f117 wip chainwatch ui 2019-12-07 23:44:45 +01:00
Łukasz Magiera
83924e6b97
sectorbuilder: Allow to restrict task types 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-12-07 19:05:15 +01:00
wanghui
5d5bc1bd39 make chainwatch db source config 2019-12-05 19:58:19 +08:00