Ian Norden
0101c4791a
pair with new statediffing geth version; travis tests will fail til release is up
2020-05-21 15:34:43 -05:00
Ian Norden
e5c5422edc
adhjustments to work with statediffing geth v1.10-alpha.2
2020-03-11 13:41:59 -05:00
Ian Norden
da844b0b83
reorg pkg/ to prepare to support chains other than ethereumm
2020-02-20 16:14:16 -06:00
Rob Mulholand
56ce8bdb41
(VDB-950) Write raw diffs before transforming
...
- Raw field we can reference by FK for related data
- Enables replay for unwatched or mistransformed diffs
2019-12-03 14:51:17 -06:00
yaoandrew
0b9f29c300
Removes import alias for logrus
2019-12-02 23:08:48 -06:00
Ian Norden
db0f024088
review fixes
2019-12-02 11:26:44 -06:00
Ian Norden
a834e55b9f
command edits; external pkg for finding min deployment block; gofmt
2019-12-02 11:22:18 -06:00
Ian Norden
8562abd180
split backfill range up into smaller bins and process them concurrently; improve tests; review fixes
2019-12-02 11:20:49 -06:00
Ian Norden
37f4a2d603
integrate backfill into storage watcher; documentation for storage backfill
2019-12-02 11:06:28 -06:00
Ian Norden
b454b61777
factor our state diff fetcher for more general use (e.g. by the super node)
2019-12-02 11:03:37 -06:00
Ian Norden
a59bd06a37
goimports -w; comments; refactor test
2019-12-02 11:03:36 -06:00
Ian Norden
2a98a30ee9
storage backfiller
2019-12-02 11:03:36 -06:00
Rob Mulholand
e1236b4072
Prefer all caps for initialisms and acronyms
2019-10-31 13:42:19 -05:00
Elizabeth Engelman
9c6182c356
Rename StorageDiff field from KeccakOfContractAddress to HashedAddress
2019-09-25 16:36:44 -05:00
Elizabeth Engelman
6672ecf547
Add trace debugging after parsing statediff
2019-09-25 16:36:44 -05:00
Elizabeth Engelman
f315988507
Factor out a bad storage diff for testing
2019-09-25 16:36:44 -05:00
Elizabeth Engelman
6869330bd3
Decode storage value RLP after fetching from statediffs
2019-09-25 16:36:44 -05:00
Elizabeth Engelman
e1de3afdfc
Small changes to helper method names/arg names
2019-09-25 16:36:08 -05:00
Rob Mulholand
d06dddbfaa
Always hash storage diff contract addresses
...
- Enables syncing Geth and Parity diffs with same transformer lookup
- Maybe worth always hashing the storage key so we don't need a hashed
and not-hashed version in the key lookups?
2019-09-25 16:36:08 -05:00
Elizabeth Engelman
66d695d93b
Update keccak of address to be a common.Hash instead of a common.Address
2019-09-25 16:34:31 -05:00
Elizabeth Engelman
639c561fdf
Remove unncessary pointer receiver from NewGethRpcStorageFetcher.FetchStorageDiffs
2019-09-25 16:32:31 -05:00
Elizabeth Engelman
9226e53e0b
Panic if connecting to geth subscription fails
2019-09-25 16:32:31 -05:00
Elizabeth Engelman
045d78be25
Rename StorageDiffRow -> StorageDiff
2019-09-25 16:32:31 -05:00
Elizabeth Engelman
87252f42b9
Add additional logging
2019-09-25 16:32:31 -05:00
Elizabeth Engelman
7cd66b8775
Use a for loop for getting diffs off the payload channel
2019-09-25 16:32:30 -05:00
Elizabeth Engelman
ee244ac6f5
Apply go fmt
2019-09-25 16:32:27 -05:00
Elizabeth Engelman
dc06991605
Wire up the streamer with a fetcher
2019-09-25 16:32:27 -05:00
Elizabeth Engelman
1b4a901892
Rename storage_fetcher -> csv_tail_storage_fetcher
2019-09-25 16:32:27 -05:00
Rob Mulholand
d496dad33c
Decouple log extraction from transformer delegation
...
- limit missing headers results set to 100 so that extraction doesn't
excessively block delegation
- wrap checked headers functions in repository struct
- move storage repository to factory, to correspond with event
repository path
- remove unused files
- reformat sql
- remove line breaks in imports
2019-08-28 09:25:13 -05:00
Andrew J Yao
11a65c525c
Adds ability to set log level from toml or CLI args
2019-06-27 11:14:11 -07:00
Rob Mulholand
76ab914bdc
Add license
2019-05-01 12:32:39 -05:00
Rob Mulholand
d77f3fe012
Don't pass empty row to channel on error
2019-05-01 12:30:37 -05:00
Rob Mulholand
6a86de87b4
(VDB-371) Recheck queued storage
...
- Iterate through queued storage at defined interval, popping rows
from the queue if successfully persisted
2019-05-01 12:30:37 -05:00
Rob Mulholand
2d684c5aec
Extract storage diff fetching behind an interface
...
- Replaces directly reading from a CSV
- Simplifies testing
- Should hopefully make it easier to plug in other sources for storage
diffs (e.g. differently formatted CSVs, JSON RPC, etc)
2019-05-01 12:30:36 -05:00
Ian Norden
9f8c50e3ab
tests for migration path ordering and errors
2019-03-13 11:42:30 -05:00
Ian Norden
708425c4d6
rebase; extract factories and the mocks they are dependent on to
...
libraries/shared; adjust omni test_helpers to drop and recreate
checked_headers table to avoid reaching 1600 column limit after repeated
tests (dropping columns doesn't actually remove them from contributing
to that limit)
2019-02-25 01:34:38 -06:00
Ian Norden
decc2a3caf
remove pkg/transformers; extract shared files needed to
...
libraries/shared; work on automated db migration management
2019-02-24 21:38:47 -06:00