Ian Norden
1235ec1f97
postgres table to hold ipfs data in same database as vulcanizedb data;
...
shared SeedNodeTransformer interface
2019-12-02 13:24:54 -06:00
Ian Norden
b1bb646ad5
goimports + streamSubscribe command for raw access to the seed node data
2019-12-02 13:24:51 -06:00
Ian Norden
8ccdfd4835
fix streamFilters issue
2019-12-02 13:24:51 -06:00
Ian Norden
2db0ce971d
vulcanizedb seed node streamer and syncPublishScreenAndServe command
2019-12-02 13:24:51 -06:00
Ian Norden
5ebe2243d8
goimports -w
2019-12-02 13:24:50 -06:00
Ian Norden
313c5fe427
adjustments after rebase
2019-12-02 11:35:16 -06:00
Ian Norden
db0f024088
review fixes
2019-12-02 11:26:44 -06:00
Ian Norden
a834e55b9f
command edits; external pkg for finding min deployment block; gofmt
2019-12-02 11:22:18 -06:00
Ian Norden
8562abd180
split backfill range up into smaller bins and process them concurrently; improve tests; review fixes
2019-12-02 11:20:49 -06:00
Ian Norden
37f4a2d603
integrate backfill into storage watcher; documentation for storage backfill
2019-12-02 11:06:28 -06:00
Ian Norden
b454b61777
factor our state diff fetcher for more general use (e.g. by the super node)
2019-12-02 11:03:37 -06:00
Ian Norden
a59bd06a37
goimports -w; comments; refactor test
2019-12-02 11:03:36 -06:00
Ian Norden
2a98a30ee9
storage backfiller
2019-12-02 11:03:36 -06:00
Rob Mulholand
e1236b4072
Prefer all caps for initialisms and acronyms
2019-10-31 13:42:19 -05:00
Rob Mulholand
eba868ff00
Drop else when if statement includes return
2019-10-31 13:33:39 -05:00
Gabe Laughlin
2dc8ace69b
(VDB-925) Add hashed address to address table
2019-10-30 11:56:25 -05:00
Rob Mulholand
b8fec5e4e3
(VDB-929) Minimize storage key lookup bespoke code
...
- Extract shared namespace for looking up and hashing keys
- Require storage transformers only to implement a loader that
associates known keys with metadata
- Move key loader/lookup utils to utils directory to avoid
multiple "storage" packages in imports
2019-10-28 14:29:09 -05:00
Ian Norden
a2d249ca9d
review fixes
2019-10-28 11:40:32 -05:00
Edvard Hübinette
f7c4a6736d
VDB-919 Generalise converter ( #152 )
...
* Generalise transformer stack to use InsertionModel
* Add tests for event repository
* Restrict accepted values in InsertionModel
* Add call to repository.SetDB
* Improve error propagation/clarity on GetABI()
* Remove maker references in example
* Please golint
* refactor rollback error handling in repository
* Cleaner errors in repository, refactor tests
2019-10-28 11:48:31 +01:00
Elizabeth
f6ab9382b2
Address repo updates ( #134 )
...
* Factor out get or create address into one sql string
* Factor out getChecksumAddress method in address repo
* Update address repo methods to not need a receiver
* Move address repository to libraries/shared
2019-10-03 11:17:08 -05:00
Elizabeth Engelman
5c0e5592ab
Updates after rebasing
2019-09-25 16:52:42 -05:00
Elizabeth Engelman
9c6182c356
Rename StorageDiff field from KeccakOfContractAddress to HashedAddress
2019-09-25 16:36:44 -05:00
Elizabeth Engelman
6672ecf547
Add trace debugging after parsing statediff
2019-09-25 16:36:44 -05:00
Elizabeth Engelman
f315988507
Factor out a bad storage diff for testing
2019-09-25 16:36:44 -05:00
Elizabeth Engelman
6869330bd3
Decode storage value RLP after fetching from statediffs
2019-09-25 16:36:44 -05:00
Elizabeth Engelman
e1de3afdfc
Small changes to helper method names/arg names
2019-09-25 16:36:08 -05:00
Rob Mulholand
2ff88de859
Extract helper for converting hex to keccak256 hash
...
- Also prefer crypto.Keccak256Hash(x) to common.BytesToHash(crypto.Keccak256(x))
2019-09-25 16:36:08 -05:00
Rob Mulholand
d06dddbfaa
Always hash storage diff contract addresses
...
- Enables syncing Geth and Parity diffs with same transformer lookup
- Maybe worth always hashing the storage key so we don't need a hashed
and not-hashed version in the key lookups?
2019-09-25 16:36:08 -05:00
Rob Mulholand
f574407bb6
Revert "Update Mappings interface to take a diff as an argument to Lookup"
...
This reverts commit cda646b78ceb6714b132891ea4489a8ff4fc95e9.
2019-09-25 16:34:31 -05:00
Rob Mulholand
8111f4ec5e
Add function for adding hashed keys to mapping
...
- Tool to facilitate parsing diffs from Geth patch that emits hashed
versions of storage keys
2019-09-25 16:34:31 -05:00
Elizabeth Engelman
3fb8e13979
Update Mappings interface to take a diff as an argument to Lookup
2019-09-25 16:34:31 -05:00
Elizabeth Engelman
66d695d93b
Update keccak of address to be a common.Hash instead of a common.Address
2019-09-25 16:34:31 -05:00
Elizabeth Engelman
639c561fdf
Remove unncessary pointer receiver from NewGethRpcStorageFetcher.FetchStorageDiffs
2019-09-25 16:32:31 -05:00
Elizabeth Engelman
9226e53e0b
Panic if connecting to geth subscription fails
2019-09-25 16:32:31 -05:00
Elizabeth Engelman
0cc90a1f80
Factor out an IStorageWatcher interface
2019-09-25 16:32:31 -05:00
Elizabeth Engelman
18f47b7b6a
Memoizing keccak hhash of address => transformer
2019-09-25 16:32:31 -05:00
Elizabeth Engelman
045d78be25
Rename StorageDiffRow -> StorageDiff
2019-09-25 16:32:31 -05:00
Elizabeth Engelman
87252f42b9
Add additional logging
2019-09-25 16:32:31 -05:00
Elizabeth Engelman
7cd66b8775
Use a for loop for getting diffs off the payload channel
2019-09-25 16:32:30 -05:00
Elizabeth Engelman
70fcc22a00
Apply go formatting
2019-09-25 16:32:27 -05:00
Elizabeth Engelman
a577811e0a
Use geth state diff source in composeAndExecute
2019-09-25 16:32:27 -05:00
Elizabeth Engelman
8c4a4d6587
Handle different contract address format for geth vs csv
2019-09-25 16:32:27 -05:00
Elizabeth Engelman
ee244ac6f5
Apply go fmt
2019-09-25 16:32:27 -05:00
Elizabeth Engelman
dc06991605
Wire up the streamer with a fetcher
2019-09-25 16:32:27 -05:00
Elizabeth Engelman
1b4a901892
Rename storage_fetcher -> csv_tail_storage_fetcher
2019-09-25 16:32:27 -05:00
Elizabeth Engelman
9de631f3a7
Add a statediff streamer
2019-09-25 16:32:27 -05:00
Rob Mulholand
b96a1ee1c6
Put secondary processes to sleep in event watcher tests
...
- Prevent extract/delegate from spinning when other side is being
simulated
2019-09-18 22:17:02 -05:00
Rob Mulholand
4fa19be90a
Return error when no logs/headers available
...
- Replaces bool and moots question of error/bool ordering
- Also make event watcher execution synchronous
2019-09-18 20:55:15 -05:00
Rob Mulholand
3f9b034c4c
Rename checked_logs => watched_logs
...
- We're logging that a given log has been included in any fetch calls
for checked headers, rather than that we have already checked for
that log
2019-09-10 21:22:14 -05:00
Rob Mulholand
13d503b851
Distinguish between missing and unchecked headers
...
- Missing == not in DB
- Unchecked == logs haven't been fetched
2019-09-10 14:39:45 -05:00