Ian Norden
308ccb5d8c
refactor super node commands into one
2020-01-24 15:37:52 -06:00
Ian Norden
7843312815
major refactoring of super_node to make it easier to support other chains
2020-01-24 15:37:52 -06:00
yaoandrew
5a1f599a4d
Clean up files after rebase
2019-12-02 23:36:00 -06:00
Andrew J Yao
e26fa12af0
Adds logging for transformer start, log conversions, log persistance
2019-12-02 22:59:32 -06:00
Ian Norden
4036d9d6a0
review fixes
2019-12-02 13:49:27 -06:00
Ian Norden
5be205ffa6
super node backfill breaks batch call into smaller bins; retrieve gap
...
test
2019-12-02 13:24:58 -06:00
Ian Norden
c16ac026db
logWithCommand; rebase fixes; config for testing super node subscription
2019-12-02 13:24:58 -06:00
Ian Norden
67df8dea77
header_cids.final => header_cids.uncle
2019-12-02 13:24:58 -06:00
Ian Norden
6880611436
command for serving data without an ongoing sync process
2019-12-02 13:24:58 -06:00
Ian Norden
3a666df294
backfiller refactoring; explicity errs; golint
2019-12-02 13:24:58 -06:00
Ian Norden
40c3aff597
seed => super; port 80 => port 8080; backfill process for the super_node
2019-12-02 13:24:58 -06:00
Ian Norden
b789ab69e6
adjustments after rebase
2019-12-02 13:24:58 -06:00
Ian Norden
8fe273fb7b
getter rpc method for the seed node's geth info
2019-12-02 13:24:58 -06:00
Ian Norden
8b31d12716
fixes after rebase
2019-12-02 13:24:58 -06:00
Ian Norden
35c8f3561a
publisher unit test
2019-12-02 13:24:58 -06:00
Ian Norden
0bbb7a30d1
review fixes
2019-12-02 13:24:58 -06:00
Ian Norden
f2efbb5d01
worker pool for handling concurrent ipld putting and cid indexing without overloading Postgres connections
2019-12-02 13:24:58 -06:00
Ian Norden
3fa33fb767
index receipts by the contract address
2019-12-02 13:24:58 -06:00
Ian Norden
23a21c14f3
make subscription config rlp encodable, group subs of the
...
same type using a hash of their config, process only once for each sub
type instead of for every sub.
2019-12-02 13:24:58 -06:00
Ian Norden
b76bdc51f2
fixing dockerfile and start up script
2019-12-02 13:24:54 -06:00
Ian Norden
5356cd50bb
seed node documentation
2019-12-02 13:24:51 -06:00
Ian Norden
e7cdd6247e
update to use ReceiptForStorage; expose rpc server over ws
2019-12-02 13:24:51 -06:00
Ian Norden
723c7c6244
fix backfill operations and dependency issue; hopefully travis will work now
2019-12-02 13:24:51 -06:00
Ian Norden
4baea2923c
make db fks deferrable so that we can commit entire cid payload in single transaction; adjust buffer sizes to optimize performane and stability
2019-12-02 13:24:51 -06:00
Ian Norden
b1bb646ad5
goimports + streamSubscribe command for raw access to the seed node data
2019-12-02 13:24:51 -06:00
Ian Norden
8ccdfd4835
fix streamFilters issue
2019-12-02 13:24:51 -06:00
Ian Norden
b5099a5051
demo commands
2019-12-02 13:24:51 -06:00
Ian Norden
2db0ce971d
vulcanizedb seed node streamer and syncPublishScreenAndServe command
2019-12-02 13:24:51 -06:00
Ian Norden
34393ffb3f
fixes for issues uncovered in integration
2019-12-02 13:24:51 -06:00
Ian Norden
5ebe2243d8
goimports -w
2019-12-02 13:24:50 -06:00
Ian Norden
15e044403d
work on mocks and unit tests
2019-12-02 13:24:50 -06:00
Ian Norden
d702cb720c
update dependencies to work with update eth-block-extractor
2019-12-02 13:24:49 -06:00
Ian Norden
31a9017c4f
index all cids in a payload in a single atomic tx; misc fixes; comment additions
2019-12-02 13:24:46 -06:00
Ian Norden
79efaeb089
syncAndPublish command
2019-12-02 13:24:46 -06:00
Ian Norden
6434a7279d
integrate backfill into storage watcher; documentation for storage backfill
2019-12-02 13:24:45 -06:00
Ian Norden
db0f024088
review fixes
2019-12-02 11:26:44 -06:00
Ian Norden
a834e55b9f
command edits; external pkg for finding min deployment block; gofmt
2019-12-02 11:22:18 -06:00
Ian Norden
37f4a2d603
integrate backfill into storage watcher; documentation for storage backfill
2019-12-02 11:06:28 -06:00
Ian Norden
a59bd06a37
goimports -w; comments; refactor test
2019-12-02 11:03:36 -06:00
Rob Mulholand
e1236b4072
Prefer all caps for initialisms and acronyms
2019-10-31 13:42:19 -05:00
Edvard Hübinette
3fff2896aa
Rename geth to eth, signifying client independence ( #161 )
2019-10-28 12:30:24 +01:00
Elizabeth Engelman
f0d2741dea
Allow storageDiff source to be set through an env variable
2019-10-01 10:24:53 -05:00
Rob Mulholand
d06dddbfaa
Always hash storage diff contract addresses
...
- Enables syncing Geth and Parity diffs with same transformer lookup
- Maybe worth always hashing the storage key so we don't need a hashed
and not-hashed version in the key lookups?
2019-09-25 16:36:08 -05:00
Elizabeth Engelman
639c561fdf
Remove unncessary pointer receiver from NewGethRpcStorageFetcher.FetchStorageDiffs
2019-09-25 16:32:31 -05:00
Elizabeth Engelman
0cc90a1f80
Factor out an IStorageWatcher interface
2019-09-25 16:32:31 -05:00
Elizabeth Engelman
b09b8a8735
Use geth state diff source in execute command
2019-09-25 16:32:27 -05:00
Elizabeth Engelman
a577811e0a
Use geth state diff source in composeAndExecute
2019-09-25 16:32:27 -05:00
20ce0ab852
Revert "option to write the plugin .go file and run the plugin migrations without building the .so file so that it can be done from the shell instead to afford complete error messages"
...
This reverts commit 9bb2f27a69
2019-09-24 23:54:25 +00:00
Ian Norden
9bb2f27a69
option to write the plugin .go file and run the plugin migrations without building the .so file so that it can be done from the shell instead to afford complete error messages
2019-09-24 18:44:04 -05:00
Rob Mulholand
4fa19be90a
Return error when no logs/headers available
...
- Replaces bool and moots question of error/bool ordering
- Also make event watcher execution synchronous
2019-09-18 20:55:15 -05:00
