 Ian Norden
|
bf26198458
|
Merge pull request #159 from vulcanize/super_node_backfill
Super node
|
2019-12-02 14:57:48 -06:00 |
|
|
Ian Norden
|
4036d9d6a0
|
review fixes
|
2019-12-02 13:49:27 -06:00 |
|
|
Ian Norden
|
5be205ffa6
|
super node backfill breaks batch call into smaller bins; retrieve gap
test
|
2019-12-02 13:24:58 -06:00 |
|
|
Ian Norden
|
c16ac026db
|
logWithCommand; rebase fixes; config for testing super node subscription
|
2019-12-02 13:24:58 -06:00 |
|
|
Ian Norden
|
e912fa6c87
|
new db schema
|
2019-12-02 13:24:58 -06:00 |
|
|
Ian Norden
|
67df8dea77
|
header_cids.final => header_cids.uncle
|
2019-12-02 13:24:58 -06:00 |
|
|
Ian Norden
|
6880611436
|
command for serving data without an ongoing sync process
|
2019-12-02 13:24:58 -06:00 |
|
|
Ian Norden
|
3a666df294
|
backfiller refactoring; explicity errs; golint
|
2019-12-02 13:24:58 -06:00 |
|
|
Ian Norden
|
40c3aff597
|
seed => super; port 80 => port 8080; backfill process for the super_node
|
2019-12-02 13:24:58 -06:00 |
|
|
Ian Norden
|
83fd76bc8a
|
fix flaky test
|
2019-12-02 13:24:58 -06:00 |
|
|
Ian Norden
|
b789ab69e6
|
adjustments after rebase
|
2019-12-02 13:24:58 -06:00 |
|
|
Ian Norden
|
8fe273fb7b
|
getter rpc method for the seed node's geth info
|
2019-12-02 13:24:58 -06:00 |
|
|
Ian Norden
|
2c997921cb
|
update dockerfile and documentation
|
2019-12-02 13:24:58 -06:00 |
|
|
Ian Norden
|
8b31d12716
|
fixes after rebase
|
2019-12-02 13:24:58 -06:00 |
|
|
Ian Norden
|
d2db5d0ac9
|
filterer unit test; that should be the last of them
|
2019-12-02 13:24:58 -06:00 |
|
|
Ian Norden
|
03dbe5dd22
|
resolver unit test
|
2019-12-02 13:24:58 -06:00 |
|
|
Ian Norden
|
825b0762cd
|
retriever unit test
|
2019-12-02 13:24:58 -06:00 |
|
|
Ian Norden
|
9ebc785d98
|
unit test for repository/indexer
|
2019-12-02 13:24:58 -06:00 |
|
|
Ian Norden
|
35c8f3561a
|
publisher unit test
|
2019-12-02 13:24:58 -06:00 |
|
|
Ian Norden
|
d79cc90cb2
|
unit test for ipfs fetcher
|
2019-12-02 13:24:58 -06:00 |
|
|
Ian Norden
|
069646905e
|
converter unit test
|
2019-12-02 13:24:58 -06:00 |
|
|
Ian Norden
|
89faa85871
|
fix transaction signing, also removes need for rpc call to do it
|
2019-12-02 13:24:58 -06:00 |
|
|
Ian Norden
|
e72995605d
|
possible fix for travis error
|
2019-12-02 13:24:58 -06:00 |
|
|
Ian Norden
|
90d685a763
|
switch from dep to go modules
|
2019-12-02 13:24:58 -06:00 |
|
|
Ian Norden
|
0bbb7a30d1
|
review fixes
|
2019-12-02 13:24:58 -06:00 |
|
|
Ian Norden
|
2244d1869f
|
process receipts from payload instead of retreiving over additional rpc call
|
2019-12-02 13:24:58 -06:00 |
|
|
Ian Norden
|
13d09e15c1
|
update deps
|
2019-12-02 13:24:58 -06:00 |
|
|
Ian Norden
|
905585b212
|
backfill concurrently, one block at a time, while normal streaming continues
|
2019-12-02 13:24:58 -06:00 |
|
|
Ian Norden
|
f2efbb5d01
|
worker pool for handling concurrent ipld putting and cid indexing without overloading Postgres connections
|
2019-12-02 13:24:58 -06:00 |
|
|
Ian Norden
|
3fa33fb767
|
index receipts by the contract address
|
2019-12-02 13:24:58 -06:00 |
|
|
Ian Norden
|
23a21c14f3
|
make subscription config rlp encodable, group subs of the
same type using a hash of their config, process only once for each sub
type instead of for every sub.
|
2019-12-02 13:24:58 -06:00 |
|
|
Ian Norden
|
1d4d0cbc15
|
fixing dep bug
|
2019-12-02 13:24:58 -06:00 |
|
|
Ian Norden
|
b76bdc51f2
|
fixing dockerfile and start up script
|
2019-12-02 13:24:54 -06:00 |
|
|
Ian Norden
|
1235ec1f97
|
postgres table to hold ipfs data in same database as vulcanizedb data;
shared SeedNodeTransformer interface
|
2019-12-02 13:24:54 -06:00 |
|
|
Ian Norden
|
230e782e6c
|
update to work with go-ipfs fork that doesn't use go modules and so can play nice with our forked dependencies; update documentation and dockerfile
|
2019-12-02 13:24:54 -06:00 |
|
|
Ian Norden
|
5356cd50bb
|
seed node documentation
|
2019-12-02 13:24:51 -06:00 |
|
|
Ian Norden
|
4c81ca4d54
|
rename blocks table to eth_blocks so that we don't clash with the ipfs blocks table; dockerfile and startup_script for the seed node
|
2019-12-02 13:24:51 -06:00 |
|
|
Ian Norden
|
e7cdd6247e
|
update to use ReceiptForStorage; expose rpc server over ws
|
2019-12-02 13:24:51 -06:00 |
|
|
Ian Norden
|
723c7c6244
|
fix backfill operations and dependency issue; hopefully travis will work now
|
2019-12-02 13:24:51 -06:00 |
|
|
Ian Norden
|
4baea2923c
|
make db fks deferrable so that we can commit entire cid payload in single transaction; adjust buffer sizes to optimize performane and stability
|
2019-12-02 13:24:51 -06:00 |
|
|
Ian Norden
|
b1bb646ad5
|
goimports + streamSubscribe command for raw access to the seed node data
|
2019-12-02 13:24:51 -06:00 |
|
|
Ian Norden
|
8ccdfd4835
|
fix streamFilters issue
|
2019-12-02 13:24:51 -06:00 |
|
|
Ian Norden
|
b5099a5051
|
demo commands
|
2019-12-02 13:24:51 -06:00 |
|
|
Ian Norden
|
2db0ce971d
|
vulcanizedb seed node streamer and syncPublishScreenAndServe command
|
2019-12-02 13:24:51 -06:00 |
|
|
Ian Norden
|
1dc46640cf
|
request handler and response screener for seed node api service
|
2019-12-02 13:24:51 -06:00 |
|
|
Ian Norden
|
34393ffb3f
|
fixes for issues uncovered in integration
|
2019-12-02 13:24:51 -06:00 |
|
|
Ian Norden
|
b83c0371d9
|
pub sub service and api
|
2019-12-02 13:24:50 -06:00 |
|
|
Ian Norden
|
5ebe2243d8
|
goimports -w
|
2019-12-02 13:24:50 -06:00 |
|
|
Ian Norden
|
671a324294
|
update to work with updated state diffing code
|
2019-12-02 13:24:50 -06:00 |
|
|
Ian Norden
|
3108957e5f
|
ipfs fetcher
|
2019-12-02 13:24:50 -06:00 |
|