Rob Mulholand
|
56ce8bdb41
|
(VDB-950) Write raw diffs before transforming
- Raw field we can reference by FK for related data
- Enables replay for unwatched or mistransformed diffs
|
2019-12-03 14:51:17 -06:00 |
|
Ian Norden
|
1178940047
|
Merge pull request #107 from vulcanize/add-indexes
Add indexes to columns used in plugin joins
|
2019-12-03 00:08:42 -06:00 |
|
Rob Mulholand
|
6f837f5e88
|
Add indexes to columns used in plugin joins
- Will probably want to update these depending on what's commonly used
in join/where statements.
|
2019-12-02 23:54:52 -06:00 |
|
Ian Norden
|
a005e0d04a
|
Merge pull request #133 from vulcanize/vdb-750-add-descriptive-logging
Vdb 750 add descriptive logging
|
2019-12-02 23:48:55 -06:00 |
|
Ian Norden
|
74a90fd124
|
use Debugf instead of strconv
|
2019-12-02 23:37:01 -06:00 |
|
yaoandrew
|
5a1f599a4d
|
Clean up files after rebase
|
2019-12-02 23:36:00 -06:00 |
|
yaoandrew
|
614ea3bba1
|
Adds logging for storage and RPC
|
2019-12-02 23:10:32 -06:00 |
|
yaoandrew
|
0b9f29c300
|
Removes import alias for logrus
|
2019-12-02 23:08:48 -06:00 |
|
Andrew J Yao
|
e26fa12af0
|
Adds logging for transformer start, log conversions, log persistance
|
2019-12-02 22:59:32 -06:00 |
|
Ian Norden
|
bf26198458
|
Merge pull request #159 from vulcanize/super_node_backfill
Super node
|
2019-12-02 14:57:48 -06:00 |
|
Ian Norden
|
4036d9d6a0
|
review fixes
|
2019-12-02 13:49:27 -06:00 |
|
Ian Norden
|
5be205ffa6
|
super node backfill breaks batch call into smaller bins; retrieve gap
test
|
2019-12-02 13:24:58 -06:00 |
|
Ian Norden
|
c16ac026db
|
logWithCommand; rebase fixes; config for testing super node subscription
|
2019-12-02 13:24:58 -06:00 |
|
Ian Norden
|
e912fa6c87
|
new db schema
|
2019-12-02 13:24:58 -06:00 |
|
Ian Norden
|
67df8dea77
|
header_cids.final => header_cids.uncle
|
2019-12-02 13:24:58 -06:00 |
|
Ian Norden
|
6880611436
|
command for serving data without an ongoing sync process
|
2019-12-02 13:24:58 -06:00 |
|
Ian Norden
|
3a666df294
|
backfiller refactoring; explicity errs; golint
|
2019-12-02 13:24:58 -06:00 |
|
Ian Norden
|
40c3aff597
|
seed => super; port 80 => port 8080; backfill process for the super_node
|
2019-12-02 13:24:58 -06:00 |
|
Ian Norden
|
83fd76bc8a
|
fix flaky test
|
2019-12-02 13:24:58 -06:00 |
|
Ian Norden
|
b789ab69e6
|
adjustments after rebase
|
2019-12-02 13:24:58 -06:00 |
|
Ian Norden
|
8fe273fb7b
|
getter rpc method for the seed node's geth info
|
2019-12-02 13:24:58 -06:00 |
|
Ian Norden
|
2c997921cb
|
update dockerfile and documentation
|
2019-12-02 13:24:58 -06:00 |
|
Ian Norden
|
8b31d12716
|
fixes after rebase
|
2019-12-02 13:24:58 -06:00 |
|
Ian Norden
|
d2db5d0ac9
|
filterer unit test; that should be the last of them
|
2019-12-02 13:24:58 -06:00 |
|
Ian Norden
|
03dbe5dd22
|
resolver unit test
|
2019-12-02 13:24:58 -06:00 |
|
Ian Norden
|
825b0762cd
|
retriever unit test
|
2019-12-02 13:24:58 -06:00 |
|
Ian Norden
|
9ebc785d98
|
unit test for repository/indexer
|
2019-12-02 13:24:58 -06:00 |
|
Ian Norden
|
35c8f3561a
|
publisher unit test
|
2019-12-02 13:24:58 -06:00 |
|
Ian Norden
|
d79cc90cb2
|
unit test for ipfs fetcher
|
2019-12-02 13:24:58 -06:00 |
|
Ian Norden
|
069646905e
|
converter unit test
|
2019-12-02 13:24:58 -06:00 |
|
Ian Norden
|
89faa85871
|
fix transaction signing, also removes need for rpc call to do it
|
2019-12-02 13:24:58 -06:00 |
|
Ian Norden
|
e72995605d
|
possible fix for travis error
|
2019-12-02 13:24:58 -06:00 |
|
Ian Norden
|
90d685a763
|
switch from dep to go modules
|
2019-12-02 13:24:58 -06:00 |
|
Ian Norden
|
0bbb7a30d1
|
review fixes
|
2019-12-02 13:24:58 -06:00 |
|
Ian Norden
|
2244d1869f
|
process receipts from payload instead of retreiving over additional rpc call
|
2019-12-02 13:24:58 -06:00 |
|
Ian Norden
|
13d09e15c1
|
update deps
|
2019-12-02 13:24:58 -06:00 |
|
Ian Norden
|
905585b212
|
backfill concurrently, one block at a time, while normal streaming continues
|
2019-12-02 13:24:58 -06:00 |
|
Ian Norden
|
f2efbb5d01
|
worker pool for handling concurrent ipld putting and cid indexing without overloading Postgres connections
|
2019-12-02 13:24:58 -06:00 |
|
Ian Norden
|
3fa33fb767
|
index receipts by the contract address
|
2019-12-02 13:24:58 -06:00 |
|
Ian Norden
|
23a21c14f3
|
make subscription config rlp encodable, group subs of the
same type using a hash of their config, process only once for each sub
type instead of for every sub.
|
2019-12-02 13:24:58 -06:00 |
|
Ian Norden
|
1d4d0cbc15
|
fixing dep bug
|
2019-12-02 13:24:58 -06:00 |
|
Ian Norden
|
b76bdc51f2
|
fixing dockerfile and start up script
|
2019-12-02 13:24:54 -06:00 |
|
Ian Norden
|
1235ec1f97
|
postgres table to hold ipfs data in same database as vulcanizedb data;
shared SeedNodeTransformer interface
|
2019-12-02 13:24:54 -06:00 |
|
Ian Norden
|
230e782e6c
|
update to work with go-ipfs fork that doesn't use go modules and so can play nice with our forked dependencies; update documentation and dockerfile
|
2019-12-02 13:24:54 -06:00 |
|
Ian Norden
|
5356cd50bb
|
seed node documentation
|
2019-12-02 13:24:51 -06:00 |
|
Ian Norden
|
4c81ca4d54
|
rename blocks table to eth_blocks so that we don't clash with the ipfs blocks table; dockerfile and startup_script for the seed node
|
2019-12-02 13:24:51 -06:00 |
|
Ian Norden
|
e7cdd6247e
|
update to use ReceiptForStorage; expose rpc server over ws
|
2019-12-02 13:24:51 -06:00 |
|
Ian Norden
|
723c7c6244
|
fix backfill operations and dependency issue; hopefully travis will work now
|
2019-12-02 13:24:51 -06:00 |
|
Ian Norden
|
4baea2923c
|
make db fks deferrable so that we can commit entire cid payload in single transaction; adjust buffer sizes to optimize performane and stability
|
2019-12-02 13:24:51 -06:00 |
|
Ian Norden
|
b1bb646ad5
|
goimports + streamSubscribe command for raw access to the seed node data
|
2019-12-02 13:24:51 -06:00 |
|