Commit Graph
1262 Commits
Author SHA1 Message Date
Ian Norden 48fb5bcd27 separate super node instances for different chains need to be within the same process to avoid contention over ipfs repo lock 2020-02-20 16:14:17 -06:00
Ian Norden ef3b043f97 emulate btc data streamer over http; misc fixes 2020-02-20 16:14:17 -06:00
Ian Norden 5173edf563 fix broken go-ipld-eth trie node dag putters 2020-02-20 16:14:17 -06:00
Ian Norden ca273a026d major refactor part 2: remove cold import, full sync, generalize node table 2020-02-20 16:14:17 -06:00
Ian Norden 0f765df12c finish constructors 2020-02-20 16:14:17 -06:00
Ian Norden 5d46e02509 tx inputs directly reference tx ouputs 2020-02-20 16:14:17 -06:00
Ian Norden 642e08a04b btc converter, publisher, and indexer unit tests 2020-02-20 16:14:17 -06:00
Ian Norden 8643a7f3b6 btc ipld fetcher, paylaod fetcher, and ipld resolver 2020-02-20 16:14:17 -06:00
Ian Norden aa2f8bd0a5 btc retriever and filterer 2020-02-20 16:14:17 -06:00
Ian Norden f33cc3f34b TxOutputs: extract and index pkscript metadata (script type, addresses, #required sigs); TxInputs: outpoint_hash => outpoint_tx_id that references transaction_cids.id 2020-02-20 16:14:17 -06:00
Ian Norden 48f70d4ddf btc mocks; reorg 2020-02-20 16:14:17 -06:00
Ian Norden 808f1b5662 btc cid indexer 2020-02-20 16:14:17 -06:00
Ian Norden 5094b975fc postgres schema and tables for btc 2020-02-20 16:14:17 -06:00
Ian Norden 9018e551ba move eth tables under eth schema 2020-02-20 16:14:17 -06:00
Ian Norden 4dde90447e wrap generic top-level interfaces with loose types 2020-02-20 16:14:17 -06:00
Ian Norden cacd9953ee go mod tidy; remove now unused deps 2020-02-20 16:14:17 -06:00
Ian Norden 68d8e68144 btc ipld publisher 2020-02-20 16:14:17 -06:00
Ian Norden 8099f726c3 internalized ipld types and dag_putters; adjust converters/publishers to work with them 2020-02-20 16:14:17 -06:00
Ian Norden 2e81f8d31a btc payload converter 2020-02-20 16:14:17 -06:00
Ian Norden 076903b174 btc payload streamer 2020-02-20 16:14:17 -06:00
Ian Norden da844b0b83 reorg pkg/ to prepare to support chains other than ethereumm 2020-02-20 16:14:16 -06:00
Ian Norden 1412f5a7f5 Merge pull request #178 from vulcanize/geth_api
Geth api
2020-02-20 16:08:28 -06:00
Ian Norden 5dec3d145d updating SuperNode dockerfile 2020-01-29 12:26:04 -06:00
Ian Norden 33ac5978f5 split uncles into their own table; add tx index to the tx index (lol); continue work on geth api endpoints 2020-01-27 14:14:03 -06:00
Ian Norden e52284b9ba update documentation, bug/error fixes, work on eth api for drawbridge 2020-01-24 15:37:52 -06:00
Ian Norden ac66759665 use updated statediffing geth release (that includes TD) 2020-01-24 15:37:52 -06:00
Ian Norden 308ccb5d8c refactor super node commands into one 2020-01-24 15:37:52 -06:00
Ian Norden 7843312815 major refactoring of super_node to make it easier to support other chains 2020-01-24 15:37:52 -06:00
Ian Norden 5ff05225c2 begin eth api recapitulation 2020-01-24 15:37:52 -06:00
Ian Norden 0785507a7d support for total difficulty (needed to support some eth endpoints) 2020-01-24 15:37:52 -06:00
Ian Norden 358575335b expand retriever, fetcher, and resolver interfaces in prep for eth api mimick 2020-01-24 15:37:52 -06:00
Ian Norden 1b37e66d9d travis ssh (#175) 2020-01-23 13:38:51 -06:00
A. F. Dudley 9e082e8a6a Merge pull request #167 from vulcanize/seed_removal
seed removal
2019-12-03 21:34:07 -05:00
A. F. Dudley df09709ec5 seed removal 2019-12-03 21:31:53 -05:00
Ian Norden aa395278bf Merge pull request #166 from vulcanize/vdb-950-raw-diffs
(VDB-950) Write raw diffs before transforming
2019-12-03 15:09:34 -06:00
Ian Norden 7ef132c400 new db schema 2019-12-03 14:55:53 -06:00
Rob Mulholand 56ce8bdb41 (VDB-950) Write raw diffs before transforming
- Raw field we can reference by FK for related data
- Enables replay for unwatched or mistransformed diffs
2019-12-03 14:51:17 -06:00
Ian Norden 1178940047 Merge pull request #107 from vulcanize/add-indexes
Add indexes to columns used in plugin joins
2019-12-03 00:08:42 -06:00
Rob Mulholand 6f837f5e88 Add indexes to columns used in plugin joins
- Will probably want to update these depending on what's commonly used
  in join/where statements.
2019-12-02 23:54:52 -06:00
Ian Norden a005e0d04a Merge pull request #133 from vulcanize/vdb-750-add-descriptive-logging
Vdb 750 add descriptive logging
2019-12-02 23:48:55 -06:00
Ian Norden 74a90fd124 use Debugf instead of strconv 2019-12-02 23:37:01 -06:00
yaoandrew 5a1f599a4d Clean up files after rebase 2019-12-02 23:36:00 -06:00
yaoandrew 614ea3bba1 Adds logging for storage and RPC 2019-12-02 23:10:32 -06:00
yaoandrew 0b9f29c300 Removes import alias for logrus 2019-12-02 23:08:48 -06:00
Andrew J Yao e26fa12af0 Adds logging for transformer start, log conversions, log persistance 2019-12-02 22:59:32 -06:00
Ian Norden bf26198458 Merge pull request #159 from vulcanize/super_node_backfill
Super node
2019-12-02 14:57:48 -06:00
Ian Norden 4036d9d6a0 review fixes 2019-12-02 13:49:27 -06:00
Ian Norden 5be205ffa6 super node backfill breaks batch call into smaller bins; retrieve gap
test
2019-12-02 13:24:58 -06:00
Ian Norden c16ac026db logWithCommand; rebase fixes; config for testing super node subscription 2019-12-02 13:24:58 -06:00
Ian Norden e912fa6c87 new db schema 2019-12-02 13:24:58 -06:00