Commit Graph
647 Commits
Author SHA1 Message Date
Ian Norden 48fb5bcd27 separate super node instances for different chains need to be within the same process to avoid contention over ipfs repo lock 2020-02-20 16:14:17 -06:00
Ian Norden ef3b043f97 emulate btc data streamer over http; misc fixes 2020-02-20 16:14:17 -06:00
Ian Norden 5173edf563 fix broken go-ipld-eth trie node dag putters 2020-02-20 16:14:17 -06:00
Ian Norden ca273a026d major refactor part 2: remove cold import, full sync, generalize node table 2020-02-20 16:14:17 -06:00
Ian Norden 0f765df12c finish constructors 2020-02-20 16:14:17 -06:00
Ian Norden 5d46e02509 tx inputs directly reference tx ouputs 2020-02-20 16:14:17 -06:00
Ian Norden 642e08a04b btc converter, publisher, and indexer unit tests 2020-02-20 16:14:17 -06:00
Ian Norden 8643a7f3b6 btc ipld fetcher, paylaod fetcher, and ipld resolver 2020-02-20 16:14:17 -06:00
Ian Norden aa2f8bd0a5 btc retriever and filterer 2020-02-20 16:14:17 -06:00
Ian Norden f33cc3f34b TxOutputs: extract and index pkscript metadata (script type, addresses, #required sigs); TxInputs: outpoint_hash => outpoint_tx_id that references transaction_cids.id 2020-02-20 16:14:17 -06:00
Ian Norden 48f70d4ddf btc mocks; reorg 2020-02-20 16:14:17 -06:00
Ian Norden 808f1b5662 btc cid indexer 2020-02-20 16:14:17 -06:00
Ian Norden 5094b975fc postgres schema and tables for btc 2020-02-20 16:14:17 -06:00
Ian Norden 9018e551ba move eth tables under eth schema 2020-02-20 16:14:17 -06:00
Ian Norden 4dde90447e wrap generic top-level interfaces with loose types 2020-02-20 16:14:17 -06:00
Ian Norden 68d8e68144 btc ipld publisher 2020-02-20 16:14:17 -06:00
Ian Norden 8099f726c3 internalized ipld types and dag_putters; adjust converters/publishers to work with them 2020-02-20 16:14:17 -06:00
Ian Norden 2e81f8d31a btc payload converter 2020-02-20 16:14:17 -06:00
Ian Norden 076903b174 btc payload streamer 2020-02-20 16:14:17 -06:00
Ian Norden da844b0b83 reorg pkg/ to prepare to support chains other than ethereumm 2020-02-20 16:14:16 -06:00
Ian Norden 33ac5978f5 split uncles into their own table; add tx index to the tx index (lol); continue work on geth api endpoints 2020-01-27 14:14:03 -06:00
Ian Norden e52284b9ba update documentation, bug/error fixes, work on eth api for drawbridge 2020-01-24 15:37:52 -06:00
Ian Norden 7843312815 major refactoring of super_node to make it easier to support other chains 2020-01-24 15:37:52 -06:00
Ian Norden 5ff05225c2 begin eth api recapitulation 2020-01-24 15:37:52 -06:00
Ian Norden 0785507a7d support for total difficulty (needed to support some eth endpoints) 2020-01-24 15:37:52 -06:00
Ian Norden 358575335b expand retriever, fetcher, and resolver interfaces in prep for eth api mimick 2020-01-24 15:37:52 -06:00
Rob Mulholand 56ce8bdb41 (VDB-950) Write raw diffs before transforming
- Raw field we can reference by FK for related data
- Enables replay for unwatched or mistransformed diffs
2019-12-03 14:51:17 -06:00
Ian Norden 74a90fd124 use Debugf instead of strconv 2019-12-02 23:37:01 -06:00
yaoandrew 5a1f599a4d Clean up files after rebase 2019-12-02 23:36:00 -06:00
yaoandrew 614ea3bba1 Adds logging for storage and RPC 2019-12-02 23:10:32 -06:00
yaoandrew 0b9f29c300 Removes import alias for logrus 2019-12-02 23:08:48 -06:00
Ian Norden 4036d9d6a0 review fixes 2019-12-02 13:49:27 -06:00
Ian Norden 5be205ffa6 super node backfill breaks batch call into smaller bins; retrieve gap
test
2019-12-02 13:24:58 -06:00
Ian Norden c16ac026db logWithCommand; rebase fixes; config for testing super node subscription 2019-12-02 13:24:58 -06:00
Ian Norden 67df8dea77 header_cids.final => header_cids.uncle 2019-12-02 13:24:58 -06:00
Ian Norden 3a666df294 backfiller refactoring; explicity errs; golint 2019-12-02 13:24:58 -06:00
Ian Norden 40c3aff597 seed => super; port 80 => port 8080; backfill process for the super_node 2019-12-02 13:24:58 -06:00
Ian Norden 83fd76bc8a fix flaky test 2019-12-02 13:24:58 -06:00
Ian Norden b789ab69e6 adjustments after rebase 2019-12-02 13:24:58 -06:00
Ian Norden 8fe273fb7b getter rpc method for the seed node's geth info 2019-12-02 13:24:58 -06:00
Ian Norden 2c997921cb update dockerfile and documentation 2019-12-02 13:24:58 -06:00
Ian Norden 8b31d12716 fixes after rebase 2019-12-02 13:24:58 -06:00
Ian Norden d2db5d0ac9 filterer unit test; that should be the last of them 2019-12-02 13:24:58 -06:00
Ian Norden 03dbe5dd22 resolver unit test 2019-12-02 13:24:58 -06:00
Ian Norden 825b0762cd retriever unit test 2019-12-02 13:24:58 -06:00
Ian Norden 9ebc785d98 unit test for repository/indexer 2019-12-02 13:24:58 -06:00
Ian Norden 35c8f3561a publisher unit test 2019-12-02 13:24:58 -06:00
Ian Norden d79cc90cb2 unit test for ipfs fetcher 2019-12-02 13:24:58 -06:00
Ian Norden 069646905e converter unit test 2019-12-02 13:24:58 -06:00
Ian Norden 89faa85871 fix transaction signing, also removes need for rpc call to do it 2019-12-02 13:24:58 -06:00