58 Commits

Author	SHA1	Message	Date
Ian Norden	3320df264f	avoid decode error on storage branch nodes when element won't decode into byte array	2020-05-12 09:32:33 -05:00
Ian Norden	ef77688145	additional logging at initialization	2020-04-28 22:08:46 -05:00
Ian Norden	35e625695e	updates to documentation for super node	2020-04-19 18:28:36 -05:00
Ian Norden	716cc3663f	don't throw error on duplicate key insert	2020-03-25 19:16:26 -05:00
Ian Norden	f81c440418	for some reason every now and then a branch node would throw a panic here; still need to figure out why; quick fix	2020-03-22 09:05:26 -05:00
Ian Norden	d47ba24373	adjust btc and eth publishers and publisher tests	2020-03-17 13:05:19 -05:00
Ian Norden	1e2b09045a	fix state and storage iplds/dag_putters; add support for eth rct trie and eth and btc tx tries	2020-03-17 11:18:20 -05:00
Ian Norden	e3e8700d34	api test; return full ipld models to subscribers	2020-02-23 17:15:26 -06:00
Ian Norden	fb360d8562	changes to super node to improve compatibility with watcher	2020-02-23 17:15:26 -06:00
Ian Norden	f0c5ff8077	begin wasm watcher engine	2020-02-23 17:15:26 -06:00
Ian Norden	5173edf563	fix broken go-ipld-eth trie node dag putters	2020-02-20 16:14:17 -06:00
Ian Norden	48f70d4ddf	btc mocks; reorg	2020-02-20 16:14:17 -06:00
Ian Norden	68d8e68144	btc ipld publisher	2020-02-20 16:14:17 -06:00
Ian Norden	8099f726c3	internalized ipld types and dag_putters; adjust converters/publishers to work with them	2020-02-20 16:14:17 -06:00
Ian Norden	e52284b9ba	update documentation, bug/error fixes, work on eth api for drawbridge	2020-01-24 15:37:52 -06:00
Ian Norden	7843312815	major refactoring of super_node to make it easier to support other chains	2020-01-24 15:37:52 -06:00
Ian Norden	0785507a7d	support for total difficulty (needed to support some eth endpoints)	2020-01-24 15:37:52 -06:00
Ian Norden	358575335b	expand retriever, fetcher, and resolver interfaces in prep for eth api mimick	2020-01-24 15:37:52 -06:00
Ian Norden	67df8dea77	header_cids.final => header_cids.uncle	2019-12-02 13:24:58 -06:00
Ian Norden	3a666df294	backfiller refactoring; explicity errs; golint	2019-12-02 13:24:58 -06:00
Ian Norden	40c3aff597	seed => super; port 80 => port 8080; backfill process for the super_node	2019-12-02 13:24:58 -06:00
Ian Norden	83fd76bc8a	fix flaky test	2019-12-02 13:24:58 -06:00
Ian Norden	8b31d12716	fixes after rebase	2019-12-02 13:24:58 -06:00
Ian Norden	d2db5d0ac9	filterer unit test; that should be the last of them	2019-12-02 13:24:58 -06:00
Ian Norden	03dbe5dd22	resolver unit test	2019-12-02 13:24:58 -06:00
Ian Norden	825b0762cd	retriever unit test	2019-12-02 13:24:58 -06:00
Ian Norden	35c8f3561a	publisher unit test	2019-12-02 13:24:58 -06:00
Ian Norden	d79cc90cb2	unit test for ipfs fetcher	2019-12-02 13:24:58 -06:00
Ian Norden	069646905e	converter unit test	2019-12-02 13:24:58 -06:00
Ian Norden	89faa85871	fix transaction signing, also removes need for rpc call to do it	2019-12-02 13:24:58 -06:00
Ian Norden	0bbb7a30d1	review fixes	2019-12-02 13:24:58 -06:00
Ian Norden	2244d1869f	process receipts from payload instead of retreiving over additional rpc call	2019-12-02 13:24:58 -06:00
Ian Norden	13d09e15c1	update deps	2019-12-02 13:24:58 -06:00
Ian Norden	905585b212	backfill concurrently, one block at a time, while normal streaming continues	2019-12-02 13:24:58 -06:00
Ian Norden	f2efbb5d01	worker pool for handling concurrent ipld putting and cid indexing without overloading Postgres connections	2019-12-02 13:24:58 -06:00
Ian Norden	3fa33fb767	index receipts by the contract address	2019-12-02 13:24:58 -06:00
Ian Norden	23a21c14f3	make subscription config rlp encodable, group subs of the ... same type using a hash of their config, process only once for each sub type instead of for every sub.	2019-12-02 13:24:58 -06:00
Ian Norden	5356cd50bb	seed node documentation	2019-12-02 13:24:51 -06:00
Ian Norden	4c81ca4d54	rename blocks table to eth_blocks so that we don't clash with the ipfs blocks table; dockerfile and startup_script for the seed node	2019-12-02 13:24:51 -06:00
Ian Norden	e7cdd6247e	update to use ReceiptForStorage; expose rpc server over ws	2019-12-02 13:24:51 -06:00
Ian Norden	723c7c6244	fix backfill operations and dependency issue; hopefully travis will work now	2019-12-02 13:24:51 -06:00
Ian Norden	4baea2923c	make db fks deferrable so that we can commit entire cid payload in single transaction; adjust buffer sizes to optimize performane and stability	2019-12-02 13:24:51 -06:00
Ian Norden	b1bb646ad5	goimports + streamSubscribe command for raw access to the seed node data	2019-12-02 13:24:51 -06:00
Ian Norden	8ccdfd4835	fix streamFilters issue	2019-12-02 13:24:51 -06:00
Ian Norden	1dc46640cf	request handler and response screener for seed node api service	2019-12-02 13:24:51 -06:00
Ian Norden	34393ffb3f	fixes for issues uncovered in integration	2019-12-02 13:24:51 -06:00
Ian Norden	b83c0371d9	pub sub service and api	2019-12-02 13:24:50 -06:00
Ian Norden	5ebe2243d8	goimports -w	2019-12-02 13:24:50 -06:00
Ian Norden	671a324294	update to work with updated state diffing code	2019-12-02 13:24:50 -06:00
Ian Norden	3108957e5f	ipfs fetcher	2019-12-02 13:24:50 -06:00