61 Commits
Author SHA1 Message Date
prathamesh0andnabarun ac00ee280f Upgrade geth (#51)
* Fix Makefile for installing mockgen tool

* Upgrade geth

* Add sleep in the failing recovery test

Co-authored-by: nabarun <nabarun@deepstacksoft.com>
2022-07-13 11:39:36 +05:30
prathamesh0andnabarun b241bf05eb Add command to take an in-place snapshot (#42)
* Add command to take an in-place snapshot

* Add test data for in place snapshot unit test

* Implement unit test for inplace snapshot

* Add check for storage IPLD

* Run unit tests sequentially

* Add github workflow for unit test

* Add missing checks for state and storage cid fields

* Add more storage nodes to test

* Update ipld-eth-db version for tests

* Add comments for inplace snapshot test data

* Add in-place snapshot cmd in readme

* Implement defer pattern for db transaction

* Log transaction commit or rollback error

Co-authored-by: nabarun <nabarun@deepstacksoft.com>
2022-06-15 12:51:26 +05:30
nabarun baef795834 Merge changes to fix iterator and update 2022-06-10 14:12:34 +05:30
roysc 8371344756 clean up logging 2022-06-08 20:12:22 +08:00
roysc ef391d8d31 simplify tracker, prevent send to closed chan 2022-06-08 20:12:22 +08:00
roysc 8572c36ee7 decrement path from restored iterator
to cover node gaps
2022-06-08 20:12:22 +08:00
roysc 3e24972a89 try to fix hanging iterator 2022-06-08 20:05:38 +08:00
Ashwin Phatak 7129044eae Log progress info 2022-06-08 18:32:10 +08:00
prathamesh dc27487b66 Merge changes to add env bindings and prometheus metrics 2022-05-23 17:11:51 +05:30
prathamesh0 cce45bda57 Add prometheus metrics collection (#33)
* Upgrade geth

* Add prometheus metrics collection

* Update README
2022-05-23 16:56:48 +05:30
i-norden 004f3e6665 constants for CLI binding strings 2022-05-17 22:33:20 -05:00
prathamesh0 0a1ea3ae4a Fix insert statements and upgrade dependencies (#31) 2022-05-17 19:19:52 +05:30
prathamesh fc9e82f717 Index block number using string in file mode 2022-05-13 14:00:40 +05:30
prathamesh 44d48b8644 Change ON CONFLICT clauses to do nothing and upgrade geth 2022-05-13 09:28:36 +05:30
prathamesh 26ae3ab008 Updates to use v4 schema 2022-04-19 18:14:25 +05:30
i-norden 31105a009c add env bindings 2022-04-04 14:35:18 -05:00
i-norden 060eb5cf67 add some logs and guards, update module name, update readme 2022-03-30 18:57:30 -05:00
i-norden de39842049 fix minor bug 2022-03-30 14:09:32 -05:00
roysc 8d1e79d22e handle sigterm 2022-03-16 18:48:51 +08:00
roysc b732ffc5f2 fix race condition 2022-03-14 23:34:26 +08:00
roysc 2481d0a28d recovery - handle signals 2022-03-14 23:34:26 +08:00
roysc 02488e2b79 logging tweaks 2022-03-14 23:32:00 +08:00
roysc 7a2ef4f542 fix fixtures 2022-03-14 23:32:00 +08:00
roysc b5d0010581 implement job recovery; fix traversal & iterator 2022-03-03 17:12:29 +08:00
roysc e0df3399e1 clanup 2022-02-17 14:35:20 +08:00
roysc 1a65d9e022 string, not ptr, as map index 2022-02-17 14:34:54 +08:00
roysc ef4ae3a0d4 revisions 2022-02-16 19:27:02 +08:00
roysc 3fda647ee9 clean up 2022-02-16 11:13:51 +08:00
roysc 73cc0f191b clean up - can rm type here 2022-02-15 18:41:31 +08:00
roysc c4b4f232e9 create csv file publisher; update geth and schema 2022-02-14 07:22:31 +08:00
roysc b91c5d2d69 Fix config initialization 2022-01-27 12:40:14 +08:00
roysc 4f53299e9a clean up [need storage node] 2022-01-16 17:55:35 -06:00
roysc 159f93902e tests - mock publisher with fixtures
* go structs for header, etc.
* refactor: pkg/types

* add fixture chaindata
2022-01-14 21:43:00 -06:00
roysc 2bb06e0a8d split ethdb out of service 2022-01-10 23:37:27 -06:00
roysc 1fab8ac1c8 rf config, mock publisher 2022-01-10 19:08:45 -06:00
roysc 802a5908df set up test 2022-01-10 18:59:15 -06:00
roysc 1f21a65478 fixes 2022-01-10 18:06:29 -06:00
roysc 317b277939 Merge branch 'master' into async-traversal 2022-01-10 17:47:27 -06:00
roysc f7b44173f8 get it to compile 2022-01-07 21:32:45 -06:00
i-norden e50bd160fe log final counts when process completes 2021-12-28 23:47:33 -06:00
i-norden 9d9fe231f7 storageNodeCounter; log the total runtime 2021-12-28 23:27:49 -06:00
Arijit Das c5dfa98ffe Refactor. 2021-12-23 20:04:34 +05:30
Arijit Das 50edaff3ce Improve logging. 2021-12-23 19:56:24 +05:30
Arijit Das 112cdc9670 Address comments. 2021-12-15 12:53:18 +05:30
Arijit Das e4de336833 Fix linting errors. 2021-12-14 12:59:34 +05:30
Arijit Das 20d6b1dc64 Small changes. 2021-12-13 20:42:02 +05:30
Arijit Das ba8e32ce97 Update geth and implement transaction batching. 2021-12-13 20:31:32 +05:30
roysc cd3d9f27cf cleanup 2020-09-07 21:02:30 -05:00
roysc 66d6acc1fe update iterator 2020-09-06 02:36:36 -05:00
roysc 169887f39f number of workers instead of divide depth
update w/ iterator change
2020-08-31 11:09:56 -05:00