Commit Graph

66 Commits

Author SHA1 Message Date
i-norden
bfb0447710 use internal concurrent iterator pkg 2023-03-31 09:04:54 -05:00
Ian Norden
253b1087bf
Merge pull request #112 from cerc-io/ian_test_3
Avoid quantization problems during segmentation and use worker chan to spread work across set # of workers
2023-03-20 07:53:09 -05:00
Michael Shaw
d83b088c37 update interface for failing docker build step 2023-03-15 01:38:22 -04:00
Michael Shaw
1788b899a4 update for interface changes in 1.11.2 geth statediffing 4.3.7 2023-03-13 18:35:54 -04:00
Michael Shaw
68ebdca6f9 dependency updates for geth 1.10.26 and leveldb cerc migraiton 2022-11-08 11:19:27 -05:00
i-norden
5f7915649d avoid quantization and use worker channel to ensure expected number of workers 2022-10-12 18:39:28 -05:00
i-norden
3054063942 add method to reader interface for accessing latest header 2022-10-10 13:38:33 -05:00
a827c4a36b Merge branch 'v4' into dboreham/prerun-workers 2022-09-21 14:04:46 -06:00
a2772762e1 Make pprof configurable, remove todos 2022-09-21 13:33:15 -06:00
b1440d9673 Fix off by one error 2022-09-21 13:06:41 -06:00
Michael
bcca82eaa3
Cerc refactor (#104)
* cerc refactor waiting on unpublished dependencies

* updated go.mod for published dependencies in cerc-io refactoring
2022-09-20 14:00:10 -04:00
7f8885f044 Add comment 2022-08-31 07:54:16 -06:00
d235f3b84c Initial version of parallel workers for prerun-only mode 2022-08-30 22:31:54 -06:00
Michael Shaw
040638ca05 updates for geth 1.10.21 2022-08-03 10:03:57 -04:00
85896f91b7 Expose database stats in metrics 2022-07-19 15:00:01 +05:30
prathamesh0
1f898f60c3
Upgrade geth after schema changes (#97)
* Include intermediate nodes in builder tests for watched addresses

* Upgrade geth
2022-07-12 16:38:05 +05:30
0c56037e1f
Upgrade geth and add params for CSV file mode (#96)
* Upgrade geth and add params for CSV file mode

* Add options for file mode flag

* index intermediate nodes when watching addresses
2022-07-01 13:29:48 +05:30
prathamesh0
9aa683442e
Reuse builder from vulcanize-geth (#92)
* Reuse builder code from vulcanize-geth

* Upgrade geth dependency
2022-06-24 14:12:58 +05:30
5f6aec35b2
Support remote RPC client to access LevelDB (#83)
* Implement use of custom chain config to test locally

* Use leveldb-ethdb-rpc instead of leveldb path

* Implement flag for leveldb access mode

* Remove custom chain config json

* Move database client to leveldb-ethdb-rpc

* Update leveldb-ethdb-rpc version
2022-05-17 14:35:11 +05:30
257b16e184 Add missing tests for direct indexing mode 2022-05-13 18:28:58 +05:30
4363bf5c07 Implement use of custom chain config to test locally 2022-05-13 16:37:30 +05:30
7c19e86698 Call method for computing watchedAddressesLeafKeys 2022-05-12 15:51:46 +05:30
6ed1bc739d Update builder tests to use geth statediff test helpers 2022-05-11 18:53:39 +05:30
32724ff46c Fix rlp.EncodeToBytes arg and creating node iterators 2022-05-11 15:21:23 +05:30
9a7ecf9ef3 Add watched addresses direct indexing mode changes 2022-05-11 00:03:20 +05:30
ea4fb6222b Update geth version 2022-05-10 11:36:14 +05:30
i-norden
108a6f89f1 update to use new version of indexer; support file writing mode 2021-11-18 18:47:28 -06:00
i-norden
d9eb68b2d2 update to use refactored statediffing geth 2021-11-12 18:49:24 -06:00
i-norden
c5c230a2ea update to use new version of statediffing geth pkgs with public.blocks insert batching 2021-11-08 19:08:36 -06:00
i-norden
3d00e3ed05 enable configuration of a prerun range by env variable; prerun only mode 2021-10-27 13:36:19 -05:00
i-norden
a7ae868dd8 finish prom metrics 2021-10-25 15:40:11 -05:00
i-norden
8571f35031 fixes 2021-10-25 14:54:55 -05:00
i-norden
f679082c3b queue size metric; touchup 2021-10-25 14:27:11 -05:00
i-norden
aace7793ba unify service RPC api and commands 2021-10-25 14:27:11 -05:00
i-norden
f207284e3a fix namespace 2021-10-24 18:37:01 -05:00
i-norden
072f035a02 wire up; customize metrics 2021-10-21 13:00:30 -05:00
i-norden
0f81dc32d2 prom pkg + monitoring 2021-10-21 11:57:44 -05:00
i-norden
fb37ee9881 cli and toml bindings; fix unit tests; remove unused code 2021-10-19 16:49:04 -05:00
i-norden
01d0c21fd5 make cache configurable 2021-10-19 16:19:44 -05:00
Arijit Das
b09e58c22a Upgrade geth to v1.10.9. 2021-10-14 12:17:38 +05:30
Ian Norden
41e2ae176f update to use v1.10.1-statediff-0.0.16; including fix for missing leaf keys in 'removed node' entries 2021-03-24 17:46:20 -05:00
Ian Norden
0315a31dd2 add endpoints for fetching/writing statediff by blockhash 2021-02-27 12:39:16 -06:00
7a6b866163 docs, tweaks, fixes 2020-11-26 18:57:54 +08:00
bd5d2992fa fix import
add namespacing to avoid name conflicts
2020-11-17 09:37:36 +08:00
abff9bf045 refactors
geth Node api change

sd ctor refactor
2020-11-16 17:49:59 +08:00
ca8b3066d1 Write directly to PostgreSQL (port from geth statediff) 2020-11-15 15:18:34 +08:00
Ian Norden
b2c00f9fc7 update go-modules 2020-11-08 17:30:43 -06:00
Ian Norden
e7d69e5d65 update unit tests to test codeAndCodeHash 2020-11-08 17:25:38 -06:00
Ian Norden
121f867a35 emit codeAndCodeHash in StateObject payloads 2020-11-08 17:25:22 -06:00
03018fa58a proper fail for worker count 2020-09-15 01:03:59 -05:00