Commit Graph

27 Commits

Author SHA1 Message Date
100c106ee5 rework iterator state stuff
Some checks failed
Test / Run unit tests (pull_request) Failing after 15m46s
Test / Run integration tests (pull_request) Successful in 30m5s
2023-09-26 18:10:38 +08:00
5b51346a83 add missing rollback, doc 2023-09-26 18:10:38 +08:00
77e00278e4 fix test
All checks were successful
Test / Run unit tests (pull_request) Successful in 16m34s
Test / Run integration tests (pull_request) Successful in 30m15s
2023-09-26 02:50:18 +08:00
52deae0528 update tracker 2023-09-26 02:50:10 +08:00
afd4c05d4a default log level = info 2023-09-22 16:47:27 +08:00
e6d312f98b fix symm diff iterator tests 2023-09-22 16:47:27 +08:00
026bd81636 re-export indexer types for consuming libs 2023-09-22 16:47:27 +08:00
7c4f8432db tweaks 2023-09-22 16:47:27 +08:00
1f477f24ea rm redundant node info 2023-09-22 16:47:27 +08:00
f528cfdf71 comments & formatting 2023-09-22 16:47:27 +08:00
1e3daaeaee WriteStateDiffTracked 2023-09-22 16:47:27 +08:00
1781675b39 expose symm diff iterator state in companion object 2023-09-22 16:47:27 +08:00
68e2aca32e refactor batch 2023-09-22 16:47:27 +08:00
a7b83fc63c factor out PushHeader method 2023-09-22 16:47:27 +08:00
82131564ca Concurrent statediff iteration (#12)
All checks were successful
Test / Run unit tests (push) Successful in 16m24s
Test / Run integration tests (push) Successful in 30m41s
Uses subtrie iterators to concurrently process the state trie.

Reviewed-on: #12
2023-09-22 08:44:35 +00:00
981bfb5895 Use symmetric difference iterator (#11)
All checks were successful
Test / Run unit tests (push) Successful in 17m53s
Test / Run integration tests (push) Successful in 37m51s
Implements https://github.com/cerc-io/go-ethereum/issues/319

With this we can perform a single pass to process updates.

Also
* refactor code structure around single-pass iteration
* refactor builder metrics to match new set of functions
* fix unit tests by running sequentially
* update ipld-eth-db in compose
* factor out fixture data into external module
* some CI updates

Reviewed-on: #11
2023-09-20 03:22:15 +00:00
c80dbe4600 Fix CI workflow & update ipld-eth-db (#10)
Some checks failed
Test / Run unit tests (push) Failing after 6m42s
Test / Run integration tests (push) Successful in 44m46s
Fix for #9
Update ipld-eth-db to 5.0.5

Reviewed-on: #10
2023-09-05 02:58:59 +00:00
840d4a4e5d Fix bug where the defensive copy loses the computed leaf paths
Some checks failed
Test / Run integration tests (push) Failing after 18s
Test / Run unit tests (push) Failing after 21s
https://github.com/cerc-io/go-ethereum/pull/400
2023-07-23 01:40:00 +08:00
b21ca5da75 Statediff missing parent blocks automatically (#8)
Some checks failed
Test / Run integration tests (push) Has started running
Test / Run unit tests (push) Failing after 4m18s
Port of https://github.com/cerc-io/go-ethereum/pull/399 and https://github.com/cerc-io/go-ethereum/pull/397.

Co-authored-by: Thomas E Lackey <telackey@bozemanpass.com>
Reviewed-on: #8
2023-07-20 02:15:48 +00:00
03f5622bea Add Gitea CI workflow
Some checks failed
Test / Run unit tests (pull_request) Failing after 5m38s
Test / Run unit tests (push) Failing after 5m59s
Test / Run integration tests (pull_request) Failing after 19m19s
Test / Run integration tests (push) Failing after 40m57s
* use dedicated access token for pulling private repos

Co-authored-by: Thomas E Lackey <telackey@bozemanpass.com>
2023-07-14 13:16:51 +08:00
cc17762fdc 292: Backfill gaps in the recent past on startup when tracking head. (#395)
* Backfill gaps in the recent past when statediffing head.
2023-07-14 13:16:51 +08:00
c4f16290c7 Updates post review
* remove StreamCodeAndCodeHash
* Makefile: local build target
* clean up comments & unused
2023-07-14 13:16:39 +08:00
c96215f9be Port: Check if the statediff is already in progress or completed. 2023-07-14 12:57:34 +08:00
49e0beb389 Port: Fix deferred rollback on error 2023-07-14 12:57:34 +08:00
ebc2eb37e7 Initial plugin implementation
* refactor packages, flags, subscriptions
* DRY refactor builder tests
* use mockgen to generate mocks
* update README
* MODE=statediff no longer needed for unit tests
* simplify func names, clean up metrics
* move write params to service field
* sql indexer: confirm quit after ipld cache reset
  prevents negative waitgroup panic
* don't let TotalDifficulty become nil
* use forked plugeth, plugeth-utils for now
2023-07-14 12:56:36 +08:00
bb00c46735 Copy package from geth fork 2023-07-11 20:10:38 +08:00
88a2405805 Initial commit 2023-05-22 12:02:03 +00:00