Commit Graph

25 Commits

Author SHA1 Message Date
00fbebb4b3 make builder tests ignore duplicate nodes
Some checks failed
Test / Run unit tests (pull_request) Successful in 18m16s
Test / Run integration tests (pull_request) Failing after 29m6s
2023-09-20 21:19:13 +08:00
44c60ac9e3 add flag for subtrie workers 2023-09-20 21:19:13 +08:00
d1be30346e test builder with different worker counts 2023-09-20 21:19:09 +08:00
8389eee504 unused 2023-09-20 16:49:49 +08:00
2b680598eb cleanup 2023-09-20 16:49:49 +08:00
afec76d65f rm redundant functions 2023-09-20 16:49:49 +08:00
8efcab2132 rm redundant functions 2023-09-20 16:49:49 +08:00
7902ad025a clean up 2023-09-20 16:49:49 +08:00
757b7ce426 unused 2023-09-20 16:49:49 +08:00
7b8ae17089 note geth bug 2023-09-20 16:49:49 +08:00
24d186ef95 go mod update & tidy 2023-09-20 16:49:47 +08:00
fc0414d165 sync indexer publishing 2023-09-20 16:44:12 +08:00
5e4622d4f4 use concurrent iterators 2023-09-20 16:44:10 +08:00
981bfb5895 Use symmetric difference iterator (#11)
All checks were successful
Test / Run unit tests (push) Successful in 17m53s
Test / Run integration tests (push) Successful in 37m51s
Implements https://github.com/cerc-io/go-ethereum/issues/319

With this we can perform a single pass to process updates.

Also
* refactor code structure around single-pass iteration
* refactor builder metrics to match new set of functions
* fix unit tests by running sequentially
* update ipld-eth-db in compose
* factor out fixture data into external module
* some CI updates

Reviewed-on: #11
2023-09-20 03:22:15 +00:00
c80dbe4600 Fix CI workflow & update ipld-eth-db (#10)
Some checks failed
Test / Run unit tests (push) Failing after 6m42s
Test / Run integration tests (push) Successful in 44m46s
Fix for #9
Update ipld-eth-db to 5.0.5

Reviewed-on: #10
2023-09-05 02:58:59 +00:00
840d4a4e5d Fix bug where the defensive copy loses the computed leaf paths
Some checks failed
Test / Run integration tests (push) Failing after 18s
Test / Run unit tests (push) Failing after 21s
https://github.com/cerc-io/go-ethereum/pull/400
2023-07-23 01:40:00 +08:00
b21ca5da75 Statediff missing parent blocks automatically (#8)
Some checks failed
Test / Run integration tests (push) Has started running
Test / Run unit tests (push) Failing after 4m18s
Port of https://github.com/cerc-io/go-ethereum/pull/399 and https://github.com/cerc-io/go-ethereum/pull/397.

Co-authored-by: Thomas E Lackey <telackey@bozemanpass.com>
Reviewed-on: #8
2023-07-20 02:15:48 +00:00
03f5622bea Add Gitea CI workflow
Some checks failed
Test / Run unit tests (pull_request) Failing after 5m38s
Test / Run unit tests (push) Failing after 5m59s
Test / Run integration tests (pull_request) Failing after 19m19s
Test / Run integration tests (push) Failing after 40m57s
* use dedicated access token for pulling private repos

Co-authored-by: Thomas E Lackey <telackey@bozemanpass.com>
2023-07-14 13:16:51 +08:00
cc17762fdc 292: Backfill gaps in the recent past on startup when tracking head. (#395)
* Backfill gaps in the recent past when statediffing head.
2023-07-14 13:16:51 +08:00
c4f16290c7 Updates post review
* remove StreamCodeAndCodeHash
* Makefile: local build target
* clean up comments & unused
2023-07-14 13:16:39 +08:00
c96215f9be Port: Check if the statediff is already in progress or completed. 2023-07-14 12:57:34 +08:00
49e0beb389 Port: Fix deferred rollback on error 2023-07-14 12:57:34 +08:00
ebc2eb37e7 Initial plugin implementation
* refactor packages, flags, subscriptions
* DRY refactor builder tests
* use mockgen to generate mocks
* update README
* MODE=statediff no longer needed for unit tests
* simplify func names, clean up metrics
* move write params to service field
* sql indexer: confirm quit after ipld cache reset
  prevents negative waitgroup panic
* don't let TotalDifficulty become nil
* use forked plugeth, plugeth-utils for now
2023-07-14 12:56:36 +08:00
bb00c46735 Copy package from geth fork 2023-07-11 20:10:38 +08:00
88a2405805 Initial commit 2023-05-22 12:02:03 +00:00