cerc-io/plugeth-statediff
16
0
Fork 0
Code Issues 3 Pull Requests 1 Actions Packages Projects Releases Wiki Activity
35 Commits 4 Branches 10 Tags 3.3 MiB
e668a73bbe
Commit Graph

10 Commits

Author SHA1 Message Date
Roy Crihfield
c2ceca9230 refactor: only support tracked snapshots
All checks were successful
Test / Run unit tests (pull_request) Successful in 16m19s
Details
Test / Run integration tests (pull_request) Successful in 32m16s
Details 
tracking incremental state diffs is not feasible like this. because updates are processed after the
trie has been traversed, the iterators' state doesn't fully capture the progress of the diff. since
currently snapshots are the only use case for tracking, let's just support that.
 2023-09-27 21:29:20 +08:00
Roy Crihfield
68e2aca32e refactor batch 2023-09-22 16:47:27 +08:00
Roy Crihfield
a7b83fc63c factor out PushHeader method 2023-09-22 16:47:27 +08:00
Roy Crihfield
82131564ca Concurrent statediff iteration (#12)
All checks were successful
Test / Run unit tests (push) Successful in 16m24s
Details
Test / Run integration tests (push) Successful in 30m41s
Details 
Uses subtrie iterators to concurrently process the state trie.

Reviewed-on: #12
 2023-09-22 08:44:35 +00:00
Roy Crihfield
981bfb5895 Use symmetric difference iterator (#11)
All checks were successful
Test / Run unit tests (push) Successful in 17m53s
Details
Test / Run integration tests (push) Successful in 37m51s
Details 
Implements https://github.com/cerc-io/go-ethereum/issues/319

With this we can perform a single pass to process updates.

Also
* refactor code structure around single-pass iteration
* refactor builder metrics to match new set of functions
* fix unit tests by running sequentially
* update ipld-eth-db in compose
* factor out fixture data into external module
* some CI updates

Reviewed-on: #11
 2023-09-20 03:22:15 +00:00
Thomas E Lackey
cc17762fdc 292: Backfill gaps in the recent past on startup when tracking head. (#395) 
* Backfill gaps in the recent past when statediffing head.
 2023-07-14 13:16:51 +08:00
Roy Crihfield
c4f16290c7 Updates post review 
* remove StreamCodeAndCodeHash
* Makefile: local build target
* clean up comments & unused
 2023-07-14 13:16:39 +08:00
Roy Crihfield
c96215f9be Port: Check if the statediff is already in progress or completed. 2023-07-14 12:57:34 +08:00
Roy Crihfield
ebc2eb37e7 Initial plugin implementation 
* refactor packages, flags, subscriptions
* DRY refactor builder tests
* use mockgen to generate mocks
* update README
* MODE=statediff no longer needed for unit tests
* simplify func names, clean up metrics
* move write params to service field
* sql indexer: confirm quit after ipld cache reset
  prevents negative waitgroup panic
* don't let TotalDifficulty become nil
* use forked plugeth, plugeth-utils for now
 2023-07-14 12:56:36 +08:00
Roy Crihfield
bb00c46735 Copy package from geth fork 2023-07-11 20:10:38 +08:00