Commit Graph

36 Commits

Author SHA1 Message Date
aeffc86033 check for recovery file
All checks were successful
Test / Run compliance tests (pull_request) Successful in 3m47s
Test / Run unit tests (pull_request) Successful in 15m27s
Test / Run integration tests (pull_request) Successful in 28m35s
2023-09-28 09:00:50 +08:00
e668a73bbe Merge pull request 'Run compliance tests.' (#16) from telackey/cict into with-iterator-tracker
All checks were successful
Test / Run unit tests (pull_request) Successful in 17m50s
Test / Run compliance tests (pull_request) Successful in 3m19s
Test / Run integration tests (pull_request) Successful in 31m34s
Reviewed-on: #16
2023-09-27 13:58:42 +00:00
c2ceca9230 refactor: only support tracked snapshots
All checks were successful
Test / Run unit tests (pull_request) Successful in 16m19s
Test / Run integration tests (pull_request) Successful in 32m16s
tracking incremental state diffs is not feasible like this. because updates are processed after the
trie has been traversed, the iterators' state doesn't fully capture the progress of the diff. since
currently snapshots are the only use case for tracking, let's just support that.
2023-09-27 21:29:20 +08:00
935c2ce4b5 Use v0.1.0
All checks were successful
Test / Run unit tests (pull_request) Successful in 16m35s
Test / Run integration tests (pull_request) Successful in 29m30s
Test / Run compliance tests (pull_request) Successful in 4m7s
2023-09-27 15:54:19 +08:00
101654f30e Rm branch spec
Some checks failed
Test / Run integration tests (pull_request) Has been cancelled
Test / Run unit tests (pull_request) Has been cancelled
Test / Run compliance tests (pull_request) Failing after 42s
2023-09-27 15:50:17 +08:00
c8e7acaacd jq
All checks were successful
Test / Run unit tests (pull_request) Successful in 16m46s
Test / Run compliance tests (pull_request) Successful in 4m16s
Test / Run integration tests (pull_request) Successful in 30m51s
2023-09-26 20:24:23 -05:00
dfa0660317 Tweak path
Some checks reported warnings
Test / Run integration tests (pull_request) Has been cancelled
Test / Run unit tests (pull_request) Has been cancelled
Test / Run compliance tests (pull_request) Has been cancelled
2023-09-26 20:16:54 -05:00
c37aab8b69 Run compliance tests.
Some checks failed
Test / Run integration tests (pull_request) Has been cancelled
Test / Run unit tests (pull_request) Has been cancelled
Test / Run compliance tests (pull_request) Failing after 14s
2023-09-26 20:12:19 -05:00
367349b85a update dep
All checks were successful
Test / Run unit tests (pull_request) Successful in 16m35s
Test / Run integration tests (pull_request) Successful in 31m17s
2023-09-26 20:12:33 +08:00
64d45bdfd8 rework iterator state stuff 2023-09-26 20:12:33 +08:00
5b51346a83 add missing rollback, doc 2023-09-26 18:10:38 +08:00
77e00278e4 fix test
All checks were successful
Test / Run unit tests (pull_request) Successful in 16m34s
Test / Run integration tests (pull_request) Successful in 30m15s
2023-09-26 02:50:18 +08:00
52deae0528 update tracker 2023-09-26 02:50:10 +08:00
afd4c05d4a default log level = info 2023-09-22 16:47:27 +08:00
e6d312f98b fix symm diff iterator tests 2023-09-22 16:47:27 +08:00
026bd81636 re-export indexer types for consuming libs 2023-09-22 16:47:27 +08:00
7c4f8432db tweaks 2023-09-22 16:47:27 +08:00
1f477f24ea rm redundant node info 2023-09-22 16:47:27 +08:00
f528cfdf71 comments & formatting 2023-09-22 16:47:27 +08:00
1e3daaeaee WriteStateDiffTracked 2023-09-22 16:47:27 +08:00
1781675b39 expose symm diff iterator state in companion object 2023-09-22 16:47:27 +08:00
68e2aca32e refactor batch 2023-09-22 16:47:27 +08:00
a7b83fc63c factor out PushHeader method 2023-09-22 16:47:27 +08:00
82131564ca Concurrent statediff iteration (#12)
All checks were successful
Test / Run unit tests (push) Successful in 16m24s
Test / Run integration tests (push) Successful in 30m41s
Uses subtrie iterators to concurrently process the state trie.

Reviewed-on: #12
2023-09-22 08:44:35 +00:00
981bfb5895 Use symmetric difference iterator (#11)
All checks were successful
Test / Run unit tests (push) Successful in 17m53s
Test / Run integration tests (push) Successful in 37m51s
Implements https://github.com/cerc-io/go-ethereum/issues/319

With this we can perform a single pass to process updates.

Also
* refactor code structure around single-pass iteration
* refactor builder metrics to match new set of functions
* fix unit tests by running sequentially
* update ipld-eth-db in compose
* factor out fixture data into external module
* some CI updates

Reviewed-on: #11
2023-09-20 03:22:15 +00:00
c80dbe4600 Fix CI workflow & update ipld-eth-db (#10)
Some checks failed
Test / Run unit tests (push) Failing after 6m42s
Test / Run integration tests (push) Successful in 44m46s
Fix for #9
Update ipld-eth-db to 5.0.5

Reviewed-on: #10
2023-09-05 02:58:59 +00:00
840d4a4e5d Fix bug where the defensive copy loses the computed leaf paths
Some checks failed
Test / Run integration tests (push) Failing after 18s
Test / Run unit tests (push) Failing after 21s
https://github.com/cerc-io/go-ethereum/pull/400
2023-07-23 01:40:00 +08:00
b21ca5da75 Statediff missing parent blocks automatically (#8)
Some checks failed
Test / Run integration tests (push) Has started running
Test / Run unit tests (push) Failing after 4m18s
Port of https://github.com/cerc-io/go-ethereum/pull/399 and https://github.com/cerc-io/go-ethereum/pull/397.

Co-authored-by: Thomas E Lackey <telackey@bozemanpass.com>
Reviewed-on: #8
2023-07-20 02:15:48 +00:00
03f5622bea Add Gitea CI workflow
Some checks failed
Test / Run unit tests (pull_request) Failing after 5m38s
Test / Run unit tests (push) Failing after 5m59s
Test / Run integration tests (pull_request) Failing after 19m19s
Test / Run integration tests (push) Failing after 40m57s
* use dedicated access token for pulling private repos

Co-authored-by: Thomas E Lackey <telackey@bozemanpass.com>
2023-07-14 13:16:51 +08:00
cc17762fdc 292: Backfill gaps in the recent past on startup when tracking head. (#395)
* Backfill gaps in the recent past when statediffing head.
2023-07-14 13:16:51 +08:00
c4f16290c7 Updates post review
* remove StreamCodeAndCodeHash
* Makefile: local build target
* clean up comments & unused
2023-07-14 13:16:39 +08:00
c96215f9be Port: Check if the statediff is already in progress or completed. 2023-07-14 12:57:34 +08:00
49e0beb389 Port: Fix deferred rollback on error 2023-07-14 12:57:34 +08:00
ebc2eb37e7 Initial plugin implementation
* refactor packages, flags, subscriptions
* DRY refactor builder tests
* use mockgen to generate mocks
* update README
* MODE=statediff no longer needed for unit tests
* simplify func names, clean up metrics
* move write params to service field
* sql indexer: confirm quit after ipld cache reset
  prevents negative waitgroup panic
* don't let TotalDifficulty become nil
* use forked plugeth, plugeth-utils for now
2023-07-14 12:56:36 +08:00
bb00c46735 Copy package from geth fork 2023-07-11 20:10:38 +08:00
88a2405805 Initial commit 2023-05-22 12:02:03 +00:00