Commit Graph
24 Commits
Author SHA1 Message Date
roysc c31b1f30ed rm redundant function 2024-07-11 15:09:25 +08:00
roysc c8ce26de6d Export IPLD encoders
Test / Run compliance tests (pull_request) Successful in 4m25s
Test / Run unit tests (pull_request) Successful in 12m10s
Test / Run integration tests (pull_request) Successful in 26m4s
2024-07-10 19:03:26 +08:00
roysc 8fbff7fe46 Update eth-testing fixtures (#28)
Test / Run compliance tests (push) Successful in 4m21s
Test / Run unit tests (push) Successful in 11m56s
Test / Run integration tests (push) Successful in 26m15s
Updates eth-testing and eth-iterator-utils.

Reviewed-on: #28
v0.3.1
2024-07-10 08:51:47 +00:00
roysc b5642c612a Index Withdrawal objects (#25)
Test / Run compliance tests (push) Successful in 4m17s
Test / Run unit tests (push) Successful in 13m20s
Test / Run integration tests (push) Successful in 29m18s
Indexes the new validator withdrawal objects (from Shanghai/Capella fork: https://eips.ethereum.org/EIPS/eip-4895)
- new table `eth.withdrawal_cids`
- new column `withdrawals_root` in `eth.header_cids`
- add unit tests
- use new external stack repo in CI/CT job (cerc-io/fixturenet-eth-stacks#14)

Reviewed-on: #25
v0.3.0
2024-06-28 09:44:58 +00:00
roysc e6150910af Fix test stack branch (#26)
Test / Run compliance tests (push) Successful in 4m3s
Test / Run unit tests (push) Successful in 13m52s
Test / Run integration tests (push) Successful in 29m26s
Reviewed-on: #26
2024-05-29 13:06:01 +00:00
roysc cd195a0fc0 Add module fixes for dependents, and test utils (#24)
Test / Run integration tests (push) Failing after 3m37s
Test / Run compliance tests (push) Successful in 4m9s
Test / Run unit tests (push) Has been cancelled
Patch for module conflict when used as a dependency: `github.com/ethereum/c-kzg-4844/bindings/go` was moved to become part of `github.com/ethereum/c-kzg-4844` by `v0.4.0`.
See:
- cerc-io/plugeth#8
- 6ea035f208
```
% go mod tidy
go: github.com/cerc-io/ipld-eth-db-validator/v5/internal/chaingen imports
	github.com/ethereum/go-ethereum/core imports
	github.com/ethereum/go-ethereum/crypto/kzg4844 imports
	github.com/ethereum/c-kzg-4844/bindings/go: ambiguous import: found package github.com/ethereum/c-kzg-4844/bindings/go in multiple modules:
	github.com/ethereum/c-kzg-4844 v0.4.0 (/Users/roy/golang/pkg/mod/github.com/ethereum/c-kzg-4844@v0.4.0/bindings/go)
	github.com/ethereum/c-kzg-4844/bindings/go v0.0.0-20230126171313-363c7d7593b4 (/Users/roy/golang/pkg/mod/github.com/ethereum/c-kzg-4844/bindings/go@v0.0.0-20230126171313-363c7d7593b4)
```

Also adds test utils from https://git.vdb.to/cerc-io/ipld-eth-db-validator to be shared by cerc-io/ipld-eth-statedb#5 and wherever else.

Reviewed-on: #24
v0.2.1
2024-05-29 09:47:09 +00:00
roysc 4af1e5cc9e Update for Deneb/Cancun fork (#23)
Test / Run unit tests (push) Successful in 11m38s
Test / Run compliance tests (push) Successful in 3m20s
Test / Run integration tests (push) Successful in 27m23s
Updates Plugeth to version corresponding to Geth 1.13.14.
- Deneb/Cancun updates
- Updates to state/trie related interfaces

Reviewed-on: #23
Reviewed-by: jonathanface <jonathanface@noreply.git.vdb.to>
Reviewed-by: Thomas E Lackey <telackey@noreply.git.vdb.to>
v0.2.0
2024-04-13 10:36:15 +00:00
telackey 88106f008b New SO repo (#22)
Test / Run compliance tests (push) Failing after 2m38s
Test / Run unit tests (push) Successful in 11m14s
Test / Run integration tests (push) Failing after 3m48s
Reviewed-on: #22
Co-authored-by: Thomas E Lackey <telackey@bozemanpass.com>
Co-committed-by: Thomas E Lackey <telackey@bozemanpass.com>
2024-03-28 17:43:55 +00:00
telackey 22aac8acef Fix checksum build error.
Test / Run integration tests (push) Failing after 5m48s
Test / Run compliance tests (push) Failing after 3m2s
Test / Run unit tests (push) Successful in 15m48s
2023-10-27 17:22:33 -05:00
roysc e70c55bf86 Set state node diff field to false for snapshots (#18)
Test / Run unit tests (push) Successful in 16m22s
Test / Run compliance tests (push) Successful in 4m26s
Test / Run integration tests (push) Successful in 31m18s
Needed for cerc-io/ipld-eth-state-snapshot#1

Reviewed-on: #18
v0.1.4
2023-09-29 18:06:21 +00:00
royscandtelackey b8fec4b571 Add WriteStateSnapshot (#15)
Test / Run unit tests (push) Successful in 16m3s
Test / Run compliance tests (push) Successful in 4m10s
Test / Run integration tests (push) Successful in 31m53s
Adds a method to perform full-state snapshots by diffing against an empty state trie.
This replicates the functionality of `ipld-eth-state-snapshot`, so that code can use this as a library; see: cerc-io/ipld-eth-state-snapshot#1

Note that due to how incremental diffs are processed (updates are processed after the trie has been traversed) the iterator state doesn't fully capture the progress of the diff, so it's not currently feasible to state diffs this way. Full snapshots don't have to worry about updated accounts, so we can support them.

Co-authored-by: Thomas E Lackey <telackey@bozemanpass.com>
Reviewed-on: #15
v0.1.3
2023-09-28 03:35:45 +00:00
roysc 82131564ca Concurrent statediff iteration (#12)
Test / Run unit tests (push) Successful in 16m24s
Test / Run integration tests (push) Successful in 30m41s
Uses subtrie iterators to concurrently process the state trie.

Reviewed-on: #12
v0.1.2
2023-09-22 08:44:35 +00:00
roysc 981bfb5895 Use symmetric difference iterator (#11)
Test / Run unit tests (push) Successful in 17m53s
Test / Run integration tests (push) Successful in 37m51s
Implements https://github.com/cerc-io/go-ethereum/issues/319

With this we can perform a single pass to process updates.

Also
* refactor code structure around single-pass iteration
* refactor builder metrics to match new set of functions
* fix unit tests by running sequentially
* update ipld-eth-db in compose
* factor out fixture data into external module
* some CI updates

Reviewed-on: https://git.vdb.to/cerc-io/plugeth-statediff/pulls/11
v0.1.1
2023-09-20 03:22:15 +00:00
roysc c80dbe4600 Fix CI workflow & update ipld-eth-db (#10)
Test / Run unit tests (push) Failing after 6m42s
Test / Run integration tests (push) Successful in 44m46s
Fix for #9
Update ipld-eth-db to 5.0.5

Reviewed-on: #10
2023-09-05 02:58:59 +00:00
telackey 840d4a4e5d Fix bug where the defensive copy loses the computed leaf paths
Test / Run integration tests (push) Failing after 18s
Test / Run unit tests (push) Failing after 21s
https://github.com/cerc-io/go-ethereum/pull/400
v0.1.0
2023-07-23 01:40:00 +08:00
royscandtelackey b21ca5da75 Statediff missing parent blocks automatically (#8)
Test / Run unit tests (push) Failing after 4m18s
Test / Run integration tests (push) Has started running
Port of https://github.com/cerc-io/go-ethereum/pull/399 and https://github.com/cerc-io/go-ethereum/pull/397.

Co-authored-by: Thomas E Lackey <telackey@bozemanpass.com>
Reviewed-on: #8
2023-07-20 02:15:48 +00:00
royscandtelackey 03f5622bea Add Gitea CI workflow
Test / Run unit tests (pull_request) Failing after 5m38s
Test / Run unit tests (push) Failing after 5m59s
Test / Run integration tests (push) Failing after 40m57s
Test / Run integration tests (pull_request) Failing after 19m19s
* use dedicated access token for pulling private repos

Co-authored-by: Thomas E Lackey <telackey@bozemanpass.com>
2023-07-14 13:16:51 +08:00
telackey cc17762fdc 292: Backfill gaps in the recent past on startup when tracking head. (#395)
* Backfill gaps in the recent past when statediffing head.
2023-07-14 13:16:51 +08:00
roysc c4f16290c7 Updates post review
* remove StreamCodeAndCodeHash
* Makefile: local build target
* clean up comments & unused
2023-07-14 13:16:39 +08:00
roysc c96215f9be Port: Check if the statediff is already in progress or completed. 2023-07-14 12:57:34 +08:00
roysc 49e0beb389 Port: Fix deferred rollback on error 2023-07-14 12:57:34 +08:00
roysc ebc2eb37e7 Initial plugin implementation
* refactor packages, flags, subscriptions
* DRY refactor builder tests
* use mockgen to generate mocks
* update README
* MODE=statediff no longer needed for unit tests
* simplify func names, clean up metrics
* move write params to service field
* sql indexer: confirm quit after ipld cache reset
  prevents negative waitgroup panic
* don't let TotalDifficulty become nil
* use forked plugeth, plugeth-utils for now
2023-07-14 12:56:36 +08:00
roysc bb00c46735 Copy package from geth fork 2023-07-11 20:10:38 +08:00
dboreham 88a2405805 Initial commit 2023-05-22 12:02:03 +00:00