Commit Graph

212 Commits

Author SHA1 Message Date
d2252193ec Refactor to use plugeth-statediff (#1)
Reviewed-on: #1
2023-09-21 06:55:26 +00:00
6470bf2f01
251: Remove uses of canonical_header_hash() and get_storage_at() fns in light of v5 schema updates. (#253)
* Remove canonical_header_hash() uses and update SQL queries for latest v5 schema.

* Remove get_storage_at() uses.
2023-08-03 14:44:58 -05:00
51c36adbea
Update dependencies for ipld-eth-db 5.0.5 and geth v1.11.6-statediff-5.0.8 (#252)
In addition to the module updates, because the new indexer code will automatically flag pre-existing blocks as non-canonical when new block is added at the same height, I had to re-order the test setup to insert non-canonical blocks first.
2023-07-31 12:43:15 -05:00
39f8b6ec79
Fix getLogs query (avoid repeated execution, separate tx, and improve performance) (#250)
* Avoid repeated queries in getLogs.

* Rewrite query for speed and simplicity.

* Make default limit 500
2023-06-16 11:49:56 -05:00
i-norden
a1fbc1875b use GasFeeCap for unmined tx GasPrice 2023-06-14 11:49:57 -05:00
i-norden
111d879d71 rlp.EncodeToBytes => MarshalBinary, in tests 2023-06-12 17:25:17 -05:00
i-norden
ac67af63e1 rlp.EncodeToBytes => tx.MarshalBinary 2023-06-12 17:18:16 -05:00
77f861dd95
Fix for getTransactionReceipt returning empty 'from' address. (#242)
* Fix for getTransactionReceipt returning empty 'from' address.

* Unify the code

* Unify the code
2023-06-12 11:37:46 -05:00
i-norden
175c840bac fix err overshadowing in defers 2023-05-31 17:57:42 -05:00
6d7487152c Upgrade to v5 schema
Now uses:
* ipld direct_by_leaf StateDB for basic queries
* trie_by_cid StateDB for trie slice and proof queries

Also:
* vulcanize => cerc refactor
* Backend method to close dbs
* state tests are in multiple packages, to allow separate ginkgo suites
* removes gap-filler module
* integration tests and github workflows
* run stack-orchestrator for testnet
* fix various issues with tests, hardhat server, dockerfile
* fix cmd flags / env vars
* fix flaky tests and clean up code
* remove unused code, scripts
* remove outdated docs
* update version
2023-05-25 21:39:48 +08:00
i-norden
ec6707c6ab return effectiveGasPrice in GetTransactionReceipt 2023-04-14 17:33:27 +08:00
i-norden
b410c0876a interface fixes for v1.11.5 2023-04-14 14:49:39 +08:00
i-norden
9fcb21f812 bump to v4 v1.11.5 and use internal concurrent_iterator 2023-04-14 14:49:39 +08:00
ea19cc8d8d Use blocks table, not header_cids, for getBlockNumber() (#232) 2023-03-17 15:17:58 -05:00
i-norden
20b787e5dc missed moving some sql into consolidated file 2023-03-14 10:04:41 -05:00
i-norden
4678b6a733 ipld-eth-statedb initialization/instantiation 2023-03-13 18:23:49 -05:00
i-norden
df8bec1ad0 adapt uncle retrieval methods to work for v5 2023-03-13 12:48:25 -05:00
i-norden
aab5a2ef0b use ipld-eth-statedb for eth_call and graphql endpoints 2023-03-13 11:25:19 -05:00
i-norden
ba5cdecf93 new backend methods using ipld_eth_statedb.StateDB 2023-03-13 07:51:03 -05:00
i-norden
4c29841c21 internalize some node type utils from geth as they are no longer used over there in v5 2023-03-07 21:49:38 -06:00
i-norden
573a3dc991 node_type => removed 2023-03-07 21:49:38 -06:00
i-norden
6f1bfc7fce combine ipld and cid retriever into one struct. the original reason for the separation of concerns was because we used to fetch cids directly from the database but then use those to fetch iplds using an ipfs.BlockService abstraction ontop of our database (and/or a ipfs.BlockExchange). But now they are both accessed directly in the local DB. Additionally, some of the queries should be further refined/refactored/combined as we no longer need to take two trips but can retrieve cid and ipld in the same query. 2023-03-07 21:49:38 -06:00
i-norden
5bd9783aed move all sql statements into own file 2023-03-07 21:49:35 -06:00
i-norden
907f15f640 mh_key => cid; leaf_cid => cid; refactor GetReceipts 2023-03-02 17:59:13 -06:00
i-norden
87013110f9 public.blocks => ipld.blocks 2023-03-02 17:41:44 -06:00
i-norden
8ec203ec3d refactor out remaining unused bits 2023-02-21 19:50:58 -06:00
i-norden
7279d48dc6 remove vestigial packages 2023-02-21 19:47:47 -06:00
Ian Norden
dec31761b2
Merge pull request #225 from cerc-io/ian_dev
Fall-through post-London endpoints
2023-01-23 12:45:15 -06:00
190d0d7ac9
Improved logging and metrics. (#227)
1. Improve logging to include API method, user ID, etc in the output. We do this by intercepting the request details in the "middleware" and adding them to the request context, as well as adding a wrapper to logrus that simplifies including the fields in the output.

2. Breakdown API metrics by method. This will allow us to differentiate call counts and durations by API method (eg, eth_call vs eth_getStorageAt).
2023-01-20 19:39:26 -06:00
i-norden
1b5dbc33d7 eth_maxPriorityFeePerGas fall-through 2023-01-12 20:58:42 -06:00
i-norden
74071ecdf9 eth_gasPrice fall-through 2023-01-12 20:58:42 -06:00
i-norden
7b19973f91 eth_estimateGas fallthrough 2023-01-12 20:58:42 -06:00
i-norden
ed088cdf21 eth_feeHistory fallthrough endpoint 2023-01-12 20:58:42 -06:00
i-norden
2b10ac5385 eth_createAccessList fall-through endpoint 2023-01-12 20:58:42 -06:00
e0de4a1591
add StateDiffTimeout config setting (#224) 2023-01-12 19:18:12 -06:00
i-norden
f667e59699 do no eth_writeStateDiffAt for certain endpoints where we cannot pinpoint which statediff is missing 2023-01-10 15:34:39 -06:00
96a0774725 Always return when forwarding. 2023-01-10 13:16:01 -06:00
3a248979b9 Remove ipld 2023-01-10 12:24:29 -06:00
c57e8091b8 Merge error 2023-01-10 12:19:38 -06:00
b37c6bb5a3
Merge branch 'v4' into telackey/pxy_get_storage_at 2023-01-10 12:10:03 -06:00
d64ac5792c Add forwardGetStorageAt setting. 2023-01-10 12:04:28 -06:00
prathamesh0
721a728d4b
Implement getSlice API (#206)
* Implement getSlice API for state nodes

* Implement getSlice API for storage nodes

* Fix the helper function to create a slice of required paths

* Fix query to get state leaf key for given storage root

* Add a test to get state slice for root path

* Add checks in queries to get canonical data

* Add tests to get state slice

* Add a todo for using an iterator

* Avoid filtering out removed nodes

* Add tests to get storage slice

* Remove logs

* Populate extra contract leaves field in the response

* Update tests

* Avoid EOAs in additional data in response

* Use iterator based approach for getSlice

* Skip undesired nodes from stem and head iterators

* Update storage slice tests

* Fix meta data updates

* Use state trie to get stem nodes directly using paths

* Bugfix - Continue processing other trie nodes on encountering a leaf

* Remove unnecessary TODO
2022-12-19 14:12:23 +05:30
4714610b72
Use get_storage_at DB functions. (#205)
* Use new get_storage_at DB functions.

* Use latest ipld-eth-db for tests.
2022-11-16 14:13:10 -06:00
prathamesh0
cc17368c0d
Optimize GQL and getBlock APIs (#201)
* Add optional block number filter to getLogs API

* Use block number while fetching block with transactions

* Fix for failing tests

* Use block number when fetching block objects

* Use block number when fetching a tx by hash

* Add back methods to get block objects by block hash

* Update run_unit_test.sh

Removing echo command, as it seems to be only change in CICD.

* Increase wait time for db setup in unit test job

Co-authored-by: Michael <michael@abastionofsanity.com>
2022-11-04 10:02:09 +05:30
prathamesh0
33602aa0e0
Optimize getLogs GQL API (#198)
* Avoid joins with header and transaction tables while getting logs

* Update getLogs GQL API to accept multiple addresses

* Update version

* Update unit tests
2022-10-05 15:14:17 +05:30
prathamesh0
2c03c8cbd0
Support debug_traceCall API (#192)
* Implement debug_traceCall API

* Use API implementation from geth with custom backend

* Update refs in GitHub workflow
2022-09-21 17:15:03 +05:30
prathamesh0
4d99ecdee3
Increase EVM timeout for eth-calls (#191)
* Increase EVM timeout for eth-calls

* Remove goose prerequisite from test targets in Makefile
2022-09-21 16:28:19 +05:30
Michael
fc0d7a6dd6
Cerc refactor (#193)
* cerc refactor waiting on unpublished dependencies

* cerc refactor updates for dependencies

* Describe imports got removed

* cleaning up more vulcanize refs in ci/cd

* another test lost Describe imports

* another test lost Describe imports... not caught in go build -a???

* more cerc-io migrations to utilize new git.vdb.to gitea instance

* switching back to github for running unit test

* first try at git.vdb.to as conatiner repository

* targeted tag was incomplete
2022-09-20 11:52:06 -04:00
Michael Shaw
d24be29ef0 use mgirated test helper func GenesisBlockForTesting 2022-09-02 11:05:54 -04:00
Michael Shaw
0e91e42128 first pass updating for statediffing geth 1.10.23... filters changed 2022-09-01 18:37:51 -04:00