Commit Graph

13275 Commits

Author SHA1 Message Date
Abdul Rabbani
a7caed41df Merge tag 'v1.10.17' into v1.10.17-statediff-v3 2022-04-05 15:30:47 -04:00
Ashwin Phatak
a9ab76cb33
Merge pull request #210 from deep-stack/pm-removed-storage-nodes
Add diffs for storage nodes of destroyed contracts
2022-04-05 14:21:19 +05:30
b351f8f335 Increase timeout in a failing test 2022-04-05 12:38:14 +05:30
c21aa96962 Index Removed diffs without leaf keys if an account or storage node is moved 2022-04-05 12:09:23 +05:30
9917e6c293 Fix linting errors 2022-04-05 12:09:23 +05:30
84365431d1 Update indexer unit tests 2022-04-05 12:09:23 +05:30
a14745dac5 Updated unit tests for changes in builder 2022-04-05 12:09:09 +05:30
4855d9304e Index Removed storage diffs on contract destruction 2022-04-05 11:03:54 +05:30
Ashwin Phatak
2aaf6bcda3
Merge pull request #212 from deep-stack/pm-watched-addresses-v3
Statediff API (v3) to change addresses watched in direct indexing mode
2022-04-05 09:33:51 +05:30
52df3460d6 Create file for watched addresses only when required 2022-04-01 14:58:50 +05:30
710312378a Add indexer unit tests for loading watched addresses 2022-04-01 14:58:50 +05:30
e7526469db Add file mode indexer unit tests for watched address methods 2022-04-01 14:58:50 +05:30
a7f9354f0e Implement watch address indexer methods for file mode 2022-04-01 14:58:50 +05:30
12b9f50930 Update context used in watch address indexer functions 2022-04-01 14:56:29 +05:30
750e44e9e6 Add builder test for removal of watched addresses 2022-04-01 14:55:33 +05:30
f3761efe76 Add a fix in builder for removal of a non-watched address 2022-04-01 14:55:33 +05:30
7f38afe542 Add tests for the API to change addresses being watched 2022-04-01 14:55:33 +05:30
af4dbed9d2 Add tests for indexer methods used to change addresses being watched 2022-04-01 14:55:33 +05:30
8fc2c09634 Add placeholder indexer methods for file and dump modes 2022-04-01 14:55:33 +05:30
9b234ef5b4 Statediff API to change addresses being watched in direct indexing 2022-04-01 14:55:33 +05:30
Abdul Rabbani
c8b68db48c
Merge pull request #217 from vulcanize/feature/known-gaps
Feature/known gaps
2022-03-31 14:38:59 -04:00
Abdul Rabbani
d24a49ef03 Add Workflow dispatch for docker builds 2022-03-31 14:14:34 -04:00
Abdul Rabbani
102f874c63 Update known_gaps table name 2022-03-31 14:11:57 -04:00
Abdul Rabbani
359799dee2 Update docker compose 2022-03-31 14:02:30 -04:00
Abdul Rabbani
2e836e869a PR Updates as per Ian's request 2022-03-31 11:37:01 -04:00
Abdul Rabbani
a60d5a016d Code Clean Up 2022-03-30 17:30:19 -04:00
Abdul Rabbani
fc6a9379e1 Add Prometheus metrics and write SQL file if it has data. 2022-03-30 12:53:44 -04:00
Abdul Rabbani
b960661807 Refactor: Decouple knownGaps and Indexer
This commit decouples knownGaps and Indexer. All knownGaps logic is in its own file. This makes testing and maintainability easier.

We have also removed all efforts to check the `lastProcessedblock` - This is because we won't ever run into this issue (hyptothetically), because geth won't let it happen.
2022-03-29 16:45:26 -04:00
Martin Holst Swende
25c9b49fdb
params: go-ethereum v1.10.17 stable 2022-03-29 19:18:26 +02:00
Marius van der Wijden
de6a113f84
eth/catalyst: only apply block if we actually have the state (#24598)
* eth/catalyst: only apply block if we actually have the state

* add header to payload queue

* Update cmd/geth/dbcmd.go

Co-authored-by: Martin Holst Swende <martin@swende.se>

Co-authored-by: Martin Holst Swende <martin@swende.se>
2022-03-29 18:26:18 +02:00
jwasinger
b502b6ac97
cmd/geth: change to non-fatal error message when legacy receipt storage is not implemented (#24603)
* cmd/geth: only check for presence of legacy receipts if developer mode is not enabled

* cmd/geth: degrade log level

* cmd/geth: fix format

Co-authored-by: Gary Rong <garyrong0905@gmail.com>
2022-03-29 10:40:42 +02:00
Péter Szilágyi
1027cb52c4
Merge pull request #24605 from karalabe/revert-setting-ttd
core: set ttd override on all chain variations
2022-03-29 11:39:45 +03:00
Zhang Zhuo
b06e8c4a8a
core/vm: fix sstore gas comment type (#24583) 2022-03-29 11:21:11 +03:00
Péter Szilágyi
b45d82e94a
core: set ttd override on all chain variations 2022-03-29 11:03:01 +03:00
Abdul Rabbani
fc341a90fc ** Write to file if you can't write to DB
This commit contains many new features:

1. Write the insert statement to file if there is an error when trying to write to DB.
2. Test the write to DB and write to file features in unit tests. They work as expected.
3. Insert logic for calling the knownGaps function (untested).

This PR makes a major change to the way statediff is started. Unless it is started in `file` mode, it will create a `file` indexer. This indexer will be used for writing errors to disk.
2022-03-28 15:00:29 -04:00
Martin Holst Swende
0fffd3acbd
build: close sftp connection when done (#24593) 2022-03-27 13:21:36 +02:00
Abdul Rabbani
f566aa780c % Checkpoint - Added the feature to write to File if writing to DB errors out. NOT TESTED 2022-03-25 16:50:43 -04:00
Martin Holst Swende
eb3ebceaa1
internal/build: exit sftp upload (#24590) 2022-03-25 16:46:31 +01:00
Martin Holst Swende
d1c243f841
internal/build: prevent travis timeout during ppa upload (#24589) 2022-03-25 15:43:07 +01:00
Martin Holst Swende
19b9cf714f
internal/build: show ppa upload process stdout on stdout (#24588) 2022-03-25 15:06:29 +01:00
Abdul Rabbani
f6ff20eb0e Handle All Gaps within Geth
Including an updated doc which keeps track of events in this PR.
2022-03-25 09:54:36 -04:00
Martin Holst Swende
6a44bf6826
build: upgrade to golangci-lint v1.45.2 (#24586) 2022-03-25 13:46:33 +01:00
Marius van der Wijden
a8040bc2c5
node: allow JWT pass by file only (#24579) 2022-03-24 15:04:47 +01:00
Marius van der Wijden
535f25d65f
eth/catalyst: fix log message (#24574) 2022-03-23 21:00:26 +01:00
Martin Holst Swende
f252154599
eth/downloader: fix flakey test (#24576) 2022-03-23 20:57:53 +01:00
Sina Mahmoodi
fd4f60f49b
core/rawdb: simple legacy receipt converter (#24028)
* cmd,core: add simple legacy receipt converter

core/rawdb: use forEach in migrate

core/rawdb: batch reads in forEach

core/rawdb: make forEach anonymous fn

cmd/geth: check for legacy receipts on node startup

fix err msg

Co-authored-by: rjl493456442 <garyrong0905@gmail.com>

fix log

Co-authored-by: rjl493456442 <garyrong0905@gmail.com>

fix some review comments

add warning to cmd

drop isLegacy fn from migrateTable params

add test for windows rename

test replacing in windows case

* minor fix

* sanity check for tail-deletion

* add log before moving files around

* speed-up hack for mainnet

* fix mainnet check, use networkid instead

* check mainnet genesis

* review fixes

* resume previous migration attempt

* core/rawdb: lint fix

Co-authored-by: Martin Holst Swende <martin@swende.se>
2022-03-23 20:57:32 +01:00
Abdul Rabbani
1a3a63d00e Find Gaps and at them to known_gaps
This contains all the logic needed to add a gap to the `known_gaps` table.

We can now add this code to various parts of the application to calculate if a gap has occured.
2022-03-23 14:03:35 -04:00
Abdul Rabbani
ce66532fcf Improve Testing for Insert, add a query function 2022-03-22 15:49:30 -04:00
rjl493456442
e0e8bf31c5
eth/downloader: ignore zero size header batch for importing (#24569)
* eth/downloader: ignore zero size header batch for importing

* core, light: reject empty header batch for importing
2022-03-22 18:58:05 +01:00
Abdul Rabbani
73f46a59ef Remove the need to pass a transaction when upserting to known_gaps
Thanks Ian :D
2022-03-22 11:52:35 -04:00