go-ethereum/trie
Elizabeth 39c2a55942 Write state diff to CSV (#2)
* port statediff from 9b7fd9af80/statediff/statediff.go; minor fixes

* integrating state diff extracting, building, and persisting into geth processes

* work towards persisting created statediffs in ipfs; based off github.com/vulcanize/eth-block-extractor

* Add a state diff service

* Remove diff extractor from blockchain

* Update imports

* Move statediff on/off check to geth cmd config

* Update starting state diff service

* Add debugging logs for creating diff

* Add statediff extractor and builder tests and small refactoring

* Start to write statediff to a CSV

* Restructure statediff directory

* Pull CSV publishing methods into their own file

* Reformatting due to go fmt

* Add gomega to vendor dir

* Remove testing focuses

* Update statediff tests to use golang test pkg

instead of ginkgo

- builder_test
- extractor_test
- publisher_test

* Use hexutil.Encode instead of deprecated common.ToHex

* Remove OldValue from DiffBigInt and DiffUint64 fields

* Update builder test

* Remove old storage value from updated accounts

* Remove old values from created/deleted accounts

* Update publisher to account for only storing current account values

* Update service loop and fetching previous block

* Update testing

- remove statediff ginkgo test suite file
- move mocks to their own dir

* Updates per go fmt

* Updates to tests

* Pass statediff mode and path in through cli

* Return filename from publisher

* Remove some duplication in builder

* Remove code field from state diff output

this is the contract byte code, and it can still be obtained by querying
the db by the codeHash

* Consolidate acct diff structs for updated & updated/deleted accts

* Include block number in csv filename

* Clean up error logging

* Cleanup formatting, spelling, etc

* Address PR comments

* Add contract address and storage value to csv

* Refactor accumulating account row in csv publisher

* Add DiffStorage struct

* Add storage key to csv

* Address PR comments

* Fix publisher to include rows for accounts that don't have store updates

* Update builder test after merging in release/1.8

* Update test contract to include storage on contract intialization

- so that we're able to test that storage diffing works for created and
deleted accounts (not just updated accounts).

* Factor out a common trie iterator method in builder
2020-03-05 10:10:50 -06:00
..
committer.go trie: separate hashes and committer, collapse on commit 2020-02-03 17:28:30 +02:00
database_test.go trie: there's no point in retrieving the metaroot 2019-04-05 13:09:28 +03:00
database.go trie: separate hashes and committer, collapse on commit 2020-02-03 17:28:30 +02:00
encoding_test.go Write state diff to CSV (#2) 2020-03-05 10:10:50 -06:00
encoding.go Write state diff to CSV (#2) 2020-03-05 10:10:50 -06:00
errors.go trie: more node iterator improvements (#14615) 2017-06-20 18:26:09 +02:00
hasher.go trie: make hasher parallel when number of changes are large (#20488) 2020-02-04 14:02:38 +02:00
iterator_test.go all: clean up and proerly abstract database access 2019-03-06 13:35:03 +02:00
iterator.go Write state diff to CSV (#2) 2020-03-05 10:10:50 -06:00
node_test.go add node.go unit test file node_test.go (#20028) 2020-01-07 10:31:20 +01:00
node.go cmd, core, eth, trie: get rid of trie cache generations (#19262) 2019-03-14 15:25:12 +02:00
proof_test.go ethdb, trie: tiny API tidy-up from the database rework pr 2019-03-12 12:32:02 +02:00
proof.go trie: make hasher parallel when number of changes are large (#20488) 2020-02-04 14:02:38 +02:00
secure_trie_test.go cmd, core, eth, trie: get rid of trie cache generations (#19262) 2019-03-14 15:25:12 +02:00
secure_trie.go trie: make hasher parallel when number of changes are large (#20488) 2020-02-04 14:02:38 +02:00
sync_bloom.go cmd/geth: wrong memory size sanitizing on OpenBSD (#19793) 2019-07-05 13:13:21 +03:00
sync_test.go trie: remove node ordering slice in sync batch (#19929) 2019-10-28 18:50:11 +01:00
sync.go trie: remove node ordering slice in sync batch (#19929) 2019-10-28 18:50:11 +01:00
trie_test.go * trie: utilize callbacks instead of amassing lists in ref/unref (#20529) 2020-01-17 13:59:45 +02:00
trie.go trie: make hasher parallel when number of changes are large (#20488) 2020-02-04 14:02:38 +02:00