Rob Mulholand
dbdd16d3a2
(VDB-380) Create separate table for ilks
...
- reference ilk by foreign key every place it's used
2019-02-21 11:23:00 -06:00
Rob Mulholand
a27aaa7e68
Use timestamps for migrations with numeric indexes
...
- Reverting the commit that switched away from timestamps did not modify
migrations created since that change was applied
- Apply timestamps that are incremented by one from previous
2019-02-20 16:01:35 -06:00
Rob Mulholand
925b1b0b1c
Revert "Convert existing migrations from timestamp to versioned"
...
- This reverts commit 4e2536bf421fd9d2c9067d81f30e0f45c6b94fe7.
- Restore timestamped migrations so goose fix can handle ordering
dynamically with plugins also supplying timestamp based migrations
2019-02-20 16:01:35 -06:00
Rob Mulholand
33c271b584
Merge pull request #14 from vulcanize/vdb-354-queue-unrecognized-diffs
...
(VDB-354) queue unrecognized diffs
2019-02-20 16:00:28 -06:00
Rob Mulholand
11dd641a84
(VDB-354) Queue unrecognized storage diffs
...
- If we recognize a storage diff as coming from a watched contract but
don't recognize the key, queue it for retrying later (after we've seen
an event that might help us recognize the key)
- Remove unused errs and args
- Panic on unrecognized types (should not happen)
2019-02-20 15:22:39 -06:00
Rob Mulholand
df521eea7f
Merge pull request #11 from vulcanize/storage-transformers-readme
...
Add storage transformers readme
2019-02-14 14:24:01 -06:00
Rob Mulholand
0378068467
add example contract and instructions for watching its storage
2019-02-13 20:34:30 -06:00
Rob Mulholand
a5b9fb944c
Merge pull request #10 from vulcanize/squash-logs-in-tests
...
Discard logs created during tests
2019-02-13 15:02:02 -06:00
Rob Mulholand
ee113668a5
Add first draft of storage transformers readme
...
- Explain process of creating a new storage transformer
2019-02-12 15:58:28 -06:00
Rob Mulholand
ac9375ae47
Discard logs created during tests
...
- Make sure output is being set to discard for logrus to reduce clutter in the console
2019-02-12 11:18:39 -06:00
Rob Mulholand
c166e8d612
Merge pull request #8 from vulcanize/vdb-280-vat-diff-parsing
...
(VDB-280) Vat diff parsing
2019-02-08 13:57:40 -06:00
Rob Mulholand
c05d3b7836
(VDB-280) Consume vat contract storage diffs
2019-02-08 13:36:30 -06:00
Rob Mulholand
dba4e48a3e
Use map for key in storage value metadata
...
- Enables inserting multiple keys for one storage row (e.g. ilk and urn)
2019-02-08 11:41:17 -06:00
Rob Mulholand
09abcb841a
Persist Urns in raw bytes32 format
...
- Enables simple usage in contract storage lookups
2019-02-08 11:41:17 -06:00
Rob Mulholand
219f099b0c
Merge pull request #3 from vulcanize/vdb-298-pit-diff-parsing
...
[VDB-298] Parse storage diffs from the Pit contract
2019-02-06 11:06:44 -06:00
Rob Mulholand
867f92c431
(VDB-298) Consume Pit contract storage diffs
...
- Continuously parse storage diffs CSV data to read Pit contract state
- Convert ilks in database to raw bytes32 value for use in generating
storage keys dynamically
- Persist storage diffs with block number and hash for validation
2019-02-06 10:31:46 -06:00
Rob Mulholand
670741616e
Use logrus for logging in populating blocks
...
- Removes logging from test output
2018-12-07 11:24:06 -06:00
Rob Mulholand
2a518ad518
(VDB-254) Convert numerical values for Pit.file ilk
...
- convert data to ray when what == "spot" and wad when what == "line"
2018-12-07 11:24:06 -06:00
Rob Mulholand
087af252c9
(VDB-253) Update numerical values for Pit.file debt ceiling
...
- convert Line to wad
2018-12-07 11:24:06 -06:00
Rob Mulholand
4a5765b20d
(VDB-249) Update numerical values for Vat.fold
...
- convert rate to ray
2018-12-07 11:24:06 -06:00
Rob Mulholand
854236fd99
(VDB-267) Remove pit file stability fee
...
- Method is no longer present on the Pit contract
2018-11-15 12:14:59 -06:00
Rob Mulholand
82fd73ba3f
(VDB-68) Verify log block hash matches header block hash
...
- Delete header on conflict to prompt data refresh (cascade deletes all
data associated with that block)
- Derive header hash from rpc payload rather than computing it from data
(prevents hash mismatch between blockchain and cache)
2018-11-13 14:51:39 -06:00
Rob Mulholand
68464d375a
Add missing signatures to getSignatures command
2018-11-08 13:08:59 -06:00
Rob Mulholand
0b58efb56a
Extract common repository methods
...
- Inject column names to reduce duplication across common behavior
- Extract checked headers column names to constants
2018-11-08 13:08:59 -06:00
Rob Mulholand
8c168ed332
Extract constants package
...
- Reduce clutter in the shared package
2018-11-08 13:08:59 -06:00
Rob Mulholand
8c5192f82f
(VDB-210) Refactor tend repository tests
2018-11-08 13:08:59 -06:00
Rob Mulholand
1c1a9c699a
(VDB-209) Refactor price feed repository tests
2018-11-08 13:08:59 -06:00
Rob Mulholand
af8bbe5ce9
(VDB-208) Refactor pit file repository tests
2018-11-08 13:08:59 -06:00
Rob Mulholand
a1c4d70a77
(VDB-99) Transform Flap deal events
...
- Add flapper address to deal transformer config
2018-11-07 10:52:55 -06:00
Rob Mulholand
9cc9d4d3b6
(VDB-95) Transform Flop dent events
...
- Add flopper address to dent config
2018-11-07 10:52:55 -06:00
Rob Mulholand
52bbedd837
(VDB-98) Transform Flap tend events
...
- Add Flapper contract address to tend transformer config
2018-11-07 10:52:55 -06:00
Rob Mulholand
b2a78f1da4
Remove unused transformer config struct
2018-11-07 10:52:55 -06:00
Rob Mulholand
cb141f7cb7
(VDB-204) Add transformer for Flap kick
2018-11-07 10:52:55 -06:00
Rob Mulholand
ba071ef13f
Consolidate test doubles
...
- Migrate various mocks of core namespaces to shared version in `fakes` pkg
- Err on the side of making test doubles less sophisticated
- Don't pull over mocks of namespaces that are only used in example code
2018-11-03 13:49:23 -05:00
Rob Mulholand
5fe6394406
Add tests for pkg/geth/blockchain
...
- inject dependencies instead of initializing them in the constructor
2018-11-03 13:49:23 -05:00
Rob Mulholand
05186634bd
Add light sync command
...
- Only syncs block headers (excludes block bodies, transactions, receipts, and logs)
- Modifies validation window to include the most recent block
- Isolates validation window to the variable defined in the cmd directory (blocks
have a separate variable defined in the block_repository for determining when
to set a block as final)
2018-11-03 13:49:23 -05:00
Rob Mulholand
78b8173b37
Improve test coverage for event method signature lookups
2018-10-26 15:35:18 -05:00
Rob Mulholand
602802e5f4
Don't test order of DB results
...
- reduce flakiness by enabling tests to pass regardless of result order
2018-10-26 15:35:18 -05:00
Rob Mulholand
ed624330f6
Rename Flog pack to Vow flog
...
- enables differentiation if another contract implements flog
- also deletes flog-specific mocks
2018-10-26 15:35:18 -05:00
Rob Mulholand
1b680d2a4b
Use transformer factory for Drip drip
2018-10-26 15:35:18 -05:00
Rob Mulholand
d1ee501f12
Use transformer factory for Bite ( #89 )
...
* Use transformer factory for Bite
- introduces separate transformer factory for non-LogNote events
- converter includes `ToEntities` for events defined via ABI
* Updates after rebasing with staging
2018-10-26 13:26:10 -05:00
Rob Mulholand
0e5b23993a
Discard log output from Vat heal during tests
2018-10-26 12:02:56 -05:00
Rob Mulholand
45a52a59f9
Add repository tests for Deal
2018-10-26 12:02:56 -05:00
Rob Mulholand
5de949f4c5
Add cat file repository tests
2018-10-26 11:36:02 -05:00
Rob Mulholand
47a3c35938
Use transformer factory for Price Feed events
2018-10-26 11:25:16 -05:00
Rob Mulholand
745b3a460e
Add test for updating existing checked header row
2018-10-26 10:45:49 -05:00
Rob Mulholand
e37447ae9a
Use transformer factory for Vat fold
2018-10-26 10:45:49 -05:00
Rob Mulholand
3ec5b4afab
Remove unused param in integration test helper
2018-10-25 10:02:06 -05:00
Rob Mulholand
8831586fba
Extract shared mock converter and repository
2018-10-25 10:02:06 -05:00
Rob Mulholand
f5b9a21a8c
Use transformer factory for Vat slip
2018-10-25 10:02:06 -05:00
Rob Mulholand
1e7ee08af5
Use transformer factory for Vat toll
2018-10-25 10:02:06 -05:00
Rob Mulholand
6d662a6ce7
Add test for can't create Vat tune of wrong type
2018-10-25 10:02:06 -05:00
Rob Mulholand
a0cae99437
Use transformer factory for Vat flux
2018-10-25 10:02:06 -05:00
Rob Mulholand
78d746bb5b
Use transformer factory for Vat tune
2018-10-24 15:49:19 -05:00
Rob Mulholand
42d60c3cbd
Add log index to Vat move
2018-10-23 15:25:21 -05:00
Rob Mulholand
4ac896c246
Add log index to Vat init
2018-10-23 15:25:21 -05:00
Rob Mulholand
702f90367a
Add log index to Vat heal
2018-10-23 15:25:21 -05:00
Rob Mulholand
650bbf5874
Add log index to Vat grab
2018-10-23 15:25:21 -05:00
Rob Mulholand
1e74c73591
Add log index to Vat fold
2018-10-23 15:25:21 -05:00
Rob Mulholand
db52955669
Add log index to Tend
2018-10-23 15:25:21 -05:00
Rob Mulholand
e0253cce55
Add log index to Price Feed events
2018-10-23 15:25:21 -05:00
Rob Mulholand
a0a86871b5
Add log index to Frob
2018-10-23 15:25:21 -05:00
Rob Mulholand
b3d00fe3c5
Add log index to Pit file events
2018-10-23 15:25:21 -05:00
Rob Mulholand
7870451b5c
Increase number of flake attempts for integration tests
...
- Temporary solution until we can get more reliable results on network
calls to Kovan data
2018-10-22 12:14:43 -05:00
Rob Mulholand
d87fb14c6b
Add log index to Drip file events
2018-10-22 12:14:43 -05:00
Rob Mulholand
de294ad8ea
Add log index to Drip drip
2018-10-22 12:14:43 -05:00
Rob Mulholand
e5ba0496a6
Add log index to Dent
2018-10-22 12:14:43 -05:00
Rob Mulholand
1aafb7201e
Add log index to Deal
2018-10-22 12:14:43 -05:00
Rob Mulholand
495f39abb8
Add log index to Bite
2018-10-22 12:14:43 -05:00
Rob Mulholand
ea3de51792
Add Flop kick integration test
2018-10-19 14:21:57 -05:00
Rob Mulholand
fa828cf041
Add Tend integration test
2018-10-19 14:21:57 -05:00
Rob Mulholand
cbb5ffa3c7
Add Pit file stability fee integration test
2018-10-19 14:21:57 -05:00
Rob Mulholand
3449a1e246
Add Pit file debt ceiling integration test
2018-10-19 14:21:57 -05:00
Rob Mulholand
a83bf5ed0d
Add Pit file ilk integration test
2018-10-19 14:21:57 -05:00
Rob Mulholand
677e78891d
Add Drip file vow integration test
2018-10-19 14:21:57 -05:00
Rob Mulholand
0ce3e3d829
Add Bite integration test
2018-10-19 14:21:57 -05:00
Rob Mulholand
ddc7ee5143
Add Drip drip integration test
2018-10-19 10:56:28 -05:00
Rob Mulholand
b067ba565e
Add Vat fold integration test
2018-10-19 10:56:28 -05:00
Rob Mulholand
fdbe0b0b44
Add Vat heal integration test
2018-10-19 10:56:28 -05:00
Rob Mulholand
a7b9b825c8
Add Vat init integration test
2018-10-19 10:56:28 -05:00
Rob Mulholand
9b427ea1e9
Add Vat move integration test
2018-10-19 10:56:28 -05:00
Rob Mulholand
130d11d0aa
Add Vat slip transformer
2018-10-17 13:30:35 -05:00
Rob Mulholand
d0226dbce5
Convert Bite event field types to numeric
...
- Enables arithmetic operations when constructing views
- Also removes application-level references to DB ID
2018-10-16 15:27:13 -05:00
Rob Mulholand
d3df685c46
Add timestamp to block header
...
- Enables quickly deriving timestamp from header for log events
2018-10-12 12:00:02 -05:00
Rob Mulholand
5f67161f41
Convert raw header to JSON
...
- Enables parsing values off of header via Postgres migration
2018-10-12 12:00:02 -05:00
Rob Mulholand
e935f2f553
Add Vat grab transformer
2018-10-09 16:48:19 -05:00
Rob Mulholand
dcdf5dc292
Add missing transformers to transformer initializer map
2018-10-09 14:37:26 -05:00
Rob Mulholand
61dca314c4
Add Vat tune transformer
2018-10-09 14:37:26 -05:00
Rob Mulholand
8ee106e14d
Add Vat toll transformer
2018-10-09 11:40:35 -05:00
Rob Mulholand
bf44ec614a
Log checked headers for MCD events ( #43 )
...
* Log checked headers for Bite events
* Log checked headers for Drip drip events
* Log checked headers for Drip file events
- mark headers checked for 3 implementations of file on the Drip contract
* Log checked headers for Frob frob events
* Log checked headers for Pit file events
- mark headers checked for 3 implementations of file on the Pit contract
* Log checked headers for Vat init events
2018-10-02 17:25:38 -05:00
Rob Mulholand
02853014b2
Fix Pit file converters
...
- Use topics 2 & 3 instead of topic 1 (call data instead of msg.sender)
- Prefer extracting fields from topics rather than data
2018-09-27 10:32:08 -05:00
Rob Mulholand
c17ad1f826
Add missing Describe statements
2018-09-27 10:32:08 -05:00
Rob Mulholand
58f17a24ae
Add transformers for Cat file events
...
- transform logs from 3 implementations of file on the Cat contract
2018-09-27 10:32:08 -05:00
Rob Mulholand
a0ba6ca6bd
Return error if RPC returns empty header
...
- Enables graceful failure if RPC returns empty data with no error
2018-09-25 14:11:35 -05:00
Rob Mulholand
92525ca575
Make price feed log persistence atomic per block
...
- Prevents marking header as checked if only one of several price feed
logs is successfully persisted
2018-09-25 14:11:35 -05:00
Rob Mulholand
ac362650db
Log checked headers for tend events
2018-09-25 14:11:35 -05:00
Rob Mulholand
009cbb8aa0
Log checked headers for flip kick events
2018-09-25 14:11:35 -05:00
Rob Mulholand
d8b1a61ff5
Log checked headers for dent events
2018-09-25 14:11:35 -05:00
Rob Mulholand
c3f1fcf796
Log checked headers for deal events
...
- mark header as checked if no matching logs
- mark header as checked if all matching logs persisted successfully
- batch convert and insert matching logs to enable transactional persist
- enable skipping previously checked block headers when restarting a sync
2018-09-25 14:11:35 -05:00
Rob Mulholand
e138e58120
Set timeout before assertions in integration tests
...
- Prevent early evaluation from triggering failure
2018-09-21 11:28:17 -05:00