Commit Graph

156 Commits

Author SHA1 Message Date
Ian Norden
8e3cf55b7f review fixes 2019-04-08 11:52:36 -05:00
Ian Norden
42890cdaa7 Refactoring readme 2019-04-07 13:18:26 -05:00
Ian Norden
72c73c25b7 update vendor dep; constrain to revision of geth with UnpackIntoMap; updates to match 2019-04-03 00:14:02 -05:00
Rob Mulholand
39471e1d04 Remove links to Maker 2019-04-01 16:03:35 -05:00
Ian Norden
1aa849bcb4 PR fixes; remove all infura token references and setup travis to use encrypted env
variable; rest of the ethjson_rpc dependent tests extracted to integration_test
2019-03-21 18:36:51 -05:00
Ian Norden
d3e172d9ab remove references to infura token except for in infura.toml so that tests will continue to pass on CI 2019-03-21 18:36:49 -05:00
Ian Norden
37fc038605 fixes for review comments 2019-03-21 18:36:49 -05:00
Ian Norden
e4e092f542 changes to plugin and commands to accomodate changes 2019-03-21 18:33:56 -05:00
Ian Norden
05c3b9bb48 update readme; example toml 2019-03-21 18:30:48 -05:00
Ian Norden
ff55e3ba7a TransformerInitializer => EventTransformerInitializer reorganization 2019-03-14 11:59:39 -05:00
Ian Norden
05cb06c2d3 config example fixes 2019-03-13 11:42:29 -05:00
Ian Norden
b3ce1ecd78 update readme and cmd usage comments 2019-03-13 11:42:29 -05:00
Ian Norden
5dad19b71b Merge branch 'staging' into unpack_update 2019-03-13 08:16:49 -05:00
Ian Norden
ac93139863 update parseTopicsIntoMap to handle strings 2019-03-12 13:36:23 -05:00
Ian Norden
35c5808a07 readme fixes 2019-03-12 12:54:36 -05:00
Ian Norden
1d6219cc83 event transformers readme and update main readme to remove last links to
mcd_transformers
2019-03-12 12:45:29 -05:00
Rob Mulholand
5eff2618ed Assorted cleanups
- Remove DataDog
- Remove token_supply table
- Drop from more tables when cleaning DB for tests
2019-03-08 11:35:10 -06:00
Rob Mulholand
b1c881a0d5 Merge pull request #30 from vulcanize/redsquirrel-patch-1
Fixing README
2019-03-08 10:56:07 -06:00
Dave Hoover
a9a95123e7 Fixing README
We had an incorrect instruction in the documentation.
2019-03-06 13:40:10 -06:00
Rob Mulholand
b6bef49318 Add tests for plugin helpers
- Prevents code analysis from showing functions as unused
- Also address other code analysis issues
2019-03-06 12:43:39 -06:00
Ian Norden
8bd397e2eb Merge pull request #29 from vulcanize/fix
Fix for Travis issue at https://github.com/vulcanize/mcd_transformers/pull/6
2019-03-06 11:27:43 -06:00
Ian Norden
e1a317c3f6 different errors; readme edit 2019-03-06 00:14:37 -06:00
Ian Norden
5fd9a59027 fix for issue with Travis building plugin from plugin repo 2019-03-05 08:57:54 -06:00
Ian Norden
e2fab256c9 update geth to 1.8.23 (post can'tstantinople) 2019-03-03 03:37:27 -06:00
Ian Norden
83f7daf37d compose and execute as separate commands; update README and add git checkout vendor/github.com/ethereum/go-ethereum/accounts/abi to make build 2019-02-28 18:15:16 -06:00
Ian Norden
2c5ddd03ba core repo migrations in fixed form 2019-02-26 00:52:54 -06:00
Ian Norden
708425c4d6 rebase; extract factories and the mocks they are dependent on to
libraries/shared; adjust omni test_helpers to drop and recreate
checked_headers table to avoid reaching 1600 column limit after repeated
tests (dropping columns doesn't actually remove them from contributing
to that limit)
2019-02-25 01:34:38 -06:00
Ian Norden
17f4d3dfa5 move maker plugin generator test to mcd_transformers 2019-02-24 21:53:04 -06:00
Ian Norden
f2072561a7 removing mcd/maker references; delete test_data; update READMEs; use
logrus
2019-02-24 21:53:04 -06:00
Edvard Hübinette
b4ded221c3 Merge branch 'staging' into VDB-281-Migrations-remake 2019-02-01 17:29:56 +01:00
Edvard
e5f3826633 Add Makefile for goose migrations, update README accordingly 2019-01-25 11:44:05 +01:00
Ian Norden
dc87f39889 change omniwatcher database test helpers so that it doesn't interfere with downstream maker tests 2019-01-23 14:55:20 -06:00
Ian Norden
46b898f690 merge public vulcanizedb/master 2019-01-23 00:37:26 -06:00
Ian Norden
59cdaa05e6 moving some memory allocation to init function rather than within
execution cycles and fixing test db tear down so that it drops
checked_headers table instead of individual columns (droping columns
only hides them, they remain in memory and continue to contribute to the
1600 column limit which causes us to eventually exceed it)
2019-01-07 13:07:31 -06:00
Ian Norden
2cbe6e7a70 method piping 2018-12-21 11:14:54 -06:00
Ian Norden
e390a97502 finish method polling with hash or address type argument values
collected from watched events; 'MissingMethodsCheckedEventsIntersection'
method to find headers which have been checked for each event of
interest but methods have not yet been polled at that header; tests for
new features; travis ci go version 1.9 -> 1.11 ; consolidate omniWatcher and lightOmniWatcher into single command with light as default
2018-12-21 10:33:31 -06:00
Ian Norden
8c5b1b4dbe remove accidental duplicate vendor lib that was imported by goland 2018-12-21 10:33:21 -06:00
Ian Norden
e02b33547d finishing porting omni watcher to work with light sync; split into full, light,
and shared directories and refactor as much into shared; finish
lightSync omni watcher tests
2018-11-30 13:33:48 -06:00
Elizabeth
590e8a40ce Update readme badge to handle private repo (#124) 2018-11-21 15:48:51 -06:00
Elizabeth
128d20c9bf Vdb 269- fetch logs by hash (#122)
* Upgrade geth from 1.8.15 to 1.8.18

* Update vat_tune to use shared repository methods

* Query blockchain by block hash instead of block number range

* Remove hash validation from repositories

* Fix vow flog integration test

* Update README Travis build sticker

* Update constants formatting per go fmt

* Update EthPublicKeyParser.ParsePublicKey to use discv5.PubkeyID method

* Address PR comments
2018-11-21 09:30:00 -06:00
James Christie
93960e7c4e Add several improvements to README.md (#28)
- Expand instructions around technical specifics of project
  setup, including special gotchas in Ubuntu-based
  environments
- Add statement of setup flow to give thousand-foot view to
  users setting up Vulcanize for the first time
2018-11-03 13:49:23 -05:00
Rob Mulholand
05186634bd Add light sync command
- Only syncs block headers (excludes block bodies, transactions, receipts, and logs)
- Modifies validation window to include the most recent block
- Isolates validation window to the variable defined in the cmd directory (blocks
  have a separate variable defined in the block_repository for determining when
  to set a block as final)
2018-11-03 13:49:23 -05:00
Maxim Krasilnikov
2201efc347 Rename dev_env to rinkeby_env, added make commands description to readme 2018-11-03 13:49:23 -05:00
Elizabeth
3baca64903 Update address formatting (#67)
* Add getSignatures command for list of signatures in constants

* Update VatTune converter's formatting of addresses

and added an integration test

* Move VatTune and PriceFeeds integration tests to a common suite

* Update VatGrab converter for address format

* Update frob converter to fix urn and ilk formatting/decoding

* Update formatting

* Update make test command and add integrationtest command

* Add integration test to travis build

* Update creating headers in integration tests to include Raw and Timestamp fields
2018-10-17 13:04:55 -05:00
Elizabeth
cee824f7ad Add transformer documentation (#32) 2018-09-24 15:39:00 -05:00
Rob Mulholand
296b7aab72 Update README
- kicking off a staging build
2018-09-19 12:08:22 -05:00
Taka Goto
acad2cc30d use Sup deployment tool to deploy to staging 2018-09-17 13:25:19 -05:00
Taka Goto
cf72eae86c add datadog monitoring for vdb 2018-09-04 15:41:24 -05:00
Taka Goto
415ec3d97c update from PR feedback 2018-08-31 10:37:02 -05:00
Taka Goto
985fa49178 migration file to create bite; create bite repository
add transaction index and raw log to bite table
work on converter for bite event
update bite repository, replace guy with 32byte lad; create bite converter to entity
update field type for bite event; start on bite transformer
finish bite event transformer
2018-08-30 08:38:43 -05:00
Rob Mulholand
634604d0b5 Combine price feed transformers
- fetches logs from all three price feeds in one query
- assumes eth/usd price feed will be updated to include LogValue event
- updates transformers to run separate from header sync
2018-08-16 11:22:16 -05:00
Rob Mulholand
9231d40369 Extract price feed contract addresses to config 2018-08-16 11:22:16 -05:00
Rob Mulholand
ac63e43543 Backfill Frob log events 2018-08-14 10:47:43 -05:00
Elizabeth
b37324bf3d Refactoring
* Move flip kick files pkg/transformers/flip_kick

* Consolidate test database setup

* Pull ganache ipcPath from config

* Update README to include info about using a Ganache chain
2018-08-07 15:17:29 -05:00
Elizabeth
c617cd9c9d Add FlipKick log events transformer 2018-08-07 10:51:34 -05:00
Rob Mulholand
1355271011 Add light sync command
- Only syncs block headers (excludes block bodies, transactions, receipts, and logs)
- Modifies validation window to include the most recent block
- Isolates validation window to the variable defined in the cmd directory (blocks
  have a separate variable defined in the block_repository for determining when
  to set a block as final)
2018-07-18 16:34:12 -05:00
Maxim Krasilnikov
1ff349e629 Rename dev_env to rinkeby_env, added make commands description to readme 2018-06-21 22:21:34 +03:00
Elizabeth
aff2ad2b09 Merge pull request #62 from vulcanize/update-build-badge
Update build badge url
2018-06-21 10:11:06 -05:00
Elizabeth Engelman
8437b72ae1 Update build badge url 2018-06-21 10:02:42 -05:00
Stan James
febf412642 Add "About" section to README
Per issue https://github.com/vulcanize/vulcanizedb/issues/60 , adding description provided by @AFDudley on gitter here:
https://gitter.im/vulcanizeio/VulcanizeDB?at=5b2a54b0148056028591b323
2018-06-20 15:55:33 -06:00
Rob Mulholand
7533e6d476 Merge pull request #52 from vulcanize/cold-import
Cold import
2018-05-21 09:34:05 -05:00
Rob Mulholand
d5c2ab33fc Sync only missing blocks on cold import
= Add eth_node_fingerprint to block that can be imitated by both hot and cold imports
- Only sync missing blocks (blocks that are missing or don't share a fingerprint) on cold import
- Set block is_final status after import
2018-05-07 16:38:04 -05:00
Rob Mulholand
5f6bf32ec1 Add cold import script 2018-05-04 10:54:00 -05:00
The Gitter Badger
021e252bb6 Add Gitter badge 2018-04-19 14:49:56 +00:00
Elizabeth Engelman
7d7f0e3790 Update README to only recommend 1 way to setup database schema 2018-04-11 11:00:25 -05:00
Elizabeth Engelman
fd6eb172e4 Address PR comments 2018-04-10 09:07:55 -05:00
Elizabeth Engelman
ba9efc2be0 Updates to README
- update configuration section
- remove creating and migrating the db as a prerequisite for running test - it doesn't seem to be necessary
- add a public.toml.example config file to be copied and updated locally
2018-04-09 17:29:31 -05:00
Matt Krump
e96066bc83 Remove geth --dev dep 2018-03-21 13:57:18 -05:00
Matt K
6c5bc673c0 Update README.md 2018-03-07 15:34:55 -06:00
Matt K
5a652190d9 Allow Parity as ingest node (#36)
* Upgrade go-ethereum to v1.8

* Add Node Info for parity nodes

* Upgrade start_private_blockchain to use v1.8
2018-03-07 15:29:21 -06:00
Matt Krump
06f78e0083 Handle events
- Adds interfaces for developers to build handlers that update data in
response to log events
- Resolves #29
2018-03-05 10:01:50 -06:00
Matt K
293dd2e848 Add vendor dir (#16) (#4)
* Add vendor dir so builds dont require dep

* Pin specific version go-eth version
2018-01-29 13:44:18 -06:00
Matt K
82119b3c4b Update README.md 2018-01-29 09:46:48 -06:00
Matt Krump
0800e331d5 Update README 2018-01-26 13:53:26 -06:00
Matt Krump
69545b72f0 Update README 2018-01-26 13:52:45 -06:00
Matt Krump
662d7e1d79 Update README 2018-01-26 13:51:13 -06:00
Matt K
3b31e2a342 Update README, add State sync test (#1) 2018-01-26 13:38:14 -06:00
Matt Krump
afdeadeca1 Update deps, schema and ci 2018-01-25 19:06:06 -06:00
Matt Krump
aac2239097 Merge old private repo into vulcanize 2018-01-25 18:08:26 -06:00
Matt Krump
ed5a8f5bc4 WIP 2018-01-25 17:19:15 -06:00
Matt K
d09c2ae9bb Remove godo (#136) 2018-01-25 15:46:55 -06:00
Matt K
c00b8a5a98 Add Filters (#133)
* Add LogFilter struct

* Add log_filters table

* Add view for events watching

* Add cmd line "add_filter" to mimic eventual endpoint

* Allow multiple filters in config
2018-01-23 12:43:35 -06:00
Matt Krump
0ae25aff95 Remove getLogs entrypoint 2018-01-16 09:49:23 -06:00
Matt K
f41bf49b0e Update README.md 2018-01-09 08:45:15 -06:00
Matt K
70cfa20c68 Watch contact updates (#127)
* Downcase all arguments for contact watching

* ABI retrieval from test networks
2018-01-08 15:59:47 -06:00
ee4f7c710a replace '8thlight' with 'vulcanize' 2018-01-06 15:31:53 -05:00
Matt K
7e5e12f488 Backfill/listen for contract logs (#113) 2017-12-22 11:42:35 -06:00
Matt K
24bc83a448 Block categorization (#110)
* Add block categorization (is_final=)

* Add godo task for vulcanizeDB (Example of how everything could work together)

* Add unique constraint on block_number and node

* Add index on block_id for transactions_table

* Add node_id index on blocks table

* Sort transactions returned from FindBlock by tx_hash

* lowercase tx_to, tx_from like etherscan
2017-12-20 14:06:22 -06:00
Matt K
5e64283a12 Get logs for a contract (#99)
* Add ability to fetch logs for a contract and a block

* Test contract related code against Infura, so can run on Travis

* Add godo task for getLogs
2017-12-11 15:08:00 -06:00
Matt Krump
72b656fc15 Update README to include contract summary usage 2017-11-28 15:14:05 -06:00
Eric Meyer
a23023f7d6 Move environment configuration to root 2017-11-14 09:10:48 -06:00
Eric Meyer
4c84173bc0 Add ability to populate missing blocks
* The command populates up to the highest known block number
 * The anticipated use case is that the listener will be running
   in parallel to the populateBlocks command
    * This will mean that the listener is responsible for picking up
      new blocks, and the populateBlocks command is reposible for
      historical blocks
 * Reformat SQL statements
2017-11-08 14:52:38 -06:00
Eric Meyer
f4a603efcb Nest packages under pkg 2017-11-06 13:06:03 -06:00
Eric Meyer
70faec6dfd Update README to account for environment based changes 2017-11-03 16:52:19 -05:00
Eric Meyer
102beb11e3 Add the concept of multiple environments
* Right now, the two environments are Public and Private
    * This was to reflect the two blockchains we run against
2017-11-01 12:15:55 -05:00
Eric Meyer
5d297584df Revert "Remove Travis indicator from README"
This reverts commit 954a3ec3aa9eb5ab351fc0155e45c711ed46cc99.
2017-10-31 09:13:47 -05:00
Eric Meyer
ebc4bfa8fd Remove Travis indicator from README 2017-10-31 08:40:34 -05:00
Eric Meyer
e25a9753b4 Add scripts to help with migrations 2017-10-27 14:20:22 -05:00
Eric Meyer
4c1ff9ecbf Update README to suggest installing dep via go get 2017-10-26 10:04:45 -05:00
Matt Krump
2e4d0b9bb1 Update README 2017-10-25 15:56:42 -05:00