Takayuki Goto
005576572f
Merge pull request #134 from 8thlight/batch-historical-headers
...
VDB-303 Batch headers by 100
2019-01-21 15:29:08 -06:00
Taka Goto
3595771825
use batchElem from rpc client
2019-01-21 14:52:37 -06:00
Takayuki Goto
54d771cb06
Merge branch 'staging' into batch-historical-headers
2019-01-16 15:56:36 -06:00
Takayuki Goto
f01d9e6d17
Merge pull request #138 from 8thlight/fix-continous-log-sync
...
lowercase address on map to get transformers
2019-01-16 15:27:27 -06:00
Taka Goto
24cf0661b0
lowercase address on map to get transformers
2019-01-16 14:24:00 -06:00
Taka Goto
07da9d720b
fix get headers when less than 100 fetched
2019-01-16 10:16:06 -06:00
Takayuki Goto
16ec6a96e9
Merge branch 'staging' into batch-historical-headers
2019-01-16 09:43:18 -06:00
Edvard Hübinette
518bfbaf54
Bump geth to 1.8.21 ( #137 )
...
* Bump geth to 1.8.21
* Bump vendored crypto library for go-ethereum
2019-01-16 10:54:01 +01:00
Taka Goto
074140b9ac
iterate for loop by headers instead of blocknumbers
2019-01-15 16:34:20 -06:00
Ian Norden
aa4e698240
move interface_getter.go from ens_watcher to vDB pkging- used to construct a custom ABI based on results from calls to supportsInterface; also moved fetcher.go from examples to pkg
2019-01-15 15:49:18 -06:00
Takayuki Goto
b76b64d0a8
Merge branch 'staging' into batch-historical-headers
2019-01-15 10:38:11 -06:00
Edvard Hübinette
909d23e176
VDB-284 Run watcher from earliest startingBlockNumber ( #136 )
...
* Watcher computes earliest starting block number
* Update tests for new watcher behaviour
* Fix error oopsie
* Extract conditional to helper and suppres tests logging
2019-01-15 11:09:13 +01:00
Edvard Hübinette
d41209d293
VDB-327 Constantinople prep ( #135 )
...
* Bump geth to 1.8.20 for Constantinople
* Fix conflicting import/toml source for logrus
2019-01-14 11:31:28 +01:00
Takayuki Goto
f1ba21b505
Merge branch 'staging' into batch-historical-headers
2019-01-13 21:29:58 -06:00
Andrew J Yao
5efd683c54
Merge pull request #131 from 8thlight/VDB-31-improve-error-handling-in-transformers
...
VDB 31 improve error handling in transformers
2019-01-11 11:06:43 -08:00
yaoandrew
e2b864baa8
Add rollback if GetTicInTx fails and move GetTicInTx to shared/repository.go
2019-01-11 10:07:00 -08:00
Andrew J Yao
c8aa3dc275
Replace standard log with logrus import
2019-01-11 10:07:00 -08:00
yaoandrew
bc8b7a101c
refactor error handling in vat, cat, vow
2019-01-11 10:07:00 -08:00
yaoandrew
525fada3d7
refactor error handling in frob, pit, price, tend
2019-01-11 10:07:00 -08:00
yaoandrew
657aaccff3
refactor error handling in drip, flap, flop
2019-01-11 10:07:00 -08:00
yaoandrew
05351a8ef4
refactor error handling in dent
2019-01-11 10:07:00 -08:00
yaoandrew
08ac7f18a5
refactor error handling in flip_deal
2019-01-11 10:07:00 -08:00
yaoandrew
f655997fde
refactor error handling in pit_vow
2019-01-11 10:07:00 -08:00
yaoandrew
843d30c88e
refactor error handling in flip
2019-01-11 10:07:00 -08:00
yaoandrew
513513e93b
refactor error handling in chop_lump
2019-01-11 10:07:00 -08:00
yaoandrew
78b302eab6
refactor error handling in bite transformer
2019-01-11 10:07:00 -08:00
Edvard Hübinette
ebca338b1e
VDB-302 Sleep when no missing blocks in lightSync ( #129 )
...
* Sleep when no missing blocks in lightSync
* Fix tests and error propagation
* Correct geth.log to logrus
2019-01-11 10:58:41 +01:00
Takayuki Goto
ac430ddf54
Merge branch 'staging' into batch-historical-headers
2019-01-08 19:06:53 -06:00
Taka Goto
aa99c861a8
batch headers by 100s
2019-01-08 16:53:26 -06:00
Edvard Hübinette
77209d3b62
Merge pull request #128 from 8thlight/VDB-125-aggregate-log-fetching
...
VDB-125 Aggregate log fetching
2019-01-08 10:51:42 +01:00
Ian Norden
59cdaa05e6
moving some memory allocation to init function rather than within
...
execution cycles and fixing test db tear down so that it drops
checked_headers table instead of individual columns (droping columns
only hides them, they remain in memory and continue to contribute to the
1600 column limit which causes us to eventually exceed it)
2019-01-07 13:07:31 -06:00
Edvard
2292c94e99
Merge branch 'staging' into VDB-125-aggregate-log-fetching
2019-01-07 15:25:37 +01:00
Edvard
50cc0c2459
Update tests for watcher and repository
2019-01-07 15:20:05 +01:00
Edvard
833dde62cf
Remove injection of fetcher and repository to watcher
2019-01-07 15:19:31 +01:00
Ian Norden
c5d4e8e7af
fix conflicts and merge branch documentation
2018-12-21 11:23:22 -06:00
Ian Norden
2cbe6e7a70
method piping
2018-12-21 11:14:54 -06:00
Ian Norden
456c735087
fetch headers and logs in batches across all contracts and events
2018-12-21 10:33:31 -06:00
Ian Norden
d188329661
fetch event logs in batches- all events for a contract address at a given block height are fetched together, different contract events still fetched separately
2018-12-21 10:33:31 -06:00
Ian Norden
e390a97502
finish method polling with hash or address type argument values
...
collected from watched events; 'MissingMethodsCheckedEventsIntersection'
method to find headers which have been checked for each event of
interest but methods have not yet been polled at that header; tests for
new features; travis ci go version 1.9 -> 1.11 ; consolidate omniWatcher and lightOmniWatcher into single command with light as default
2018-12-21 10:33:31 -06:00
Ian Norden
0a59f06cac
begin work on: Add checked_headers column for methods that are polled so taht we don’t duplicate; Add batching of method polling so that we arent generating a rediculously large account address list before using it to poll methods (or persist the list in pg?); User passed ABI and other ways to get ABI; Add ability to collect []byte and hashes from events and use them in method polling same manner as addresses; Event filter addrs => only those event’s addresses/hashes are used for polling; Option to persist seen address/hash/bytes lists into pg; Only generate lists of addresses, []byte, or hashes if a method will use them later
2018-12-21 10:33:31 -06:00
Ian Norden
8c5b1b4dbe
remove accidental duplicate vendor lib that was imported by goland
2018-12-21 10:33:21 -06:00
Takayuki Goto
8723575521
Merge pull request #130 from 8thlight/update-staging-config
...
update staging/integration ipc path to 20c's kovan node
2018-12-17 13:16:59 -06:00
Taka Goto
f787e7ac0d
update staging/integration ipc path to 20c's kovan node
2018-12-17 08:37:35 -06:00
Edvard
e54699c039
Remove todo on chunker non-match (it's basically a filter)
2018-12-14 15:22:46 +01:00
Edvard Hübinette
a3e8633aff
VDB-104 improve lightsync ui ( #125 )
...
* Return PopulateMissingHeaders early if the sync is at the head of the chain
* Squelch logging if no blocks to sync
* Fix broken test
* Refactor repository tests
2018-12-14 12:11:48 +01:00
Edvard
7cf694f5e7
Update transformer documentation
2018-12-14 10:30:08 +01:00
Edvard
35f7f719e6
Swap strings.Builder for bytes.Buffer for go 1.9 support
2018-12-13 16:08:57 +01:00
Edvard
129964f3bc
Add tests for now shared MissingHeaders
2018-12-13 13:58:16 +01:00
Edvard
a3737c46f6
Remove duplicate entry in initializer map
2018-12-13 13:16:49 +01:00
Edvard
e5db740ae4
Move MockTransformer to test_data
2018-12-13 13:03:51 +01:00