77209d3b62
Merge pull request #128 from 8thlight/VDB-125-aggregate-log-fetching
Edvard Hübinette2019-01-08 10:51:42 +01:00
59cdaa05e6
moving some memory allocation to init function rather than within execution cycles and fixing test db tear down so that it drops checked_headers table instead of individual columns (droping columns only hides them, they remain in memory and continue to contribute to the 1600 column limit which causes us to eventually exceed it)
Ian Norden2019-01-04 12:15:22 -06:00
2292c94e99
Merge branch 'staging' into VDB-125-aggregate-log-fetching
Edvard2019-01-07 15:25:37 +01:00
50cc0c2459
Update tests for watcher and repository
Edvard2019-01-07 15:20:05 +01:00
833dde62cf
Remove injection of fetcher and repository to watcher
Edvard2019-01-07 15:19:31 +01:00
c5d4e8e7af
fix conflicts and merge branch documentation
Ian Norden2018-12-21 11:23:22 -06:00
456c735087
fetch headers and logs in batches across all contracts and events
Ian Norden2018-12-18 13:00:26 -06:00
d188329661
fetch event logs in batches- all events for a contract address at a given block height are fetched together, different contract events still fetched separately
Ian Norden2018-12-18 11:31:21 -06:00
e390a97502
finish method polling with hash or address type argument values collected from watched events; 'MissingMethodsCheckedEventsIntersection' method to find headers which have been checked for each event of interest but methods have not yet been polled at that header; tests for new features; travis ci go version 1.9 -> 1.11 ; consolidate omniWatcher and lightOmniWatcher into single command with light as default
Ian Norden2018-12-14 11:52:02 -06:00
0a59f06cac
begin work on: Add checked_headers column for methods that are polled so taht we don’t duplicate; Add batching of method polling so that we arent generating a rediculously large account address list before using it to poll methods (or persist the list in pg?); User passed ABI and other ways to get ABI; Add ability to collect []byte and hashes from events and use them in method polling same manner as addresses; Event filter addrs => only those event’s addresses/hashes are used for polling; Option to persist seen address/hash/bytes lists into pg; Only generate lists of addresses, []byte, or hashes if a method will use them later
Ian Norden2018-12-07 09:38:46 -06:00
8c5b1b4dbe
remove accidental duplicate vendor lib that was imported by goland
Ian Norden2018-11-30 13:53:15 -06:00
ce428199eb
finishing porting omni watcher to work with light sync; split into full, light, and shared directories and refactor as much into shared; finish lightSync omni watcher tests
Ian Norden2018-11-23 22:26:07 -06:00
75fe3186fd
run integration tests on kovan archive instead of full
Taka Goto2018-12-06 11:00:17 -06:00
47c75d055b
Update repository tests for absence of MissingHeaders
Edvard2018-12-04 17:53:46 +01:00
9789648cc2
Delegate log chunks to respective transformers
Edvard2018-12-04 17:40:39 +01:00
8bebcdc064
Change transformer.Execute to single header
Edvard2018-12-04 17:05:34 +01:00
38c745e8c3
Refactor fetching out from repositories to log_fetcher and watcher
Edvard2018-12-04 16:04:13 +01:00
e02b33547d
finishing porting omni watcher to work with light sync; split into full, light, and shared directories and refactor as much into shared; finish lightSync omni watcher tests
Ian Norden2018-11-23 22:26:07 -06:00
c26736dc9e
WIP continue on aggregate fetching architecture
Edvard2018-11-30 17:28:52 +01:00
58b34548f3
vendor updates to work with go 1.11 and geth 1.8.18
Ian Norden2018-11-23 16:28:36 -06:00
975f13b969
reorganizing omni directory and beginning light watcher work
Ian Norden2018-11-23 12:12:24 -06:00
817bd76713
refactoring event converter and repository so that event logs are persisted as they are converted, preventing build up in memory, and finishing method polling (for full sync)
Ian Norden2018-11-20 10:38:23 -06:00
390a60f7f6
port over lightSync updates from maker repo
Ian Norden2018-11-15 12:53:08 -06:00
8ce901d1af
Convert drip_file_ilk tax field to ray (#117)
Elizabeth2018-11-29 14:10:12 -06:00
417b18ec6a
Edits to address PR issues; change license from apache to AGPL; and work towards generic method polling and reposito;y; config settings to filterevents/methods by account address; refactoring some stuff out of repo and into converter; remove fetcher and instead call blockchain's FetchContractData directly; finishing tests
Ian Norden2018-11-07 15:50:43 -06:00
Edvard Hübinette
Takayuki Goto
Taka Goto
Ian Norden
Rob Mulholand
Elizabeth