integrate backfill into storage watcher; documentation for storage backfill

This commit is contained in:
Ian Norden 2019-10-24 11:35:39 -05:00
parent 1a208546d1
commit 7f32c907fd

View File

@ -202,11 +202,11 @@ Storage transformers stream data from a geth subscription or parity csv file whe
full sync progresses. If the transformers have missed consuming a range of diffs due to lag in the startup of the processes or due to misalignment of the sync, full sync progresses. If the transformers have missed consuming a range of diffs due to lag in the startup of the processes or due to misalignment of the sync,
we can configure our storage transformers to backfill missing diffs from a [modified archival geth client](https://github.com/vulcanize/go-ethereum/tree/statediff_at). we can configure our storage transformers to backfill missing diffs from a [modified archival geth client](https://github.com/vulcanize/go-ethereum/tree/statediff_at).
To do so, add the following fields to the config file. To do so, add the following field to the config file.
```toml ```toml
[storageBackFill] [storageBackFill]
on = false on = false
``` ```
- `on` is set to `true` to turn the backfill process on - `on` is set to `true` to turn the backfill process on
This process uses the regular `client.ipcPath` rpc path, it assumes that it is either an http or ipc path that supports the `StateDiffAt` endpoint. This process uses the regular `client.ipcPath` rpc path, it assumes that it is either an http or ipc path that supports the `StateDiffAt` endpoint.