a846917f1d
* Add export-watcher CLI generation * Export snapshot block and add import-watcher CLI gen * Update codegen docs with export and import commands * Use different function to get latest checkpoint in export CLI * Update generated watcher docs with import state instructions * Push IPLDBlocks to IPFS * Change ts type for data column to Buffer * Add checkpoint hook * Push CLI checkpoint to IPFS * Fix latest IPLDBlock query to filter out irrelevant blocks * Add CLI to inspect a CID * Decode data before exporting * Encode data in JSON for getState GQL API * Use go-ipfs and export cbor-encoded buffer * Remove empty post-block methods from existing watchers * Call hooks and checkpoint job complete handlers in fill * Remove subscription to hooks queue from existing watchers |
||
---|---|---|
.github/workflows | ||
.husky | ||
packages | ||
scripts | ||
.dockerignore | ||
.gitignore | ||
Dockerfile | ||
lerna.json | ||
LICENSE | ||
Makefile | ||
package.json | ||
README.md | ||
yarn.lock |
watcher-ts
Setup
This project uses yarn workspaces.
Install packages (Node.JS v16.13.1):
yarn
Services
The default config files used by the watchers assume the following services are setup and running on localhost:
vulcanize/go-ethereum
on port 8545vulcanize/ipld-eth-server
with native GQL API enabled, on port 8082postgraphile
on thevulcanize/ipld-eth-server
database, on port 5000
Note
-
In
vulcanize/ipld-eth-server
, add the following statement to[ethereum]
section inenvironments/config.toml
:chainConfig = "./chain.json" # ETH_CHAIN_CONFIG
Databases
Note: Requires postgres12
.
Login as the postgres user:
sudo su - postgres
Create the databases for the watchers:
createdb erc20-watcher
createdb address-watcher
createdb uni-watcher
createdb uni-info-watcher
Create the databases for the job queues and enable the pgcrypto
extension on them (https://github.com/timgit/pg-boss/blob/master/docs/usage.md#intro):
createdb erc20-watcher-job-queue
createdb address-watcher-job-queue
createdb uni-watcher-job-queue
createdb uni-info-watcher-job-queue
postgres@tesla:~$ psql -U postgres -h localhost erc20-watcher-job-queue
Password for user postgres:
psql (12.7 (Ubuntu 12.7-1.pgdg18.04+1))
SSL connection (protocol: TLSv1.3, cipher: TLS_AES_256_GCM_SHA384, bits: 256, compression: off)
Type "help" for help.
erc20-watcher-job-queue=# CREATE EXTENSION pgcrypto;
CREATE EXTENSION
erc20-watcher-job-queue=# exit
postgres@tesla:~$ psql -U postgres -h localhost address-watcher-job-queue
Password for user postgres:
psql (12.7 (Ubuntu 12.7-1.pgdg18.04+1))
SSL connection (protocol: TLSv1.3, cipher: TLS_AES_256_GCM_SHA384, bits: 256, compression: off)
Type "help" for help.
address-watcher-job-queue=# CREATE EXTENSION pgcrypto;
CREATE EXTENSION
address-watcher-job-queue=# exit
postgres@tesla:~$ psql -U postgres -h localhost uni-watcher-job-queue
Password for user postgres:
psql (12.7 (Ubuntu 12.7-1.pgdg18.04+1))
SSL connection (protocol: TLSv1.3, cipher: TLS_AES_256_GCM_SHA384, bits: 256, compression: off)
Type "help" for help.
uni-watcher-job-queue=# CREATE EXTENSION pgcrypto;
CREATE EXTENSION
uni-watcher-job-queue=# exit
postgres@tesla:~$ psql -U postgres -h localhost uni-info-watcher-job-queue
Password for user postgres:
psql (12.7 (Ubuntu 12.7-1.pgdg18.04+1))
SSL connection (protocol: TLSv1.3, cipher: TLS_AES_256_GCM_SHA384, bits: 256, compression: off)
Type "help" for help.
uni-info-watcher-job-queue=# CREATE EXTENSION pgcrypto;
CREATE EXTENSION
uni-info-watcher-job-queue=# exit
Reset
Reset the databases used by the watchers:
yarn db:reset
Run
Build the files in packages:
yarn build
# To watch for changes and build (used in development).
yarn build:watch
To run any watcher, cd
into their package folder and run:
yarn server
If the watcher uses a job queue, start the job runner in another terminal:
yarn job-runner