watcher-ts/packages/erc721-watcher
nikugogoi 1a903fccc6
CLI to compare eden-watcher entities and fix mapping code (#149)
* Make sumStaked variable local in eden network mapping

* Implement compare CLI to fetch and query by ids

* Set filterLogs to true for eden-watcher

* Use varchar for bigint array type in eden-watcher

* Store subgraph entities by id in IPLD state

* Store bigint vales as string in IPLD state

* Update eden watcher hook to store single Block entity in IPLD checkpoint

* Fix entity enum type property

* Fix parsing big numbers in event params

* Fix event bigint params parsing in all watchers

* Set default limit to query result and process block after events
2022-08-08 15:58:13 +05:30
..
environments Add prometheus metrics support for watchers (#152) 2022-08-03 16:26:51 +05:30
src CLI to compare eden-watcher entities and fix mapping code (#149) 2022-08-08 15:58:13 +05:30
test Use stack-orchestrator for erc721-watcher demo (#132) 2022-06-22 17:01:05 +05:30
.eslintignore Generate erc721-watcher using codegen 2022-06-08 16:43:15 +05:30
.eslintrc.json Generate erc721-watcher using codegen 2022-06-08 16:43:15 +05:30
.gitignore Add demo for erc721-watcher 2022-06-08 16:43:15 +05:30
demo.md Rename to watcher-ts (#140) 2022-07-07 12:38:32 +05:30
hardhat.config.ts Use stack-orchestrator for erc721-watcher demo (#132) 2022-06-22 17:01:05 +05:30
package.json Update codegen with changes implemented in mobymask watcher (#148) 2022-07-22 13:17:56 +05:30
README.md Update erc721-watcher demo for IPLD blocks (#125) 2022-06-15 10:40:40 +05:30
tsconfig.json Update codegen with changes implemented in mobymask watcher (#148) 2022-07-22 13:17:56 +05:30

erc721-watcher

Setup

  • Run the following command to install required packages:

    yarn
    
  • Run the IPFS (go-ipfs version 0.12.2) daemon:

    ipfs daemon
    
  • Create a postgres12 database for the watcher:

    sudo su - postgres
    createdb erc721-watcher
    
  • If the watcher is an active watcher:

    Create database for the job queue and enable the pgcrypto extension on them (https://github.com/timgit/pg-boss/blob/master/docs/usage.md#intro):

    createdb erc721-watcher-job-queue
    
    postgres@tesla:~$ psql -U postgres -h localhost erc721-watcher-job-queue
    Password for user postgres:
    psql (12.7 (Ubuntu 12.7-1.pgdg18.04+1))
    SSL connection (protocol: TLSv1.3, cipher: TLS_AES_256_GCM_SHA384, bits: 256, compression: off)
    Type "help" for help.
    
    erc721-watcher-job-queue=# CREATE EXTENSION pgcrypto;
    CREATE EXTENSION
    erc721-watcher-job-queue=# exit
    
  • The following core services should be setup and running on localhost:

  • In the config file:

    • Update the database connection settings.

    • Update the upstream config and provide the ipld-eth-server GQL API endpoint.

    • Update the server config with state checkpoint settings and provide the IPFS API address.

Customize

  • Indexing on an event:

    • Edit the custom hook function handleEvent (triggered on an event) in hooks.ts to perform corresponding indexing using the Indexer object.

    • While using the indexer storage methods for indexing, pass diff as true if default state is desired to be generated using the state variables being indexed.

  • Generating state:

    • Edit the custom hook function createInitialState (triggered if the watcher passes the start block, checkpoint: true) in hooks.ts to save an initial state IPLDBlock using the Indexer object.

    • Edit the custom hook function createStateDiff (triggered on a block) in hooks.ts to save the state in a diff IPLDBlock using the Indexer object. The default state (if exists) is updated.

    • Edit the custom hook function createStateCheckpoint (triggered just before default and CLI checkpoint) in hooks.ts to save the state in a checkpoint IPLDBlock using the Indexer object.

Run

Follow the steps below or follow the Demo

  • Run the watcher:

    yarn server
    

GQL console: http://localhost:3006/graphql

  • If the watcher is an active watcher:

    • Run the job-runner:

      yarn job-runner
      
    • To watch a contract:

      yarn watch:contract --address <contract-address> --kind <contract-kind> --checkpoint <true | false> --starting-block [block-number]
      
      • address: Address or identifier of the contract to be watched.
      • kind: Kind of the contract.
      • checkpoint: Turn checkpointing on (true | false).
      • starting-block: Starting block for the contract (default: 1).

      Examples:

      Watch a contract with its address and checkpointing on:

      yarn watch:contract --address 0x1F78641644feB8b64642e833cE4AFE93DD6e7833 --kind ERC721 --checkpoint true
      

      Watch a contract with its identifier and checkpointing on:

      yarn watch:contract --address MyProtocol --kind protocol --checkpoint true
      
    • To fill a block range:

      yarn fill --start-block <from-block> --end-block <to-block>
      
      • start-block: Block number to start filling from.
      • end-block: Block number till which to fill.
    • To create a checkpoint for a contract:

      yarn checkpoint --address <contract-address> --block-hash [block-hash]
      
      • address: Address or identifier of the contract for which to create a checkpoint.
      • block-hash: Hash of a block (in the pruned region) at which to create the checkpoint (default: latest canonical block hash).
    • To reset the watcher to a previous block number:

      • Reset state:

        yarn reset state --block-number <previous-block-number>
        
      • Reset job-queue:

        yarn reset job-queue --block-number <previous-block-number>
        
      • block-number: Block number to which to reset the watcher.

    • To export and import the watcher state:

      • In source watcher, export watcher state:

        yarn export-state --export-file [export-file-path]
        
        • export-file: Path of JSON file to which to export the watcher data.
      • In target watcher, run job-runner:

        yarn job-runner
        
      • Import watcher state:

        yarn import-state --import-file <import-file-path>
        
        • import-file: Path of JSON file from which to import the watcher data.
      • Run fill:

        yarn fill --start-block <snapshot-block> --end-block <to-block>
        
        • snapshot-block: Block number at which the watcher state was exported.
      • Run server:

        yarn server
        
    • To inspect a CID:

      yarn inspect-cid --cid <cid>
      
      • cid: CID to be inspected.