watcher-ts/packages/codegen
2023-11-14 15:01:52 +05:30
..
scripts Add script to set package versions in codegen (#270) 2022-11-29 14:52:39 +05:30
src Upgrade package versions before release (#469) 2023-11-14 15:01:52 +05:30
.eslintignore CLI to flatten and generate GQL schema from Solidity file (#245) 2021-09-16 17:06:10 +05:30
.eslintrc.json Upgrade dependency versions to remove vulnerabilities from dependabot (#343) 2023-03-28 13:17:53 +05:30
non-subgraph-demo.md Add demo for graph-test-watcher (#267) 2022-11-28 16:35:19 +05:30
package.json Upgrade package versions before release (#469) 2023-11-14 15:01:52 +05:30
README.md Update codegen reamde for subgraph build using cerc-io dependencies (#434) 2023-10-23 12:21:38 +05:30
subgraph-demo.md Use block number for eth_call in rpc-eth-client (#435) 2023-10-25 11:04:12 +05:30
tsconfig.json Generating eth_call based lazy watcher (#249) 2021-09-23 16:55:46 +05:30

Code Generator

Setup

  • In root of the repository:

    • Install required packages:

      yarn
      
    • Build files:

      yarn build
      

Run

Follow the steps below or follow the demos:

Steps:

  • Create a .yaml config file in the following format for generating a watcher:

    # Example config.yaml
    # Contracts to watch (required).
    # Can pass empty array ([]) when using subgraphPath.
    contracts:
        # Contract name.
      - name: Example
        # Contract file path or an url.
        path: ../graph-node/test/contracts/Example.sol
        # Contract kind (should match name of dataSource in {subgraphPath}/subgraph.yaml if subgraphPath provided)
        kind: Example1
    
    # Output folder path (logs output using `stdout` if not provided).
    outputFolder: ../test-watcher
    
    # Code generation mode [eth_call | storage | all | none] (default: none).
    mode: none
    
    # Kind of watcher [lazy | active] (default: active).
    kind: active
    
    # Watcher server port (default: 3008).
    port: 3008
    
    # Solc version to use (optional)
    # Use longVersion prefixed with v from the release list https://binaries.soliditylang.org/bin/list.json
    # If not defined, uses solc version listed in dependencies
    solc: v0.8.0+commit.c7dfd78e
    
    # Flatten the input contract file(s) [true | false] (default: true).
    flatten: true
    
    # Path to the subgraph build (optional).
    # Can set empty contracts array when using subgraphPath.
    # Subgraph WASM files should be compiled using @cerc-io/graph-cli
    # graph-cli and graph-ts dependencies in the target subgraph repo can be replaced with forked cerc-io packages
    subgraphPath: ../graph-node/test/subgraph/example1/build
    
    # NOTE: When passed an *URL* as contract path, it is assumed that it points to an already flattened contract file.
    
  • Ensure dependencies are installed in the contracts repository before generating the watcher

  • Run the following command to generate a watcher from contract(s):

    yarn codegen --config-file <config-file-path>
    
    • config-file(alias: c): Watcher generation config file path (yaml) (required).

    • continue-on-error (alias: e): To continue generation if any unhandled data type is encountered (optional).

    Example:

    • Generate code using a config file config.yaml:

      yarn codegen --config-file ./config.yaml
      
    • Generate code ignoring any unhandled data types:

      yarn codegen --config-file ./config.yaml --continue-on-error
      

    This will create a folder containing the generated code at the path provided in config. Follow the steps in Run Generated Watcher to setup and run the generated watcher.

Development

  • lint

    Command to check lint issues in files

    yarn lint
    

    To fix lint issue

    yarn lint --fix
    
  • version:set

    Command to set cerc-io package versions in package.json template

    yarn version:set <VERSION>
    

    Example

    yarn version:set 0.2.17
    

Run Generated Watcher

Setup

  • Run the following command to install required packages:

    yarn
    
  • In the config file (environments/local.toml):

    • Update the state checkpoint settings.
  • Create the databases configured in environments/local.toml.

Customize

  • Indexing on an event:

    • Edit the custom hook function handleEvent (triggered on an event) in src/hooks.ts to perform corresponding indexing using the Indexer object.

    • While using the indexer storage methods for indexing, pass diff as true if default state is desired to be generated using the state variables being indexed.

  • Generating state:

    • Edit the custom hook function createInitialState (triggered if the watcher passes the start block, checkpoint: true) in src/hooks.ts to save an initial State using the Indexer object.

    • Edit the custom hook function createStateDiff (triggered on a block) in src/hooks.ts to save the state in a diff State using the Indexer object. The default state (if exists) is updated.

    • Edit the custom hook function createStateCheckpoint (triggered just before default and CLI checkpoint) in src/hooks.ts to save the state in a checkpoint State using the Indexer object.

Run

  • Run lint:

    yarn lint
    
  • Run the watcher:

    yarn server
    
  • If the watcher is an active watcher:

    • Run the job-runner:

      yarn job-runner
      
    • To watch a contract:

      yarn watch:contract --address <contract-address> --kind <contract-kind> --checkpoint <true | false> --starting-block [block-number]
      
    • To fill a block range:

      yarn fill --start-block <from-block> --end-block <to-block>
      
    • To create a checkpoint for a contract:

      yarn checkpoint --address <contract-address> --block-hash [block-hash]
      
    • To reset the watcher to a previous block number:

      • Reset state:

        yarn reset state --block-number <previous-block-number>
        
      • Reset job-queue:

        yarn reset job-queue
        
    • To export the watcher state:

      yarn export-state --export-file [export-file-path]
      
    • To import the watcher state:

      yarn import-state --import-file <import-file-path>
      
    • To inspect a CID:

      yarn inspect-cid --cid <cid>
      

Known Issues

  • Currently, node-fetch v2.6.2 is being used to fetch from URLs as v3.0.0 is an ESM-only module and ts-node transpiles to import it using require.