Server backend for indexed ETH IPLD objects
Go to file
2022-04-18 17:16:53 -04:00
.github/workflows Update on-pr.yaml 2022-04-18 17:16:53 -04:00
cmd Add env flag to load .env file. 2022-01-13 23:15:20 +05:30
documentation continue refactor/purge 2020-09-01 16:15:31 -05:00
environments explicity set whether to forward to proxy on errors, so that we can turn it off and test the direct forwarding 2021-12-30 01:45:53 -06:00
monitoring monitoring documentation, prometheus config, grafana dashboard 2020-10-21 15:38:48 +03:00
pkg explicity set whether to forward to proxy on errors, so that we can turn it off and test the direct forwarding 2021-12-30 01:45:53 -06:00
scripts explicity set whether to forward to proxy on errors, so that we can turn it off and test the direct forwarding 2021-12-30 01:45:53 -06:00
test dependabot security update 2022-01-26 11:15:01 -06:00
test_config Remove ipld-eth-indexer dependency. 2021-08-12 11:56:29 +05:30
version update version; bump to be in line with the ipld-eth-db schema version it is compatible with 2022-01-26 09:16:47 -06:00
.dockerignore Add container service files and docker README 2019-02-11 11:26:12 +01:00
.gitignore update deps/paths/names 2020-08-31 10:52:47 -05:00
chain.json integration tests: fix issue with eth_call (pass chain config via json file to match geth chain config) 2021-04-23 12:46:35 +03:00
docker-compose.test.yml integration test: run integration tests in GA 2021-04-19 14:43:21 +03:00
docker-compose.yml explicity set whether to forward to proxy on errors, so that we can turn it off and test the direct forwarding 2021-12-30 01:45:53 -06:00
Dockerfile Remove migration from dockerfile. 2021-10-13 12:18:31 +05:30
entrypoint.sh Remove migration from dockerfile. 2021-10-13 12:18:31 +05:30
go.mod update geth dep version 2022-01-26 09:18:59 -06:00
go.sum update geth dep version 2022-01-26 09:18:59 -06:00
LICENSE Edits to address PR issues; change license from apache to AGPL; and work 2018-11-15 12:32:52 -06:00
main.go watch => serve 2020-08-31 10:59:41 -05:00
Makefile update Makefile 2021-12-29 14:58:29 -06:00
README.md fix race conditions in tests, call contract service instead of hardcoded values 2021-04-19 23:07:38 +03:00

ipld-eth-server

Go Report Card

ipld-eth-server is the server backend for indexed ETH IPLD objects

Table of Contents

  1. Background
  2. Install
  3. Usage
  4. Contributing
  5. License

Background

NOTE: WIP

ipld-eth-server is used to service queries against the Ethereum IPLD objects indexed by ipld-eth-indexer.

It exposes standard Ethereum JSON RPC endpoints on top of the database, in some cases these endpoints can leverage the unique indexes to improve query performance. Additional, unique endpoints are exposed which utilize the new indexes and state diff data objects.

Dependencies

Minimal build dependencies

  • Go (1.13)
  • Git
  • GCC compiler
  • This repository

External dependency

Install

Start by downloading ipld-eth-server and moving into the repo:

GO111MODULE=off go get -d github.com/vulcanize/ipld-eth-server

cd $GOPATH/src/github.com/vulcanize/ipld-eth-server

Then, build the binary:

make build

Usage

After building the binary, run as

./ipld-eth-server serve --config=<the name of your config file.toml>

Configuration

Below is the set of parameters for the ipld-eth-server command, in .toml form, with the respective environmental variables commented to the side. The corresponding CLI flags can be found with the ./ipld-eth-server serve --help command.

[database]
    name     = "vulcanize_public" # $DATABASE_NAME
    hostname = "localhost" # $DATABASE_HOSTNAME
    port     = 5432 # $DATABASE_PORT
    user     = "postgres" # $DATABASE_USER
    password = "" # $DATABASE_PASSWORD

[log]
    level = "info" # $LOGRUS_LEVEL

[server]
    ipcPath = "~/.vulcanize/vulcanize.ipc" # $SERVER_IPC_PATH
    wsPath = "127.0.0.1:8081" # $SERVER_WS_PATH
    httpPath = "127.0.0.1:8082" # $SERVER_HTTP_PATH
    graphql = true # $SERVER_GRAPHQL
    graphqlEndpoint = "" # $SERVER_GRAPHQL_ENDPOINT

[ethereum]
    chainID = "1" # $ETH_CHAIN_ID
    defaultSender = "" # $ETH_DEFAULT_SENDER_ADDR
    rpcGasCap = "1000000000000" # $ETH_RPC_GAS_CAP
    httpPath = "127.0.0.1:8545" # $ETH_HTTP_PATH
    nodeID = "arch1" # $ETH_NODE_ID
    clientName = "Geth" # $ETH_CLIENT_NAME
    genesisBlock = "0xd4e56740f876aef8c010b86a40d5f56745a118d0906a34e69aec8c0db1cb8fa3" # $ETH_GENESIS_BLOCK
    networkID = "1" # $ETH_NETWORK_ID

The database fields are for connecting to a Postgres database that has been/is being populated by ipld-eth-indexer
The server fields set the paths for exposing the ipld-eth-server endpoints
The ethereum fields set the chainID and default sender address to use for EVM simulation, and can optionally be used to configure a remote eth node to forward cache misses to

Endpoints

IPLD subscription

TODO: Port the IPLD RPC subscription endpoints after the decoupling

Ethereum JSON-RPC

ipld-eth-server currently recapitulates portions of the Ethereum JSON-RPC api standard.

The currently supported standard endpoints are:
eth_call
eth_getBalance
eth_getStorageAt
eth_getCode
eth_getProof
eth_blockNumber
eth_getHeaderByNumber
eth_getHeaderByHash
eth_getBlockByNumber
eth_getBlockByHash
eth_getTransactionCount
eth_getBlockTransactionCountByHash
eth_getBlockTransactionCountByNumber
eth_getTransactionByHash
eth_getRawTransactionByHash
eth_getTransactionByBlockHashAndIndex
eth_getTransactionByBlockNumberAndIndex
eth_getRawTransactionByBlockHashAndIndex
eth_getRawTransactionByBlockNumberAndIndex
eth_getTransactionReceipt
eth_getLogs
eth_getUncleCountByBlockHash
eth_getUncleCountByBlockNumber
eth_getUncleByBlockHashAndIndex
eth_getUncleByBlockNumberAndIndex

TODO: Add the rest of the standard endpoints and unique endpoints (e.g. getSlice)

CLI Options and Environment variables

CLI Option Environment Variable Default Value Comment
database-hostname DATABASE_HOSTNAME localhost IPLD database host
database-port DATABASE_PORT 5432 IPLD database port
database-name DATABASE_NAME vulcanize_public IPLD database name
database-user DATABASE_USER IPLD database user
database-password DATABASE_PASSWORD IPLD database password
eth-server-graphql ETH_SERVER_GRAPHQL false If true enable Eth GraphQL Server
eth-server-graphql-path ETH_SERVER_GRAPHQLPATH If eth-server-graphql set to true, endpoint url for graphql server (host:port)
eth-server-http ETH_SERVER_HTTP true If true enable Eth HTTP JSON-RPC Server
eth-server-http-path ETH_SERVER_HTTPPATH If eth-server-http set to true, endpoint url for Eth HTTP JSON-RPC server (host:port)
eth-server-ws ETH_SERVER_WS false If true enable Eth WS JSON-RPC Server
eth-server-ws-path ETH_SERVER_WSPATH If eth-server-ws set to true, endpoint url for Eth WS JSON-RPC server (host:port)
eth-server-ipc ETH_SERVER_IPC false If true enable Eth IPC JSON-RPC Server
eth-server-ipc-path ETH_SERVER_IPC_PATH If eth-server-ws set to true, path for Eth IPC JSON-RPC server
ipld-server-graphql IPLD_SERVER_GRAPHQL false If true enable IPLD GraphQL Server
ipld-server-graphql-path IPLD_SERVER_GRAPHQLPATH If ipld-server-graphql set to true, endpoint url for graphql server (host:port)
ipld-postgraphile-path IPLD_POSTGRAPHILEPATH If ipld-server-graphql set to true, http url for postgraphile server on top of IPLD db
tracing-http-path TRACING_HTTPPATH If ipld-server-graphql set to true, http url for tracing server
tracing-postgraphile-path TRACING.POSTGRAPHILEPATH If ipld-server-graphql set to true, http url for postgraphile server on top of tracing db

Testing

make test will run the unit tests
make test setups a clean vulcanize_testing db

Monitoring

  • Enable http server and metrics using parameters --http --metrics
  • ipld-eth-server exposes prometheus metrics at /metric endpoint
  • start prometheus using monitoring/prometheus.yml config (prometheus --config.file=monitoring/prometheus.yml)
  • start grafana, connect to prometheus datasource and import dashboard from monitoring/grafana/dashboard_main.json

Contributing

Contributions are welcome!

VulcanizeDB follows the Contributor Covenant Code of Conduct.

License

AGPL-3.0 © Vulcanize Inc