cosmos-sdk/systemtests
Julien Robert ca48cef255
build(deps): bump cometbft to v1.0.0-rc2 (#22577)
Co-authored-by: marbar3778 <marbar3778@yahoo.com>
2024-11-28 11:33:27 +00:00
..
CHANGELOG.md build(deps): bump cometbft to v1.0.0-rc2 (#22577) 2024-11-28 11:33:27 +00:00
cli.go build(deps): bump cometbft to v1.0.0-rc2 (#22577) 2024-11-28 11:33:27 +00:00
genesis_io.go refactor(systemtests): Extract system test framework (#22578) 2024-11-26 14:46:54 +00:00
getting_started.md refactor(systemtests): Extract system test framework (#22578) 2024-11-26 14:46:54 +00:00
go.mod chore: prepare systemtests release (#22658) 2024-11-27 06:32:59 +00:00
go.sum refactor(systemtests): Extract system test framework (#22578) 2024-11-26 14:46:54 +00:00
io_utils.go refactor(systemtests): Extract system test framework (#22578) 2024-11-26 14:46:54 +00:00
node_utils.go refactor(systemtests): Extract system test framework (#22578) 2024-11-26 14:46:54 +00:00
README.md refactor(systemtests): Extract system test framework (#22578) 2024-11-26 14:46:54 +00:00
rest_support.go refactor(systemtests): Extract system test framework (#22578) 2024-11-26 14:46:54 +00:00
rpc_client.go refactor(systemtests): Extract system test framework (#22578) 2024-11-26 14:46:54 +00:00
system.go refactor(systemtests): Extract system test framework (#22578) 2024-11-26 14:46:54 +00:00
test_runner.go refactor(systemtests): Extract system test framework (#22578) 2024-11-26 14:46:54 +00:00
testnet_init.go refactor(systemtests): Extract system test framework (#22578) 2024-11-26 14:46:54 +00:00

System Tests

This package contains the testing framework for black-box system tests. It includes a test runner that sets up a multi-node blockchain locally for use in tests. The framework provides utilities and helpers for easy access and setup in tests.

Components

  • CLI: Command-line interface wrapper for interacting with the chain or keyring
  • Servers: Server instances to run the blockchain environment.
  • Events: Event listeners
  • RPC: Remote Procedure Call setup for communication.

Dependencies

  • testify: Testing toolkit.
  • gjson: JSON parser.
  • sjson: JSON modifier.

Server and client-side operations are executed on the host machine.

Developer

Test strategy

System tests cover the full stack via cli and a running (multi node) network. They are more expensive (in terms of time/ cpu) to run compared to unit or integration tests. Therefore, we focus on the critical path and do not cover every condition.

How to use

Read the getting_started.md guide to get started.

Execute a single test

go test -tags system_test -count=1 -v . --run TestStakeUnstake  -verbose

Test cli parameters

  • -verbose verbose output
  • -wait-time duration - time to wait for chain events (default 30s)
  • -nodes-count int - number of nodes in the cluster (default 4)

Port ranges

With n nodes:

  • 26657 - 26657+n - RPC
  • 1317 - 1317+n - API
  • 9090 - 9090+n - GRPC
  • 16656 - 16656+n - P2P

For example Node 3 listens on 26660 for RPC calls

Resources

Disclaimer

This is based on the system test framework in wasmd built by Confio.