cerc-io/lotus-stack
11
0
Fork 0
Code Issues 1 Pull Requests Actions Packages Projects Releases Wiki Activity

Implement stack to run lotus-node (mainnet and calibration) #1

Merged
dboreham merged 10 commits from ng-create-stack into main 2024-05-31 16:22:03 +00:00
Conversation 4 Commits 10 Files Changed 7
+380 -1
nabarun commented 2024-05-23 09:53:05 +00:00
Collaborator
Copy Link
Copy Source

Part of Create stack for lotus mainnet and calibration

Part of [Create stack for lotus mainnet and calibration](https://www.notion.so/Create-stack-for-lotus-mainnet-and-calibration-700b4903f2004a4fb440ebb6922da954) - This PR is based on stack [mainnet-lotus](https://git.vdb.to/cerc-io/stack-orchestrator/src/branch/lotus-stack/stack_orchestrator/data/stacks/mainnet-lotus) in SO branch [lotus-stack](https://git.vdb.to/cerc-io/stack-orchestrator/src/branch/lotus-stack) - Use manually downloaded snapshot for running Lotus node with `DOCKER_LOTUS_IMPORT_SNAPSHOT` env - Support running Lotus node for Calibration network - Use `cerc-io/lotus` release [v1.27.0-rc3-interal-0.0.1](https://git.vdb.to/cerc-io/lotus/releases/tag/v1.27.0-rc3-interal-0.0.1) - Add Lotus node config params with default values - `LOTUS_FEVM_ENABLEETHRPC`: true - [Enables eth_rpc](https://git.vdb.to/cerc-io/lotus/src/tag/v1.27.0-rc3-interal-0.0.1/documentation/en/default-lotus-config.toml#L248) - `LOTUS_EVENTS_ENABLEACTOREVENTSAPI`: true - [Enables the Actor events API that enables clients to consume events](https://git.vdb.to/cerc-io/lotus/src/tag/v1.27.0-rc3-interal-0.0.1/documentation/en/default-lotus-config.toml#L279) - `LOTUS_INDEX_ENABLEMSGINDEX`: true - [Enables indexing of messages on chain](https://git.vdb.to/cerc-io/lotus/src/tag/v1.27.0-rc3-interal-0.0.1/documentation/en/default-lotus-config.toml#L325) - Should be the fix for incorrect `eth_call` behaviour - `LOTUS_CHAINSTORE_ENABLESPLITSTORE`: true - [Enable the splitstore](https://git.vdb.to/cerc-io/lotus/src/tag/v1.27.0-rc3-interal-0.0.1/blockstore/splitstore#splitstore-an-actively-scalable-blockstore-for-the-filecoin-chain) - `LOTUS_FEVM_ETHTXHASHMAPPINGLIFETIMEDAYS`: 0 - [Delete mappings that have been stored for more than x day in transaction hash lookup database](https://git.vdb.to/cerc-io/lotus/src/tag/v1.27.0-rc3-interal-0.0.1/documentation/en/default-lotus-config.toml#L255) - LOTUS_FVM_CONCURRENCY: 4 - [Adjust the amount of threads used for more concurrent FMV execution](https://git.vdb.to/cerc-io/lotus/src/tag/v1.27.0-rc3-interal-0.0.1/CHANGELOG.md?display=source#L1179) - LOTUS_SKIP_APPLY_TS_MESSAGE_CALL_WITH_GAS: 0 - [If node is a Storage Provider and is pushing many messages within a short period of time, then set to 1](https://git.vdb.to/cerc-io/lotus/src/tag/v1.27.0-rc3-interal-0.0.1/CHANGELOG.md?display=source#L1179) - Some config params that were set previously but no longer used in release [v1.27.0-rc3-interal-0.0.1](https://git.vdb.to/cerc-io/lotus/releases/tag/v1.27.0-rc3-interal-0.0.1) - `LOTUS_FEVM_EVENTS_MAXFILTERHEIGHTRANGE` - `LOTUS_FEVM_EVENTS_FILTERTTL` - `ALLOWED_DELAY` - `LOTUS_FEVM_ENABLEETHHASHTOFILECOINCIDMAPPING`
nabarun added 4 commits 2024-05-23 09:53:06 +00:00
Create stack for snap synced node 701faa3ee9
Enable ETH_RPC and add health check 1f85ad09ac
Remove option for using existing snapshot 0177fff7d6
Add steps to check lotus node status 4ed4491e00
nabarun force-pushed ng-create-stack from 4ed4491e00 to 092c19c337 2024-05-23 11:50:32 +00:00 Compare
nabarun marked the pull request as work in progress 2024-05-23 12:22:05 +00:00
nabarun added 1 commit 2024-05-23 12:33:22 +00:00
Update readme a0b893a0ad
nabarun force-pushed ng-create-stack from a0b893a0ad to e75c36ab1d 2024-05-23 12:34:27 +00:00 Compare
nabarun added 4 commits 2024-05-24 09:25:15 +00:00
Add support for running node in calibration network 78b0a695cc
Update Dockerfile for new release aaa2fd29f2
Update Dockerfile for calibnet 1bf133173d
Add node config params 2309c26aea
nabarun self-assigned this 2024-05-24 09:44:30 +00:00
nabarun removed their assignment 2024-05-24 09:44:40 +00:00
nabarun self-assigned this 2024-05-24 09:45:00 +00:00
nabarun changed title from [WIP] Implement stack to run mainnet lotus-node to [WIP] Implement stack to run lotus-node (mainnet and calibration) 2024-05-24 09:45:48 +00:00
nabarun added 1 commit 2024-05-28 05:34:22 +00:00
Update readme for env variables c90c77c83e
nabarun marked the pull request as ready for review 2024-05-28 05:38:00 +00:00
ashwin requested review from srw 2024-05-28 05:38:57 +00:00
ashwin requested review from dboreham 2024-05-28 05:38:57 +00:00
ashwin requested review from jonathanface 2024-05-28 05:38:58 +00:00
ashwin requested review from ashwin 2024-05-28 05:39:12 +00:00
ashwin approved these changes 2024-05-28 05:39:31 +00:00
dboreham approved these changes 2024-05-28 12:05:56 +00:00
Dismissed
stack-orchestrator/container-build/cerc-lotus-node/Dockerfile Outdated
@@ -0,0 +1,156 @@
#####################################
dboreham commented 2024-05-28 11:44:30 +00:00
Contributor
Copy Link
Copy Source

Consider adding a comment that this file is a copy of the Dockerfile in the lotus repo with some local changes (also consider commenting the changes for ease of future manual merging upstream changes).

Consider adding a comment that this file is a copy of the Dockerfile in the lotus repo with some local changes (also consider commenting the changes for ease of future manual merging upstream changes).
nabarun marked this conversation as resolved
stack-orchestrator/container-build/cerc-lotus-node/build.sh
@@ -0,0 +3,4 @@
source ${CERC_CONTAINER_BASE_DIR}/build-base.sh
SCRIPT_DIR=$( cd -- "$( dirname -- "${BASH_SOURCE[0]}" )" &> /dev/null && pwd )
git stash
dboreham commented 2024-05-28 11:49:07 +00:00
Contributor
Copy Link
Copy Source

Should this be here?

Should this be here?
nabarun marked this conversation as resolved
stack-orchestrator/stacks/lotus-node/README.md Outdated
@@ -0,0 +49,4 @@
## Setup config
Inside deployment directory, open the `config.env` file and set following env variables:
dboreham commented 2024-05-28 12:04:45 +00:00
Contributor
Copy Link
Copy Source

Note that simple environment values can be specified on the deploy init command line like:

$ laconic-so --stack $(pwd)/stack-orchestrator/stacks/lotus-node deploy init --map-ports-to-host any-same --output lotus-node.yml --config CERC_LOTUS_NETWORK=mainnet,CERC_LOTUS_SNAPSHOT_PATH=/path-to-file/mainnet-snapshot.car.zst
$ more lotus-node.yml
stack: /home/david/projects/cerc/lotus-stack/stack-orchestrator/stacks/lotus-node
deploy-to: compose
config:
  CERC_LOTUS_NETWORK: mainnet
  CERC_LOTUS_SNAPSHOT_PATH: /path-to-file/mainnet-snapshot.car.zst
network:
  ports:
    lotus:
     - 0.0.0.0:1234:1234
     - 0.0.0.0:1235:1235
volumes:
  parameters: ./data/parameters
  lotus-repo: ./data/lotus-repo
  lotus_shared: ./data/lotus_shared
Note that simple environment values can be specified on the `deploy init` command line like: ``` $ laconic-so --stack $(pwd)/stack-orchestrator/stacks/lotus-node deploy init --map-ports-to-host any-same --output lotus-node.yml --config CERC_LOTUS_NETWORK=mainnet,CERC_LOTUS_SNAPSHOT_PATH=/path-to-file/mainnet-snapshot.car.zst $ more lotus-node.yml stack: /home/david/projects/cerc/lotus-stack/stack-orchestrator/stacks/lotus-node deploy-to: compose config: CERC_LOTUS_NETWORK: mainnet CERC_LOTUS_SNAPSHOT_PATH: /path-to-file/mainnet-snapshot.car.zst network: ports: lotus: - 0.0.0.0:1234:1234 - 0.0.0.0:1235:1235 volumes: parameters: ./data/parameters lotus-repo: ./data/lotus-repo lotus_shared: ./data/lotus_shared ```
nabarun marked this conversation as resolved
stack-orchestrator/stacks/lotus-node/stack.yml Outdated
@@ -0,0 +2,4 @@
name: lotus-node
description: "Lotus node stack"
repos:
- git.vdb.to/cerc-io/lotus@v1.27.0-rc3-interal-0.0.1
dboreham commented 2024-05-28 11:38:18 +00:00
Contributor
Copy Link
Copy Source

Consider not pinning the branch here. You can specify on the SO command line like:

laconic-so --stack $(pwd)/stack-orchestrator/stacks/lotus-node setup-repositories --branches git.vdb.to/cerc-io/lotus@v1.27.0-rc3-interal-0.0.1
Dev Root is: /home/david/cerc
Checking: /home/david/cerc/lotus: Needs to be fetched
100%|####################################################################################################################################################| 113k/113k [01:15<00:00, 1.49kB/s]
Checking
switching to branch v1.27.0-rc3-interal-0.0.1 in repo cerc-io/lotus
Consider not pinning the branch here. You can specify on the SO command line like: ``` laconic-so --stack $(pwd)/stack-orchestrator/stacks/lotus-node setup-repositories --branches git.vdb.to/cerc-io/lotus@v1.27.0-rc3-interal-0.0.1 Dev Root is: /home/david/cerc Checking: /home/david/cerc/lotus: Needs to be fetched 100%|####################################################################################################################################################| 113k/113k [01:15<00:00, 1.49kB/s] Checking switching to branch v1.27.0-rc3-interal-0.0.1 in repo cerc-io/lotus ```
nabarun marked this conversation as resolved
nabarun added 1 commit 2024-05-28 13:07:04 +00:00
Remove git stash from Dockerfile 91a4535743
dboreham approved these changes 2024-05-31 16:21:21 +00:00
dboreham commented 2024-05-31 16:21:54 +00:00
Contributor
Copy Link
Copy Source

Going to merge this one since it's the weekend and it would be nice to start using/enhancing it..

Going to merge this one since it's the weekend and it would be nice to start using/enhancing it..
dboreham merged commit 041c52a7cc into main 2024-05-31 16:22:03 +00:00
ashwin deleted branch ng-create-stack 2024-06-06 05:07:03 +00:00
Sign in to join this conversation.
Reviewers
No Reviewers
srw
jonathanface
ashwin
dboreham
Labels
Clear labels
Copied from Github
An issue or PR manually copied from GitHub.
 Kind/Breaking
Breaking change that won't be backward compatible
 Kind/Bug
Something is not working
 Kind/Documentation
Documentation changes
 Kind/Enhancement
Improve existing functionality
 Kind/Feature
New functionality
 Kind/Security
This is security issue
 Kind/Testing
Issue or pull request related to testing
Priority
Critical
The priority is critical
Priority
High
The priority is high
Priority
Low
The priority is low
Priority
Medium
The priority is medium
Reviewed
Confirmed
Issue has been confirmed
Reviewed
Duplicate
This issue or pull request already exists
Reviewed
Invalid
Invalid issue
Reviewed
Won't Fix
This issue won't be fixed
Status
Abandoned
Somebody has started to work on this but abandoned work
Status
Blocked
Something is blocking this issue or pull request
Status
Need More Info
Feedback is required to reproduce issue or to continue work
No labels
Milestone
No items
No Milestone
Projects
Clear projects
No projects
Assignees
Clear assignees
AFDudley (A. F. Dudley) Alex cerccicd ericlewis i-norden (Ian Norden) rachmaninovquar rjk-laconic roysc (Roy Crihfield) srw (srw) zramsay
No Assignees nabarun
3 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: cerc-io/lotus-stack#1