Ethereum consensus client in Rust
Go to file
Michael Sproul 01556f6f01 Optimise payload attributes calculation and add SSE ()
## Issue Addressed

Closes 
Closes 
Closes 

## Proposed Changes

- Optimise the calculation of withdrawals for payload attributes by avoiding state clones, avoiding unnecessary state advances and reading from the snapshot cache if possible.
- Use the execution layer's payload attributes cache to avoid re-calculating payload attributes. I actually implemented a new LRU cache just for withdrawals but it had the exact same key and most of the same data as the existing payload attributes cache, so I deleted it.
- Add a new SSE event that fires when payloadAttributes are calculated. This is useful for block builders, a la https://github.com/ethereum/beacon-APIs/issues/244.
- Add a new CLI flag `--always-prepare-payload` which forces payload attributes to be sent with every fcU regardless of connected proposers. This is intended for use by builders/relays.

For maximum effect, the flags I've been using to run Lighthouse in "payload builder mode" are:

```
--always-prepare-payload \
--prepare-payload-lookahead 12000 \
--suggested-fee-recipient 0x0000000000000000000000000000000000000000
```

The fee recipient is required so Lighthouse has something to pack in the payload attributes (it can be ignored by the builder). The lookahead causes fcU to be sent at the start of every slot rather than at 8s. As usual, fcU will also be sent after each change of head block. I think this combination is sufficient for builders to build on all viable heads. Often there will be two fcU (and two payload attributes) sent for the same slot: one sent at the start of the slot with the head from `n - 1` as the parent, and one sent after the block arrives with `n` as the parent.

Example usage of the new event stream:

```bash
curl -N "http://localhost:5052/eth/v1/events?topics=payload_attributes"
```

## Additional Info

- [x] Tests added by updating the proposer re-org tests. This has the benefit of testing the proposer re-org code paths with withdrawals too, confirming that the new changes don't interact poorly.
- [ ] Benchmarking with `blockdreamer` on devnet-7 showed promising results but I'm yet to do a comparison to `unstable`.


Co-authored-by: Michael Sproul <micsproul@gmail.com>
2023-03-05 23:43:30 +00:00
.cargo Switch allocator to jemalloc () 2023-01-20 04:19:29 +00:00
.github Merge branch 'capella' into unstable 2023-02-22 10:25:45 +11:00
account_manager Clippy lints for rust 1.66 () 2022-12-16 04:04:00 +00:00
beacon_node Optimise payload attributes calculation and add SSE () 2023-03-05 23:43:30 +00:00
book Delete Kiln and Ropsten configs () 2023-03-01 06:16:14 +00:00
boot_node v3.5.0 () 2023-02-22 06:00:49 +00:00
common Optimise payload attributes calculation and add SSE () 2023-03-05 23:43:30 +00:00
consensus Clean capella () 2023-03-01 03:19:02 +00:00
crypto Verify execution block hashes during finalized sync () 2023-01-09 03:11:59 +00:00
database_manager Super small improvement: Remove unnecessary mut () 2022-11-21 03:15:54 +00:00
lcli Clean capella () 2023-03-01 03:19:02 +00:00
lighthouse Optimise payload attributes calculation and add SSE () 2023-03-05 23:43:30 +00:00
scripts Fix doppelganger script () 2023-02-21 23:45:43 +00:00
slasher Allow compilation with no slasher backend () 2023-02-28 02:20:49 +00:00
testing Permit a null LVH from an INVALID response to newPayload () 2023-03-03 04:12:50 +00:00
validator_client Add latency measurement service to VC () 2023-03-05 23:43:29 +00:00
.dockerignore Exclude EE build dirs from Docker context () 2022-05-09 23:43:31 +00:00
.editorconfig Add editorconfig template 2019-03-11 15:09:57 +11:00
.gitignore Docs for Siren () 2023-02-28 02:20:52 +00:00
.gitmodules Replace EF tests submodule with a makefile 2019-09-08 04:19:54 +10:00
bors.toml Switch allocator to jemalloc () 2023-01-20 04:19:29 +00:00
Cargo.lock Clean capella () 2023-03-01 03:19:02 +00:00
Cargo.toml Merge remote-tracking branch 'origin/unstable' into capella-merge 2023-02-14 12:07:27 +11:00
CONTRIBUTING.md Book spelling and grammar corrections () 2022-10-28 03:23:50 +00:00
Cross.toml Ensure protoc is installed for release CI () 2022-10-03 23:09:25 +00:00
Dockerfile Fixed Clippy Complaints & Some Failing Tests () 2022-12-13 10:50:24 -06:00
Dockerfile.cross Use a stable tag for ubuntu in dockerfile () 2022-05-31 06:09:12 +00:00
LICENSE Update License to Apache 2.0 2019-04-15 16:47:35 +10:00
Makefile Allow compilation with no slasher backend () 2023-02-28 02:20:49 +00:00
README.md Fix some dead links in markdown files () 2023-01-17 05:13:49 +00:00
SECURITY.md Add how users should report security vulnerabilities for this repository () 2021-09-07 01:54:05 +00:00

Lighthouse: Ethereum consensus client

An open-source Ethereum consensus client, written in Rust and maintained by Sigma Prime.

Book Status Chat Badge

Documentation

Banner

Overview

Lighthouse is:

  • Ready for use on Ethereum consensus mainnet.
  • Fully open-source, licensed under Apache 2.0.
  • Security-focused. Fuzzing techniques have been continuously applied and several external security reviews have been performed.
  • Built in Rust, a modern language providing unique safety guarantees and excellent performance (comparable to C++).
  • Funded by various organisations, including Sigma Prime, the Ethereum Foundation, ConsenSys, the Decentralization Foundation and private individuals.
  • Actively involved in the specification and security analysis of the Ethereum proof-of-stake consensus specification.

Staking Deposit Contract

The Lighthouse team acknowledges 0x00000000219ab540356cBB839Cbe05303d7705Fa as the canonical staking deposit contract address.

Documentation

The Lighthouse Book contains information for users and developers.

The Lighthouse team maintains a blog at lighthouse-blog.sigmaprime.io which contains periodical progress updates, roadmap insights and interesting findings.

Branches

Lighthouse maintains two permanent branches:

  • stable: Always points to the latest stable release.
    • This is ideal for most users.
  • unstable: Used for development, contains the latest PRs.
    • Developers should base their PRs on this branch.

Contributing

Lighthouse welcomes contributors.

If you are looking to contribute, please head to the Contributing section of the Lighthouse book.

Contact

The best place for discussion is the Lighthouse Discord server.

Sign up to the Lighthouse Development Updates mailing list for email notifications about releases, network status and other important information.

Encrypt sensitive messages using our PGP key.

Donations

Lighthouse is an open-source project and a public good. Funding public goods is hard and we're grateful for the donations we receive from the community via:

  • Gitcoin Grants.
  • Ethereum address: 0x25c4a76E7d118705e7Ea2e9b7d8C59930d8aCD3b (donation.sigmaprime.eth).