realbigsean
9d24844f50
Lookup log improvements ( #5491 )
...
* log improvements
2024-03-27 13:24:04 +00:00
realbigsean
334aa2eabd
Single lookup improvements ( #5488 )
...
* Fix unexpected `UnrequestedBlobId` and `ExtraBlocksReturned` errors due to race conditions.
* Continue chain segment processing and skip any blocks that are already known, rather than returning an error.
* more de-dup checking
* ensure we don't reset `requested_ids` during rpc download
* better fix
* Merge branch 'unstable' of https://github.com/sigp/lighthouse into more-dup-lookup-fixes
* remove chain hash check
* Merge branch 'fix-block-lookup-race' of https://github.com/jimmygchen/lighthouse into sean-test-lookups
* remove block check
* add back tests
* Log and CI fixes
* undue extra check
* Merge branch 'sean-test-lookups' of https://github.com/realbigsean/lighthouse into sean-test-lookups
* log improvements
* Improve logging
2024-03-27 10:01:27 +00:00
Michael Sproul
250a5bdc27
Run fork choice after RPC blob import ( #5475 )
...
* Run fork choice after RPC blob import
2024-03-26 21:36:08 +00:00
João Oliveira
59ef564b1d
Move gossipsub into a separate crate ( #5401 )
...
* move gossipsub into a separate crate
* Merge branch 'unstable' of github.com:sigp/lighthouse into separate-gossipsub
* address review 2
* clippy beta
* update logging to log gossipsub logs
2024-03-26 03:10:59 +00:00
Akihito Nakano
8cec8a6793
Fix double counted metrics ( #5476 )
...
* Fix double counted metrics
2024-03-26 03:10:26 +00:00
Eitan Seri-Levi
e4d4e439cb
Add Capella & Deneb light client support ( #4946 )
...
* rebase and add comment
* conditional test
* test
* optimistic chould be working now
* finality should be working now
* try again
* try again
* clippy fix
* add lc bootstrap beacon api
* add lc optimistic/finality update to events
* fmt
* That error isn't occuring on my computer but I think this should fix it
* Merge branch 'unstable' into light_client_beacon_api_1
# Conflicts:
# beacon_node/beacon_chain/src/events.rs
# beacon_node/http_api/src/lib.rs
# beacon_node/http_api/src/test_utils.rs
# beacon_node/http_api/tests/main.rs
# beacon_node/lighthouse_network/src/rpc/codec/ssz_snappy.rs
# beacon_node/lighthouse_network/src/rpc/methods.rs
# beacon_node/lighthouse_network/src/service/api_types.rs
# beacon_node/network/src/beacon_processor/worker/rpc_methods.rs
# beacon_node/tests/test.rs
# common/eth2/src/types.rs
# lighthouse/src/main.rs
* Add missing test file
* Update light client types to comply with Altair light client spec.
* Fix test compilation
* Merge branch 'unstable' into light_client_beacon_api_1
* Support deserializing light client structures for the Bellatrix fork
* Move `get_light_client_bootstrap` logic to `BeaconChain`. `LightClientBootstrap` API to return `ForkVersionedResponse`.
* Misc fixes.
- log cleanup
- move http_api config mutation to `config::get_config` for consistency
- fix light client API responses
* Add light client bootstrap API test and fix existing ones.
* Merge branch 'unstable' into light_client_beacon_api_1
* Fix test for `light-client-server` http api config.
* Appease clippy
* Add Altair light client SSZ tests
* Merge branch 'unstable' of https://github.com/sigp/lighthouse into light_client_beacon_api_1
* updates to light client header
* light client header from signed beacon block
* using options
* implement helper functions
* placeholder conversion from vec hash256 to exec branch
* add deneb
* using fixed vector
* remove unwraps
* by epoch
* compute merkle proof
* merkle proof
* update comments
* resolve merge conflicts
* linting
* Merge branch 'unstable' into light-client-ssz-tests
# Conflicts:
# beacon_node/beacon_chain/src/beacon_chain.rs
# consensus/types/src/light_client_bootstrap.rs
# consensus/types/src/light_client_header.rs
* superstruct attempt
* superstruct changes
* lint
* altair
* update
* update
* changes to light_client_optimistic_ and finality
* merge unstable
* refactor
* resolved merge conflicts
* Merge branch 'unstable' of https://github.com/sigp/lighthouse into capella_deneb_light_client_types
* block_to_light_client_header fork aware
* fmt
* comment fix
* comment fix
* include merge fork, update deserialize_by_fork, refactor
* fmt
* pass by ref to prevent clone
* rename merkle proof fn
* add FIXME
* LightClientHeader TestRandom
* fix comments
* fork version deserialize
* merge unstable
* move fn arguments, fork name calc
* use task executor
* remove unneeded fns
* remove dead code
* add manual ssz decoding/encoding and add ssz_tests_by_fork macro
* merge deneb types with tests
* merge ssz tests, revert code deletion, cleanup
* move chainspec
* update ssz tests
* fmt
* light client ssz tests
* change to superstruct
* changes from feedback
* linting
* Merge branch 'unstable' of https://github.com/sigp/lighthouse into capella_deneb_light_client_types
* test fix
* cleanup
* Remove unused `derive`.
* Merge branch 'unstable' of https://github.com/sigp/lighthouse into capella_deneb_light_client_types
* beta compiler fix
* merge
2024-03-25 11:01:56 +00:00
chonghe
19b0db2cdf
Delete PRE_CAPELLA_ENGINE_CAPABILITIES ( #5406 )
...
* Adjust width
* Commit changes
* Delete PRE_CAPELLA_ENGINE_CAPABILITIES
* Revert "Adjust width"
This reverts commit 6fea81b897ce4a346c90902f1c95190875afc2d9.
* Revert "Commit changes"
This reverts commit d00859a63e526c791e0fec25acdaa2557da2fb95.
* Simplify
* Merge branch 'delete-pre-capella' of https://github.com/chong-he/lighthouse into delete-pre-capella
2024-03-23 21:30:36 +00:00
dknopik
0a6e4a11d7
Verify whether validators really are unknown during sync committee duty API request ( #5174 )
...
* Verify whether validators really are unknown during sync committee duty API request
* Merge branch 'unstable' into fix-4717
* Merge branch 'unstable' into fix-4717
* Merge branch 'unstable' of https://github.com/sigp/lighthouse into fix-4717
2024-03-23 00:01:11 +00:00
Lion - dapplion
306d3eb0eb
Delete unused incomplete_processing_components ( #5418 )
...
* Delete unused incomplete_processing_components
* lint
2024-03-23 00:00:35 +00:00
Michael Sproul
332e1bb9e6
Fix one and hide all beacon-processor flags ( #5397 )
...
* Fix `beacon-processor-work-queue-len`
* Hide beacon-processor flags
2024-03-22 23:24:17 +00:00
zhiqiangxu
5121d655f7
chore: reduce scope of commitment ( #5426 )
...
* reduce scope of commitment
* avoid clone for last reference
* Merge branch 'unstable' of https://github.com/sigp/lighthouse into mod_merge_single_blob
2024-03-22 18:16:52 +00:00
zhiqiangxu
5bfe6a8ae3
chore: remove stale comment ( #5440 )
...
* rm stale comment
* Merge branch 'unstable' of https://github.com/sigp/lighthouse into rm_irelevant_comment
2024-03-22 18:16:49 +00:00
realbigsean
21cdc64bfe
Improve parent lookup logging ( #5451 )
...
* upgrade parent lookup result processing logs to debug, use display instead of debug for BlockError in case a blob parent unknown error is hit, add block root to BlockIsAlreadyKnown
* fix compile
* fix compile
* fix compile
2024-03-22 18:16:13 +00:00
realbigsean
5ce16192c7
Release v5.1.2 ( #5453 )
...
* Release v5.1.2
2024-03-21 18:04:00 +00:00
João Oliveira
6edf031490
disable libp2p upnp ( #5449 )
...
* disable libp2p upnp
when passing --disable-upnp cli flag
2024-03-21 01:13:03 +00:00
Michael Sproul
65a6118c53
Fix gossip verification of duplicate attester slashings ( #5385 )
...
* Fix gossip verification of duplicate attester slashings
2024-03-20 20:47:38 +00:00
Akihito Nakano
7117772fb3
Fix peer count metrics ( #5404 )
...
* Set the peers_per_client metrics directly, rather than using increment/decrement
* Move PEERS_CONNECTED related update to the same place
* Move PEERS_CONNECTED_MULTI related update to the same place
* Rename
* Remove unused variables
2024-03-20 06:45:16 +00:00
Eitan Seri-Levi
01ec42e75a
Fix Rust beta compiler errors 1.78.0-beta.1 ( #5439 )
...
* remove redundant imports
* fix test
* contains key
* fmt
* Merge branch 'unstable' into fix-beta-compiler
2024-03-20 05:17:02 +00:00
realbigsean
4449627c7c
Dedup parent blob requests ( #5432 )
...
* de dup parent blob requests
* add new line
2024-03-20 00:19:26 +00:00
Michael Sproul
2a3c709f8c
Release v5.1.1 ( #5396 )
...
* Release v5.1.1
2024-03-12 03:42:15 +00:00
Pawan Dhananjay
10a38a8aae
Release v5.1.0 ( #5372 )
...
* Bump versions
2024-03-10 23:44:29 +00:00
Pawan Dhananjay
54b1c229e1
Downgrade rate limited log ( #5381 )
...
* Address review comments
* Downgrade log for by_root requests
2024-03-10 23:05:24 +00:00
Michael Sproul
f93844e63b
Optimise concurrent block production ( #5368 )
...
* Optimise concurrent block production
2024-03-08 05:15:28 +00:00
Jonas Bostoen
641f6be3f0
Explicit peers ( #5333 )
...
* Merge branch 'unstable' into feature/explicit-peers
* Merge latest unstable
* refactor: remove explicit-peers flag, mark trusted peers as explicit instead
* feat(beacon_node): add explicit peers to GossipSub, mark as trusted
* feat(beacon_node): add explicit peers cli + config
2024-03-07 22:22:39 +00:00
Age Manning
de91c77cb2
Improve peer performance for NAT'd nodes ( #5345 )
...
* Merge latest unstable
* Reduce diff
* Reduce logic, discover up to max peers
* Peer discovery for Natd peers
2024-03-07 12:32:30 +00:00
Pawan Dhananjay
84a902a589
Reduce load on validator subscription channels ( #5311 )
...
* Fix tests
* Merge branch 'unstable' into unclog-channels
* Avoid reallocations
* Reduce subscription load on beacon node
2024-03-07 12:32:27 +00:00
Age Manning
85c3204d70
Correct the metrics for topic subscriptions ( #5344 )
...
* Handle fork boundaries
* Merge latest unstable
* Topic subscription fix
2024-03-07 12:32:21 +00:00
Age Manning
fc8f1a4ca7
Attempt to publish to at least mesh_n peers ( #5357 )
...
* Code improvements
* Fix gossipsub tests
* Merge latest unstable
* Differentiate errors and better scoring
* Attempt to publish to mesh_n peers
2024-03-07 09:48:51 +00:00
Michael Sproul
bf118a17d4
Fix block v3 header decoding ( #5366 )
...
* Fix block v3 header decoding
2024-03-07 03:31:06 +00:00
Age Manning
f919f82e4f
Improve logging around peer scoring ( #5325 )
...
* Improve logging around score states
* Improve logs also
2024-03-04 19:39:23 +00:00
Lion - dapplion
7b65d385b3
Drop address_change_broadcast ( #5287 )
...
* Drop address_change_broadcast
2024-02-29 01:51:11 +00:00
Age Manning
64e563f5e9
Recognize the Caplin consensus client ( #5304 )
...
* Caplin has joined the party
* Fix typo
2024-02-28 05:38:24 +00:00
João Oliveira
a89ff100af
improve libp2p connected peer metrics ( #5314 )
...
* patch rust-yamux dep
* improve libp2p connected peer metrics
2024-02-28 03:52:55 +00:00
João Oliveira
65c4ff0775
remove exit-future ( #5183 )
...
* remove exit-future usage,
as it is non maintained, and replace with async-channel which is already in the repo.
* Merge branch 'unstable' of https://github.com/sigp/lighthouse into remove-exit-future
* Merge branch 'unstable' of https://github.com/sigp/lighthouse into remove-exit-future
2024-02-27 22:12:44 +00:00
João Oliveira
abd99652b4
remove nat module and use libp2p upnp ( #4840 )
...
* remove nat module and use libp2p upnp
* update Cargo.lock
* remove no longer used dependencies
* restore nat module refactored
* log successful mapping
* only activate upnp if config enabled
reduce logs to debug!
* Merge branch 'unstable' of https://github.com/sigp/lighthouse into libp2p-nat
* Merge branch 'unstable' of https://github.com/sigp/lighthouse into libp2p-nat
* Merge branch 'unstable' of https://github.com/sigp/lighthouse into libp2p-nat
* address review
* Merge branch 'unstable' of https://github.com/sigp/lighthouse into libp2p-nat
* Merge branch 'unstable' of https://github.com/sigp/lighthouse into libp2p-nat
* Merge branch 'unstable' of https://github.com/sigp/lighthouse into libp2p-nat
* address review
2024-02-27 07:29:18 +00:00
Age Manning
d36241b4a1
Track multiaddr in connection status ( #5308 )
...
* Record the multiaddr for connected peers
2024-02-27 06:32:48 +00:00
Michael Sproul
744c598b1c
Fix typos and make block hash calculation public ( #5275 )
...
* Fix typo in `verify_payload_block_hash`
* Make calculate_execution_block_hash public again
2024-02-26 07:45:17 +00:00
Pawan Dhananjay
3ab9d3a84e
Add a cli option for the snapshot cache size ( #5270 )
...
* Add a cli option for snapshot cache size
* Remove junk
* Make snapshot_cache module public
* lint
* Update docs
2024-02-26 05:19:39 +00:00
Paul Hauner
b5bae6e7a2
Release v5.0.0 ( #5254 )
...
* Bump versions
2024-02-20 22:12:52 +00:00
Jimmy Chen
50c423ad88
Revert libp2p metrics ( #4870 ) ( #5265 )
...
* Revert "improve libp2p connected peer metrics (#4870 )"
This reverts commit 0c3fef59b3
2024-02-20 04:19:17 +00:00
João Oliveira
a229b52723
Deactivate RPC Connection Handler after goodbye message is sent ( #5250 )
...
* Deactivate RPC Connection Handler
after goodbye message is sent
* nit: use to_string instead of format
* Merge branch 'unstable' of https://github.com/sigp/lighthouse into rpc-shutdown-improvement
* clippy
* Fix cargo.lock
* Merge latest unstable
2024-02-19 07:16:01 +00:00
Michael Sproul
c9702cb0a1
Download checkpoint blobs during checkpoint sync ( #5252 )
...
* MVP implementation (untested)
* update store checkpoint sync test
* update cli help
* Merge pull request #5253 from realbigsean/checkpoint-blobs-sean
Checkpoint blobs sean
* Warn only if blobs are missing from server
* Merge remote-tracking branch 'origin/unstable' into checkpoint-blobs
* Verify checkpoint blobs
* Move blob verification earlier
2024-02-19 02:22:23 +00:00
realbigsean
f21472991d
check the da cache and the attester cache in responding to RPC requests ( #5138 )
...
* check the da cache and the attester cache in responding to RPC requests
* use the processing cache instead
* update comment
* add da cache metrics
* rename early attester cache method
* Merge branch 'unstable' of https://github.com/sigp/lighthouse into check-da-cache-in-rpc-response
* make rustup update run on the runners
* Revert "make rustup update run on the runners"
This reverts commit d097e9bfa84a13b1d7813c03df38e7756fb0bfc5.
2024-02-19 02:22:15 +00:00
ethDreamer
a264afd19f
Verify Versioned Hashes During Optimistic Sync ( #4832 )
...
* Convert NewPayloadRequest to use Reference
* Refactor for Clarity
* Verify Versioned Hashes
* Added Tests for Version Hash Verification
* Added Moar Tests
* Fix Problems Caused By Merge
* Update to use Alloy Instead of Reth Crates (#14 )
* Update beacon_node/execution_layer/src/engine_api/new_payload_request.rs
Co-authored-by: realbigsean <seananderson33@GMAIL.com>
* Faster Versioned Hash Extraction
* Update to rust 1.75 & Pin alloy-consensus
2024-02-18 12:40:45 +00:00
Michael Sproul
f17fb291b7
Handle unknown head during attestation publishing ( #5010 )
...
* Handle unknown head during attestation publishing
* Merge remote-tracking branch 'origin/unstable' into queue-http-attestations
* Simplify task spawner
* Improve logging
* Add a test
* Improve error logging
* Merge remote-tracking branch 'origin/unstable' into queue-http-attestations
* Fix beta compiler warnings
2024-02-15 12:24:47 +00:00
Michael Sproul
7c23625193
Quieten gossip republish logs ( #5235 )
...
* Quieten gossip republish logs
2024-02-15 04:18:23 +00:00
João Oliveira
256d9042d3
Drop gossipsub stale messages when polling ConnectionHandler. ( #5175 )
...
* drop gossipsub stale messages
* convert async-channel::Receiver to Peekable,
to be able to Peek next message without dropping it
2024-02-15 00:41:52 +00:00
Eitan Seri-Levi
e7ef2a3a54
validator liveness endpoint should accept string encoded indices ( #5184 )
...
* deserialize string indices as u64
* client should send quoted indices
2024-02-09 04:59:39 +00:00
realbigsean
4172d9f75c
Update to consensus spec v1.4.0-beta.6 ( #5094 )
...
* get latest ef tests passing
* fix tests
* Fix invalid payload recovery tests
* Merge branch 'unstable' into update-to-spec-v1.4.0-beta.6
* Revert "fix tests"
This reverts commit 0c875b02e032ebd9bebd822183a1c3d10d333a4c.
* Fix fork choice def. tests
* Update beacon_node/beacon_chain/tests/payload_invalidation.rs
2024-02-08 18:08:21 +00:00
Michael Sproul
6f442f2bb8
Improve database compaction and prune-states ( #5142 )
...
* Fix no-op state prune check
* Compact freezer DB after pruning
* Refine DB compaction
* Add blobs-db options to inspect/compact
* Better key size
* Fix compaction end key
2024-02-08 10:05:08 +00:00
