lighthouse/book/src
realbigsean adbb62f7f3
Devnet6 (#4404)
* some blob reprocessing work

* remove ForceBlockLookup

* reorder enum match arms in sync manager

* a lot more reprocessing work

* impl logic for triggerng blob lookups along with block lookups

* deal with rpc blobs in groups per block in the da checker. don't cache missing blob ids in the da checker.

* make single block lookup generic

* more work

* add delayed processing logic and combine some requests

* start fixing some compile errors

* fix compilation in main block lookup mod

* much work

* get things compiling

* parent blob lookups

* fix compile

* revert red/stevie changes

* fix up sync manager delay message logic

* add peer usefulness enum

* should remove lookup refactor

* consolidate retry error handling

* improve peer scoring during certain failures in parent lookups

* improve retry code

* drop parent lookup if either req has a peer disconnect during download

* refactor single block processed method

* processing peer refactor

* smol bugfix

* fix some todos

* fix lints

* fix lints

* fix compile in lookup tests

* fix lints

* fix lints

* fix existing block lookup tests

* renamings

* fix after merge

* cargo fmt

* compilation fix in beacon chain tests

* fix

* refactor lookup tests to work with multiple forks and response types

* make tests into macros

* wrap availability check error

* fix compile after merge

* add random blobs

* start fixing up lookup verify error handling

* some bug fixes and the start of deneb only tests

* make tests work for all forks

* track information about peer source

* error refactoring

* improve peer scoring

* fix test compilation

* make sure blobs are sent for processing after stream termination, delete copied tests

* add some tests and fix a bug

* smol bugfixes and moar tests

* add tests and fix some things

* compile after merge

* lots of refactoring

* retry on invalid block/blob

* merge unknown parent messages before current slot lookup

* get tests compiling

* penalize blob peer on invalid blobs

* Check disk on in-memory cache miss

* Update beacon_node/beacon_chain/src/data_availability_checker/overflow_lru_cache.rs

* Update beacon_node/network/src/sync/network_context.rs

Co-authored-by: Divma <26765164+divagant-martian@users.noreply.github.com>

* fix bug in matching blocks and blobs in range sync

* pr feedback

* fix conflicts

* upgrade logs from warn to crit when we receive incorrect response in range

* synced_and_connected_within_tolerance -> should_search_for_block

* remove todo

* add data gas used and update excess data gas to u64

* Fix Broken Overflow Tests

* payload verification with commitments

* fix merge conflicts

* restore payload file

* Restore payload file

* remove todo

* add max blob commitments per block

* c-kzg lib update

* Fix ef tests

* Abstract over minimal/mainnet spec in kzg crate

* Start integrating new KZG

* checkpoint sync without alignment

* checkpoint sync without alignment

* add import

* add import

* query for checkpoint state by slot rather than state root (teku doesn't serve by state root)

* query for checkpoint state by slot rather than state root (teku doesn't serve by state root)

* loosen check

* get state first and query by most recent block root

* Revert "loosen check"

This reverts commit 069d13dd63aa794a3505db9f17bd1a6b73f0be81.

* get state first and query by most recent block root

* merge max blobs change

* simplify delay logic

* rename unknown parent sync message variants

* rename parameter, block_slot -> slot

* add some docs to the lookup module

* use interval instead of sleep

* drop request if blocks and blobs requests both return `None` for `Id`

* clean up `find_single_lookup` logic

* add lookup source enum

* clean up `find_single_lookup` logic

* add docs to find_single_lookup_request

* move LookupSource our of param where unnecessary

* remove unnecessary todo

* query for block by `state.latest_block_header.slot`

* fix lint

* fix merge transition ef tests

* fix test

* fix test

* fix observed  blob sidecars test

* Add some metrics (#33)

* fix protocol limits for blobs by root

* Update Engine API for 1:1 Structure Method

* make beacon chain tests to fix devnet 6 changes

* get ckzg working and fix some tests

* fix remaining tests

* fix lints

* Fix KZG linking issues

* remove unused dep

* lockfile

* test fixes

* remove dbgs

* remove unwrap

* cleanup tx generator

* small fixes

* fixing fixes

* more self reivew

* more self review

* refactor genesis header initialization

* refactor mock el instantiations

* fix compile

* fix network test, make sure they run for each fork

* pr feedback

* fix last test (hopefully)

---------

Co-authored-by: Pawan Dhananjay <pawandhananjay@gmail.com>
Co-authored-by: Mark Mackey <mark@sigmaprime.io>
Co-authored-by: Divma <26765164+divagant-martian@users.noreply.github.com>
Co-authored-by: Michael Sproul <michael@sigmaprime.io>
2023-06-29 15:35:43 -04:00
..
css Make API friendly to block explorers (#702) 2019-12-19 11:45:28 +11:00
imgs Minor revision in Lighthouse book (#4385) 2023-06-13 13:12:56 +00:00
js Add support for multiple testnet flags (#1396) 2020-07-29 06:39:29 +00:00
LaTeX Minor revision in Lighthouse book (#4385) 2023-06-13 13:12:56 +00:00
advanced_database.md Minor revision in Lighthouse book (#4385) 2023-06-13 13:12:56 +00:00
advanced_metrics.md Configurable monitoring endpoint frequency (#3530) 2022-09-05 08:29:00 +00:00
advanced_networking.md Update discv5 to expand ipv6 support (#4319) 2023-06-13 01:25:05 +00:00
advanced-datadir.md Fixing a few typos / documentation (#3531) 2022-09-05 04:50:48 +00:00
advanced-proposer-only.md Separate BN for block proposals (#4182) 2023-04-26 01:12:36 +00:00
advanced-release-candidates.md Update Lighthouse Book API and Advanced Usage section (#4300) 2023-06-02 03:17:36 +00:00
advanced.md Update Lighthouse Book API and Advanced Usage section (#4300) 2023-06-02 03:17:36 +00:00
api-bn.md Update Lighthouse Book API and Advanced Usage section (#4300) 2023-06-02 03:17:36 +00:00
api-lighthouse.md Update Lighthouse Book API and Advanced Usage section (#4300) 2023-06-02 03:17:36 +00:00
api-vc-auth-header.md Implement standard keystore API (#2736) 2022-01-30 23:22:04 +00:00
api-vc-endpoints.md Add support for updating validator graffiti (#4417) 2023-06-22 02:14:57 +00:00
api-vc-sig-header.md Implement VC API (#1657) 2020-10-02 09:42:19 +00:00
api-vc.md Update Lighthouse Book API and Advanced Usage section (#4300) 2023-06-02 03:17:36 +00:00
api.md Update book with missing Lighthouse endpoints (#3769) 2022-12-09 09:20:10 +00:00
builders.md Minor revision in Lighthouse book (#4385) 2023-06-13 13:12:56 +00:00
checkpoint-sync.md Update Lighthouse Book API and Advanced Usage section (#4300) 2023-06-02 03:17:36 +00:00
cli.md Rename Eth1/Eth2 in documents (#3021) 2022-03-02 01:05:08 +00:00
contributing.md [Contribution docs] Add GitPOAP Badge to Display Number of Minted GitPOAPs for Contributors (#3343) 2022-08-09 02:27:04 +00:00
cross-compiling.md Add maxperf build profile (#3608) 2022-09-29 06:13:33 +00:00
database-migrations.md Update Lighthouse Book API and Advanced Usage section (#4300) 2023-06-02 03:17:36 +00:00
docker.md Devnet6 (#4404) 2023-06-29 15:35:43 -04:00
faq.md Update Lighthouse book on Doppelganger Protection (#4418) 2023-06-20 05:20:37 +00:00
graffiti.md Add support for updating validator graffiti (#4417) 2023-06-22 02:14:57 +00:00
homebrew.md Document Homebrew package (#2885) 2022-01-08 01:15:07 +00:00
http.md Rename Eth1/Eth2 in documents (#3021) 2022-03-02 01:05:08 +00:00
installation-binaries.md Update Lighthouse book and some FAQs (#4178) 2023-04-14 01:11:45 +00:00
installation-priorities.md Reformat tables and add borders (#3377) 2022-07-27 00:51:07 +00:00
installation-source.md Switch default slasher backend to LMDB (#4360) 2023-06-07 01:50:33 +00:00
installation.md Update Lighthouse book Sec 3-6 and FAQ (#4221) 2023-05-05 00:51:56 +00:00
intro.md Add Run a Node guide (#3681) 2022-11-28 10:05:43 +00:00
key-management.md Update Lighthouse Book API and Advanced Usage section (#4300) 2023-06-02 03:17:36 +00:00
key-recovery.md Update Lighthouse book Sec 3-6 and FAQ (#4221) 2023-05-05 00:51:56 +00:00
late-block-re-orgs.md Make re-org strat more cautious and add more config (#4151) 2023-04-13 07:05:01 +00:00
lighthouse-ui.md Feat: lighthouse book - ui authentication (#4232) 2023-05-01 02:15:57 +00:00
mainnet-validator.md Update links in Lighthouse Book (#4279) 2023-05-10 00:33:11 +00:00
merge-migration.md Update Lighthouse Book API and Advanced Usage section (#4300) 2023-06-02 03:17:36 +00:00
partial-withdrawal.md Minor revision in Lighthouse book (#4385) 2023-06-13 13:12:56 +00:00
pi.md Update Lighthouse book and some FAQs (#4178) 2023-04-14 01:11:45 +00:00
redundancy.md Update Lighthouse Book API and Advanced Usage section (#4300) 2023-06-02 03:17:36 +00:00
run_a_node.md Update links in Lighthouse Book (#4279) 2023-05-10 00:33:11 +00:00
setup.md Add libpq-dev and docker to the to the list of additional requirements for developers in the Book (#4282) 2023-05-30 06:15:54 +00:00
slasher.md Switch default slasher backend to LMDB (#4360) 2023-06-07 01:50:33 +00:00
slashing-protection.md Update Lighthouse book Sec 3-6 and FAQ (#4221) 2023-05-05 00:51:56 +00:00
suggested-fee-recipient.md Update Lighthouse Book API and Advanced Usage section (#4300) 2023-06-02 03:17:36 +00:00
SUMMARY.md Minor revision in Lighthouse book (#4385) 2023-06-13 13:12:56 +00:00
ui-authentication.md Feat: lighthouse book - ui authentication (#4232) 2023-05-01 02:15:57 +00:00
ui-configuration.md Add SSH tunneling in Lighthouse UI Siren (#4328) 2023-05-30 06:15:57 +00:00
ui-faqs.md feat: added new info about logs and config features (#4378) 2023-06-07 01:50:35 +00:00
ui-installation.md Siren Ui Lighthouse Version Requirments (#4093) 2023-03-16 08:03:43 +00:00
ui-usage.md feat: added new info about logs and config features (#4378) 2023-06-07 01:50:35 +00:00
validator-doppelganger.md Update Lighthouse book on Doppelganger Protection (#4418) 2023-06-20 05:20:37 +00:00
validator-inclusion.md Update Lighthouse Book API and Advanced Usage section (#4300) 2023-06-02 03:17:36 +00:00
validator-management.md Update Lighthouse book Sec 3-6 and FAQ (#4221) 2023-05-05 00:51:56 +00:00
validator-monitoring.md Update Lighthouse book Sec 3-6 and FAQ (#4221) 2023-05-05 00:51:56 +00:00
validator-web3signer.md Update Lighthouse Book API and Advanced Usage section (#4300) 2023-06-02 03:17:36 +00:00
voluntary-exit.md Correct table formatting in Lighthouse book (#4407) 2023-06-16 06:44:32 +00:00