lighthouse/beacon_node
Michael Sproul a60ab4eff2 Refine compaction (#1916)
## Proposed Changes

In an attempt to fix OOM issues and database consistency issues observed by some users after the introduction of compaction in v0.3.4, this PR makes the following changes:

* Run compaction less often: roughly every 1024 epochs, including after long periods of non-finality. I think the division check proposed by Paul is pretty solid, and ensures we don't miss any events where we should be compacting. LevelDB lacks an easy way to check the size of the DB, which would be another good trigger.
* Make it possible to disable the compaction on finalization using `--auto-compact-db=false`
* Make it possible to trigger a manual, single-threaded foreground compaction on start-up using `--compact-db`
* Downgrade the pruning log to `DEBUG`, as it's particularly noisy during sync

I would like to ship these changes to affected users ASAP, and will document them further in the Advanced Database section of the book if they prove effective.
2020-11-17 09:10:53 +00:00
..
beacon_chain Refine compaction (#1916) 2020-11-17 09:10:53 +00:00
client Add --testnet mainnet and start HTTP server before genesis (#1862) 2020-11-09 05:04:03 +00:00
eth1 Validate eth1 chain id (#1877) 2020-11-16 23:10:42 +00:00
eth2_libp2p Performance improvement for db reads (#1909) 2020-11-16 07:28:30 +00:00
genesis Return eth1-related data via the API (#1797) 2020-11-02 00:37:30 +00:00
http_api add slot validation to attestation_data endpoint (#1888) 2020-11-16 02:59:35 +00:00
http_metrics Support pre-flight CORS check (#1772) 2020-10-22 04:47:27 +00:00
network router: drop requests from peers that have dc'd (#1919) 2020-11-17 02:06:21 +00:00
operation_pool Refine op pool pruning (#1805) 2020-10-22 04:47:29 +00:00
src Refine compaction (#1916) 2020-11-17 09:10:53 +00:00
store Refine compaction (#1916) 2020-11-17 09:10:53 +00:00
tests Implement standard eth2.0 API (#1569) 2020-10-01 11:12:36 +10:00
timer Upgrade discovery and restructure task execution (#1693) 2020-10-05 18:45:54 +11:00
websocket_server Update external deps (#1711) 2020-10-05 08:22:19 +00:00
Cargo.toml Release v0.3.4 (#1894) 2020-11-13 06:06:35 +00:00