556190ff46
## Issue Addressed Closes #1866 ## Proposed Changes * Compact the database on finalization. This removes the deleted states from disk completely. Because it happens in the background migrator, it doesn't block other database operations while it runs. On my Medalla node it took about 1 minute and shrank the database from 90GB to 9GB. * Fix an inefficiency in the pruning algorithm where it would always use the genesis checkpoint as the `old_finalized_checkpoint` when running for the first time after start-up. This would result in loading lots of states one-at-a-time back to genesis, and storing a lot of block roots in memory. The new code stores the old finalized checkpoint on disk and only uses genesis if no checkpoint is already stored. This makes it both backwards compatible _and_ forwards compatible -- no schema change required! * Introduce two new `INFO` logs to indicate when pruning has started and completed. Users seem to want to know this information without enabling debug logs!
40 lines
1.2 KiB
Rust
40 lines
1.2 KiB
Rust
//! Garbage collection process that runs at start-up to clean up the database.
|
|
use crate::hot_cold_store::HotColdDB;
|
|
use crate::{Error, LevelDB, StoreOp};
|
|
use slog::debug;
|
|
use types::EthSpec;
|
|
|
|
impl<E> HotColdDB<E, LevelDB<E>, LevelDB<E>>
|
|
where
|
|
E: EthSpec,
|
|
{
|
|
/// Clean up the database by performing one-off maintenance at start-up.
|
|
pub fn remove_garbage(&self) -> Result<(), Error> {
|
|
self.delete_temp_states()?;
|
|
Ok(())
|
|
}
|
|
|
|
/// Delete the temporary states that were leftover by failed block imports.
|
|
pub fn delete_temp_states(&self) -> Result<(), Error> {
|
|
let delete_ops =
|
|
self.iter_temporary_state_roots()
|
|
.try_fold(vec![], |mut ops, state_root| {
|
|
let state_root = state_root?;
|
|
ops.push(StoreOp::DeleteState(state_root, None));
|
|
ops.push(StoreOp::DeleteStateTemporaryFlag(state_root));
|
|
Result::<_, Error>::Ok(ops)
|
|
})?;
|
|
|
|
if !delete_ops.is_empty() {
|
|
debug!(
|
|
self.log,
|
|
"Garbage collecting {} temporary states",
|
|
delete_ops.len() / 2
|
|
);
|
|
self.do_atomically(delete_ops)?;
|
|
}
|
|
|
|
Ok(())
|
|
}
|
|
}
|