core/rawdb: fix high memory usage in freezer (#21243)
The ancients variable in the freezer is a list of hashes, which identifies all of the hashes to be frozen. The slice is being allocated with a capacity of `limit`, which is the number of the last block this batch will attempt to add to the freezer. That means we are allocating memory for all of the blocks in the freezer, not just the ones to be added. If instead we allocate `limit - f.frozen`, we will only allocate enough space for the blocks we're about to add to the freezer. On mainnet this reduces usage by about 320 MB.
This commit is contained in:
parent
5435e0d1a1
commit
3ebfeb09fe
@ -311,7 +311,7 @@ func (f *freezer) freeze(db ethdb.KeyValueStore) {
|
|||||||
var (
|
var (
|
||||||
start = time.Now()
|
start = time.Now()
|
||||||
first = f.frozen
|
first = f.frozen
|
||||||
ancients = make([]common.Hash, 0, limit)
|
ancients = make([]common.Hash, 0, limit-f.frozen)
|
||||||
)
|
)
|
||||||
for f.frozen < limit {
|
for f.frozen < limit {
|
||||||
// Retrieves all the components of the canonical block
|
// Retrieves all the components of the canonical block
|
||||||
|
Loading…
Reference in New Issue
Block a user