vyzo
|
874ecd3573
|
adjust hot store options, redux.
|
2021-03-05 14:46:17 +02:00 |
|
vyzo
|
ca8a673b5f
|
adjust hot store options
|
2021-03-05 14:46:17 +02:00 |
|
vyzo
|
69a88d41b6
|
fix snoop test
|
2021-03-05 14:46:17 +02:00 |
|
vyzo
|
cdf5bd0500
|
return annotated xerrors where appropriate
|
2021-03-05 14:46:17 +02:00 |
|
vyzo
|
ea05fd9d86
|
use xerrors instead of fmt.Errorf
|
2021-03-05 14:46:17 +02:00 |
|
vyzo
|
d91b60df91
|
fix potential panic with max readers retry and cursor channel
|
2021-03-05 14:46:17 +02:00 |
|
vyzo
|
b9f8a3d587
|
log MDB_READERS_FULL retries
|
2021-03-05 14:46:17 +02:00 |
|
vyzo
|
c89ab1a990
|
retry on MDB_READERS_FULL errors
|
2021-03-05 14:46:17 +02:00 |
|
vyzo
|
2080e467ba
|
don't set MaxReaders for tracking store
|
2021-03-05 14:46:17 +02:00 |
|
vyzo
|
5872f246ff
|
go get go-bs-lmdb@v1.0.2
|
2021-03-05 14:46:17 +02:00 |
|
Raúl Kripalani
|
877ecab960
|
update go-bs-lmdb and migrate to ledgerwatch/lmdb-go.
|
2021-03-05 14:46:17 +02:00 |
|
vyzo
|
5b4e6b7b26
|
don't set max readers for livesets
|
2021-03-05 14:46:17 +02:00 |
|
vyzo
|
58a8434825
|
temporary log level for splitstore to DEBUG
|
2021-03-05 14:46:17 +02:00 |
|
vyzo
|
8b0087524f
|
adjust walk boundaries for marking
|
2021-03-05 14:46:17 +02:00 |
|
vyzo
|
76d6edbb52
|
fix max readers for tracking store
|
2021-03-05 14:46:17 +02:00 |
|
vyzo
|
1a23b1f6af
|
make CompactionThreshold a var to fix lotus-soup build
finality is not a constant there!
|
2021-03-05 14:46:17 +02:00 |
|
vyzo
|
6e51e6db9a
|
better handling of MDB_KEYEXIST in Put
|
2021-03-05 14:46:17 +02:00 |
|
vyzo
|
3f8da19a34
|
go get go-bs-lmdb@v0.0.3
|
2021-03-05 14:46:17 +02:00 |
|
vyzo
|
ce41e394dc
|
handle MDB_KEYEXIST in liveset marking
|
2021-03-05 14:46:17 +02:00 |
|
vyzo
|
843fd09a62
|
deal with MDB_KEY_EXIST errors
|
2021-03-05 14:46:17 +02:00 |
|
vyzo
|
f44cf0f2c4
|
appease linter
|
2021-03-05 14:46:17 +02:00 |
|
vyzo
|
facdc555b1
|
add nil check for curTs -- some tests don't have chain state
|
2021-03-05 14:46:17 +02:00 |
|
vyzo
|
3912694fb7
|
fix lotus-shed build
|
2021-03-05 14:46:17 +02:00 |
|
vyzo
|
622b4f7d9d
|
hook splitstore into DI
|
2021-03-05 14:46:17 +02:00 |
|
vyzo
|
e07c6c71c0
|
splitstore constructor
|
2021-03-05 14:46:17 +02:00 |
|
vyzo
|
e87ce6cb60
|
go get go-bs-lmdb
|
2021-03-05 14:46:17 +02:00 |
|
vyzo
|
b0f48b500f
|
use CAS for compacting state
|
2021-03-05 14:46:17 +02:00 |
|
vyzo
|
0af7b16ad5
|
simplify Has
|
2021-03-05 14:46:17 +02:00 |
|
vyzo
|
37e391f133
|
add TODO note about map size
|
2021-03-05 14:46:17 +02:00 |
|
vyzo
|
5db314f422
|
fallback to coldstore if snooping fails.
|
2021-03-05 14:46:17 +02:00 |
|
vyzo
|
d20cbc0c28
|
protect against potential data races
overkill, but let's not have race detectors scream at us.
|
2021-03-05 14:46:17 +02:00 |
|
vyzo
|
da478832cb
|
quiet linter
|
2021-03-05 14:46:17 +02:00 |
|
vyzo
|
4763397281
|
add tracking store test
|
2021-03-05 14:46:17 +02:00 |
|
vyzo
|
0d7476c5b2
|
implement LMDB-backed tracking store
|
2021-03-05 14:46:17 +02:00 |
|
vyzo
|
83f8a0ab12
|
quiet linter
|
2021-03-05 14:46:17 +02:00 |
|
vyzo
|
5043f31adf
|
liveset unit test
|
2021-03-05 14:46:17 +02:00 |
|
vyzo
|
3f92a000c7
|
implement lmdb-backed LiveSet
|
2021-03-05 14:46:17 +02:00 |
|
vyzo
|
df856b7315
|
gomod: get lmdb-go
|
2021-03-05 14:46:17 +02:00 |
|
vyzo
|
0bf1a78b39
|
stubs for tracking store and live set
|
2021-03-05 14:46:17 +02:00 |
|
vyzo
|
17bc5fcd85
|
move splitstore implementation to its own directory
|
2021-03-05 14:46:17 +02:00 |
|
vyzo
|
2c9b58aaec
|
add some logging
|
2021-03-05 14:46:17 +02:00 |
|
vyzo
|
c1b1a9ce2a
|
avoid race with compacting state variable
|
2021-03-05 14:46:17 +02:00 |
|
vyzo
|
3083d80f5e
|
no need to import go-ipfs-blockstore, lib/blockstore will do
|
2021-03-05 14:46:17 +02:00 |
|
vyzo
|
101e5c6540
|
close keys channel when dome emitting keys
|
2021-03-05 14:46:17 +02:00 |
|
vyzo
|
b945747eb2
|
satisfy linter
|
2021-03-05 14:46:17 +02:00 |
|
vyzo
|
2bed6c94cd
|
use dual live set marking algorithm to keep all hotly reachable objects in the hotstore
|
2021-03-05 14:46:17 +02:00 |
|
vyzo
|
c2cc198316
|
fix off by 1 in marking
|
2021-03-05 14:46:17 +02:00 |
|
vyzo
|
fd08786048
|
track base epoch in metadata ds
|
2021-03-05 14:46:17 +02:00 |
|
vyzo
|
b192adfd2e
|
trigger compaction from head changes
|
2021-03-05 14:46:17 +02:00 |
|
vyzo
|
c8f1139e0d
|
compaction algorithm
|
2021-03-05 14:46:17 +02:00 |
|