vyzo
|
e129ae3706
|
refactor nextBatch in badger markset
|
2022-02-09 18:34:50 +02:00 |
|
vyzo
|
8ddf4766ea
|
update README
Adds note about 3k IOPs requirement with badger markset, updates the memory requirement for
map to 48G based on observed behaviour of test nodes.
|
2022-02-08 10:10:51 +02:00 |
|
Łukasz Magiera
|
966071d437
|
Merge pull request #8034 from filecoin-project/feat/splitstore-default-markset-badger
splitstore: set badger as the default default markset type
|
2022-02-07 19:27:13 +00:00 |
|
vyzo
|
0ad1f0e233
|
moar make gen
|
2022-02-06 12:48:49 +02:00 |
|
vyzo
|
1221c0ba3f
|
make gen
|
2022-02-06 12:28:21 +02:00 |
|
vyzo
|
d45e2074a6
|
update README for map as the default
|
2022-02-06 11:25:27 +02:00 |
|
vyzo
|
03352ea863
|
make badger the default splitstore markset type
|
2022-02-06 11:21:16 +02:00 |
|
vyzo
|
049b48928f
|
add note about compaction algorithm changes in README
|
2022-02-02 14:39:21 +02:00 |
|
vyzo
|
75ad0c3c2d
|
badger markset option tweaks
|
2022-02-02 14:34:30 +02:00 |
|
vyzo
|
c1d8368fdc
|
share a concurrent visitor between workers in markLiveRefs
|
2022-02-01 21:40:09 +02:00 |
|
vyzo
|
4b4104e400
|
fix comment
|
2022-02-01 12:10:30 +02:00 |
|
vyzo
|
b13aa8f172
|
unblock waitForSync on close
|
2022-02-01 11:30:21 +02:00 |
|
vyzo
|
9c92d77b64
|
improve robustness of waitForSync
|
2022-02-01 11:25:07 +02:00 |
|
vyzo
|
cd95892bf0
|
fix test
|
2022-02-01 11:13:01 +02:00 |
|
vyzo
|
7b4ab2077b
|
wait for sync in a non racey way
|
2022-02-01 11:10:51 +02:00 |
|
vyzo
|
578b5691bc
|
check for closing after the sync wait
|
2022-02-01 10:59:08 +02:00 |
|
vyzo
|
6353fa72d8
|
decouple SyncGapTime from wait time
|
2022-02-01 10:55:15 +02:00 |
|
vyzo
|
fd07ca87ce
|
wait for the sync gap time befor starting the purge
|
2022-02-01 10:46:42 +02:00 |
|
vyzo
|
11ae85645b
|
optimize single object marking in markLiveRefs
|
2022-02-01 09:13:21 +02:00 |
|
vyzo
|
3aabb0314a
|
synchronously mark live refs on put/putmany
|
2022-02-01 09:07:14 +02:00 |
|
vyzo
|
37673c6de6
|
downgrade marking log to debug
|
2022-01-31 21:44:10 +02:00 |
|
vyzo
|
7896af731f
|
use walkObjectIncomplete for marking live refs
|
2022-01-31 21:41:42 +02:00 |
|
vyzo
|
877dfbe992
|
hold the lock in the second protect call
|
2022-01-31 19:21:03 +02:00 |
|
vyzo
|
5b9ea1b4e0
|
avoid races in beginCriticalSection
|
2022-01-31 18:48:53 +02:00 |
|
vyzo
|
710fda49f0
|
fix putmany marking
|
2022-01-31 17:35:30 +02:00 |
|
vyzo
|
2b14bda6b8
|
recursively mark puts during the critical section
|
2022-01-31 17:26:08 +02:00 |
|
vyzo
|
1abfc5b1cf
|
fix comment
|
2022-01-31 15:00:03 +02:00 |
|
vyzo
|
c9bd5ec452
|
mark tipset references to protect them during critical section
|
2022-01-31 14:54:23 +02:00 |
|
vyzo
|
ee63be26a1
|
fix race in protectView
|
2022-01-31 12:40:26 +02:00 |
|
vyzo
|
1900c907fd
|
account for missing refs in the markset in Has
|
2022-01-31 09:44:51 +02:00 |
|
vyzo
|
a9d4495d83
|
use both hot and cold when doing fetches for markset positive objects
|
2022-01-30 22:47:20 +02:00 |
|
vyzo
|
7b8447a95a
|
reinstante waitForMissingRefs
|
2022-01-30 19:00:52 +02:00 |
|
vyzo
|
7931f1f8f9
|
fix lint
|
2022-01-30 15:43:52 +02:00 |
|
vyzo
|
20b75022aa
|
fix mockStore for splitstore tests
|
2022-01-30 15:33:30 +02:00 |
|
vyzo
|
dbc8903bac
|
sortless compaction
|
2022-01-30 15:33:15 +02:00 |
|
vyzo
|
a4f720d866
|
coldset test
|
2022-01-30 15:11:25 +02:00 |
|
vyzo
|
4b8369c071
|
fix buffered reads
|
2022-01-30 15:11:18 +02:00 |
|
vyzo
|
72333147d3
|
prettier checkpoint close
|
2022-01-30 15:00:03 +02:00 |
|
vyzo
|
64cda4aeda
|
on disk coldsets
|
2022-01-30 14:19:05 +02:00 |
|
vyzo
|
6ede77b254
|
checkpoint test
|
2022-01-30 14:10:11 +02:00 |
|
vyzo
|
c94eee5fc3
|
on disk checkpoints
|
2022-01-30 12:47:30 +02:00 |
|
vyzo
|
322b85898f
|
make markSets synchronous in critical section
|
2022-01-30 12:10:08 +02:00 |
|
vyzo
|
cf09dd044a
|
moar markset tests
|
2022-01-30 11:45:12 +02:00 |
|
vyzo
|
a4c1a34163
|
check for existence of badger db in recover
|
2022-01-30 11:44:27 +02:00 |
|
vyzo
|
d140909562
|
add MarkMany to MarkSet interface
|
2022-01-30 11:43:45 +02:00 |
|
vyzo
|
f9fd47e7d0
|
use temporary dir for splitstore test path
|
2022-01-29 13:11:58 +02:00 |
|
vyzo
|
67fbf9eb00
|
improve peristence test
|
2022-01-28 15:55:34 +02:00 |
|
vyzo
|
730aceac6d
|
immediately flush pending writes when entering critical section
|
2022-01-28 15:55:10 +02:00 |
|
vyzo
|
1bf396f9af
|
add test for markset persistence
|
2022-01-28 15:49:41 +02:00 |
|
vyzo
|
45c2f34295
|
refactor marksets for critical section on-disk persistence
|
2022-01-28 15:41:33 +02:00 |
|