Raúl Kripalani
3795cc2bd2
segregate chain and state blockstores.
...
This paves the way for better object lifetime management.
Concretely, it makes it possible to:
- have different stores backing chain and state data.
- having the same datastore library, but using different parameters.
- attach different caching layers/policies to each class of data, e.g.
sizing caches differently.
- specifying different retention policies for chain and state data.
This separation is important because:
- access patterns/frequency of chain and state data are different.
- state is derivable from chain, so one could never expunge the chain
store, and only retain state objects reachable from the last finality
in the state store.
2021-02-28 22:49:44 +00:00
Raúl Kripalani
7f0f7d0b36
Merge branch 'master' into refactor/lib/blockstore
2021-02-28 19:55:23 +00:00
Łukasz Magiera
b1dfd41c19
Merge pull request #4950 from zgfzgf/feat-bench-policy
...
delete bench policy
2021-01-30 12:34:40 +01:00
Raúl Kripalani
b0cbc932bd
consolidate all blockstores in blockstore package.
2021-01-29 20:01:00 +00:00
Frank
fdc46ad5df
update json format
2021-01-06 12:20:33 +08:00
Frank
f24d401b61
add bench env print
2020-12-18 17:57:32 +08:00
zgfzgf
e197038b9f
delete policy useless code
2020-11-21 10:14:13 +08:00
zgfzgf
549afbaa5f
add policy 8m and 512m
2020-11-21 10:04:07 +08:00
zgfzgf
d033042d6b
update code
2020-11-20 23:20:26 +08:00
zgfzgf
7d4bc90d42
solve merge conflicts
2020-11-20 22:34:15 +08:00
Aayush Rajasekaran
68a16afeda
Merge branch 'master' into release/v1.2.0
2020-11-17 19:40:05 -05:00
Raúl Kripalani
0c6072a1a0
chainstore lifecycle: close via Close() instead of context.
2020-11-16 22:28:59 +00:00
Łukasz Magiera
915c5e0fdd
Get most tests to pass
2020-11-16 19:03:30 +01:00
Raúl Kripalani
d7b4f92f1f
add context to ChainStore.
2020-11-16 15:52:19 +00:00
Raúl Kripalani
3577300aee
Merge branch 'master' into badger-viewable
2020-11-06 19:34:25 +00:00
Raúl Kripalani
8befc0c1f5
export metrics from bench.
2020-11-05 19:09:47 +00:00
Raúl Kripalani
a411342f0c
export more metrics.
2020-11-04 17:09:01 +00:00
Raúl Kripalani
370ef93db6
chainstore: new ForceHeadSilent to support benchmarks.
2020-11-04 14:39:01 +00:00
Raúl Kripalani
fd1439f284
fix lint.
2020-11-03 22:49:55 +00:00
Łukasz Magiera
a1e1b03ca4
Optionally allow bitswap for chainstore
2020-11-03 23:44:44 +01:00
Raúl Kripalani
87ce2f774d
lotus-bench: write separate profiles for import and validation.
2020-11-03 22:40:21 +00:00
Raúl Kripalani
5487356370
fix lint errors.
2020-11-03 21:23:41 +00:00
Raúl Kripalani
18418128c3
lotus-bench: make start tipset walkback start from end tipset.
2020-11-03 18:15:59 +00:00
Raúl Kripalani
581ac5b019
lotus-bench: add ability to specify tipsets.
2020-11-03 18:11:43 +00:00
Raúl Kripalani
842c8ca056
improve lotus-bench; support running validation on a store without a CAR.
2020-11-03 17:35:31 +00:00
zgfzgf
3e7efad0fd
modify lint error
2020-11-03 21:28:01 +08:00
zgfzgf
3c2cd506ec
modify merge lotus-bench
2020-11-03 19:56:04 +08:00
Raúl Kripalani
f4e13ffd80
actually register prometheus gauge.
2020-11-01 20:01:57 +00:00
Raúl Kripalani
44e34d9606
lotus-bench: native badger SyncWrites=false.
2020-11-01 19:54:47 +00:00
Raúl Kripalani
35ccd73a86
lotus-bench: improve for observability.
2020-11-01 19:52:53 +00:00
Raúl Kripalani
aece624d1c
lotus-bench: add support for native badger blockstore.
2020-11-01 18:54:35 +00:00
Raúl Kripalani
c2355b18f9
write heap and allocs profile in lotus-bench.
2020-11-01 18:00:08 +00:00
Łukasz Magiera
660236b224
Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers
2020-10-23 23:25:35 +02:00
Łukasz Magiera
041762a34f
Merge pull request #4383 from filecoin-project/steb/actor-v2-imports
...
Remove most v0 actor imports
2020-10-22 17:17:56 +02:00
Łukasz Magiera
0832d5a7d5
bench: Fix lint warnings
2020-10-22 15:00:31 +02:00
whyrusleeping
602d2b8ad5
record datastore metrics after successful run
2020-10-22 14:57:06 +02:00
Jakub Sztandera
0341944350
Inject prometheus
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-10-22 14:57:05 +02:00
whyrusleeping
00d1e6b549
add measure datastore wrapper around bench chain datastore
2020-10-22 14:57:04 +02:00
Steven Allen
4e730b5ec8
port to v2 imports
2020-10-21 12:16:23 -07:00
Łukasz Magiera
71b3b9075d
Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers
2020-10-13 21:33:21 +02:00
zgfzgf
bc1f18b73a
lotus bench optimize
2020-10-11 18:55:12 +08:00
zgfzgf
c3a405eac7
add lotus bench print
2020-10-11 18:26:27 +08:00
zgfzgf
e4209d86f6
lotus bench add ticket-preimage
2020-10-11 17:20:55 +08:00
zgfzgf
fcb9dea501
add sum sealing time
2020-10-11 16:31:39 +08:00
zgfzgf
c810b157cf
lotus bench delete ix
2020-10-11 11:39:27 +08:00
zgfzgf
c458f6e826
lotus bench replace abi.SectorID with sid
2020-10-11 11:25:19 +08:00
zgfzgf
c99e223cb1
lotus bench change and add print
2020-10-11 10:48:09 +08:00
zgfzgf
5c27d6aeee
lotus-bench UnsealPiece SectorID.Number error
2020-10-11 10:12:06 +08:00
Steven Allen
748d2e82a7
unshare the journal
...
Motivation:
* Run lotus with the race detector enabled (primary motivation).
* Allow multiple lotus nodes in a process (not a high priority).
Previously, the journal was shared between all lotus instances, but it was
initialized for every new node. This caused safety problems in tests (at a
minimum).
This patch explicitly passes the journal to all services that need it.
2020-10-09 13:23:07 -07:00
Łukasz Magiera
2cfe22d4e5
Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers
2020-09-30 20:48:16 +02:00
