Aayush Rajasekaran
a41a1cbd93
Gate runtime's GetRandomnessFromBeacon on HyperdriveHeight, not network version
2021-06-03 15:47:49 -04:00
Łukasz Magiera
c5797482b2
Revert CallWithGas hack
2021-06-03 18:51:01 +02:00
Łukasz Magiera
78c128f6a3
chain: Better logging in sync tests
2021-06-03 10:42:26 +02:00
Łukasz Magiera
ee21351aa0
statetree: Add missing version defs
2021-06-01 21:16:01 +02:00
Łukasz Magiera
a676da8a7e
Merge remote-tracking branch 'origin/master' into feat/nv13-1.11
2021-06-01 21:07:04 +02:00
Łukasz Magiera
dc642d0b7b
Merge remote-tracking branch 'origin/feat/nv13' into feat/nv13-1.11
2021-06-01 21:06:58 +02:00
Łukasz Magiera
fa8beeac2b
Merge pull request #6371 from filecoin-project/fix/robustify-commit-batcher
...
Fix tests
2021-06-01 21:01:03 +02:00
Aayush Rajasekaran
39f2246ae6
Use build.UpgradeHyperDriveHeight directly when sourcing randomness in VM
2021-06-01 14:43:46 -04:00
Aayush Rajasekaran
c8cef1cb7e
Fix chain/gen randomness getting (test only)
2021-06-01 13:44:08 -04:00
Łukasz Magiera
66c1554670
vm syscalls: fix typo
2021-06-01 19:23:12 +02:00
Aayush Rajasekaran
49fce48c3e
Tweak CallVM to use current epoch, not future epoch
2021-06-01 12:43:16 -04:00
Łukasz Magiera
5a9e6c8142
Merge pull request #6364 from filecoin-project/asr/resolve-messages
...
Improve address resolution for messages
2021-06-01 14:38:31 +02:00
Aayush Rajasekaran
2ab24b358d
Fix supported proof type manipulations for v5 actors
2021-05-31 18:50:29 -04:00
Mimir
ee508120d9
Typo fix in error message: "pubusb" -> "pubsub"
2021-05-31 15:30:10 -07:00
Aayush Rajasekaran
621e4eab0d
Address review
2021-05-31 18:13:23 -04:00
Aayush Rajasekaran
9ceee6028b
More tweaking of context handling in the messagepool
2021-05-31 18:13:23 -04:00
Aayush Rajasekaran
183c12db25
Make mempool reject ID addresses that are not reorg-stable
2021-05-31 18:13:23 -04:00
Aayush Rajasekaran
ed93d0725f
Protect mp.localAddrs and mp.pending behind helper functions
2021-05-31 18:13:23 -04:00
Aayush Rajasekaran
1f03a618f9
Plumb contexts through
2021-05-31 18:13:23 -04:00
Aayush Rajasekaran
8d991283f4
Resolve to ID addresses when handling message selection
2021-05-31 18:13:23 -04:00
Łukasz Magiera
3671f2a6ff
fix 2k build
2021-05-31 21:52:23 +02:00
Łukasz Magiera
ffa47659a1
Merge remote-tracking branch 'origin/feat/nv13' into feat/nv13-1.11
2021-05-31 21:38:34 +02:00
Łukasz Magiera
c3e8eddb9b
Merge remote-tracking branch 'origin/master' into feat/nv13-1.11
2021-05-31 21:24:56 +02:00
Łukasz Magiera
2a1b35e694
Merge pull request #6361 from filecoin-project/asr/fip-0015
...
Implement FIP-0015
2021-05-31 20:58:21 +02:00
Aayush Rajasekaran
61554cf3e0
Update to latest actors
2021-05-31 14:47:41 -04:00
Aayush Rajasekaran
7fca1c1ee7
Implement FIP-0015
2021-05-31 14:40:54 -04:00
Łukasz Magiera
8003a8a2d0
events: Fix handling of multiple matched events per epoch
2021-05-31 20:17:50 +02:00
Łukasz Magiera
3ea39f76e1
events: Fix handling of multiple matched events per epoch
2021-05-30 17:20:14 +02:00
Łukasz Magiera
dd79c2c41a
Merge pull request #6347 from filecoin-project/feat/agg-gas-price
...
Introduce gas prices for aggregate verifications
2021-05-28 12:40:16 +02:00
Aayush Rajasekaran
10b931312b
Fix edgecase in tipset skipcache
2021-05-27 13:44:37 -04:00
Jakub Sztandera
cb59daf3c1
Introduce gas prices for aggregate verifications
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2021-05-27 17:51:01 +02:00
Łukasz Magiera
1e4456138e
Merge master into feat/nv13
2021-05-27 12:28:20 +02:00
Aayush Rajasekaran
21b4741e30
Fix randomness fetching around null blocks
2021-05-26 21:06:06 -04:00
Aayush Rajasekaran
7714537239
Allow starting networks from arbitrary actor versions
2021-05-26 12:48:14 -04:00
Łukasz Magiera
43c62f4406
Revert "Allow starting networks from arbitrary actor versions"
2021-05-26 12:33:08 +02:00
Aayush Rajasekaran
cf574ca9a1
Allow starting networks from arbitrary actor versions
2021-05-25 19:30:20 -04:00
Łukasz Magiera
f5409845b5
Some review addressing
2021-05-25 16:07:45 +02:00
Peter Rabbitson
c2e5a837e6
Adjust various CLI display ratios to arbitrary precision
...
Originally the deviations from using float64 were insignificant, but at
exabyte scale they start to show up. Cleanup all displays, and clarify
the expectation text, adding an extra 99.9% probability calculator to
`lotus-miner info`
2021-05-25 14:09:01 +02:00
Peter Rabbitson
aed7017ab2
Forgotten deadcode
2021-05-21 15:30:08 +02:00
Peter Rabbitson
308d1e9b7c
Fix logging around mineOne
...
- A nil MiningBaseInfo is *NOT* unexpected: it happens when one is in penalty
https://github.com/filecoin-project/lotus/blob/v1.9.0/chain/stmgr/utils.go#L500-L502
- Remove the log from IsRoundWinner(): all we care about is the randbase epoch
2021-05-21 15:00:21 +02:00
Łukasz Magiera
678812f35b
gofmt, lint
2021-05-20 12:05:04 +02:00
raulk
996feda1f7
typo.
...
Co-authored-by: dirkmc <dirkmdev@gmail.com>
2021-05-19 15:08:14 +01:00
Łukasz Magiera
a5677d1b7a
ffiwrapper: Separate Prover interface
2021-05-19 15:20:23 +02:00
Łukasz Magiera
5112b9fe2b
Lower default batch slack
2021-05-18 21:04:47 +02:00
Łukasz Magiera
81b5d8c671
Make things build with both batchers
2021-05-18 16:53:49 +02:00
Łukasz Magiera
c7ba083fa4
Import precommit batcher
2021-05-18 16:51:06 +02:00
Jennifer Wang
5af3af5a22
Merge branch 'release/v1.9.0' into releases
2021-05-17 16:16:34 -04:00
Łukasz Magiera
2afe725933
Get PreCommitting to work
2021-05-17 22:02:23 +02:00
Łukasz Magiera
578bef4f83
Update gen
2021-05-17 20:56:28 +02:00
Łukasz Magiera
6278bdc69a
Make things build
2021-05-17 20:47:41 +02:00
Raúl Kripalani
c77f8fb382
adopt clearer method names; fix typo.
2021-05-15 15:07:02 +01:00
Raúl Kripalani
5daacc0f07
docs: add docs to chain store methods.
2021-05-13 13:08:52 +01:00
Łukasz Magiera
506f39b294
WIP: Integrate FIP0013
2021-05-11 22:10:29 -04:00
Aayush Rajasekaran
bf10b051ff
Merge pull request #6108 from filecoin-project/feat/actors-codegen
...
wip actor wrapper codegen
2021-05-10 20:12:57 -04:00
Aayush Rajasekaran
5f821cc733
Generate builtin.go
2021-05-10 19:53:07 -04:00
Aayush Rajasekaran
60446b46c8
Generate policy.go
2021-05-10 19:46:44 -04:00
Łukasz Magiera
cd2b959a88
wip partial codegen
2021-05-10 19:46:44 -04:00
Łukasz Magiera
a80259d986
Actor upgrade checklist
2021-05-10 19:46:44 -04:00
Łukasz Magiera
94d3c8bed7
fix lint
2021-05-10 19:46:44 -04:00
Łukasz Magiera
c6cebb448f
Cleanup actor adapter templates
2021-05-10 19:46:44 -04:00
Łukasz Magiera
715b3dccec
Fix error message
2021-05-10 19:46:44 -04:00
Łukasz Magiera
1a84bd5842
chain actors: codegen templates for all actors
2021-05-10 19:46:44 -04:00
Łukasz Magiera
0db070779f
wip actor wrapper codegen
2021-05-10 19:46:44 -04:00
Aayush Rajasekaran
b5da2655dc
Introduce v5 actors
2021-05-10 19:44:28 -04:00
Łukasz Magiera
63189cd81d
Generate wrappers for new actor versions
2021-05-09 21:04:50 -04:00
Jakub Sztandera
18cbdcfc81
Disable checks API on Lotus Lite
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2021-05-07 17:19:17 +02:00
Jakub Sztandera
d777680449
Fix mpool.GetActor for lite node
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2021-05-07 15:30:06 +02:00
Jakub Sztandera
cbfb4770fd
Add function to display nanoFIL
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2021-05-07 15:30:05 +02:00
Jakub Sztandera
8d75da1629
Use MessagePrototype for check API
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2021-05-07 15:30:05 +02:00
Jakub Sztandera
7535c5bb53
Add mpool manage
command
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2021-05-07 15:30:05 +02:00
Jakub Sztandera
87df73a455
Fix get nonce check
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2021-05-07 15:30:05 +02:00
Jakub Sztandera
86e90dc6f1
Message sending UI
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2021-05-07 15:30:04 +02:00
vyzo
d782250aba
implement MessagePool.CheckReplaceMessages
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2021-05-07 15:30:04 +02:00
vyzo
91e774063e
implement MessagePool.CheckMessages
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2021-05-07 15:30:04 +02:00
Peter Rabbitson
de60229957
mining lookback is effectively a constant - make it so
2021-05-06 10:18:08 +02:00
Peter Rabbitson
b1db3fee78
Log more ComputeVRF() inputs as per Why's request
2021-05-06 10:18:08 +02:00
Peter Rabbitson
72134ff458
Add a mining-heartbeat INFO line at every epoch
2021-05-06 10:18:08 +02:00
Peter Rabbitson
26841aa094
mining lookback is effectively a constant - make it so
2021-05-05 23:23:01 +02:00
Peter Rabbitson
3b0fc01e82
Log more ComputeVRF() inputs as per Why's request
2021-05-05 23:23:01 +02:00
Peter Rabbitson
14f6d170b2
Add a mining-heartbeat INFO line at every epoch
2021-05-05 23:23:01 +02:00
Aayush Rajasekaran
c074031fa1
Merge pull request #6167 from filecoin-project/asr/state-tree-version
...
Allow creation of state tree v3s
2021-05-03 19:16:44 -04:00
Aayush Rajasekaran
2a90de30bd
Merge pull request #6164 from filecoin-project/fix/drand-cache
...
drand: fix beacon cache
2021-05-01 12:21:38 -04:00
Aayush Rajasekaran
4193235b59
Allow creation of state tree v3s
2021-04-30 22:41:02 -04:00
Łukasz Magiera
04c71b2c6b
mpool: Cleanup pre-nv12 selection logic
2021-04-30 10:10:42 +02:00
Łukasz Magiera
ab811e2e19
drand: fix beacon cache
2021-04-30 09:35:38 +02:00
Steven Allen
eb10918470
Merge pull request #6107 from filecoin-project/feat/checkpoint-sync
...
feat: allow checkpointing to forks
2021-04-29 16:30:52 -07:00
Aayush Rajasekaran
e6779b0b6f
Add a command to get the fees of a deal
2021-04-29 13:29:17 -04:00
Steven Allen
f983fa8cd5
Merge pull request #6134 from filecoin-project/asr/emptytsk
...
Use EmptyTSK where appropriate
2021-04-29 09:35:43 -07:00
Steven Allen
4867425685
fix: use the parent state when listing actors
...
To be consistent with other commands.
2021-04-28 23:35:27 -07:00
Łukasz Magiera
4b04cac219
Merge pull request #4938 from filecoin-project/asr/total-power
...
Return total power when GetPowerRaw doesn't find miner claim
2021-04-29 07:45:43 +02:00
Aayush Rajasekaran
d794b49df3
Use EmptyTSK where appropriate
2021-04-29 01:00:03 -04:00
Steven Allen
8f309b214b
chain: move checkpoint logic into chainstore
...
That way, checkpoints can be enforced by the chainstore, removing a
potential race where an in-progress sync of a fork could bypass a sync
checkpoint.
2021-04-28 15:06:29 -07:00
Steven Allen
0ad51f8a14
test(sync): fix tipset check and re-enable checkpoint tests
...
We need to wait until the node _has_ the tipset, not until it doesn't.
This probably only worked before due to race conditions.
fixes #4716 (probably)
2021-04-28 15:06:29 -07:00
Steven Allen
69da6a2a29
feat: allow checkpointing to forks
...
Previously, `lotus sync checkpoint` would only checkpoint on the current
chain. Now, it can switch to a new fork.
2021-04-28 13:54:26 -07:00
Łukasz Magiera
95e0c3df1d
1.9.0-rc1
2021-04-27 10:30:51 +02:00
Łukasz Magiera
a24a73bb52
Merge tag 'v1.8.0' into release/v1.9.0
2021-04-27 10:30:33 +02:00
Łukasz Magiera
c4137a438d
Merge commit 'f1ded63d608e1b191d79c780b8065f8cff367c98' into feat/nv12-1.11
2021-04-27 08:22:55 +02:00
Aayush Rajasekaran
f1ded63d60
v4 specs-actors integration, nv12 migration
2021-04-27 02:02:44 -04:00
Łukasz Magiera
2e63690125
Merge pull request #6056 from filecoin-project/feat/vm-metrics
...
stmgr: Improve ApplyBlocks metrics
2021-04-18 17:07:16 +02:00
Łukasz Magiera
c7a67cf0e1
Merge pull request #6059 from filecoin-project/frrist/expose-filReserveDisbursed
...
polish(api): expose filReserveDisbursed via CirculatingSupply API
2021-04-18 16:31:03 +02:00
Łukasz Magiera
c72eb0ccaf
Merge pull request #6048 from filecoin-project/fix/nonce-getting
...
Fix nonce getting on Lotus lite
2021-04-18 16:25:47 +02:00
Łukasz Magiera
bb7801e6b7
fix lint
2021-04-18 16:17:31 +02:00
frrist
c118415b12
polish(api): expose filReserveDisbursed via CirculatingSupply API
...
- motivated by: https://github.com/filecoin-project/sentinel-visor/issues/462
2021-04-16 15:15:38 -07:00
Jakub Sztandera
66c408938b
Fix signature in messagepool, wire in context
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2021-04-16 18:43:28 +02:00
Łukasz Magiera
1b696aae5f
stmgr: Fix VMApplyEarly metric
2021-04-16 14:57:59 +02:00
Jakub Sztandera
fd0eb2ec8f
Disable flaky checkpoint tests
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2021-04-15 19:59:25 +02:00
Jakub Sztandera
77d004ec06
Fix nonce getting on Lotus lite
...
Resolves #5593 #5995
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2021-04-15 19:57:09 +02:00
Łukasz Magiera
53537a0af2
stmgr: Improve ApplyBlocks metrics
2021-04-15 19:44:13 +02:00
Łukasz Magiera
e76935147f
Merge remote-tracking branch 'origin/master' into feat/v1-api
2021-04-13 14:24:22 +02:00
Aayush Rajasekaran
c1e4eb3b20
Add a whitelisted block
2021-04-10 02:12:38 -04:00
FinnZhang
9805758e8a
remove messagepool CapGasFee duplicate code
2021-04-08 17:50:19 +08:00
Peter Rabbitson
a40fb1e1dd
Merge pull request #5974 from filecoin-project/chore/move_to_ipfs_log_v2
...
Centralize everything on ipfs/go-log/v2
2021-04-06 18:01:36 +02:00
Peter Rabbitson
25a77d905d
Centralize everything on ipfs/go-log/v2
...
I am not entirely sure this is right, but everything seems to build...
2021-04-06 15:04:32 +02:00
Peter Rabbitson
7bced1532b
Convert the chainstore lock to RW
...
High read-API concurrency facilitates multiple calls to GetHeaviestTipSet
which in turn could slow down chainsync.
2021-04-06 13:01:48 +02:00
Łukasz Magiera
e8f28d7b9f
Fix tests
2021-04-06 12:24:58 +02:00
Aayush Rajasekaran
37ca23d9e2
Merge branch 'releases' into asr/release-master
2021-04-05 17:29:19 -04:00
Łukasz Magiera
81bd27911f
Propagate StateMsg api changes
2021-04-05 19:56:53 +02:00
Łukasz Magiera
deb2b90b6a
Fix lotus/miner build
2021-04-05 13:23:46 +02:00
Aayush Rajasekaran
72c410cd8f
Address review on v1 sector extension tool
2021-04-03 22:19:36 -04:00
Łukasz Magiera
0103d2f621
v1 api: Cleanup message wait/search apis
2021-04-02 13:52:24 +02:00
Łukasz Magiera
c9866da688
Merge remote-tracking branch 'origin/master' into feat/v1-api
2021-04-02 13:15:33 +02:00
Łukasz Magiera
28a8636f0b
Merge pull request #5807 from filecoin-project/asr/remainder-acct-fix
...
Fix creation of remainder account when it's not a multisig
2021-04-01 16:31:19 +02:00
Łukasz Magiera
1a5c4d70f4
Merge remote-tracking branch 'origin/master' into feat/v1-api
2021-04-01 15:33:37 +02:00
Aayush Rajasekaran
cea46e5f53
Upgrade to version 11 at Norwegian height
2021-03-29 18:50:13 -04:00
Łukasz Magiera
a7122d424b
Merge pull request #5527 from filcloud/handle-ticket-expire
...
fix precommit ticket expiration handling
2021-03-29 22:55:43 +02:00
Łukasz Magiera
bf6ee88539
Merge pull request #5270 from filcloud/deal-duration
...
use deal duration from actors
2021-03-29 20:17:34 +02:00
Łukasz Magiera
089ff08d81
Merge pull request #5881 from filecoin-project/fix/lint-skip
...
lint: don't skip builtin
2021-03-27 10:09:44 +01:00
Steven Allen
f5029a0187
lint: don't skip builtin
2021-03-25 17:21:56 -07:00
Łukasz Magiera
e003977559
apiclient: Version client funcs
2021-03-25 15:39:48 +01:00
Łukasz Magiera
759ea5b14f
Merge remote-tracking branch 'origin/master' into feat/v1-api
2021-03-25 14:13:21 +01:00
Łukasz Magiera
53cba157e2
Merge pull request #5804 from zl03jsj/fix/StateManager.Replay
...
fix: StateManager.Replay
2021-03-25 13:27:45 +01:00
Łukasz Magiera
fc4f60e528
Merge pull request #5850 from filecoin-project/feat/markets-dealid
...
expose NextID from nice market actor interface
2021-03-25 13:26:29 +01:00
Łukasz Magiera
65dcec0ebc
api client: Use versioned api packages
2021-03-23 19:15:53 +01:00
Łukasz Magiera
c41777dcd2
API proxy struct codegen ( #5854 )
...
* mostly working api proxy gen
* api: Consistent api names
* fix docsgen
* regenerate api struct
* api: expand external interfaces
* Add missing gen files
* apigen: fix perm detection
* api: Move perm tags to the interface
* gofmt
* worker perms
* docsgen
* docsgen: ignore tag comments
* apigen: add codegen warning
* gofmt
* missing actor type
* docsgen
* make linter happy
* fix lint
* apigen: use directives for tags
* docsgen
* regen openrpc docs
2021-03-23 13:42:56 +01:00
frrist
0b579c1e03
feat(events): define Observer intreface for events
...
- allows tipset apply and revert to be observed
2021-03-22 15:37:44 -07:00
whyrusleeping
6bcf92f71a
expose NextID from nice market actor interface
2021-03-21 00:11:42 -07:00
Peter Rabbitson
c340750672
Nerpa reset backport/cherry-pick from 73eabc310f
2021-03-18 20:55:15 +01:00
Aayush Rajasekaran
707219b7a1
Disable the Calico migration on not-mainnet
2021-03-17 20:46:00 -04:00
Aayush Rajasekaran
fe473e111c
Fix creation of remainder account when it's not a multisig
2021-03-12 17:12:41 -05:00
zl
6f64d5db6f
bugfix: StateManager.Replay
2021-03-13 00:12:37 +08:00
whyrusleeping
e0b650d4ec
make rpcstatemanager its own package, for easy reuse
2021-03-11 18:21:18 -08:00
Łukasz Magiera
58d7627168
Merge pull request #5730 from filecoin-project/asr/genesis-rootkey
...
Customize verifreg root key and remainder account when making genesis
2021-03-08 22:42:09 +01:00
Aayush Rajasekaran
fc03a0773b
gen/genesis: Allow remainder to be either account or msig
2021-03-06 01:43:48 -05:00
Aayush Rajasekaran
279f9e6fec
gen/genesis: Allow verifreg rootkey to be either account or msig
2021-03-06 01:43:48 -05:00
Raúl Kripalani
b1b452bc0f
remove dependency from blockstore/splitstore => chain/store.
2021-03-05 14:46:18 +02:00
Raúl Kripalani
1a804fbdec
move splitstore into blockstore package.
2021-03-05 14:46:18 +02:00
Raúl Kripalani
1b51c10d78
split off lmdb support to a different branch.
2021-03-05 14:46:18 +02:00
vyzo
0fc2f3a26f
fix post-rebase compilation errors
2021-03-05 14:46:18 +02:00
vyzo
3282f856ec
fix tests
2021-03-05 14:46:18 +02:00
vyzo
99c6e4f48f
adjust min bloom filter size
2021-03-05 14:46:18 +02:00
vyzo
cae5ddce88
dynamically size bloom filters
2021-03-05 14:46:18 +02:00
vyzo
5639261e44
make compaction parameters variable
2021-03-05 14:46:18 +02:00
vyzo
7587ab6234
quiet the stupid linter
2021-03-05 14:46:18 +02:00
vyzo
05fee27840
remove stale references to lmdb from splitstore implementation
2021-03-05 14:46:18 +02:00
vyzo
f62999d2b8
use named constants for bloom filter parameters
2021-03-05 14:46:18 +02:00
vyzo
44aadb931a
rehash salted keys in bloom filter
2021-03-05 14:46:17 +02:00
vyzo
88849201ff
fix tests
2021-03-05 14:46:17 +02:00
vyzo
f5ce7957f3
size bloom filter for 50M objects
2021-03-05 14:46:17 +02:00
vyzo
f4c6bc6a86
comment nomenclature
2021-03-05 14:46:17 +02:00
vyzo
4cc672d0c5
batch move objects from coldstore to hotstore
2021-03-05 14:46:17 +02:00
vyzo
97abbe1eca
add (salted) bloom filter liveset
2021-03-05 14:46:17 +02:00
vyzo
aba6530411
batch deletion for purging the tracking store
2021-03-05 14:46:17 +02:00
vyzo
09cd1175a1
structured log for beginning of compaction
2021-03-05 14:46:17 +02:00
vyzo
e52c709d8a
more accurate setting of skip params
2021-03-05 14:46:17 +02:00
vyzo
2426ffb277
better logging plus moving some code around
2021-03-05 14:46:17 +02:00
vyzo
2f26026991
compactSimple should walk the cold epoch at depth 1
...
So that it finds reachable objects that should stay in the hotstore
2021-03-05 14:46:17 +02:00
vyzo
783dcda19c
add Sync to the tracking store
2021-03-05 14:46:17 +02:00
vyzo
364076c1ea
set NoSync option for bolt livesets
2021-03-05 14:46:17 +02:00
vyzo
73259aa350
add configuration for splitstore and default to a simple compaction algorithm
2021-03-05 14:46:17 +02:00
vyzo
2e4d45ef07
test for bolt backed tracking store
2021-03-05 14:46:17 +02:00
vyzo
f1c61c4753
implement bolt backed tracking store
2021-03-05 14:46:17 +02:00
vyzo
2c1a9781cf
add test for bolt liveset
2021-03-05 14:46:17 +02:00
vyzo
27a9b974db
implement bolt-backed liveset
2021-03-05 14:46:17 +02:00
vyzo
68b6f913c7
propagate useLMDB option to splitstore through DI
2021-03-05 14:46:17 +02:00
vyzo
923a3db4b0
abstract tracking store and live set construction
2021-03-05 14:46:17 +02:00
vyzo
8f0ddac41a
add comment
2021-03-05 14:46:17 +02:00
vyzo
e79445123f
handle MDB_KEY_EXIST in tracking store Puts
2021-03-05 14:46:17 +02:00
vyzo
9977f5c3ec
rewrite sweep logic to avoid doing writes/deletes nested in a read txn
2021-03-05 14:46:17 +02:00
vyzo
ee751f88cd
refactor lmdb specific snoop/liveset code into their own files
...
paves the way for different back ends
2021-03-05 14:46:17 +02:00
vyzo
8e12377e69
handle consistency edge case
2021-03-05 14:46:17 +02:00
vyzo
31268ba685
walk snapshot the same way snapshot exporting does; skip old msgs and receipts by default.
...
so that we don't panic with missing blocks in non-archival nodes
2021-03-05 14:46:17 +02:00
vyzo
5068d51ac3
use CompactionCold epochs for delinating the cold epoch cliff
...
this allows us to change the thresholds for testing.
2021-03-05 14:46:17 +02:00
vyzo
d44719dbd3
amend confusing comment
2021-03-05 14:46:17 +02:00
vyzo
842ec43c2f
get rid of goroutine iteration in tracking store; long live ForEach
2021-03-05 14:46:17 +02:00
vyzo
a586d42c3b
make hot store DI injectable in the split store, default to badger.
2021-03-05 14:46:17 +02:00
vyzo
7044e623f9
flag to enable GC during compaction, disabled for now
2021-03-05 14:46:17 +02:00
vyzo
f6c930d0aa
crank up blockstore max readers to 16K, reduce retry delays to 10us
2021-03-05 14:46:17 +02:00
vyzo
95befa1e41
set lmdb max readers retry delay to 1ms
2021-03-05 14:46:17 +02:00
vyzo
874ecd3573
adjust hot store options, redux.
2021-03-05 14:46:17 +02:00
vyzo
ca8a673b5f
adjust hot store options
2021-03-05 14:46:17 +02:00
vyzo
69a88d41b6
fix snoop test
2021-03-05 14:46:17 +02:00
vyzo
cdf5bd0500
return annotated xerrors where appropriate
2021-03-05 14:46:17 +02:00
vyzo
ea05fd9d86
use xerrors instead of fmt.Errorf
2021-03-05 14:46:17 +02:00
vyzo
d91b60df91
fix potential panic with max readers retry and cursor channel
2021-03-05 14:46:17 +02:00
vyzo
b9f8a3d587
log MDB_READERS_FULL retries
2021-03-05 14:46:17 +02:00
vyzo
c89ab1a990
retry on MDB_READERS_FULL errors
2021-03-05 14:46:17 +02:00
vyzo
2080e467ba
don't set MaxReaders for tracking store
2021-03-05 14:46:17 +02:00
Raúl Kripalani
877ecab960
update go-bs-lmdb and migrate to ledgerwatch/lmdb-go.
2021-03-05 14:46:17 +02:00
vyzo
5b4e6b7b26
don't set max readers for livesets
2021-03-05 14:46:17 +02:00
vyzo
58a8434825
temporary log level for splitstore to DEBUG
2021-03-05 14:46:17 +02:00