Łukasz Magiera
678812f35b
gofmt, lint
2021-05-20 12:05:04 +02:00
raulk
996feda1f7
typo.
...
Co-authored-by: dirkmc <dirkmdev@gmail.com>
2021-05-19 15:08:14 +01:00
Łukasz Magiera
a5677d1b7a
ffiwrapper: Separate Prover interface
2021-05-19 15:20:23 +02:00
Łukasz Magiera
5112b9fe2b
Lower default batch slack
2021-05-18 21:04:47 +02:00
Łukasz Magiera
81b5d8c671
Make things build with both batchers
2021-05-18 16:53:49 +02:00
Łukasz Magiera
c7ba083fa4
Import precommit batcher
2021-05-18 16:51:06 +02:00
Jennifer Wang
5af3af5a22
Merge branch 'release/v1.9.0' into releases
2021-05-17 16:16:34 -04:00
Łukasz Magiera
2afe725933
Get PreCommitting to work
2021-05-17 22:02:23 +02:00
Łukasz Magiera
578bef4f83
Update gen
2021-05-17 20:56:28 +02:00
Łukasz Magiera
6278bdc69a
Make things build
2021-05-17 20:47:41 +02:00
Raúl Kripalani
c77f8fb382
adopt clearer method names; fix typo.
2021-05-15 15:07:02 +01:00
Raúl Kripalani
5daacc0f07
docs: add docs to chain store methods.
2021-05-13 13:08:52 +01:00
Łukasz Magiera
506f39b294
WIP: Integrate FIP0013
2021-05-11 22:10:29 -04:00
Aayush Rajasekaran
bf10b051ff
Merge pull request #6108 from filecoin-project/feat/actors-codegen
...
wip actor wrapper codegen
2021-05-10 20:12:57 -04:00
Aayush Rajasekaran
5f821cc733
Generate builtin.go
2021-05-10 19:53:07 -04:00
Aayush Rajasekaran
60446b46c8
Generate policy.go
2021-05-10 19:46:44 -04:00
Łukasz Magiera
cd2b959a88
wip partial codegen
2021-05-10 19:46:44 -04:00
Łukasz Magiera
a80259d986
Actor upgrade checklist
2021-05-10 19:46:44 -04:00
Łukasz Magiera
94d3c8bed7
fix lint
2021-05-10 19:46:44 -04:00
Łukasz Magiera
c6cebb448f
Cleanup actor adapter templates
2021-05-10 19:46:44 -04:00
Łukasz Magiera
715b3dccec
Fix error message
2021-05-10 19:46:44 -04:00
Łukasz Magiera
1a84bd5842
chain actors: codegen templates for all actors
2021-05-10 19:46:44 -04:00
Łukasz Magiera
0db070779f
wip actor wrapper codegen
2021-05-10 19:46:44 -04:00
Aayush Rajasekaran
b5da2655dc
Introduce v5 actors
2021-05-10 19:44:28 -04:00
Łukasz Magiera
63189cd81d
Generate wrappers for new actor versions
2021-05-09 21:04:50 -04:00
Jakub Sztandera
18cbdcfc81
Disable checks API on Lotus Lite
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2021-05-07 17:19:17 +02:00
Jakub Sztandera
d777680449
Fix mpool.GetActor for lite node
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2021-05-07 15:30:06 +02:00
Jakub Sztandera
cbfb4770fd
Add function to display nanoFIL
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2021-05-07 15:30:05 +02:00
Jakub Sztandera
8d75da1629
Use MessagePrototype for check API
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2021-05-07 15:30:05 +02:00
Jakub Sztandera
7535c5bb53
Add mpool manage
command
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2021-05-07 15:30:05 +02:00
Jakub Sztandera
87df73a455
Fix get nonce check
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2021-05-07 15:30:05 +02:00
Jakub Sztandera
86e90dc6f1
Message sending UI
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2021-05-07 15:30:04 +02:00
vyzo
d782250aba
implement MessagePool.CheckReplaceMessages
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2021-05-07 15:30:04 +02:00
vyzo
91e774063e
implement MessagePool.CheckMessages
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2021-05-07 15:30:04 +02:00
Peter Rabbitson
de60229957
mining lookback is effectively a constant - make it so
2021-05-06 10:18:08 +02:00
Peter Rabbitson
b1db3fee78
Log more ComputeVRF() inputs as per Why's request
2021-05-06 10:18:08 +02:00
Peter Rabbitson
72134ff458
Add a mining-heartbeat INFO line at every epoch
2021-05-06 10:18:08 +02:00
Peter Rabbitson
26841aa094
mining lookback is effectively a constant - make it so
2021-05-05 23:23:01 +02:00
Peter Rabbitson
3b0fc01e82
Log more ComputeVRF() inputs as per Why's request
2021-05-05 23:23:01 +02:00
Peter Rabbitson
14f6d170b2
Add a mining-heartbeat INFO line at every epoch
2021-05-05 23:23:01 +02:00
Aayush Rajasekaran
c074031fa1
Merge pull request #6167 from filecoin-project/asr/state-tree-version
...
Allow creation of state tree v3s
2021-05-03 19:16:44 -04:00
Aayush Rajasekaran
2a90de30bd
Merge pull request #6164 from filecoin-project/fix/drand-cache
...
drand: fix beacon cache
2021-05-01 12:21:38 -04:00
Aayush Rajasekaran
4193235b59
Allow creation of state tree v3s
2021-04-30 22:41:02 -04:00
Łukasz Magiera
04c71b2c6b
mpool: Cleanup pre-nv12 selection logic
2021-04-30 10:10:42 +02:00
Łukasz Magiera
ab811e2e19
drand: fix beacon cache
2021-04-30 09:35:38 +02:00
Steven Allen
eb10918470
Merge pull request #6107 from filecoin-project/feat/checkpoint-sync
...
feat: allow checkpointing to forks
2021-04-29 16:30:52 -07:00
Aayush Rajasekaran
e6779b0b6f
Add a command to get the fees of a deal
2021-04-29 13:29:17 -04:00
Steven Allen
f983fa8cd5
Merge pull request #6134 from filecoin-project/asr/emptytsk
...
Use EmptyTSK where appropriate
2021-04-29 09:35:43 -07:00
Steven Allen
4867425685
fix: use the parent state when listing actors
...
To be consistent with other commands.
2021-04-28 23:35:27 -07:00
Łukasz Magiera
4b04cac219
Merge pull request #4938 from filecoin-project/asr/total-power
...
Return total power when GetPowerRaw doesn't find miner claim
2021-04-29 07:45:43 +02:00
Aayush Rajasekaran
d794b49df3
Use EmptyTSK where appropriate
2021-04-29 01:00:03 -04:00
Steven Allen
8f309b214b
chain: move checkpoint logic into chainstore
...
That way, checkpoints can be enforced by the chainstore, removing a
potential race where an in-progress sync of a fork could bypass a sync
checkpoint.
2021-04-28 15:06:29 -07:00
Steven Allen
0ad51f8a14
test(sync): fix tipset check and re-enable checkpoint tests
...
We need to wait until the node _has_ the tipset, not until it doesn't.
This probably only worked before due to race conditions.
fixes #4716 (probably)
2021-04-28 15:06:29 -07:00
Steven Allen
69da6a2a29
feat: allow checkpointing to forks
...
Previously, `lotus sync checkpoint` would only checkpoint on the current
chain. Now, it can switch to a new fork.
2021-04-28 13:54:26 -07:00
Łukasz Magiera
95e0c3df1d
1.9.0-rc1
2021-04-27 10:30:51 +02:00
Łukasz Magiera
a24a73bb52
Merge tag 'v1.8.0' into release/v1.9.0
2021-04-27 10:30:33 +02:00
Łukasz Magiera
c4137a438d
Merge commit 'f1ded63d608e1b191d79c780b8065f8cff367c98' into feat/nv12-1.11
2021-04-27 08:22:55 +02:00
Aayush Rajasekaran
f1ded63d60
v4 specs-actors integration, nv12 migration
2021-04-27 02:02:44 -04:00
Łukasz Magiera
2e63690125
Merge pull request #6056 from filecoin-project/feat/vm-metrics
...
stmgr: Improve ApplyBlocks metrics
2021-04-18 17:07:16 +02:00
Łukasz Magiera
c7a67cf0e1
Merge pull request #6059 from filecoin-project/frrist/expose-filReserveDisbursed
...
polish(api): expose filReserveDisbursed via CirculatingSupply API
2021-04-18 16:31:03 +02:00
Łukasz Magiera
c72eb0ccaf
Merge pull request #6048 from filecoin-project/fix/nonce-getting
...
Fix nonce getting on Lotus lite
2021-04-18 16:25:47 +02:00
Łukasz Magiera
bb7801e6b7
fix lint
2021-04-18 16:17:31 +02:00
frrist
c118415b12
polish(api): expose filReserveDisbursed via CirculatingSupply API
...
- motivated by: https://github.com/filecoin-project/sentinel-visor/issues/462
2021-04-16 15:15:38 -07:00
Jakub Sztandera
66c408938b
Fix signature in messagepool, wire in context
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2021-04-16 18:43:28 +02:00
Łukasz Magiera
1b696aae5f
stmgr: Fix VMApplyEarly metric
2021-04-16 14:57:59 +02:00
Jakub Sztandera
fd0eb2ec8f
Disable flaky checkpoint tests
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2021-04-15 19:59:25 +02:00
Jakub Sztandera
77d004ec06
Fix nonce getting on Lotus lite
...
Resolves #5593 #5995
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2021-04-15 19:57:09 +02:00
Łukasz Magiera
53537a0af2
stmgr: Improve ApplyBlocks metrics
2021-04-15 19:44:13 +02:00
Łukasz Magiera
e76935147f
Merge remote-tracking branch 'origin/master' into feat/v1-api
2021-04-13 14:24:22 +02:00
Aayush Rajasekaran
c1e4eb3b20
Add a whitelisted block
2021-04-10 02:12:38 -04:00
FinnZhang
9805758e8a
remove messagepool CapGasFee duplicate code
2021-04-08 17:50:19 +08:00
Peter Rabbitson
a40fb1e1dd
Merge pull request #5974 from filecoin-project/chore/move_to_ipfs_log_v2
...
Centralize everything on ipfs/go-log/v2
2021-04-06 18:01:36 +02:00
Peter Rabbitson
25a77d905d
Centralize everything on ipfs/go-log/v2
...
I am not entirely sure this is right, but everything seems to build...
2021-04-06 15:04:32 +02:00
Peter Rabbitson
7bced1532b
Convert the chainstore lock to RW
...
High read-API concurrency facilitates multiple calls to GetHeaviestTipSet
which in turn could slow down chainsync.
2021-04-06 13:01:48 +02:00
Łukasz Magiera
e8f28d7b9f
Fix tests
2021-04-06 12:24:58 +02:00
Aayush Rajasekaran
37ca23d9e2
Merge branch 'releases' into asr/release-master
2021-04-05 17:29:19 -04:00
Łukasz Magiera
81bd27911f
Propagate StateMsg api changes
2021-04-05 19:56:53 +02:00
Łukasz Magiera
deb2b90b6a
Fix lotus/miner build
2021-04-05 13:23:46 +02:00
Aayush Rajasekaran
72c410cd8f
Address review on v1 sector extension tool
2021-04-03 22:19:36 -04:00
Łukasz Magiera
0103d2f621
v1 api: Cleanup message wait/search apis
2021-04-02 13:52:24 +02:00
Łukasz Magiera
c9866da688
Merge remote-tracking branch 'origin/master' into feat/v1-api
2021-04-02 13:15:33 +02:00
Łukasz Magiera
28a8636f0b
Merge pull request #5807 from filecoin-project/asr/remainder-acct-fix
...
Fix creation of remainder account when it's not a multisig
2021-04-01 16:31:19 +02:00
Łukasz Magiera
1a5c4d70f4
Merge remote-tracking branch 'origin/master' into feat/v1-api
2021-04-01 15:33:37 +02:00
Aayush Rajasekaran
cea46e5f53
Upgrade to version 11 at Norwegian height
2021-03-29 18:50:13 -04:00
Łukasz Magiera
a7122d424b
Merge pull request #5527 from filcloud/handle-ticket-expire
...
fix precommit ticket expiration handling
2021-03-29 22:55:43 +02:00
Łukasz Magiera
bf6ee88539
Merge pull request #5270 from filcloud/deal-duration
...
use deal duration from actors
2021-03-29 20:17:34 +02:00
Łukasz Magiera
089ff08d81
Merge pull request #5881 from filecoin-project/fix/lint-skip
...
lint: don't skip builtin
2021-03-27 10:09:44 +01:00
Steven Allen
f5029a0187
lint: don't skip builtin
2021-03-25 17:21:56 -07:00
Łukasz Magiera
e003977559
apiclient: Version client funcs
2021-03-25 15:39:48 +01:00
Łukasz Magiera
759ea5b14f
Merge remote-tracking branch 'origin/master' into feat/v1-api
2021-03-25 14:13:21 +01:00
Łukasz Magiera
53cba157e2
Merge pull request #5804 from zl03jsj/fix/StateManager.Replay
...
fix: StateManager.Replay
2021-03-25 13:27:45 +01:00
Łukasz Magiera
fc4f60e528
Merge pull request #5850 from filecoin-project/feat/markets-dealid
...
expose NextID from nice market actor interface
2021-03-25 13:26:29 +01:00
Łukasz Magiera
65dcec0ebc
api client: Use versioned api packages
2021-03-23 19:15:53 +01:00
Łukasz Magiera
c41777dcd2
API proxy struct codegen ( #5854 )
...
* mostly working api proxy gen
* api: Consistent api names
* fix docsgen
* regenerate api struct
* api: expand external interfaces
* Add missing gen files
* apigen: fix perm detection
* api: Move perm tags to the interface
* gofmt
* worker perms
* docsgen
* docsgen: ignore tag comments
* apigen: add codegen warning
* gofmt
* missing actor type
* docsgen
* make linter happy
* fix lint
* apigen: use directives for tags
* docsgen
* regen openrpc docs
2021-03-23 13:42:56 +01:00
frrist
0b579c1e03
feat(events): define Observer intreface for events
...
- allows tipset apply and revert to be observed
2021-03-22 15:37:44 -07:00
whyrusleeping
6bcf92f71a
expose NextID from nice market actor interface
2021-03-21 00:11:42 -07:00
Peter Rabbitson
c340750672
Nerpa reset backport/cherry-pick from 73eabc310f
2021-03-18 20:55:15 +01:00
Aayush Rajasekaran
707219b7a1
Disable the Calico migration on not-mainnet
2021-03-17 20:46:00 -04:00
Aayush Rajasekaran
fe473e111c
Fix creation of remainder account when it's not a multisig
2021-03-12 17:12:41 -05:00
zl
6f64d5db6f
bugfix: StateManager.Replay
2021-03-13 00:12:37 +08:00
whyrusleeping
e0b650d4ec
make rpcstatemanager its own package, for easy reuse
2021-03-11 18:21:18 -08:00
Łukasz Magiera
58d7627168
Merge pull request #5730 from filecoin-project/asr/genesis-rootkey
...
Customize verifreg root key and remainder account when making genesis
2021-03-08 22:42:09 +01:00
Aayush Rajasekaran
fc03a0773b
gen/genesis: Allow remainder to be either account or msig
2021-03-06 01:43:48 -05:00
Aayush Rajasekaran
279f9e6fec
gen/genesis: Allow verifreg rootkey to be either account or msig
2021-03-06 01:43:48 -05:00
Raúl Kripalani
b1b452bc0f
remove dependency from blockstore/splitstore => chain/store.
2021-03-05 14:46:18 +02:00
Raúl Kripalani
1a804fbdec
move splitstore into blockstore package.
2021-03-05 14:46:18 +02:00
Raúl Kripalani
1b51c10d78
split off lmdb support to a different branch.
2021-03-05 14:46:18 +02:00
vyzo
0fc2f3a26f
fix post-rebase compilation errors
2021-03-05 14:46:18 +02:00
vyzo
3282f856ec
fix tests
2021-03-05 14:46:18 +02:00
vyzo
99c6e4f48f
adjust min bloom filter size
2021-03-05 14:46:18 +02:00
vyzo
cae5ddce88
dynamically size bloom filters
2021-03-05 14:46:18 +02:00
vyzo
5639261e44
make compaction parameters variable
2021-03-05 14:46:18 +02:00
vyzo
7587ab6234
quiet the stupid linter
2021-03-05 14:46:18 +02:00
vyzo
05fee27840
remove stale references to lmdb from splitstore implementation
2021-03-05 14:46:18 +02:00
vyzo
f62999d2b8
use named constants for bloom filter parameters
2021-03-05 14:46:18 +02:00
vyzo
44aadb931a
rehash salted keys in bloom filter
2021-03-05 14:46:17 +02:00
vyzo
88849201ff
fix tests
2021-03-05 14:46:17 +02:00
vyzo
f5ce7957f3
size bloom filter for 50M objects
2021-03-05 14:46:17 +02:00
vyzo
f4c6bc6a86
comment nomenclature
2021-03-05 14:46:17 +02:00
vyzo
4cc672d0c5
batch move objects from coldstore to hotstore
2021-03-05 14:46:17 +02:00
vyzo
97abbe1eca
add (salted) bloom filter liveset
2021-03-05 14:46:17 +02:00
vyzo
aba6530411
batch deletion for purging the tracking store
2021-03-05 14:46:17 +02:00
vyzo
09cd1175a1
structured log for beginning of compaction
2021-03-05 14:46:17 +02:00
vyzo
e52c709d8a
more accurate setting of skip params
2021-03-05 14:46:17 +02:00
vyzo
2426ffb277
better logging plus moving some code around
2021-03-05 14:46:17 +02:00
vyzo
2f26026991
compactSimple should walk the cold epoch at depth 1
...
So that it finds reachable objects that should stay in the hotstore
2021-03-05 14:46:17 +02:00
vyzo
783dcda19c
add Sync to the tracking store
2021-03-05 14:46:17 +02:00
vyzo
364076c1ea
set NoSync option for bolt livesets
2021-03-05 14:46:17 +02:00
vyzo
73259aa350
add configuration for splitstore and default to a simple compaction algorithm
2021-03-05 14:46:17 +02:00
vyzo
2e4d45ef07
test for bolt backed tracking store
2021-03-05 14:46:17 +02:00
vyzo
f1c61c4753
implement bolt backed tracking store
2021-03-05 14:46:17 +02:00
vyzo
2c1a9781cf
add test for bolt liveset
2021-03-05 14:46:17 +02:00
vyzo
27a9b974db
implement bolt-backed liveset
2021-03-05 14:46:17 +02:00
vyzo
68b6f913c7
propagate useLMDB option to splitstore through DI
2021-03-05 14:46:17 +02:00
vyzo
923a3db4b0
abstract tracking store and live set construction
2021-03-05 14:46:17 +02:00
vyzo
8f0ddac41a
add comment
2021-03-05 14:46:17 +02:00
vyzo
e79445123f
handle MDB_KEY_EXIST in tracking store Puts
2021-03-05 14:46:17 +02:00
vyzo
9977f5c3ec
rewrite sweep logic to avoid doing writes/deletes nested in a read txn
2021-03-05 14:46:17 +02:00
vyzo
ee751f88cd
refactor lmdb specific snoop/liveset code into their own files
...
paves the way for different back ends
2021-03-05 14:46:17 +02:00
vyzo
8e12377e69
handle consistency edge case
2021-03-05 14:46:17 +02:00
vyzo
31268ba685
walk snapshot the same way snapshot exporting does; skip old msgs and receipts by default.
...
so that we don't panic with missing blocks in non-archival nodes
2021-03-05 14:46:17 +02:00
vyzo
5068d51ac3
use CompactionCold epochs for delinating the cold epoch cliff
...
this allows us to change the thresholds for testing.
2021-03-05 14:46:17 +02:00
vyzo
d44719dbd3
amend confusing comment
2021-03-05 14:46:17 +02:00
vyzo
842ec43c2f
get rid of goroutine iteration in tracking store; long live ForEach
2021-03-05 14:46:17 +02:00
vyzo
a586d42c3b
make hot store DI injectable in the split store, default to badger.
2021-03-05 14:46:17 +02:00
vyzo
7044e623f9
flag to enable GC during compaction, disabled for now
2021-03-05 14:46:17 +02:00
vyzo
f6c930d0aa
crank up blockstore max readers to 16K, reduce retry delays to 10us
2021-03-05 14:46:17 +02:00
vyzo
95befa1e41
set lmdb max readers retry delay to 1ms
2021-03-05 14:46:17 +02:00
vyzo
874ecd3573
adjust hot store options, redux.
2021-03-05 14:46:17 +02:00
vyzo
ca8a673b5f
adjust hot store options
2021-03-05 14:46:17 +02:00
vyzo
69a88d41b6
fix snoop test
2021-03-05 14:46:17 +02:00
vyzo
cdf5bd0500
return annotated xerrors where appropriate
2021-03-05 14:46:17 +02:00
vyzo
ea05fd9d86
use xerrors instead of fmt.Errorf
2021-03-05 14:46:17 +02:00
vyzo
d91b60df91
fix potential panic with max readers retry and cursor channel
2021-03-05 14:46:17 +02:00
vyzo
b9f8a3d587
log MDB_READERS_FULL retries
2021-03-05 14:46:17 +02:00
vyzo
c89ab1a990
retry on MDB_READERS_FULL errors
2021-03-05 14:46:17 +02:00
vyzo
2080e467ba
don't set MaxReaders for tracking store
2021-03-05 14:46:17 +02:00
Raúl Kripalani
877ecab960
update go-bs-lmdb and migrate to ledgerwatch/lmdb-go.
2021-03-05 14:46:17 +02:00
vyzo
5b4e6b7b26
don't set max readers for livesets
2021-03-05 14:46:17 +02:00
vyzo
58a8434825
temporary log level for splitstore to DEBUG
2021-03-05 14:46:17 +02:00
vyzo
8b0087524f
adjust walk boundaries for marking
2021-03-05 14:46:17 +02:00
vyzo
76d6edbb52
fix max readers for tracking store
2021-03-05 14:46:17 +02:00
vyzo
1a23b1f6af
make CompactionThreshold a var to fix lotus-soup build
...
finality is not a constant there!
2021-03-05 14:46:17 +02:00
vyzo
6e51e6db9a
better handling of MDB_KEYEXIST in Put
2021-03-05 14:46:17 +02:00
vyzo
ce41e394dc
handle MDB_KEYEXIST in liveset marking
2021-03-05 14:46:17 +02:00
vyzo
843fd09a62
deal with MDB_KEY_EXIST errors
2021-03-05 14:46:17 +02:00
vyzo
f44cf0f2c4
appease linter
2021-03-05 14:46:17 +02:00
vyzo
facdc555b1
add nil check for curTs -- some tests don't have chain state
2021-03-05 14:46:17 +02:00
vyzo
e07c6c71c0
splitstore constructor
2021-03-05 14:46:17 +02:00
vyzo
b0f48b500f
use CAS for compacting state
2021-03-05 14:46:17 +02:00
vyzo
0af7b16ad5
simplify Has
2021-03-05 14:46:17 +02:00
vyzo
37e391f133
add TODO note about map size
2021-03-05 14:46:17 +02:00
vyzo
5db314f422
fallback to coldstore if snooping fails.
2021-03-05 14:46:17 +02:00
vyzo
d20cbc0c28
protect against potential data races
...
overkill, but let's not have race detectors scream at us.
2021-03-05 14:46:17 +02:00
vyzo
da478832cb
quiet linter
2021-03-05 14:46:17 +02:00
vyzo
4763397281
add tracking store test
2021-03-05 14:46:17 +02:00
vyzo
0d7476c5b2
implement LMDB-backed tracking store
2021-03-05 14:46:17 +02:00
vyzo
83f8a0ab12
quiet linter
2021-03-05 14:46:17 +02:00
vyzo
5043f31adf
liveset unit test
2021-03-05 14:46:17 +02:00
vyzo
3f92a000c7
implement lmdb-backed LiveSet
2021-03-05 14:46:17 +02:00
vyzo
0bf1a78b39
stubs for tracking store and live set
2021-03-05 14:46:17 +02:00
vyzo
17bc5fcd85
move splitstore implementation to its own directory
2021-03-05 14:46:17 +02:00
vyzo
2c9b58aaec
add some logging
2021-03-05 14:46:17 +02:00
vyzo
c1b1a9ce2a
avoid race with compacting state variable
2021-03-05 14:46:17 +02:00
vyzo
3083d80f5e
no need to import go-ipfs-blockstore, lib/blockstore will do
2021-03-05 14:46:17 +02:00
vyzo
101e5c6540
close keys channel when dome emitting keys
2021-03-05 14:46:17 +02:00
vyzo
b945747eb2
satisfy linter
2021-03-05 14:46:17 +02:00
vyzo
2bed6c94cd
use dual live set marking algorithm to keep all hotly reachable objects in the hotstore
2021-03-05 14:46:17 +02:00
vyzo
c2cc198316
fix off by 1 in marking
2021-03-05 14:46:17 +02:00
vyzo
fd08786048
track base epoch in metadata ds
2021-03-05 14:46:17 +02:00
vyzo
b192adfd2e
trigger compaction from head changes
2021-03-05 14:46:17 +02:00
vyzo
c8f1139e0d
compaction algorithm
2021-03-05 14:46:17 +02:00
vyzo
6577cc8ea6
splitstore struct and Blockstore interface implementation
2021-03-05 14:46:17 +02:00
Łukasz Magiera
d53c700d18
Merge pull request #5704 from filecoin-project/asr/log-large-delay
...
Log block CID in the large delay warning
2021-03-05 13:19:03 +01:00
Aayush Rajasekaran
374bd9b578
Update chain/sub/incoming.go
...
Co-authored-by: raulk <raul@protocol.ai>
2021-03-05 01:09:07 -05:00
Aayush Rajasekaran
22e465ba9c
log block cid in the large delay warning
2021-03-02 16:46:10 -05:00
Raúl Kripalani
1ac0c9a926
address review comments.
2021-03-02 21:29:24 +00:00
Raúl Kripalani
2047a74958
implement blockstore.Union, a union blockstore.
...
The union blockstore takes a list of blockstores. It returns the first
satisfying read, and broadcasts writes to all stores.
It can be used for operations that require reading from any two blockstores,
for example WalkSnapshot.
2021-03-02 17:03:11 +00:00
Raúl Kripalani
b1c348b4a7
address review comments.
2021-03-02 16:31:01 +00:00
Raúl Kripalani
3795cc2bd2
segregate chain and state blockstores.
...
This paves the way for better object lifetime management.
Concretely, it makes it possible to:
- have different stores backing chain and state data.
- having the same datastore library, but using different parameters.
- attach different caching layers/policies to each class of data, e.g.
sizing caches differently.
- specifying different retention policies for chain and state data.
This separation is important because:
- access patterns/frequency of chain and state data are different.
- state is derivable from chain, so one could never expunge the chain
store, and only retain state objects reachable from the last finality
in the state store.
2021-02-28 22:49:44 +00:00
Raúl Kripalani
7f0f7d0b36
Merge branch 'master' into refactor/lib/blockstore
2021-02-28 19:55:23 +00:00
Łukasz Magiera
35759fa07e
Merge pull request #5635 from filecoin-project/deps/cbg-soft-map
...
Update markets, cbor-gen with soft map decoding
2021-02-22 18:27:38 +01:00
Aayush Rajasekaran
60b7f56297
Code review
2021-02-19 15:10:56 -05:00
Łukasz Magiera
26399dba70
Update markets, cbor-gen with soft map decoding
2021-02-19 20:11:43 +01:00
Aayush Rajasekaran
96b4b828f7
Remove the null bls actor from the init actor state
2021-02-18 19:01:28 -05:00
Aayush Rajasekaran
a0fedf8bdb
Only delete the zero BLS actor on mainnet
2021-02-18 19:01:21 -05:00
Aayush Rajasekaran
2ca70e600d
Move the zero bls actor creation check into the VM
2021-02-18 19:01:11 -05:00
Aayush Rajasekaran
5aff54161a
Delete the null-bls actor
2021-02-18 19:01:03 -05:00
Łukasz Magiera
0c6aef221d
Fix error logging format strings
2021-02-11 12:00:26 +01:00
Łukasz Magiera
fcbd9950ca
Merge pull request #5507 from filecoin-project/fix/coalescer
...
refactor coalescing logic into its own function, take both cancellation sets into account
2021-02-10 17:40:47 +01:00
Łukasz Magiera
9f546c2d1c
Merge pull request #5540 from austinabell/austin/beyondmaxio
...
Remove unnecessary database reads in validation check
2021-02-05 22:40:32 +01:00
austinabell
3228ae5672
Remove unnecessary database reads in validation check
2021-02-05 15:46:46 -05:00
Łukasz Magiera
8f603717a6
Merge remote-tracking branch 'origin/master' into steb/refactor-consistent-tipset-methods
2021-02-05 13:08:49 +01:00
Łukasz Magiera
06d3892e38
lotus-wallet: Add interactive mode
2021-02-05 12:44:01 +01:00
He Weidong
0e2e1125d3
fix precommit ticket expiration handling
2021-02-05 10:45:15 +08:00
vyzo
5c6988a7c1
refactor coalescing logic into its own function, take both cancellation sets into account
2021-02-02 21:26:50 +02:00
Łukasz Magiera
c59e2fea5b
Use correct contexts in storageadapter
2021-02-02 18:43:49 +01:00
Łukasz Magiera
56a9d05491
Merge remote-tracking branch 'origin/master' into steb/refactor-consistent-tipset-methods
2021-01-30 12:05:21 +01:00
Łukasz Magiera
a541a2500a
Merge pull request #5282 from filecoin-project/chore/snake_context_through_blockstore_init
...
Snake a context through the Chain-blockstore creation
2021-01-30 11:55:17 +01:00
Łukasz Magiera
7c7301f701
Merge pull request #5350 from GFZRZK/GFZRZK/optmize/avoid_race_in_mpool_cfg
...
avoid use mp.cfg directly to avoid race
2021-01-30 11:31:56 +01:00
Łukasz Magiera
5cfae0f1e8
Merge pull request #5449 from filecoin-project/chore/document_blockheader_fields
...
Better document the block-header fields
2021-01-30 11:26:56 +01:00
Raúl Kripalani
d1104fec4c
rename blockstores for consistency.
2021-01-29 23:17:25 +00:00
Raúl Kripalani
af429dba0f
Merge branch 'master' into chore/snake_context_through_blockstore_init
2021-01-29 21:21:46 +00:00
Raúl Kripalani
e02fdf5064
Merge branch 'master' into refactor/lib/blockstore
2021-01-29 21:21:31 +00:00
Raúl Kripalani
b0cbc932bd
consolidate all blockstores in blockstore package.
2021-01-29 20:01:00 +00:00
Steven Allen
53271729b6
tweak migration perf
2021-01-28 16:15:23 -08:00
Steven Allen
2f3c912ad9
improve upgrade logging
2021-01-28 16:15:23 -08:00
Steven Allen
a9a65e05d8
feat: avoid computing the tip-set state when looking up addresses
2021-01-27 17:54:42 -08:00
Steven Allen
4890d83acb
test: assert that pre-migrations are actually run
2021-01-27 16:12:08 -08:00
Steven Allen
39d4f6780d
pre-migration: refactor timing specification
...
There are now three times:
1. StartWithin: start within X epochs of the upgrade.
2. DontStartWithin: don't start within X epochs of the upgrade.
3. StopWithin: stop within X epochs of the upgrade.
2021-01-27 16:09:07 -08:00
Steven Allen
bceb246080
set worker counts for pre-migrations
2021-01-27 15:47:51 -08:00
Steven Allen
cffeb1a590
fix doc comments
...
Co-authored-by: Aayush Rajasekaran <arajasek94@gmail.com>
2021-01-27 15:41:26 -08:00
Steven Allen
9574db6d0a
log in migration
2021-01-27 15:05:00 -08:00
Steven Allen
9a03c003fe
fix sorted test
2021-01-27 13:05:14 -08:00
Steven Allen
56054b0ad3
sort pre-migrations
2021-01-27 12:57:47 -08:00
Steven Allen
854385168d
add additional pre-migration validations
2021-01-27 12:57:47 -08:00
Steven Allen
716f10e570
remove unnecessary wrapper store in tests
...
This was causing a lot of warnings about not implementing View.
2021-01-27 12:57:47 -08:00
Steven Allen
35d6a40071
cleanup pre-migration code a bit
2021-01-27 12:57:17 -08:00
Steven Allen
4072f24bf2
test pre-migrations
2021-01-27 12:57:17 -08:00
Steven Allen
ed3e0869c3
register tipsets with the chainstore when testing
2021-01-27 12:57:17 -08:00
Steven Allen
05026a23b9
actually use the temp cache for pre-migrations
2021-01-27 12:57:17 -08:00
Steven Allen
32059d0cbf
stmgr: only persist the migration cache on success
...
Otherwise, we may end up referencing blocks we never wrote to disk.
2021-01-27 12:56:47 -08:00
Steven Allen
b08abc12ba
fix error message
2021-01-27 12:55:56 -08:00
Steven Allen
6362887ce3
rename Upgrade to Migration where applicable
...
This was really confusing.
2021-01-27 12:55:56 -08:00
Steven Allen
77117a0be5
wait for pre-upgrades to exit on stop
2021-01-27 12:55:56 -08:00
Steven Allen
f65d179f2c
make pre-migrations async
2021-01-27 12:55:56 -08:00
Steven Allen
8d05c5d62c
validate pre-migrations
2021-01-27 12:55:56 -08:00
Steven Allen
8986a2002d
wire up re-migration logic for nv10
2021-01-27 12:55:56 -08:00
Steven Allen
8d3cc632ac
add support for running pre-migrations and caching their results
...
This can significantly speedup state migrations.
2021-01-27 12:55:53 -08:00
Peter Rabbitson
ac616eb340
Better document the block-header fields
2021-01-27 20:52:18 +01:00