Łukasz Magiera
7246ef273f
miner: Control address config for (pre)commits
2020-12-02 19:58:00 +01:00
Raúl Kripalani
e8a5e0d2fe
integrate memory watchdog; impose limits on badger caches.
2020-12-02 16:40:28 +00:00
Raúl Kripalani
655aea1018
Merge branch 'master' into raulk/badger-index-cache
2020-12-02 11:46:57 +00:00
Aayush Rajasekaran
370817eb60
Allow miners to filter (un)verified deals
2020-12-02 01:32:34 -05:00
Łukasz Magiera
95eaf13b5a
sectorstorage: Fix tests
2020-12-02 00:36:32 +01:00
Łukasz Magiera
c6f85886bf
miner: Add slow mode to proving check
2020-12-02 00:32:14 +01:00
Łukasz Magiera
82b5cb89cd
Merge pull request #5061 from filecoin-project/fix/err-late-deals
...
Error out deals that are not activated by proposed deal start epoch
2020-12-01 17:02:06 +01:00
Łukasz Magiera
614f45dcfb
Merge pull request #5041 from filecoin-project/feat/5013
...
Sector check command
2020-12-01 14:59:01 +01:00
Dirk McCormick
cb044f83a7
fix: ensure deal start is far enough in future for tests
2020-12-01 14:25:48 +01:00
Jakub Sztandera
65d50c76d6
bonus: fix WalletSign using t0 addresses in WalletSignMessage
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-11-27 17:19:41 +01:00
Łukasz Magiera
fcec665267
Merge remote-tracking branch 'origin/master' into feat/deal-await-precommit
2020-11-26 11:51:36 +01:00
s1m0n21
663b3f4f21
add a sector check command
2020-11-26 15:02:43 +08:00
Łukasz Magiera
2e544e3e6a
configure SimultaneousTransfers in node/builder
2020-11-25 19:57:38 +01:00
hannahhoward
694834e8d5
feat(graphsync): configure simultaneous requests
...
allow configuration of the number of simultaneous requests graphsync will process at once
2020-11-24 14:32:30 -08:00
Dirk McCormick
239e180683
feat: markets - separate watching for pre-commit from prove-commit
2020-11-24 13:24:41 -08:00
hannahhoward
afec58f780
feat(markets): add logging on data-transfer to miner
2020-11-23 12:43:30 -08:00
Łukasz Magiera
be2a5942fb
Merge pull request #4082 from leviok/fix-nil-pointer
...
fix nil pointer in StateSectorPreCommitInfo
2020-11-23 18:58:32 +01:00
Łukasz Magiera
0e39e760e5
Merge pull request #4929 from filecoin-project/feat/update-markets-commp-extraction
...
Remove all temp file generation for deals
2020-11-23 18:43:00 +01:00
Łukasz Magiera
7d540905ac
Don't return nil in StateSectorPreCommitInfo
2020-11-23 12:14:49 +01:00
Dirk McCormick
4a8df0c3fa
feat: add data transfer logging
2020-11-23 10:31:39 +01:00
leviok
9fe3649dd2
correct it
2020-11-23 11:08:21 +08:00
leviok
9b199f0476
fix nil pointer
2020-11-23 11:08:21 +08:00
hannahhoward
218f7c2c5d
feat(markets): update markets, extract commp
2020-11-20 13:29:14 -08:00
Łukasz Magiera
4483d94db3
Merge pull request #4902 from GFZRZK/GFZRZK/patch/remove_unuseful_code_in_newstorageask
...
just return storedask.NewStoredAsk to reduce unuseful code
2020-11-20 16:28:03 +01:00
Łukasz Magiera
94763c2aaa
Merge pull request #4849 from filecoin-project/feat/conngater
...
Connection Gater support
2020-11-20 16:25:02 +01:00
Raúl Kripalani
44040f0f3f
badger options: enable IndexCache and CompactL0OnClose.
2020-11-20 00:33:43 +00:00
Raúl Kripalani
55061ae6fb
fix blockstore directory not created automatically.
2020-11-19 15:55:02 +00:00
wangchao
49f8590578
just return storedask.NewStoredAsk to reduce unuseful code
2020-11-18 13:53:48 +08:00
Aayush Rajasekaran
68a16afeda
Merge branch 'master' into release/v1.2.0
2020-11-17 19:40:05 -05:00
Łukasz Magiera
50146fb9b9
Merge pull request #4872 from filecoin-project/raulk/fix-blockstore-import
...
fix badger double open on daemon --import-snapshot; chainstore lifecycle
2020-11-18 01:36:16 +01:00
Łukasz Magiera
3536ec9f85
Merge pull request #4879 from filecoin-project/fix/4833
...
Fix MaxSealingSectrosForDeals getting reset to 0
2020-11-17 23:41:22 +01:00
hannahhoward
a2abeef727
feat(markets): upgrade to fix cid recording issue
2020-11-16 17:57:57 -08:00
Łukasz Magiera
dd9682f2be
Fix MaxSealingSectrosForDeals getting reset to 0
2020-11-17 00:28:49 +01:00
Raúl Kripalani
0c6072a1a0
chainstore lifecycle: close via Close() instead of context.
2020-11-16 22:28:59 +00:00
Steven Allen
bead8ac38e
use the miner's proof type when proposing storage deals
2020-11-16 19:04:17 +01:00
Steven Allen
638900f97f
Remove static proof type configuration from market subsystem
...
Instead, use proof type from miner actor. This will, in turn, use the upgraded
proof type if/when it's switched at runtime.
TODO: Consider making this some form of config option instead?
2020-11-16 19:04:17 +01:00
Steven Allen
d8afd71f4c
add a test to demonstrate SDR upgrade while committing sectors
2020-11-16 19:04:17 +01:00
Steven Allen
869867e92e
fix compile
2020-11-16 19:04:17 +01:00
Steven Allen
508375a55c
Upgrade seal proof version in miner info after the upgrade.
...
This is terrible, but we don't (currently) update this in the miner info.
Q: Maybe we should delay this by a few epochs? Some pre-commits could fail if we
get a reorg.
2020-11-16 19:04:17 +01:00
Łukasz Magiera
915c5e0fdd
Get most tests to pass
2020-11-16 19:03:30 +01:00
Steven Allen
931979809f
get lotus building
2020-11-16 19:03:30 +01:00
Steven Allen
219c695967
fix storage adapter miner
2020-11-16 19:03:30 +01:00
Łukasz Magiera
6bea9dd178
Making sealing logic work with multiple seal proof types
2020-11-16 19:03:30 +01:00
Raúl Kripalani
d7b4f92f1f
add context to ChainStore.
2020-11-16 15:52:19 +00:00
Łukasz Magiera
49d3bb9497
Merge pull request #4851 from filecoin-project/fix/daemon-test-mode-restart
...
Truncate genesis file before generating
2020-11-16 16:13:33 +01:00
Jakub Sztandera
afe6c51016
Merge pull request #4813 from filecoin-project/chore/blockstore_nits
...
Chore/blockstore nits
2020-11-15 19:52:10 +01:00
Aayush Rajasekaran
1af1ceb1e0
Merge pull request #3646 from filecoin-project/feat/delayed-pubsub-subscribe
...
delayed pubsub subscribe for messages topic
2020-11-13 17:44:32 -05:00
vyzo
91e2530e11
remove dtypes dependency from api; move NetBlockList type to api/types.go
2020-11-13 21:11:17 +02:00
Dirk McCormick
f9fc601567
fix: truncate genesis file before generating
2020-11-13 17:30:12 +01:00
vyzo
4b187b85eb
close existing connections that match the filters when adding rules to the connection gater
2020-11-13 14:38:13 +02:00
vyzo
b71f069854
implement connection gater API
2020-11-13 13:59:38 +02:00
vyzo
5a0b9f4197
connectiong gater API scaffolding
2020-11-13 12:17:48 +02:00
vyzo
4b1d1b6540
connection gater for libp2p host
2020-11-13 11:44:29 +02:00
Łukasz Magiera
99031bae17
Merge pull request #4709 from filecoin-project/feat/mute-logs
...
Make some logs quieter
2020-11-12 20:40:10 +01:00
Dirk McCormick
26e12e6f6a
fix: dont crash on startup if funds migration fails
2020-11-12 17:15:05 +01:00
Peter Rabbitson
29817b6617
Remove all Chain GC wrappings/types
...
There is no practical way to do GC against the chainstore given the current
state of affairs: remove all GC-related types for the time being.
2020-11-12 06:49:53 +01:00
Peter Rabbitson
7be7a9b5e3
Stop referring to github.com/ipfs/go-ipfs-blockstore outside of lib
2020-11-12 06:01:35 +01:00
Łukasz Magiera
09f9f871a3
Create a command to abort sealing calls
2020-11-11 17:39:12 +01:00
hannahhoward
9f7204ee26
feat(builder): finish new FundManager setup
...
Finish setup of new FundManager and provide a migration for previously reserved funds
2020-11-10 21:11:05 -08:00
Dirk McCormick
0d243bb824
refactor: integrate new FundManager
2020-11-10 21:11:05 -08:00
Aayush Rajasekaran
735c04f999
Merge pull request #4681 from filecoin-project/badger-viewable
...
move to native badger blockstore; leverage zero-copy View() to deserialize in-place
2020-11-10 18:08:12 -05:00
vyzo
185653f85a
improve coalescing
2020-11-09 13:35:42 +02:00
vyzo
6660f81363
minimize coalesce delay for tests
2020-11-06 22:26:47 +02:00
Jakub Sztandera
5a34e5b2bf
Merge pull request #4599 from filecoin-project/feat/sync-manager-redux
...
rewrite sync manager
2020-11-06 21:01:26 +01:00
Raúl Kripalani
3577300aee
Merge branch 'master' into badger-viewable
2020-11-06 19:34:25 +00:00
Raúl Kripalani
0b2a02c8ea
remove redundant import.
2020-11-06 18:57:04 +00:00
Raúl Kripalani
85e37e4b70
make the value log loading mode mmap, to leverage zero-copy access.
2020-11-06 18:39:08 +00:00
Łukasz Magiera
426c2e8c2b
Merge pull request #4717 from filecoin-project/feat/optional-chain-bitswap
...
Optional chain Bitswap
2020-11-06 16:49:39 +01:00
Jakub Sztandera
94438bf3cd
Use TSK passed to GasEstimateGasLimit
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-11-05 21:14:38 +01:00
vyzo
dab20efc99
add env var controlling msgs sync epochs
2020-11-05 18:09:04 +02:00
vyzo
0e40a04975
nicer check using Time objects
2020-11-05 18:08:52 +02:00
vyzo
c6cd699f0d
fix nearsync check
2020-11-05 18:08:35 +02:00
vyzo
3306bdec29
fix tests
2020-11-05 18:08:13 +02:00
vyzo
32b7797394
only subscribe to messages topic if we are synced within 10 epochs
2020-11-05 18:08:13 +02:00
Łukasz Magiera
a1e1b03ca4
Optionally allow bitswap for chainstore
2020-11-03 23:44:44 +01:00
Raúl Kripalani
809111336a
Merge branch 'master' into badger-viewable
2020-11-03 18:29:10 +00:00
Łukasz Magiera
9270ac6358
Make some logs quieter
2020-11-03 13:28:41 +01:00
Raúl Kripalani
656ece06e5
fix metrics wiring.
...
Some components like go-ds-measure, go-ipfs-blockstore and go-bitswap
expose metrics via ipfs/go-metrics-interface, but Lotus never injects
the Prometheus exporter (ipfs/go-metrics-prometheus). Therefore, those
metrics never surface in instrumentation.
Instead, Lotus uses OpenCensus directly.
This commit injects the Prometheus exporter for go-metrics-interface, and
instructs the OpenCensus Prometheus exporter to use the DefaultRegistry.
This has the effect of exposing blending the metrics of both metrics
libraries.
With this patch, the datastore, cache utilisation, and bitswap metrics
are now exported via the /debug/metrics endpoint.
This commit also fixes an issue where the metrics scope was empty, making
go-metrics-interface default to "<no-scope>". Angle brackets are inadmissible
characters for Prometheus, so it was refusing to export the affected metrics.
(These were the ARC cache metrics.)
2020-11-02 17:56:49 +00:00
Raúl Kripalani
0b8a21ee16
badger: restore prev. max table size (64MiB; default).
2020-11-01 17:26:37 +00:00
Raúl Kripalani
72e573d98d
fix lint.
2020-11-01 17:09:14 +00:00
Raúl Kripalani
5a98660d1b
make repo.Blockstore() idempotent; wrap in IDStore.
2020-11-01 16:56:20 +00:00
Raúl Kripalani
d8d85373f5
fix lotus-shed datastore commands.
2020-11-01 13:50:41 +00:00
Raúl Kripalani
a16d7f221e
Merge branch 'master' into badger-viewable
2020-11-01 13:10:56 +00:00
Raúl Kripalani
d2e2322fd2
make the lotus node use the new native badger blockstore.
2020-11-01 13:01:26 +00:00
Łukasz Magiera
a5c05f87f1
Merge pull request #4105 from filecoin-project/asr/decode-params
...
Add a StateDecodeParams method
2020-10-31 01:05:50 +01:00
Jakub Sztandera
22742a9ba0
bootstrap: don't return early when one drand resolution fails
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-10-30 21:58:17 +01:00
Łukasz Magiera
3b16faddad
Merge pull request #4652 from filecoin-project/feat/default-max-fee-cfg
...
Config for default max gas fee
2020-10-30 21:35:10 +01:00
Łukasz Magiera
6cdbf5216e
Merge pull request #4629 from filecoin-project/fix/badger-lsm-trsh
...
Reduce badger ValueTreshold to 128
2020-10-30 21:10:18 +01:00
Łukasz Magiera
7fbb868513
Debug flag to force running sealing scheduler
2020-10-30 11:07:35 +01:00
Aayush Rajasekaran
5ff42505e8
Add a StateDecodeParams method
2020-10-29 22:04:33 -04:00
Łukasz Magiera
c3d00b0ac6
Merge pull request #4650 from jsign/jsign/offlinemode
...
make IPFS online mode configurable
2020-10-29 22:24:58 +01:00
Łukasz Magiera
ae7889f830
Config for default max gas fee
2020-10-29 20:50:11 +01:00
Ignacio Hagopian
7d0f279353
make IPFS online mode configurable
...
Signed-off-by: Ignacio Hagopian <jsign.uy@gmail.com>
2020-10-29 15:16:45 -03:00
vyzo
8d25fd39cf
set BootstrapPeerThreshold to 1 for tests
2020-10-29 19:32:09 +02:00
Jakub Sztandera
0297be4b9a
Add lotus-shed datastore rewrite
command
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-10-28 23:24:45 +01:00
Jakub Sztandera
ecc1d94b3a
Reduce badger ValueTreshold to 128
...
It should significntly size of the LSM index, and thus increase the
performance with bigger datastores
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-10-28 22:17:01 +01:00
Jakub Sztandera
ad905fc310
Expose WorkerID
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-10-28 20:22:07 +01:00
Łukasz Magiera
413643a712
Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers
2020-10-27 16:56:29 +01:00
Łukasz Magiera
8c60069bb8
Merge pull request #4535 from filecoin-project/feat/clientdeal-cache-commd
...
client deal: Cache CommD when creating multiple deals
2020-10-27 03:58:25 +01:00
Łukasz Magiera
e1da874258
Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers
2020-10-27 03:31:07 +01:00
Steven Allen
0d06f8fa2b
Add commands to change the worker key
2020-10-26 18:16:24 -07:00
Łukasz Magiera
31a474a1ca
Move CommPWriter to lib/
2020-10-26 15:16:28 +01:00
Łukasz Magiera
a37c372d06
Merge pull request #4572 from filecoin-project/feat/data-transfer-utils
...
Flesh out data transfer features
2020-10-26 13:29:26 +01:00
Łukasz Magiera
660236b224
Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers
2020-10-23 23:25:35 +02:00
Łukasz Magiera
de2cbfa8a9
client deal: Cache CommD when creating multiple deals
2020-10-23 22:20:17 +02:00
Łukasz Magiera
36816fb4f3
Fix list-asks, deals with non-genesis miners in lite-mode
2020-10-23 17:08:21 +02:00
Dirk McCormick
906286fdbe
feat: lite-mode - CLI tests for lotus client
commands
2020-10-23 15:02:49 +02:00
Dirk McCormick
92942d44d1
feat: lite-mode - market storage and retrieval clients
2020-10-23 15:02:26 +02:00
hannahhoward
98297cef4d
feat(data-transfer): fill in utils
2020-10-22 13:40:26 -07:00
Łukasz Magiera
041762a34f
Merge pull request #4383 from filecoin-project/steb/actor-v2-imports
...
Remove most v0 actor imports
2020-10-22 17:17:56 +02:00
Łukasz Magiera
618fed75fe
Merge branch 'hunjixin/feat/batchmsg' of github.com:hunjixin/lotus into hunjixin-hunjixin/feat/batchmsg
2020-10-22 14:45:33 +02:00
Łukasz Magiera
7c16f2182c
Merge branch 'animesh2049/status-api' of github.com:animesh2049/lotus into animesh2049-animesh2049/status-api
2020-10-22 14:14:50 +02:00
Steven Allen
0c2ec04c09
use upgrade schedule from node when getting the network name
...
It doesn't matter now, but may in the future.
2020-10-21 12:18:38 -07:00
Steven Allen
bcabe7b3b5
migrate methods to abstracted methods
...
Method numbers never change anyways. At worst, we'll deprecate old methods and
have to explicitly import them from the correct actors version to use them.
2020-10-21 12:18:37 -07:00
Steven Allen
4e730b5ec8
port to v2 imports
2020-10-21 12:16:23 -07:00
Łukasz Magiera
06c0444d45
Merge pull request #4480 from filecoin-project/fix/max-piece-size-reverting-to-default
...
Don't overwrite previously-configured maxPieceSize for a persisted ask
2020-10-19 22:55:55 +02:00
Ingar Shu
1974490ab0
Don't overwrite previously-configured maxPieceSize for a persisted ask
2020-10-19 13:12:28 -07:00
Aayush Rajasekaran
d24d3e420d
Fix StateReplay to use provided tipset
2020-10-19 14:27:04 -04:00
Łukasz Magiera
8d06cca073
sched: Handle workers using sessions instead of connections
2020-10-18 12:36:06 +02:00
Łukasz Magiera
7ac5dc55d0
Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers
2020-10-17 13:45:11 +02:00
Łukasz Magiera
68be28ca6d
Add Session API
2020-10-17 12:53:42 +02:00
Łukasz Magiera
4a057d84b8
Merge pull request #4422 from filecoin-project/fix/message-list
...
fix message list api
2020-10-16 20:52:34 +02:00
Łukasz Magiera
111942b50b
Merge pull request #4424 from filecoin-project/feat/retrieval-cli-deal-filter
...
Custom filters for retrieval deals
2020-10-16 18:41:40 +02:00
Ingar Shu
d0e4150cea
Use separate config for Retrieval Filter
2020-10-16 08:30:55 -07:00
Aayush Rajasekaran
2fd4a97698
Remove StateTransplant, modify StateReplay
2020-10-15 22:54:29 -04:00
Aayush Rajasekaran
6f86b95f62
Remove StateMsgGasCost
2020-10-15 21:03:02 -04:00
Aayush Rajasekaran
99c07703f8
Add a new StateReplay CLI/API endpoint
2020-10-15 19:47:02 -04:00
Aayush Rajasekaran
7826cc0bab
Rename StateReplay to StateTransplant
2020-10-15 19:14:53 -04:00
Aayush Rajasekaran
cb801d47c7
Add GasCost to InvocResult
2020-10-15 18:48:51 -04:00
Ingar Shu
0b7dc6971d
Rebasing
2020-10-15 09:33:01 -07:00
whyrusleeping
a931ff94e9
fix message list api
2020-10-15 08:54:36 -07:00
Łukasz Magiera
c56ef260d5
Merge pull request #4421 from filecoin-project/fix/lite-msig-inspect
...
Ensure msig inspect cli works with lotus-lite
2020-10-15 15:11:34 +02:00
Dirk McCormick
9c99171cb8
fix: ensure msig inspect cli works with lotus-lite
2020-10-15 12:15:21 +02:00
hannahhoward
b29e3b5242
feat(markets): use build.BlockDelaySecs for start buffer
...
instead of constant from spec-actors which uses hardcoded start epoch, use one that factors in
possibility of different block time
2020-10-14 21:28:36 -07:00
Łukasz Magiera
52800f5dca
Merge pull request #4222 from filecoin-project/feat/increase-inclusion-premium
...
Change default gas premium to for 10 block inclusion
2020-10-15 02:57:12 +02:00
Jakub Sztandera
df6f4a572c
Change default gas premium to for 6 block inclusion
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-10-15 02:53:40 +02:00
Łukasz Magiera
698b49b7ef
Improve gas defaults
2020-10-15 02:46:47 +02:00
Steven Allen
ddade32bd3
write bitswap blocks into a temporary, in-memory block cache
...
If they end up validating, we'll write them back to the underlying blockstore.
Otherwise, there's no reason to keep them.
2020-10-14 14:43:58 -07:00
Łukasz Magiera
465703b618
Merge pull request #4384 from filecoin-project/feat/4220
...
Use updated stored ask API
2020-10-14 12:03:07 +02:00
Aarsh Shah
30dd5d9644
use updated stored ask api
2020-10-14 11:39:57 +02:00
Aayush Rajasekaran
bf619862c3
Merge pull request #4382 from filecoin-project/asr/invoc-result
...
Add message CID to InvocResult
2020-10-14 02:06:09 -04:00
Aayush Rajasekaran
ce54110228
Add message CID to InvocResult
2020-10-14 00:06:22 -04:00
hannahhoward
58662b79b3
fix(deps): use tagged go-fil-markets 0.9.0
2020-10-13 19:50:13 -07:00
Łukasz Magiera
b74a3229f8
fsm: process expired-ticket sectors
2020-10-13 21:35:41 +02:00
Łukasz Magiera
71b3b9075d
Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers
2020-10-13 21:33:21 +02:00
hannahhoward
4edebcec2b
feat(markets): update markets 0.9.0 and add data transfer restart command
2020-10-13 03:41:08 -07:00
Aayush Rajasekaran
195d96ccc0
Merge pull request #4148 from filecoin-project/asr/circ-supply
...
Add a StateExactCirculatingSupply command
2020-10-12 17:02:07 -04:00
Ingar Shu
49155ace62
Use seal-duration in calculating the earliest StartEpoch that we will consider ( #4337 )
2020-10-12 17:45:37 -03:00
Aayush Rajasekaran
83624a8858
Rename StateVMCirculatingSupply to StateVMCirculatingSupplyInternal
2020-10-12 16:41:27 -04:00
Aayush Rajasekaran
96e1dfd8d7
Add an endpoint for precise circulating supply
2020-10-12 16:38:29 -04:00