Ian Davis
9f85d3dca7
Address simple linter issues
2022-11-24 16:32:27 +00:00
hannahhoward
34d78093e8
chore(deps): update index provider 0.9.1
2022-11-22 20:49:11 -08:00
Shrenuj Bansal
2fa21ff091
Merge branch 'master' into sbansal/nonce-coordination-and-consensus-for-chain-nodes
2022-11-11 14:41:38 -05:00
Łukasz Magiera
5f5cc794f0
make config not depend on ffi
2022-11-08 09:37:43 +00:00
Łukasz Magiera
2c89b3240f
retrieval: Support retrievals into remote stores
2022-11-08 09:37:34 +00:00
ZenGround0
4ffded6fef
feat:splitstore:single compaction that can handle prune aka two marksets one compaction ( #9571 )
...
* begin
* rough draft -- this should probably actually work?
* WIP
* Start testing
* message mode
* Fix tests, make gen
* Better default
* docsgen-cli
* Review Response
Co-authored-by: zenground0 <ZenGround0@users.noreply.github.com>
2022-11-07 16:31:12 -05:00
Shrenuj Bansal
15ed1ee33c
Merge branch 'master' into sbansal/nonce-coordination-and-consensus-for-chain-nodes
2022-10-17 22:55:48 -04:00
Shrenuj Bansal
900525f8c2
some cleanup
2022-10-17 16:13:30 -04:00
Łukasz Magiera
2c11f9d265
feat: Add node uptime rpc / output in info command
2022-10-11 10:11:09 +02:00
Łukasz Magiera
d240b12196
feat: miner paramfetch: Don't fetch param files when not needed
2022-09-29 12:08:05 +00:00
Shrenuj Bansal
f89a682d98
Add Mpool ref to raft state and rearrange some APIs
2022-09-29 10:56:57 +00:00
Shrenuj Bansal
570f61438a
Retries within proxy working
2022-09-28 15:07:05 +00:00
Shrenuj Bansal
559c2c6d34
Merge branch 'master' into sbansal/nonce-coordination-and-consensus-for-chain-nodes
2022-09-27 16:29:03 +00:00
Shrenuj Bansal
7470549199
Address moar comments
2022-09-22 16:27:15 -04:00
Shrenuj Bansal
1fe4aa3467
Add Auth func for gorpc and address comments
2022-09-21 15:41:10 -04:00
Łukasz Magiera
bf3daea124
sealing: Minimum upgrade sector expiration/target config
2022-09-15 16:19:57 +02:00
Alfonso de la Rocha
d1a4f1dc50
fixed bugs in consistent broadcast integration
2022-09-14 19:59:29 +02:00
Shrenuj Bansal
8f1b1bb1ff
WIP: Raft consensus for lotus nodes in a cluster
2022-09-12 16:10:15 -04:00
Shrenuj Bansal
b3175f0b5c
Merge branch 'master' into 9171-add-retries-to-mpool-push-message
2022-08-26 12:31:35 -04:00
Łukasz Magiera
45d1bd61ce
Merge pull request #9183 from filecoin-project/feat/sectornum-mgmt
...
feat: sealing: Use bitfields to manage sector numbers
2022-08-26 10:59:24 -04:00
Łukasz Magiera
dd144eaab9
Update other deprecated libp2p imports
2022-08-25 14:23:25 -04:00
Łukasz Magiera
2086b219d2
Don't use go-libp2p-core
2022-08-25 14:20:41 -04:00
Shrenuj Bansal
b972e079b8
Address comments
2022-08-22 17:32:43 -04:00
Łukasz Magiera
ca72590e49
sealing: Use bitfields to manage sector numbers
2022-08-22 16:55:08 -04:00
Shrenuj Bansal
8a19cd19d8
Merge branch 'master' into 9171-add-retries-to-mpool-push-message
2022-08-19 12:08:07 -04:00
Łukasz Magiera
ba67431731
Merge branch 'update-go-libp2p-v0.21' of github.com:MarcoPolo/lotus into deps/go-libp2p-v0.21
2022-08-19 11:22:04 -04:00
Shrenuj Bansal
afb4b1b68f
mod tidy and fiximports
2022-08-18 18:23:42 -04:00
Shrenuj Bansal
00975237b1
Add retries for specific types of errors
2022-08-18 15:57:59 -04:00
Shrenuj Bansal
a59f977db1
Add retries to mpool push message from lotus miner
2022-08-17 14:22:31 -04:00
Shrenuj Bansal
60751f809b
Change func name and nil pointer check based on comments
2022-08-17 10:47:05 -04:00
Shrenuj Bansal
b7227d3a6b
run make gen
2022-08-16 15:56:32 -04:00
Shrenuj Bansal
fa4a479b97
Add uuid to mpool message sent to chain node from miner
2022-08-16 15:39:06 -04:00
Łukasz Magiera
77208728ad
sealing: fix lint/tests
2022-08-14 12:50:18 -04:00
Marco Munizaga
1af9e3c313
Check err for view.Register
2022-08-12 09:55:03 -07:00
Marco Munizaga
1f65d51a69
Update go-libp2p-resource-manager to v0.5.3
2022-08-12 09:49:38 -07:00
Marco Munizaga
5a133ff2d4
Hook up resource manager metrics
2022-08-11 15:56:48 -07:00
Marco Munizaga
d03992f878
Update rcmgr
2022-08-11 11:23:19 -07:00
Marco Munizaga
abd418af41
Fix lint
2022-08-11 11:20:12 -07:00
Marco Munizaga
766d809f0c
Update to go-libp2p v0.21-RC
2022-08-11 11:15:20 -07:00
Łukasz Magiera
71dacb5af8
sealing pipeline: Remove useless storage adapter code
2022-08-09 13:40:06 +02:00
ZenGround0
8b7be6d47e
feat:chain:splitstore auto prune ( #9123 )
...
Auto Prune
Co-authored-by: zenground0 <ZenGround0@users.noreply.github.com>
2022-08-08 16:06:32 -04:00
Jennifer Wang
8486ae0d51
Merge branch 'releases' into jen/backport
2022-07-11 14:27:26 -04:00
Marten Seemann
a825682bf9
chore: stop using the deprecated github.com/libp2p/go-libp2p-yamux ( #8998 )
2022-07-08 09:44:24 -07:00
Steven Allen
6bed08fe54
chore: update libp2p
...
1. This pulls in a multistream fix that should fix that fixes a few
tests (and probably a few actual bugs).
2. This deduplicates dependencies that have been merged into the
monorepo.
fixes #8953
2022-07-07 21:38:13 -07:00
Marten Seemann
d52f01a19f
fix incorrect usage of peer.IDFromString (should be peer.Decode)
2022-07-07 21:47:33 +00:00
Łukasz Magiera
673f9238be
feat: wdpost: Config for maximum partition count per message
2022-07-07 14:10:31 -04:00
Łukasz Magiera
59f3161fd6
wdpost: Config for disabling sector prechecks
2022-07-01 22:20:05 +02:00
Masih H. Derkani
e8c44babcf
Remove dependency to archived quic and regenerate CLI docs
...
The quic transport implementation is now moved to `go-libp2p` mono repo.
Replace the dependency to the archived repo with the new one.
Regenerate CLI docs.
2022-06-29 14:55:35 -04:00
Masih H. Derkani
39a710e1d6
Address lint issues as a result of libp2p deprecations and tidy go mod
...
Address staticcheck issues caused by deprecated APIs and `go mod tidy`.
2022-06-29 14:55:35 -04:00
Łukasz Magiera
db676acdf8
storage: Cleanup interfaces a bit
2022-06-17 13:52:19 +02:00
Łukasz Magiera
05cdeb80c3
chore: remove redundant import prefixes
2022-06-15 12:06:22 +02:00
Łukasz Magiera
28099a3905
storage: Move storage/sealer/stores to storage/paths
2022-06-14 20:25:52 +02:00
Łukasz Magiera
a9600b8a6f
storage: Move extern/sector-storage to storage/sealer
2022-06-14 20:03:38 +02:00
Łukasz Magiera
98a48a47f8
storage: Move extern/storage-sealing to storage/pipeline
2022-06-14 19:41:59 +02:00
Łukasz Magiera
717bda63b1
storage: Move control address logic to storage/ctladdr
2022-06-14 19:32:29 +02:00
Łukasz Magiera
dff1bf2868
storage: Move window-post logic into a separate package
2022-06-14 19:27:09 +02:00
Łukasz Magiera
e65fae28de
chore: fix imports
2022-06-14 17:00:51 +02:00
Steven Allen
ddc9425c07
feat: refactor: actor bundling system ( #8838 )
...
1. Include the builtin-actors in the lotus source tree.
2. Embed the bundle on build instead of downloading at runtime.
3. Avoid reading the bundle whenever possible by including bundle
metadata (the bundle CID, the actor CIDs, etc.).
4. Remove everything related to dependency injection.
1. We're no longer downloading the bundle, so doing anything ahead
of time doesn't really help.
2. We register the manifests on init because, unfortunately, they're
global.
3. We explicitly load the current actors bundle in the genesis
state-tree method.
4. For testing, we just change the in-use bundle with a bit of a
hack. It's not great, but using dependency injection doesn't make
any sense either because, again, the manifest information is
global.
5. Remove the bundle.toml file. Bundles may be overridden by
specifying an override path in the parameters file, or an
environment variable.
fixes #8701
2022-06-13 10:51:49 -07:00
Steven Allen
30981d0fdd
feat: refactor: actor bundling system ( #8838 )
...
1. Include the builtin-actors in the lotus source tree.
2. Embed the bundle on build instead of downloading at runtime.
3. Avoid reading the bundle whenever possible by including bundle
metadata (the bundle CID, the actor CIDs, etc.).
4. Remove everything related to dependency injection.
1. We're no longer downloading the bundle, so doing anything ahead
of time doesn't really help.
2. We register the manifests on init because, unfortunately, they're
global.
3. We explicitly load the current actors bundle in the genesis
state-tree method.
4. For testing, we just change the in-use bundle with a bit of a
hack. It's not great, but using dependency injection doesn't make
any sense either because, again, the manifest information is
global.
5. Remove the bundle.toml file. Bundles may be overridden by
specifying an override path in the parameters file, or an
environment variable.
fixes #8701
2022-06-13 10:15:00 -07:00
Łukasz Magiera
1cd94f598d
Merge pull request #8820 from filecoin-project/asr/deprecate-blocksync
...
refactor: remove old BlockSyncProtocolID
2022-06-13 18:36:21 +02:00
vyzo
d4d5ce3021
only enable rcmgr by default in full nodes
...
opt-in with envvar for other nodes, as there are still some issues
with markets related protocols
2022-06-13 12:16:20 -04:00
Aayush
789f212f6c
refactor: remove old BlockSyncProtocolID
2022-06-08 13:38:56 -04:00
Aayush
b28c11a57d
Merge branch 'feat/nv16'
2022-06-03 14:01:49 -04:00
vyzo
207ff66b3b
update comment.
...
Co-authored-by: Peter Rabbitson <ribasushi@protocol.ai>
2022-05-31 12:33:08 +03:00
vyzo
bc180c8d78
update comment.
...
Co-authored-by: Peter Rabbitson <ribasushi@protocol.ai>
2022-05-31 12:32:56 +03:00
vyzo
a1e6410178
remove outdated comment
2022-05-31 12:09:04 +03:00
vyzo
a313dcba74
only enable rcmgr by default in full nodes
...
opt-in with envvar for other nodes, as there are still some issues
with markets related protocols
2022-05-31 12:03:03 +03:00
Geoff Stuart
30e7f89662
Check for manifest CID while loading bundle
2022-05-26 17:30:32 -04:00
vyzo
bb0e3a6cb0
don't clobber test bundles during migration
2022-05-25 19:16:11 +03:00
Steven Allen
496799f867
build: set NetworkBundle in params file
...
Otherwise, we end up overriding the ldflags.
fixes #8684
2022-05-24 09:42:22 -07:00
vyzo
91daae2e36
add the network name to the bundle key in the datastore
2022-05-18 19:14:11 +03:00
vyzo
93417fca7d
Merge pull request #8660 from filecoin-project/fix/issue-8659
...
[nv16] use network bundle names consistent with the network name
2022-05-17 22:13:02 +03:00
vyzo
31c8460116
fix typo
2022-05-17 21:47:01 +03:00
vyzo
ccb2e44e36
make path/url be a map of network name to car uri
2022-05-17 21:45:17 +03:00
vyzo
d949b6c8ef
fix envvar handling
2022-05-17 21:14:49 +03:00
vyzo
daf452a180
flexible bundle loading
2022-05-17 20:38:32 +03:00
vyzo
314b417446
use network bundle names consistent with the network name
2022-05-16 22:02:37 +03:00
vyzo
eee73eed59
use switch for release/path logic
2022-05-16 21:45:12 +03:00
vyzo
5eccdaaab7
fix typo
...
Co-authored-by: raulk <raul@protocol.ai>
2022-05-16 21:38:43 +03:00
vyzo
221e7952ab
fix typo
...
Co-authored-by: raulk <raul@protocol.ai>
2022-05-16 21:38:09 +03:00
vyzo
46a85fc11e
niceties for development bundle loading
2022-05-16 21:09:09 +03:00
vyzo
b4be759b2c
don't store dev bundle release keys in the datastore
...
This is a nicety for development, so that we always load a development bundle to avoid having
to give them distinct names etc. Just call you release "dev" or "dev.xxx..." and put the bundle
in `.lotus/builtin-actors/v8/dev/builting-actors-${network}.{car,sha256sum}` and it will be
unconditionally loaded.
2022-05-16 15:11:10 +03:00
vyzo
68b280b695
add comments in the DI bundle loader
2022-05-12 22:03:18 +03:00
vyzo
7be42d9935
refactor to pass the network bundle name through ldflags from build
2022-05-12 16:42:59 +03:00
vyzo
da8bda3248
fix typo
2022-05-12 09:47:27 +03:00
vyzo
98730b90a3
fix lint
2022-05-11 22:41:56 +03:00
vyzo
74f300290e
dynamic loading of builtin actor bundles
2022-05-11 22:30:07 +03:00
Raúl Kripalani
6050d04c7c
Merge tag 'v1.15.2' into feat/nv16-merge-v1.15.2
2022-05-10 14:17:29 +01:00
vyzo
30ed272aa9
fetch testing-fwp bundle
...
use testing-fwp bundle when InsecurePostValidation is true
testing-fwp is testing-fake-proofs
2022-04-26 18:38:52 +03:00
Masih H. Derkani
d044e30e12
Infer index provider topic from network name by default
...
Index provider integration uses a gossipsub topic to announce changes to
the advertised content. The topic name was fixed to the default topic
which is `/indexer/ingest/mainnet`.
In the case of lotus, the gossipsub validators enforce a list of topics
the instance is permitted to join by setting subscription filter option
when `PubSub` instance is constructed via DI.
Having the fixed topic name meant that any SP starting up a node on a
network other than `mainnet` would have to override the default config
to avoid the node crashing when index provider is enabled.
Instead of a fixed default, the changes here infer the allowed indexer
topic name from network name automatically if the topic configuration is
left empty.
Fixes #8510
2022-04-22 02:46:05 +02:00
vyzo
adaa02fd26
load testing bundles for tests
2022-04-19 17:33:20 +03:00
vyzo
6bd2d89e30
use memory blockstore for miner manifest loading
2022-04-14 19:34:26 +03:00
vyzo
395c772222
make the miner load the manifest so that it can correctly map actors
2022-04-14 19:34:26 +03:00
vyzo
36cb76a322
genesis depends on actor bundle
2022-04-14 19:30:47 +03:00
vyzo
5e3112fa95
introduce a marker type for builtin actor loading to make DI work
2022-04-14 19:29:22 +03:00
vyzo
f26d19ed7d
load actor bundle at startup and initialize the manifest CID from the loaded file
2022-04-14 19:29:22 +03:00
Jiaying Wang
ce3c6472fb
Merge pull request #8470 from filecoin-project/feat/enable-rcmgr-by-default
...
enable rcmgr by default
2022-04-12 16:12:03 +02:00
vyzo
3c8aa18f70
enabled rcmgr by default; disable with LOTUS_RCMGR=0
2022-04-12 11:32:37 +03:00
Aayush Rajasekaran
656a33863f
Fixup merge
2022-04-11 20:45:13 -04:00
jennijuju
0dcad9cc18
Merge branch 'releases' into jen/mergeback
2022-04-12 01:25:02 +02:00