Łukasz Magiera
660236b224
Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers
2020-10-23 23:25:35 +02:00
Dirk McCormick
92942d44d1
feat: lite-mode - market storage and retrieval clients
2020-10-23 15:02:26 +02:00
Steven Allen
0c2ec04c09
use upgrade schedule from node when getting the network name
...
It doesn't matter now, but may in the future.
2020-10-21 12:18:38 -07:00
Steven Allen
4e730b5ec8
port to v2 imports
2020-10-21 12:16:23 -07:00
Ingar Shu
1974490ab0
Don't overwrite previously-configured maxPieceSize for a persisted ask
2020-10-19 13:12:28 -07:00
Łukasz Magiera
7ac5dc55d0
Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers
2020-10-17 13:45:11 +02:00
Łukasz Magiera
111942b50b
Merge pull request #4424 from filecoin-project/feat/retrieval-cli-deal-filter
...
Custom filters for retrieval deals
2020-10-16 18:41:40 +02:00
Ingar Shu
0b7dc6971d
Rebasing
2020-10-15 09:33:01 -07:00
hannahhoward
b29e3b5242
feat(markets): use build.BlockDelaySecs for start buffer
...
instead of constant from spec-actors which uses hardcoded start epoch, use one that factors in
possibility of different block time
2020-10-14 21:28:36 -07:00
Steven Allen
ddade32bd3
write bitswap blocks into a temporary, in-memory block cache
...
If they end up validating, we'll write them back to the underlying blockstore.
Otherwise, there's no reason to keep them.
2020-10-14 14:43:58 -07:00
Aarsh Shah
30dd5d9644
use updated stored ask api
2020-10-14 11:39:57 +02:00
hannahhoward
58662b79b3
fix(deps): use tagged go-fil-markets 0.9.0
2020-10-13 19:50:13 -07:00
Łukasz Magiera
71b3b9075d
Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers
2020-10-13 21:33:21 +02:00
hannahhoward
4edebcec2b
feat(markets): update markets 0.9.0 and add data transfer restart command
2020-10-13 03:41:08 -07:00
Ingar Shu
49155ace62
Use seal-duration in calculating the earliest StartEpoch that we will consider ( #4337 )
2020-10-12 17:45:37 -03:00
Jakub Sztandera
2b21fdef33
Refactor from crypto.SigType to types.KeyType
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-10-12 00:07:53 +02:00
Steven Allen
c463582528
fix a race and optimize hello messages
...
LifecycleCtx can _only_ be called during startup as it appends an fx hook.
Worse, this was causing us to append an fx hook on every single hello message,
leaking memory (and probably causing other shutdown issues...).
2020-10-10 08:33:06 -07:00
Steven Allen
748d2e82a7
unshare the journal
...
Motivation:
* Run lotus with the race detector enabled (primary motivation).
* Allow multiple lotus nodes in a process (not a high priority).
Previously, the journal was shared between all lotus instances, but it was
initialized for every new node. This caused safety problems in tests (at a
minimum).
This patch explicitly passes the journal to all services that need it.
2020-10-09 13:23:07 -07:00
Dirk McCormick
ef73b964fb
feat: add end-to-end test for lite mode
2020-10-09 11:48:35 +02:00
Dirk McCormick
2719adc1b1
feat: lite-mode - thin client for chan & state
2020-10-09 11:43:03 +02:00
Dirk McCormick
8fa4c0a970
feat: gateway - MpoolPush
2020-10-09 11:43:03 +02:00
Dirk McCormick
00a14de094
feat: gateway - StateLookupID
2020-10-09 11:43:03 +02:00
Dirk McCormick
e19cd9ed01
feat: lotus-lite - replace wallet StateManager with thin client to gateway
2020-10-09 11:43:03 +02:00
vyzo
7933cf094f
allow all drand topics
2020-10-08 21:48:55 +03:00
vyzo
4cd73f1560
use subscription filter in pubsub
2020-10-08 21:40:36 +03:00
Łukasz Magiera
0de3051821
Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers
2020-10-08 13:10:41 +02:00
vyzo
de390749fc
set pubsub IPColocationFactor to 5
2020-10-06 09:11:44 +03:00
Łukasz Magiera
0e2f697217
Merge pull request #4133 from filecoin-project/feat/backup
...
Miner backup/restore commands
2020-10-06 02:05:03 +02:00
Ingar Shu
1227bf2893
Change max time in future for StartEpoch to 7 days
2020-10-05 12:35:58 -07:00
Ingar Shu
550f3771ea
Reject deals that are > 90 days in the future in the BasicDealFilter
2020-10-05 11:39:02 -07:00
Łukasz Magiera
2dc9a1ee4e
lotus-miner backup command
2020-10-01 17:55:47 +02:00
Łukasz Magiera
5932f28519
Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers
2020-10-01 02:39:48 +02:00
hannahhoward
be884e27be
feat(markets): update markets 0.7.0
2020-09-30 10:26:50 -07:00
Łukasz Magiera
cf71f034dc
Merge remote-tracking branch 'origin/dev' into feat/async-restartable-workers
2020-09-26 12:35:32 +02:00
Łukasz Magiera
ef28ebb14a
Ignition upgrades, much excite.
2020-09-25 23:55:37 -07:00
Łukasz Magiera
03c3d8bdb3
workers: Return unfinished tasks on restart
2020-09-22 00:52:33 +02:00
Łukasz Magiera
5e09581256
sectorstorage: get new work tracker to run
2020-09-16 22:33:58 +02:00
Łukasz Magiera
03cf6cca40
Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers
2020-09-15 17:47:03 +02:00
Łukasz Magiera
6665a9ca69
Merge pull request #3845 from filecoin-project/sync-manager
...
syncer: make SyncManager an interface.
2020-09-15 10:28:48 +02:00
Raúl Kripalani
dd841f32db
syncer: make SyncManager an interface.
2020-09-14 21:58:59 +01:00
Raúl Kripalani
954ff32503
fix transitive api dependency on ffi.
2020-09-14 19:01:35 +01:00
Łukasz Magiera
381a6cdfac
Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers
2020-09-14 19:11:50 +02:00
Łukasz Magiera
1ebca8f732
more working code
2020-09-14 19:09:01 +02:00
Raúl Kripalani
09e9d6d778
deal journal events: wire into markets subscriptions.
2020-09-14 16:20:01 +01:00
Raúl Kripalani
6d29d75724
Merge branch 'master' into inmem-journal
2020-09-14 12:17:45 +01:00
Jakub Sztandera
c71e1adc93
Integrate multiple drand networks with pubsub
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-09-10 17:41:55 -04:00
Jakub Sztandera
64fa6fd9e5
Draw the rest of the owl
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-09-10 17:41:55 -04:00
Jakub Sztandera
2d3f92aeed
Introduce beacon Schedule
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-09-10 17:41:55 -04:00
Aayush Rajasekaran
35aa78dad9
Allow marking a certain tipset as checkpointed
2020-09-09 14:34:00 -04:00
Raúl Kripalani
b33db9c1ab
Merge branch 'master' into blocksync-refactor
2020-09-08 14:22:43 +01:00
Aayush Rajasekaran
c77f5f6252
Revert "only subscribe to pubsub topics once we are synced"
2020-09-08 00:32:26 -04:00
hannahhoward
2db4b57013
feat(markets): upgrade markets 0.6.0
2020-09-07 15:48:42 -04:00
Aayush Rajasekaran
39755a294a
Update to specs v0.9.6
2020-09-07 15:48:41 -04:00
Łukasz Magiera
2080458f0d
Merge pull request #3518 from filecoin-project/feat/pubsub-red
...
integrate pubsub Random Early Drop
2020-09-07 21:42:14 +02:00
Raúl Kripalani
878ffafb51
rename other Chain{Exchange=>Bitswap}; fix ChainBlock{s=>S}ervice().
2020-09-07 20:20:23 +01:00
Raúl Kripalani
453e826a0f
rename p2p protocol to /fil/chain/xchg/0.0.1 (backwards-compatible); rename more.
2020-09-07 19:45:34 +01:00
Raúl Kripalani
55b1456d45
blocksync: introduce interfaces; rename to chainexchange.
2020-09-07 19:31:43 +01:00
vyzo
0d0dd250ee
use faster decay for bootstrappers
2020-09-07 19:54:38 +03:00
vyzo
81e674ad36
subscribe early in bootstrappers and get rid of ugly test flag
2020-09-07 19:46:35 +03:00
vyzo
e33798ff90
rename variable for better semantics
2020-09-07 15:58:05 +03:00
vyzo
d9faff19a5
fix tests
2020-09-07 15:55:53 +03:00
vyzo
4f0ab4f226
remove notifee after subscribing
2020-09-07 15:55:53 +03:00
vyzo
05740e0f64
silence linter for unnecessary conversion
2020-09-07 15:55:53 +03:00
vyzo
666dc65b8e
only subscribed to pubsub topics once we are synced
2020-09-07 15:55:53 +03:00
vyzo
c616958557
specify topic delivery weights, with priority for blocks
2020-09-07 13:40:48 +03:00
vyzo
453ab95e54
enable pubsub RED
2020-09-07 13:40:48 +03:00
vyzo
1c27a0c1cf
adjust gossipsub gossip factor
2020-09-04 22:04:48 +03:00
Raúl Kripalani
3206f92063
Merge branch 'master' into inmem-journal
2020-09-02 19:50:52 +01:00
Jakub Sztandera
625c6951bb
Don't use context to close bitswap
...
Use just the Close
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-08-31 19:24:04 +02:00
hannahhoward
0a36db06ed
feat(markets): update to markets v0.5.8
2020-08-28 18:03:27 -07:00
Łukasz Magiera
84a632787c
Merge pull request #3313 from filecoin-project/feat/mpool-balance-tracking
...
Message Pool Rudimentary Spam Protection Measures
2020-08-28 22:35:30 +02:00
Łukasz Magiera
ec2bc0baf6
Merge pull request #3363 from filecoin-project/fix/pubsub-params-tweaking
...
tweak some pubsub parameters
2020-08-28 00:18:26 +02:00
vyzo
20fbd66c90
tweak some pubsub parameters
...
- increase Bootstapp prune backoff to 5min from the default 1min
- reduce opportunistic graft threshold to 3.5 to account for low peer scores
2020-08-27 21:12:38 +03:00
Jakub Sztandera
b27ee8241a
Add TODO note
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-08-27 19:05:37 +02:00
Jakub Sztandera
6e4889d340
Don't fail if could not resolved drand dnsaddr
...
Resolves https://github.com/filecoin-project/lotus/issues/3335
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-08-27 17:50:16 +02:00
Raúl Kripalani
efdfd3ee3e
Merge branch 'master' into inmem-journal
2020-08-26 16:38:23 +01:00
Raúl Kripalani
4e1ef09751
make journal a global var.
2020-08-26 16:09:37 +01:00
vyzo
bedbdcaf13
give some score weight to the messages topic
2020-08-26 15:14:15 +03:00
Steven Allen
5733c71c50
Lint everything
...
We were ignoring quite a few error cases, and had one case where we weren't
actually updating state where we wanted to. Unfortunately, if the linter doesn't
pass, nobody has any reason to actually check lint failures in CI.
There are three remaining XXXs marked in the code for lint.
2020-08-20 20:46:36 -07:00
vyzo
d1718369a1
Merge pull request #3205 from filecoin-project/fix/update-pubsub
...
update pubsub and bump behaviour penalty threshold to 6
2020-08-20 23:37:17 +03:00
vyzo
896edfe072
pubsub metrics for RPCs
2020-08-20 23:14:32 +03:00
vyzo
de05120e69
increase behaviour penalty threshold to 6
2020-08-20 22:32:41 +03:00
vyzo
6193f4e062
pubsub: increase gossip history length to 10 heartbeats
2020-08-20 18:09:17 +03:00
vyzo
98d6d25c74
pubsub: set behaviour penalty threshold, increase IWANT follow up time to 5s
2020-08-20 18:08:02 +03:00
Łukasz Magiera
ed098390cb
Merge pull request #3172 from filecoin-project/feat/lotus-shed-jwt
...
lotus-shed: add simple jwt creation support
2020-08-19 23:32:01 +02:00
Travis Person
f1632376e7
lotus-shed: add simple jwt creation support
2020-08-19 19:21:36 +00:00
vyzo
6c5a91735a
fix drand topic first message delivery cap
2020-08-19 18:45:31 +03:00
Łukasz Magiera
a03192a39b
Separate concurrent sealing sector limit for deals
2020-08-18 21:48:18 +02:00
Łukasz Magiera
baf91f08a1
Unbreak tests
2020-08-18 18:27:18 +02:00
Łukasz Magiera
65ffde9e4b
fsm: Config for max WaitDeals sectors
2020-08-18 16:20:31 +02:00
vyzo
ff7f0a9dcd
Merge pull request #3090 from filecoin-project/fix/pubsub-validation-clown-shoes
...
Fix clown shoes in pubsub validation
2020-08-17 23:31:45 +03:00
Łukasz Magiera
6ef7a30b19
Merge pull request #3089 from filecoin-project/integrate/storage-fsm
...
integrate extern/{storage-fsm,sector-storage} into lotus source tree
2020-08-17 18:37:54 +02:00
Raúl Kripalani
862bafc63a
fix lint errors.
2020-08-17 14:39:33 +01:00
Raúl Kripalani
efdc428d5d
keep storage-fsm (renamed to storage-sealing) and sector-storage in extern.
2020-08-17 14:26:18 +01:00
vyzo
8cf9595d35
collect pubsub metrics through the tracer
2020-08-17 10:46:20 +03:00
vyzo
884d4ad9df
fix clown shoes pubsub validation: we always accept our own self-published messages
2020-08-16 20:46:19 +03:00
Raúl Kripalani
3c17cd655e
integrate extern/sector-storage into lotus proper.
2020-08-16 11:09:58 +01:00
Raúl Kripalani
fb0ccc9260
integrate extern/storage-fsm into lotus proper.
2020-08-16 10:42:13 +01:00
hannahhoward
6b5525b8d2
feat(markets): update markets 0.5.6
...
update markets to 0.5.6, removing use of validators that moved inside markets
2020-08-14 11:14:03 -07:00
Aayush Rajasekaran
d614135ebb
Check repo's genesis against baked-in genesis
2020-08-12 17:22:16 -04:00