Aayush Rajasekaran
35aa78dad9
Allow marking a certain tipset as checkpointed
2020-09-09 14:34:00 -04:00
Raúl Kripalani
b33db9c1ab
Merge branch 'master' into blocksync-refactor
2020-09-08 14:22:43 +01:00
Aayush Rajasekaran
c77f5f6252
Revert "only subscribe to pubsub topics once we are synced"
2020-09-08 00:32:26 -04:00
hannahhoward
2db4b57013
feat(markets): upgrade markets 0.6.0
2020-09-07 15:48:42 -04:00
Aayush Rajasekaran
39755a294a
Update to specs v0.9.6
2020-09-07 15:48:41 -04:00
Łukasz Magiera
2080458f0d
Merge pull request #3518 from filecoin-project/feat/pubsub-red
...
integrate pubsub Random Early Drop
2020-09-07 21:42:14 +02:00
Raúl Kripalani
878ffafb51
rename other Chain{Exchange=>Bitswap}; fix ChainBlock{s=>S}ervice().
2020-09-07 20:20:23 +01:00
Raúl Kripalani
453e826a0f
rename p2p protocol to /fil/chain/xchg/0.0.1 (backwards-compatible); rename more.
2020-09-07 19:45:34 +01:00
Raúl Kripalani
55b1456d45
blocksync: introduce interfaces; rename to chainexchange.
2020-09-07 19:31:43 +01:00
vyzo
0d0dd250ee
use faster decay for bootstrappers
2020-09-07 19:54:38 +03:00
vyzo
81e674ad36
subscribe early in bootstrappers and get rid of ugly test flag
2020-09-07 19:46:35 +03:00
vyzo
e33798ff90
rename variable for better semantics
2020-09-07 15:58:05 +03:00
vyzo
d9faff19a5
fix tests
2020-09-07 15:55:53 +03:00
vyzo
4f0ab4f226
remove notifee after subscribing
2020-09-07 15:55:53 +03:00
vyzo
05740e0f64
silence linter for unnecessary conversion
2020-09-07 15:55:53 +03:00
vyzo
666dc65b8e
only subscribed to pubsub topics once we are synced
2020-09-07 15:55:53 +03:00
vyzo
c616958557
specify topic delivery weights, with priority for blocks
2020-09-07 13:40:48 +03:00
vyzo
453ab95e54
enable pubsub RED
2020-09-07 13:40:48 +03:00
vyzo
1c27a0c1cf
adjust gossipsub gossip factor
2020-09-04 22:04:48 +03:00
Raúl Kripalani
3206f92063
Merge branch 'master' into inmem-journal
2020-09-02 19:50:52 +01:00
Jakub Sztandera
625c6951bb
Don't use context to close bitswap
...
Use just the Close
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-08-31 19:24:04 +02:00
hannahhoward
0a36db06ed
feat(markets): update to markets v0.5.8
2020-08-28 18:03:27 -07:00
Łukasz Magiera
84a632787c
Merge pull request #3313 from filecoin-project/feat/mpool-balance-tracking
...
Message Pool Rudimentary Spam Protection Measures
2020-08-28 22:35:30 +02:00
Łukasz Magiera
ec2bc0baf6
Merge pull request #3363 from filecoin-project/fix/pubsub-params-tweaking
...
tweak some pubsub parameters
2020-08-28 00:18:26 +02:00
vyzo
20fbd66c90
tweak some pubsub parameters
...
- increase Bootstapp prune backoff to 5min from the default 1min
- reduce opportunistic graft threshold to 3.5 to account for low peer scores
2020-08-27 21:12:38 +03:00
Jakub Sztandera
b27ee8241a
Add TODO note
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-08-27 19:05:37 +02:00
Jakub Sztandera
6e4889d340
Don't fail if could not resolved drand dnsaddr
...
Resolves https://github.com/filecoin-project/lotus/issues/3335
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-08-27 17:50:16 +02:00
Raúl Kripalani
efdfd3ee3e
Merge branch 'master' into inmem-journal
2020-08-26 16:38:23 +01:00
Raúl Kripalani
4e1ef09751
make journal a global var.
2020-08-26 16:09:37 +01:00
vyzo
bedbdcaf13
give some score weight to the messages topic
2020-08-26 15:14:15 +03:00
Steven Allen
5733c71c50
Lint everything
...
We were ignoring quite a few error cases, and had one case where we weren't
actually updating state where we wanted to. Unfortunately, if the linter doesn't
pass, nobody has any reason to actually check lint failures in CI.
There are three remaining XXXs marked in the code for lint.
2020-08-20 20:46:36 -07:00
vyzo
d1718369a1
Merge pull request #3205 from filecoin-project/fix/update-pubsub
...
update pubsub and bump behaviour penalty threshold to 6
2020-08-20 23:37:17 +03:00
vyzo
896edfe072
pubsub metrics for RPCs
2020-08-20 23:14:32 +03:00
vyzo
de05120e69
increase behaviour penalty threshold to 6
2020-08-20 22:32:41 +03:00
vyzo
6193f4e062
pubsub: increase gossip history length to 10 heartbeats
2020-08-20 18:09:17 +03:00
vyzo
98d6d25c74
pubsub: set behaviour penalty threshold, increase IWANT follow up time to 5s
2020-08-20 18:08:02 +03:00
Łukasz Magiera
ed098390cb
Merge pull request #3172 from filecoin-project/feat/lotus-shed-jwt
...
lotus-shed: add simple jwt creation support
2020-08-19 23:32:01 +02:00
Travis Person
f1632376e7
lotus-shed: add simple jwt creation support
2020-08-19 19:21:36 +00:00
vyzo
6c5a91735a
fix drand topic first message delivery cap
2020-08-19 18:45:31 +03:00
Łukasz Magiera
a03192a39b
Separate concurrent sealing sector limit for deals
2020-08-18 21:48:18 +02:00
Łukasz Magiera
baf91f08a1
Unbreak tests
2020-08-18 18:27:18 +02:00
Łukasz Magiera
65ffde9e4b
fsm: Config for max WaitDeals sectors
2020-08-18 16:20:31 +02:00
vyzo
ff7f0a9dcd
Merge pull request #3090 from filecoin-project/fix/pubsub-validation-clown-shoes
...
Fix clown shoes in pubsub validation
2020-08-17 23:31:45 +03:00
Łukasz Magiera
6ef7a30b19
Merge pull request #3089 from filecoin-project/integrate/storage-fsm
...
integrate extern/{storage-fsm,sector-storage} into lotus source tree
2020-08-17 18:37:54 +02:00
Raúl Kripalani
862bafc63a
fix lint errors.
2020-08-17 14:39:33 +01:00
Raúl Kripalani
efdc428d5d
keep storage-fsm (renamed to storage-sealing) and sector-storage in extern.
2020-08-17 14:26:18 +01:00
vyzo
8cf9595d35
collect pubsub metrics through the tracer
2020-08-17 10:46:20 +03:00
vyzo
884d4ad9df
fix clown shoes pubsub validation: we always accept our own self-published messages
2020-08-16 20:46:19 +03:00
Raúl Kripalani
3c17cd655e
integrate extern/sector-storage into lotus proper.
2020-08-16 11:09:58 +01:00
Raúl Kripalani
fb0ccc9260
integrate extern/storage-fsm into lotus proper.
2020-08-16 10:42:13 +01:00
hannahhoward
6b5525b8d2
feat(markets): update markets 0.5.6
...
update markets to 0.5.6, removing use of validators that moved inside markets
2020-08-14 11:14:03 -07:00
Aayush Rajasekaran
d614135ebb
Check repo's genesis against baked-in genesis
2020-08-12 17:22:16 -04:00
Łukasz Magiera
e1a1b325bc
Merge remote-tracking branch 'origin/next' into feat/max-msg-fee-config
2020-08-12 21:55:03 +02:00
vyzo
e17732b365
remove secio support, replace with noise
2020-08-12 21:15:16 +03:00
Łukasz Magiera
6f890a3edd
Miner fee config
2020-08-12 19:47:09 +02:00
Jakub Sztandera
a45febc065
Fix MpoolLocker
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-08-11 19:32:31 +02:00
Raúl Kripalani
2ea5abdfb5
wire journal into miner.
2020-08-11 13:48:32 +01:00
Raúl Kripalani
92598237c3
Merge branch 'next' into inmem-journal
2020-08-11 12:41:11 +01:00
Łukasz Magiera
e2d5451ffb
Merge pull request #2715 from filecoin-project/schomatis/blocksync/review
...
Rewrite internal logic of block sync client
2020-08-06 19:46:58 +02:00
Łukasz Magiera
711b626a8b
Merge pull request #2852 from filecoin-project/jeff
...
Jeff
2020-08-06 13:01:14 +02:00
Łukasz Magiera
73b8868046
gofmt
2020-08-06 03:32:59 +02:00
Łukasz Magiera
f8b8ecc0c3
Consensus filter
2020-08-06 03:16:39 +02:00
hannahhoward
a89c290f62
feat(markets): update to 0.5.4
2020-08-05 15:35:59 -07:00
Lucas Molas
76d40ec408
first pass, ready for review
2020-08-03 12:20:04 -03:00
hannahhoward
3cac1080cc
feat(retrievalstoremgr): add retrievalstoremgr
...
add manager for retrievals to handle different cases for IPFS/non-ipfs
2020-07-31 14:16:18 -07:00
Łukasz Magiera
3ae55d1da3
Merge pull request #2714 from filecoin-project/feat/user-dealfiter
...
Support external deal decision logic
2020-07-31 21:56:44 +02:00
Aayush Rajasekaran
c33e38eef2
Update markets
2020-07-31 15:43:34 -04:00
Łukasz Magiera
6d21255678
Merge remote-tracking branch 'origin/master' into next
2020-07-31 21:36:14 +02:00
Łukasz Magiera
fc3c91b738
Support external deal decision logic
2020-07-31 20:29:16 +02:00
Whyrusleeping
bd6a80505b
Merge pull request #2731 from filecoin-project/pubsub-block-tracing
...
pubsub: only trace messages for the blocks topic
2020-07-31 09:27:26 -07:00
Łukasz Magiera
b6c9169a87
client cli: Interactive deal command
2020-07-31 18:23:36 +02:00
Łukasz Magiera
4cb4e7c2c2
Merge remote-tracking branch 'origin/master' into next
2020-07-31 14:02:04 +02:00
hannahhoward
e201408d61
feat(markets): better event logging
2020-07-31 12:55:45 +02:00
vyzo
d8ca29dd52
support extended pubsub peer scores
2020-07-31 11:27:22 +03:00
vyzo
1649c32325
pubsub: only trace message for the blocks topic
2020-07-31 10:15:21 +03:00
Łukasz Magiera
4d328cad54
Get things to mostly work
2020-07-30 14:31:50 +02:00
whyrusleeping
4e4fbafbe0
only log hello failure if the other side claims to support hello
2020-07-29 14:28:25 -07:00
Aayush Rajasekaran
5df0ee7935
Merge pull request #2647 from filecoin-project/feat/better-seal-duration-ui
...
Feat/better seal duration ui
2020-07-28 21:32:54 -04:00
whyrusleeping
dd8c88b418
improve some seal duration things
2020-07-28 17:40:42 -07:00
Łukasz Magiera
09b90773d8
Merge remote-tracking branch 'origin/next' into feat/cid-builder
2020-07-28 16:06:06 +02:00
hannahhoward
5a623cccb5
feat(markets): update markets mulitple deal stores
2020-07-27 23:13:28 -07:00
hannahhoward
dd885b7302
feat(multistore): extract multistore code to repo
...
Extract multistore + multiread blockstore to a seperate repo
2020-07-24 14:47:22 -07:00
Steven Allen
b7a4dbb07f
Support inline CIDs
...
And use the new CidBuilder from the spec actors.
This patch does not switch over to inline CIDs by default, but paves the way.
2020-07-23 23:12:32 -07:00
whyrusleeping
0594177191
add some better logging for hello handshake failures
2020-07-23 16:58:21 -07:00
Jakub Sztandera
7ae69c70fb
Cleanup DrandBootstrap
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-07-23 18:45:08 +02:00
Jakub Sztandera
ff5ff4d294
Add multiple drand configs
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-07-23 18:45:08 +02:00
Łukasz Magiera
d70edbcb7c
Set things on syscallShim
2020-07-22 13:35:10 -04:00
Raúl Kripalani
d6e6eedd58
pipe sealing events to the journal.
2020-07-21 13:02:51 +01:00
Raúl Kripalani
7459ec6bba
add mpool journal events; fix dependency injection.
2020-07-20 16:37:32 +01:00
Raúl Kripalani
226786c1da
wip
2020-07-20 14:45:17 +01:00
Raúl Kripalani
4d2d8b2d11
Merge branch 'next' into inmem-journal
2020-07-20 10:38:58 +01:00
Łukasz Magiera
d266c665b0
Update sector-storage with windowed scheduler
2020-07-18 00:38:02 +02:00
Jakub Sztandera
cc1d23a94c
Use single multi ds
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-07-17 22:14:37 +02:00
Raúl Kripalani
becbff0b13
add NilJournal; fix call sites to ChainStore constructor.
2020-07-17 19:10:47 +01:00
Raúl Kripalani
695f6cfe45
wip in-memory journal.
2020-07-17 14:34:42 +01:00
Aayush Rajasekaran
a5ef629cef
Add expected seal duration to custom deal logic, reject deals that start too early
2020-07-15 17:31:50 -04:00
hannahhoward
61f120222f
feat(markets): update markets with new retrieval
2020-07-15 14:04:31 -07:00
Łukasz Magiera
0f2043d874
Merge pull request #2317 from filcloud/issue-2304
...
fix issue 2304: ux improvements
2020-07-15 19:38:35 +02:00
Frank
14ec9a2068
update storage miner and seal worker document
2020-07-11 16:55:13 +08:00
Raúl Kripalani
13de81b3b2
introduce the ability to mock time.
2020-07-10 15:51:45 +01:00
Łukasz Magiera
66237415c5
Merge remote-tracking branch 'origin/next' into feat/client-multi-bstore
2020-07-08 22:48:47 +02:00
Łukasz Magiera
2b9c05d395
Merge remote-tracking branch 'origin/next' into feat/upgrade-markets-0.4.0
2020-07-08 15:53:55 +02:00
Łukasz Magiera
b049c5a7d1
Merge remote-tracking branch 'origin/master' into next
2020-07-08 14:35:40 +02:00
Łukasz Magiera
ba0f7d703e
Set lower polling interval for deal client
2020-07-08 12:52:37 +02:00
hannahhoward
24e3a4218b
feat(markets): upgrade to latest
...
upgrade to latest markets with fast retrieval, underlying data transfer upgrade
2020-07-08 01:35:50 -07:00
Aayush Rajasekaran
411c82ae8f
Update storage-FSM, add API to set sector seal delay
2020-07-07 15:23:23 -04:00
Łukasz Magiera
55f089d997
client: Unbreak retrieval
2020-07-07 14:35:02 +02:00
Łukasz Magiera
47f0898ce9
Wire up client import manager
2020-07-07 10:52:19 +02:00
Łukasz Magiera
8942967223
Client Import manager
2020-07-07 10:52:04 +02:00
whyrusleeping
42bd4eccbe
implement a persistent journal for lotus node operations
2020-07-06 09:42:00 -07:00
whyrusleeping
ffd012906c
add peer ID to hello protocol failure log
2020-07-01 16:20:05 -07:00
Łukasz Magiera
8f0e04027e
Merge pull request #2154 from laser/feat/1920-selection-commands
...
implement toggling of online/offline storage/retrieval deals
2020-07-01 11:06:32 +02:00
Raúl Kripalani
4f9c907248
rename build.{BlockDelay=>BlockDelaySecs}.
...
Since this global is not typed as a time.Duration,
rather as an int, it makes sense to clarify the unit.
2020-06-30 14:26:49 +01:00
Raúl Kripalani
0fddf3e114
make system constants configurable as vars.
...
This configurability is unlocked through the `testground`
build tag, which Project Oni will uses.
Changes in the usage places of these relaxed constants
were required due to the fact that Golang constants are
untyped, but vars aren't.
Read https://blog.golang.org/constants for more info.
2020-06-30 14:18:26 +01:00
Travis Person
12f10ac414
lotus-shed: organize peer key generate and other key commands under keyinfo
2020-06-29 20:07:39 +00:00
laser
b9180a99d4
toggle consideration of offline storage/retrieval deal proposals
2020-06-26 12:27:41 -07:00
laser
e910a045d0
big rename to allow for later introducing the "consider offline" config
2020-06-26 10:50:54 -07:00
laser
4c760ec1b1
lint: update comments to match type declarations
2020-06-24 08:08:10 -07:00
laser
ef0abf2b98
disable/enable retrieval deal consideration via config
2020-06-24 08:07:12 -07:00
Yusef Napora
5074cf8beb
import DrandConfig from dtypes
2020-06-23 16:23:06 -04:00
Yusef Napora
b448de422e
improve DrandConfig dependency injection
2020-06-23 16:01:10 -04:00
Yusef Napora
628872d0e4
forgot my go fmt hook
2020-06-23 15:10:27 -04:00
Yusef Napora
566a99240d
allow overriding drand config
2020-06-23 13:33:18 -04:00
Raúl Kripalani
d20255b1b4
provide an option to disable loading of built-in assets.
2020-06-22 19:42:04 +01:00
laser
fbeaab466a
obey the linter
2020-06-19 09:20:20 -07:00
laser
de7d6c255c
blacklist -> blocklist
2020-06-18 15:51:01 -07:00
laser
0c8d648998
specify which CID is being blacklisted (it's the piece)
2020-06-18 14:02:22 -07:00
laser
aa18d1985e
reject storage deal proposals containing blacklisted piece CIDs
2020-06-18 13:32:20 -07:00
laser
b0edf924b4
add commands for manipulating storage deal CID blacklist
2020-06-18 13:15:18 -07:00
hannahhoward
9262661135
chore(deps): update to fil-markets 0.3.0
...
Updates to latest fil markets with resumability and other fixes
2020-06-15 15:43:47 -07:00
laser
36b327b57b
various symbol renames
2020-06-11 13:18:18 -07:00
laser
7587e6c08b
get and set storage deal acceptance through CLI
2020-06-11 12:59:50 -07:00
laser
5421d0d1c5
better field and struct names + set default appropriately
...
Storage miners, by default, should be configured to accept storage deals.
2020-06-11 12:15:28 -07:00
laser
c458b4712a
better rejection messages
2020-06-11 12:06:38 -07:00
laser
d6b2519843
config-driven IsAcceptingStorageDeals flag
...
Makes incremental progress towards #1920 .
2020-06-11 11:29:59 -07:00
Jakub Sztandera
7762cd0a68
Assign positive scores to drand bootstrappers
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-08 11:34:46 +02:00
Jakub Sztandera
e91cc9cd08
Add drand topic scores
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-08 11:34:46 +02:00
Łukasz Magiera
163c2b2544
Merge remote-tracking branch 'origin/master' into next
2020-06-06 00:58:24 +02:00
laser
4855045ea2
pass context to paramfetch.GetParams
...
Fixes #1209
2020-06-05 10:28:00 -07:00
Jakub Sztandera
7bee5b3abc
Merge remote-tracking branch 'origin/master' into next
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-05 00:33:43 +02:00
vyzo
f210a6e91a
pubsub: set Dout parameter to 3 (from the default of 2)
...
we are using a higher D value than the default, so this can be safely increased.
2020-06-04 00:03:31 +03:00
Jakub Sztandera
7f962e19c2
Fix lint
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-03 03:19:18 +02:00
Jakub Sztandera
186fd4da74
Add lotus net scores for pubsub score visibility
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-03 03:13:49 +02:00
laser
bea9cd2fe2
rename to better convey intent + document
2020-06-02 12:35:11 -07:00
laser
38d714a28a
first take at "daemon stop" command
...
Fixes #1827
TODO: plumb the daemon-stopping into lotus-storage-miner, too
2020-06-02 12:29:58 -07:00
Łukasz Magiera
64f4e80446
Include build type in version
2020-06-01 20:49:39 +02:00
Łukasz Magiera
c73326e96d
fsrepo: Use LevelDB for metadata datastore
2020-06-01 20:13:07 +02:00
Łukasz Magiera
7003960fdd
Merge remote-tracking branch 'origin/master' into next
2020-06-01 18:52:06 +02:00
Jakub Sztandera
241c3fa673
Merge pull request #1869 from filecoin-project/feat/drand-pubsub
...
Add pubsub support to drand beacon
2020-05-29 18:06:38 +02:00
Łukasz Magiera
785eeb1eee
Merge pull request #1850 from filecoin-project/chore/lint
...
Cleanup many lint warnings
2020-05-29 18:06:06 +02:00
