Łukasz Magiera
09b90773d8
Merge remote-tracking branch 'origin/next' into feat/cid-builder
2020-07-28 16:06:06 +02:00
hannahhoward
5a623cccb5
feat(markets): update markets mulitple deal stores
2020-07-27 23:13:28 -07:00
hannahhoward
dd885b7302
feat(multistore): extract multistore code to repo
...
Extract multistore + multiread blockstore to a seperate repo
2020-07-24 14:47:22 -07:00
Steven Allen
b7a4dbb07f
Support inline CIDs
...
And use the new CidBuilder from the spec actors.
This patch does not switch over to inline CIDs by default, but paves the way.
2020-07-23 23:12:32 -07:00
whyrusleeping
0594177191
add some better logging for hello handshake failures
2020-07-23 16:58:21 -07:00
Jakub Sztandera
7ae69c70fb
Cleanup DrandBootstrap
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-07-23 18:45:08 +02:00
Jakub Sztandera
ff5ff4d294
Add multiple drand configs
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-07-23 18:45:08 +02:00
Łukasz Magiera
d70edbcb7c
Set things on syscallShim
2020-07-22 13:35:10 -04:00
Raúl Kripalani
d6e6eedd58
pipe sealing events to the journal.
2020-07-21 13:02:51 +01:00
Raúl Kripalani
7459ec6bba
add mpool journal events; fix dependency injection.
2020-07-20 16:37:32 +01:00
Raúl Kripalani
226786c1da
wip
2020-07-20 14:45:17 +01:00
Raúl Kripalani
4d2d8b2d11
Merge branch 'next' into inmem-journal
2020-07-20 10:38:58 +01:00
Łukasz Magiera
d266c665b0
Update sector-storage with windowed scheduler
2020-07-18 00:38:02 +02:00
Jakub Sztandera
cc1d23a94c
Use single multi ds
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-07-17 22:14:37 +02:00
Raúl Kripalani
becbff0b13
add NilJournal; fix call sites to ChainStore constructor.
2020-07-17 19:10:47 +01:00
Raúl Kripalani
695f6cfe45
wip in-memory journal.
2020-07-17 14:34:42 +01:00
Aayush Rajasekaran
a5ef629cef
Add expected seal duration to custom deal logic, reject deals that start too early
2020-07-15 17:31:50 -04:00
hannahhoward
61f120222f
feat(markets): update markets with new retrieval
2020-07-15 14:04:31 -07:00
Łukasz Magiera
0f2043d874
Merge pull request #2317 from filcloud/issue-2304
...
fix issue 2304: ux improvements
2020-07-15 19:38:35 +02:00
Frank
14ec9a2068
update storage miner and seal worker document
2020-07-11 16:55:13 +08:00
Raúl Kripalani
13de81b3b2
introduce the ability to mock time.
2020-07-10 15:51:45 +01:00
Łukasz Magiera
66237415c5
Merge remote-tracking branch 'origin/next' into feat/client-multi-bstore
2020-07-08 22:48:47 +02:00
Łukasz Magiera
2b9c05d395
Merge remote-tracking branch 'origin/next' into feat/upgrade-markets-0.4.0
2020-07-08 15:53:55 +02:00
Łukasz Magiera
b049c5a7d1
Merge remote-tracking branch 'origin/master' into next
2020-07-08 14:35:40 +02:00
Łukasz Magiera
ba0f7d703e
Set lower polling interval for deal client
2020-07-08 12:52:37 +02:00
hannahhoward
24e3a4218b
feat(markets): upgrade to latest
...
upgrade to latest markets with fast retrieval, underlying data transfer upgrade
2020-07-08 01:35:50 -07:00
Aayush Rajasekaran
411c82ae8f
Update storage-FSM, add API to set sector seal delay
2020-07-07 15:23:23 -04:00
Łukasz Magiera
55f089d997
client: Unbreak retrieval
2020-07-07 14:35:02 +02:00
Łukasz Magiera
47f0898ce9
Wire up client import manager
2020-07-07 10:52:19 +02:00
Łukasz Magiera
8942967223
Client Import manager
2020-07-07 10:52:04 +02:00
whyrusleeping
42bd4eccbe
implement a persistent journal for lotus node operations
2020-07-06 09:42:00 -07:00
whyrusleeping
ffd012906c
add peer ID to hello protocol failure log
2020-07-01 16:20:05 -07:00
Łukasz Magiera
8f0e04027e
Merge pull request #2154 from laser/feat/1920-selection-commands
...
implement toggling of online/offline storage/retrieval deals
2020-07-01 11:06:32 +02:00
Raúl Kripalani
4f9c907248
rename build.{BlockDelay=>BlockDelaySecs}.
...
Since this global is not typed as a time.Duration,
rather as an int, it makes sense to clarify the unit.
2020-06-30 14:26:49 +01:00
Raúl Kripalani
0fddf3e114
make system constants configurable as vars.
...
This configurability is unlocked through the `testground`
build tag, which Project Oni will uses.
Changes in the usage places of these relaxed constants
were required due to the fact that Golang constants are
untyped, but vars aren't.
Read https://blog.golang.org/constants for more info.
2020-06-30 14:18:26 +01:00
Travis Person
12f10ac414
lotus-shed: organize peer key generate and other key commands under keyinfo
2020-06-29 20:07:39 +00:00
laser
b9180a99d4
toggle consideration of offline storage/retrieval deal proposals
2020-06-26 12:27:41 -07:00
laser
e910a045d0
big rename to allow for later introducing the "consider offline" config
2020-06-26 10:50:54 -07:00
laser
4c760ec1b1
lint: update comments to match type declarations
2020-06-24 08:08:10 -07:00
laser
ef0abf2b98
disable/enable retrieval deal consideration via config
2020-06-24 08:07:12 -07:00
Yusef Napora
5074cf8beb
import DrandConfig from dtypes
2020-06-23 16:23:06 -04:00
Yusef Napora
b448de422e
improve DrandConfig dependency injection
2020-06-23 16:01:10 -04:00
Yusef Napora
628872d0e4
forgot my go fmt hook
2020-06-23 15:10:27 -04:00
Yusef Napora
566a99240d
allow overriding drand config
2020-06-23 13:33:18 -04:00
Raúl Kripalani
d20255b1b4
provide an option to disable loading of built-in assets.
2020-06-22 19:42:04 +01:00
laser
fbeaab466a
obey the linter
2020-06-19 09:20:20 -07:00
laser
de7d6c255c
blacklist -> blocklist
2020-06-18 15:51:01 -07:00
laser
0c8d648998
specify which CID is being blacklisted (it's the piece)
2020-06-18 14:02:22 -07:00
laser
aa18d1985e
reject storage deal proposals containing blacklisted piece CIDs
2020-06-18 13:32:20 -07:00
laser
b0edf924b4
add commands for manipulating storage deal CID blacklist
2020-06-18 13:15:18 -07:00
hannahhoward
9262661135
chore(deps): update to fil-markets 0.3.0
...
Updates to latest fil markets with resumability and other fixes
2020-06-15 15:43:47 -07:00
laser
36b327b57b
various symbol renames
2020-06-11 13:18:18 -07:00
laser
7587e6c08b
get and set storage deal acceptance through CLI
2020-06-11 12:59:50 -07:00
laser
5421d0d1c5
better field and struct names + set default appropriately
...
Storage miners, by default, should be configured to accept storage deals.
2020-06-11 12:15:28 -07:00
laser
c458b4712a
better rejection messages
2020-06-11 12:06:38 -07:00
laser
d6b2519843
config-driven IsAcceptingStorageDeals flag
...
Makes incremental progress towards #1920 .
2020-06-11 11:29:59 -07:00
Jakub Sztandera
7762cd0a68
Assign positive scores to drand bootstrappers
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-08 11:34:46 +02:00
Jakub Sztandera
e91cc9cd08
Add drand topic scores
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-08 11:34:46 +02:00
Łukasz Magiera
163c2b2544
Merge remote-tracking branch 'origin/master' into next
2020-06-06 00:58:24 +02:00
laser
4855045ea2
pass context to paramfetch.GetParams
...
Fixes #1209
2020-06-05 10:28:00 -07:00
Jakub Sztandera
7bee5b3abc
Merge remote-tracking branch 'origin/master' into next
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-05 00:33:43 +02:00
vyzo
f210a6e91a
pubsub: set Dout parameter to 3 (from the default of 2)
...
we are using a higher D value than the default, so this can be safely increased.
2020-06-04 00:03:31 +03:00
Jakub Sztandera
7f962e19c2
Fix lint
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-03 03:19:18 +02:00
Jakub Sztandera
186fd4da74
Add lotus net scores
for pubsub score visibility
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-03 03:13:49 +02:00
laser
bea9cd2fe2
rename to better convey intent + document
2020-06-02 12:35:11 -07:00
laser
38d714a28a
first take at "daemon stop" command
...
Fixes #1827
TODO: plumb the daemon-stopping into lotus-storage-miner, too
2020-06-02 12:29:58 -07:00
Łukasz Magiera
64f4e80446
Include build type in version
2020-06-01 20:49:39 +02:00
Łukasz Magiera
c73326e96d
fsrepo: Use LevelDB for metadata datastore
2020-06-01 20:13:07 +02:00
Łukasz Magiera
7003960fdd
Merge remote-tracking branch 'origin/master' into next
2020-06-01 18:52:06 +02:00
Jakub Sztandera
241c3fa673
Merge pull request #1869 from filecoin-project/feat/drand-pubsub
...
Add pubsub support to drand beacon
2020-05-29 18:06:38 +02:00
Łukasz Magiera
785eeb1eee
Merge pull request #1850 from filecoin-project/chore/lint
...
Cleanup many lint warnings
2020-05-29 18:06:06 +02:00
Jakub Sztandera
002d021eb7
Enable HashMsgId
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-05-29 17:55:24 +02:00
Jakub Sztandera
71eb41b9aa
Add pubsub support to drand beacon
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-05-29 17:55:17 +02:00
hannahhoward
0c4db8cf6b
fix(storageminer): add missing err check
...
Missing an err check in storage miner initialization in the stored ask
2020-05-28 17:05:17 -07:00
Ignacio Hagopian
17c378c18a
fix
...
Signed-off-by: Ignacio Hagopian <jsign.uy@gmail.com>
2020-05-28 22:11:49 +02:00
Ignacio Hagopian
0af7cd1448
allow using ipfs for retrieval
...
Signed-off-by: Ignacio Hagopian <jsign.uy@gmail.com>
2020-05-28 22:11:49 +02:00
Ignacio Hagopian
de3edc2ec7
remote ipfs support & automatic env
...
Signed-off-by: Ignacio Hagopian <jsign.uy@gmail.com>
2020-05-28 22:11:49 +02:00
Jakub Sztandera
b372881e91
Fix more lint warnings
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-05-28 01:15:19 +02:00
Jakub Sztandera
d6615b6286
Cleanup many lint warnings
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-05-27 22:53:20 +02:00
Jakub Sztandera
4604b60fb1
Remove drand on miner side, MinerGetBaseInfo provides the same info
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-05-27 20:24:26 +02:00
Ignacio Hagopian
009cd92010
fix
...
Signed-off-by: Ignacio Hagopian <jsign.uy@gmail.com>
2020-05-27 09:50:32 -03:00
Ignacio Hagopian
61daaa774b
allow using ipfs for retrieval
...
Signed-off-by: Ignacio Hagopian <jsign.uy@gmail.com>
2020-05-26 14:52:52 -03:00
Ignacio Hagopian
d5346f8326
remote ipfs support & automatic env
...
Signed-off-by: Ignacio Hagopian <jsign.uy@gmail.com>
2020-05-26 14:52:51 -03:00
vyzo
314da26da3
unconditionally disable relay
2020-05-25 13:39:50 +03:00
vyzo
5531f27798
sink the FirstMessageDeliveries boost for the messages topic
2020-05-22 17:25:56 +03:00
Whyrusleeping
83436842c5
Merge pull request #1802 from filecoin-project/feat/gfm-v0.2.7
...
Use latest go-fil-markets
2020-05-21 10:05:54 -07:00
vyzo
d597c3fb0d
increase OpportunisticGraftThreshold to 5
2020-05-21 14:38:11 +03:00
vyzo
0cc8446a79
configure Dout=0 for bootstrappers, turn off Mesh Failure Penalty for messages as well
2020-05-21 12:11:22 +03:00
hannahhoward
3264a9faad
feat(deps): update to latest go-fil-markets
...
update to go-fil-markets v0.2.7 with latest changes, modify constructors as needed to accomodate new
DS Prefix customization
2020-05-20 16:01:03 -07:00
shannonwells
652c257763
passing w/ new namespace wraps
2020-05-20 15:58:59 -07:00
shannonwells
e68ab286f6
upgrade lotus to go-fil-markets v0.2.5
2020-05-20 15:56:58 -07:00
Łukasz Magiera
f7325a69c1
Extract auth utils to go-jsonrpc
2020-05-20 20:37:45 +02:00
Łukasz Magiera
ae60001dcc
post: Handle Recovering sectors
2020-05-20 18:41:20 +02:00
Łukasz Magiera
cea7c41023
Merge pull request #1761 from dtynn/fix/dtynn/use_abs_path_for_client_filestore
...
use abs path to construct FileManager
2020-05-20 12:49:53 +02:00
Łukasz Magiera
0fe7a0b2e3
Merge pull request #1764 from filecoin-project/feat/has-cache-bs
...
add blockstore 'Has' caching
2020-05-20 12:48:50 +02:00
Jeromy
607bcc401c
very basic api documentation autogeneration
2020-05-18 17:20:54 -07:00
Jeromy
9804bd3c4c
add blockstore 'Has' caching
2020-05-16 11:31:14 -07:00
dtynn
30e2642f4d
use abs path to construct FileManager
2020-05-16 09:36:38 +08:00
Whyrusleeping
70657e35ba
Merge pull request #1708 from filecoin-project/feat/block-validator
...
Improved pubsub block validator
2020-05-15 11:26:26 -07:00
vyzo
dbe2a1e2cd
turn off Mesh Delivery Failure penalty
2020-05-15 12:50:20 +03:00
vyzo
6e0dac06f4
utility to retrieve miner worker key from the chain
2020-05-14 20:48:19 +03:00
vyzo
5bd0e92068
remove source flagging from bogus CID blocks
...
it's ineffective.
2020-05-14 20:48:19 +03:00
vyzo
b032d3524b
configure behaviour penalty for gsv1.1
2020-05-14 20:48:19 +03:00
Jeromy
d3eb808ff4
add profile for bootstrappers
2020-05-14 09:27:07 -07:00
Łukasz Magiera
e8d92a5f31
node: Use correct network name for DHT
2020-05-12 19:38:04 +02:00
hannahhoward
581e7e6fde
chore(deps): update to fil-markets 0.2.1
...
Update fil-markets to 0.2.1 that no longer keeps streams open
2020-05-08 14:11:40 -07:00
Łukasz Magiera
523a7a9d8d
Merge pull request #1670 from filecoin-project/feat/update-markets-0.2.0
...
Update go-fil-markets
2020-05-06 01:45:33 +02:00
Łukasz Magiera
60b78a74f7
Merge pull request #1676 from filecoin-project/cleanup/multi-addr-miner
...
block producers should have only one address
2020-05-05 22:12:32 +02:00
Jeromy
8b58f22c2e
block producers should have only one address
2020-05-05 12:01:44 -07:00
vyzo
eb24baa70c
use go-libp2p-core/peer instead of the deprecated alias, try to pacify the silly linter
2020-05-05 17:26:59 +03:00
vyzo
4e5179557d
flag block source when messages cannot be retrieved
2020-05-05 16:49:43 +03:00
hannahhoward
a9866c757e
feat(deps): update go-fil-markets
...
Update to latest 0.2.0 release of go-fil-markets with less-blocking node io
2020-05-04 18:36:51 -07:00
vyzo
e3f6e586ee
use blake2b hash as the message ID function
2020-05-04 19:34:30 +03:00
vyzo
805d07bca6
turn off the mesh in bootstrappers
2020-05-04 19:04:24 +03:00
vyzo
112aca7896
pubsub-specific configuration
2020-05-04 18:30:54 +03:00
Whyrusleeping
ae420fc9f4
Merge branch 'testnet/3' into feat/gossipsub-v1.1
2020-04-30 10:19:42 -07:00
Łukasz Magiera
81e3b714a2
gofmt
2020-04-30 12:51:19 +02:00
Łukasz Magiera
5ec76d4b7b
support making deals with data directly from IPFS nodes
2020-04-30 01:56:45 +02:00
vyzo
43aca717d1
gossipsubv1.1: tweak score parameters
2020-04-29 23:15:29 +03:00
vyzo
7de882b4d0
gossipsubv1.1: use score parameter helpers
2020-04-29 22:50:51 +03:00
vyzo
f8f6e28985
fix linter complaint
2020-04-29 19:01:45 +03:00
vyzo
9570ebfe0a
fix comparison logic for bootstrap peers
2020-04-29 18:56:58 +03:00
vyzo
667fb17b43
gossipsubv1.1: configure larger overlay D params
2020-04-29 17:09:39 +03:00
vyzo
7d7c83ef79
gossipsubv1.1: configure scores for bootstrapper PX
2020-04-29 17:03:41 +03:00
vyzo
6b56652768
gossipsubv1.1: score parameters and flood publishing
2020-04-29 16:41:44 +03:00
Jeromy
6a27c65201
updating to specs actors v0.2.0
2020-04-28 13:52:07 -07:00
Travis Person
c807469a5a
bitswap: disable provider ( #1620 )
...
Co-authored-by: Travis Person <travisperson@users.noreply.github.com>
2020-04-27 15:54:16 -07:00
Aayush Rajasekaran
7c22dabb63
default to setting max piece size to sector size
2020-04-24 01:01:22 -04:00
Łukasz Magiera
e6ce6211de
Merge remote-tracking branch 'origin/testnet/3' into feat/dht-upgrade
2020-04-24 00:50:23 +02:00
Whyrusleeping
faa9002cce
working on sector pledge requirements after specs-actors 1.0.0 ( #1584 )
...
* WIP: working on sector pledge requirements after specs-actors 1.0.0
* update storage-fsm with pledge collateral logic
* Set bigger balances for miners
* Return only additional required pledge
* split collateral methods into two methods
Co-authored-by: Łukasz Magiera <magik6k@gmail.com>
2020-04-23 12:39:34 -07:00
Jeromy
18f4e9d828
enable autonat service
2020-04-22 15:28:01 -07:00
Adin Schmahmann
9199c03f0d
disable using the DHT to find provider records or arbitrary values
2020-04-22 11:13:26 -07:00
Adin Schmahmann
744a02eb5a
update DHT options and use automatic DHT mode switching
2020-04-22 11:13:25 -07:00
Łukasz Magiera
b941b29fe5
miner: Use correct randomness for sealing
2020-04-20 20:33:53 +02:00
Łukasz Magiera
93b2b6d65d
Merge branch 'testnet/3' into feat/windowed-post
2020-04-17 18:38:20 +02:00
Łukasz Magiera
bab352fb44
Wireup WinningPost validation
2020-04-17 16:47:19 +02:00
Łukasz Magiera
dc2a67f13f
Fix worker key resolving
2020-04-16 22:38:42 +02:00
Łukasz Magiera
afdfc8807d
api: Single method for static miner info
2020-04-16 19:36:36 +02:00
Jakub Sztandera
08e74a90f9
Add missing files
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-04-15 16:13:20 +02:00
Jeromy
4e6839b5ef
some small cleanup
2020-04-14 15:13:52 -07:00
Jeromy
674be39af1
real drand network integration
2020-04-13 20:06:10 -07:00
Łukasz Magiera
5bf80a60f1
Get proof type in NewWinningPoStProver constructor
2020-04-13 23:25:46 +02:00
Łukasz Magiera
d3ffe48fcb
Get things to mostly build
2020-04-10 23:29:05 +02:00
Łukasz Magiera
e053cd6b9c
Merge remote-tracking branch 'origin/testnet/3' into feat/windowed-post
2020-04-10 23:09:01 +02:00
Łukasz Magiera
613e61222b
mostly wire up WindowedPoSt
2020-04-10 23:07:18 +02:00
Łukasz Magiera
3426611340
Merge pull request #1526 from filecoin-project/feat/pass-deal-schedule-for-pre-commit-expiry-scheduling
...
provide deal scheduling info to FSM so that it can set pre-commit expiry
2020-04-10 23:05:50 +02:00
Łukasz Magiera
072dd8b744
Merge remote-tracking branch 'origin/testnet/3' into feat/windowed-post
2020-04-10 20:38:25 +02:00
Łukasz Magiera
0f0015f45c
Merge pull request #1520 from filecoin-project/feat/graphsync-chainsync-extension
...
Update to latest go-fil-markets w/ enhanced Graphsync
2020-04-10 20:27:05 +02:00
laser
6dffe9377f
provide deal scheduling info to FSM so that it can set pre-commit expiry
2020-04-10 08:22:28 -07:00
Jeromy
ef6fb1b756
rename beacon to randombeacon
2020-04-08 16:10:08 -07:00