Łukasz Magiera
381a6cdfac
Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers
2020-09-14 19:11:50 +02:00
Raúl Kripalani
05aa5f2d38
allow customizing disabled journal events + tests.
2020-09-14 13:01:03 +01:00
Raúl Kripalani
6d29d75724
Merge branch 'master' into inmem-journal
2020-09-14 12:17:45 +01:00
zgfzgf
45a5eaf913
optimize Settings.nodeType
2020-09-14 11:00:08 +08:00
Jakub Sztandera
64fa6fd9e5
Draw the rest of the owl
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-09-10 17:41:55 -04:00
Łukasz Magiera
5f08fe7ead
Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers
2020-09-10 17:30:54 +02:00
Raúl Kripalani
878ffafb51
rename other Chain{Exchange=>Bitswap}; fix ChainBlock{s=>S}ervice().
2020-09-07 20:20:23 +01:00
Raúl Kripalani
453e826a0f
rename p2p protocol to /fil/chain/xchg/0.0.1 (backwards-compatible); rename more.
2020-09-07 19:45:34 +01:00
Raúl Kripalani
55b1456d45
blocksync: introduce interfaces; rename to chainexchange.
2020-09-07 19:31:43 +01:00
Łukasz Magiera
9e6f974f3c
storage: Fix build
2020-09-07 16:12:55 +02:00
Łukasz Magiera
780f6dba34
Remote wallet backends
2020-09-05 21:39:09 +02:00
Łukasz Magiera
f90cfda2e6
wallet: Add interface layer
2020-09-04 22:18:03 +02:00
Raúl Kripalani
1ec534d607
Merge branch 'master' into inmem-journal
2020-09-04 10:55:40 +01:00
whyrusleeping
a59dadccc9
add apis and command to inspect bandwidth usage
2020-09-02 15:25:53 -07:00
Raúl Kripalani
0b6a182a44
move InitJournalKey to the top; add godcs on invoke order.
2020-09-02 19:15:07 +01:00
Raúl Kripalani
efdfd3ee3e
Merge branch 'master' into inmem-journal
2020-08-26 16:38:23 +01:00
Raúl Kripalani
4e1ef09751
make journal a global var.
2020-08-26 16:09:37 +01:00
Steven Allen
5733c71c50
Lint everything
...
We were ignoring quite a few error cases, and had one case where we weren't
actually updating state where we wanted to. Unfortunately, if the linter doesn't
pass, nobody has any reason to actually check lint failures in CI.
There are three remaining XXXs marked in the code for lint.
2020-08-20 20:46:36 -07:00
vyzo
92faf5c5f9
don't prefer TLS over NOISE
2020-08-20 11:33:19 +03:00
Łukasz Magiera
65ffde9e4b
fsm: Config for max WaitDeals sectors
2020-08-18 16:20:31 +02:00
Raúl Kripalani
862bafc63a
fix lint errors.
2020-08-17 14:39:33 +01:00
Raúl Kripalani
efdc428d5d
keep storage-fsm (renamed to storage-sealing) and sector-storage in extern.
2020-08-17 14:26:18 +01:00
Raúl Kripalani
3c17cd655e
integrate extern/sector-storage into lotus proper.
2020-08-16 11:09:58 +01:00
Raúl Kripalani
fb0ccc9260
integrate extern/storage-fsm into lotus proper.
2020-08-16 10:42:13 +01:00
hannahhoward
6b5525b8d2
feat(markets): update markets 0.5.6
...
update markets to 0.5.6, removing use of validators that moved inside markets
2020-08-14 11:14:03 -07:00
Łukasz Magiera
6f890a3edd
Miner fee config
2020-08-12 19:47:09 +02:00
Jakub Sztandera
a45febc065
Fix MpoolLocker
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-08-11 19:32:31 +02:00
Raúl Kripalani
2ea5abdfb5
wire journal into miner.
2020-08-11 13:48:32 +01:00
Raúl Kripalani
92598237c3
Merge branch 'next' into inmem-journal
2020-08-11 12:41:11 +01:00
Łukasz Magiera
e2d5451ffb
Merge pull request #2715 from filecoin-project/schomatis/blocksync/review
...
Rewrite internal logic of block sync client
2020-08-06 19:46:58 +02:00
Dirk McCormick
fdfccf0466
WIP: fix payment channel locking
2020-08-06 12:04:10 -04:00
Łukasz Magiera
c6acfa624e
Merge pull request #2834 from filecoin-project/feat/fund-manager-fix
...
Improve Fund Manager
2020-08-06 16:45:05 +02:00
Łukasz Magiera
73b8868046
gofmt
2020-08-06 03:32:59 +02:00
Łukasz Magiera
f8b8ecc0c3
Consensus filter
2020-08-06 03:16:39 +02:00
hannahhoward
b4d1b628be
feat(fundmgr): add monitoring to FundMgr
2020-08-04 17:29:52 -07:00
Lucas Molas
76d40ec408
first pass, ready for review
2020-08-03 12:20:04 -03:00
hannahhoward
3cac1080cc
feat(retrievalstoremgr): add retrievalstoremgr
...
add manager for retrievals to handle different cases for IPFS/non-ipfs
2020-07-31 14:16:18 -07:00
Łukasz Magiera
fc3c91b738
Support external deal decision logic
2020-07-31 20:29:16 +02:00
Łukasz Magiera
4d328cad54
Get things to mostly work
2020-07-30 14:31:50 +02:00
Łukasz Magiera
09b90773d8
Merge remote-tracking branch 'origin/next' into feat/cid-builder
2020-07-28 16:06:06 +02:00
hannahhoward
5a623cccb5
feat(markets): update markets mulitple deal stores
2020-07-27 23:13:28 -07:00
Steven Allen
b7a4dbb07f
Support inline CIDs
...
And use the new CidBuilder from the spec actors.
This patch does not switch over to inline CIDs by default, but paves the way.
2020-07-23 23:12:32 -07:00
Łukasz Magiera
d70edbcb7c
Set things on syscallShim
2020-07-22 13:35:10 -04:00
hannahhoward
98535d5e06
feat(settler): monitor settled channels
...
Add a routine to monitor the chain for payment channels settling, and if it's a channel that we are
the recipient of payments on, submit any outstanding vouchers to the
chain
2020-07-22 13:34:35 -04:00
Raúl Kripalani
cb8e209f78
journal: disable noisy message pool events.
2020-07-21 13:13:09 +01:00
Raúl Kripalani
7459ec6bba
add mpool journal events; fix dependency injection.
2020-07-20 16:37:32 +01:00
Raúl Kripalani
226786c1da
wip
2020-07-20 14:45:17 +01:00
Raúl Kripalani
695f6cfe45
wip in-memory journal.
2020-07-17 14:34:42 +01:00
Aayush Rajasekaran
a5ef629cef
Add expected seal duration to custom deal logic, reject deals that start too early
2020-07-15 17:31:50 -04:00
Frank
14ec9a2068
update storage miner and seal worker document
2020-07-11 16:55:13 +08:00
Łukasz Magiera
66237415c5
Merge remote-tracking branch 'origin/next' into feat/client-multi-bstore
2020-07-08 22:48:47 +02:00
Łukasz Magiera
b049c5a7d1
Merge remote-tracking branch 'origin/master' into next
2020-07-08 14:35:40 +02:00
Aayush Rajasekaran
411c82ae8f
Update storage-FSM, add API to set sector seal delay
2020-07-07 15:23:23 -04:00
Łukasz Magiera
47f0898ce9
Wire up client import manager
2020-07-07 10:52:19 +02:00
Łukasz Magiera
8942967223
Client Import manager
2020-07-07 10:52:04 +02:00
whyrusleeping
42bd4eccbe
implement a persistent journal for lotus node operations
2020-07-06 09:42:00 -07:00
laser
b9180a99d4
toggle consideration of offline storage/retrieval deal proposals
2020-06-26 12:27:41 -07:00
laser
e910a045d0
big rename to allow for later introducing the "consider offline" config
2020-06-26 10:50:54 -07:00
laser
ef0abf2b98
disable/enable retrieval deal consideration via config
2020-06-24 08:07:12 -07:00
Yusef Napora
b448de422e
improve DrandConfig dependency injection
2020-06-23 16:01:10 -04:00
laser
de7d6c255c
blacklist -> blocklist
2020-06-18 15:51:01 -07:00
laser
0c8d648998
specify which CID is being blacklisted (it's the piece)
2020-06-18 14:02:22 -07:00
laser
b0edf924b4
add commands for manipulating storage deal CID blacklist
2020-06-18 13:15:18 -07:00
hannahhoward
9262661135
chore(deps): update to fil-markets 0.3.0
...
Updates to latest fil markets with resumability and other fixes
2020-06-15 15:43:47 -07:00
Łukasz Magiera
01f0bb3124
Merge pull request #1994 from laser/feat/1920-toggle-accepting-storage-deals
...
allow miner to disable/enable consideration of received storage deal proposals
2020-06-15 19:05:39 +02:00
laser
36b327b57b
various symbol renames
2020-06-11 13:18:18 -07:00
laser
7587e6c08b
get and set storage deal acceptance through CLI
2020-06-11 12:59:50 -07:00
laser
d6b2519843
config-driven IsAcceptingStorageDeals flag
...
Makes incremental progress towards #1920 .
2020-06-11 11:29:59 -07:00
Jim Pick
6e11ff3796
Make libp2p swarm Announce / NoAnnounce addresses configurable
...
In go-ipfs, it is possible to manually configure addresses to announce
or not announce to the swarm.
https://github.com/ipfs/go-ipfs/blob/master/docs/config.md#addressesannounce
This PR adds the same feature to Lotus. It can be configured from the [libp2p]
section of either the .lotus or .lotusstorage config.toml file. Example:
[Libp2p]
ListenAddresses = ["/ip4/0.0.0.0/tcp/34515", "/ip6/::/tcp/34515"]
AnnounceAddresses = ["/ip4/52.13.91.110/tcp/34515"]
2020-06-08 17:03:11 -07:00
Jakub Sztandera
7762cd0a68
Assign positive scores to drand bootstrappers
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-08 11:34:46 +02:00
Jakub Sztandera
7bee5b3abc
Merge remote-tracking branch 'origin/master' into next
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-05 00:33:43 +02:00
Jakub Sztandera
186fd4da74
Add lotus net scores
for pubsub score visibility
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-03 03:13:49 +02:00
laser
bea9cd2fe2
rename to better convey intent + document
2020-06-02 12:35:11 -07:00
laser
38d714a28a
first take at "daemon stop" command
...
Fixes #1827
TODO: plumb the daemon-stopping into lotus-storage-miner, too
2020-06-02 12:29:58 -07:00
Jakub Sztandera
71eb41b9aa
Add pubsub support to drand beacon
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-05-29 17:55:17 +02:00
Ignacio Hagopian
0af7cd1448
allow using ipfs for retrieval
...
Signed-off-by: Ignacio Hagopian <jsign.uy@gmail.com>
2020-05-28 22:11:49 +02:00
Ignacio Hagopian
de3edc2ec7
remote ipfs support & automatic env
...
Signed-off-by: Ignacio Hagopian <jsign.uy@gmail.com>
2020-05-28 22:11:49 +02:00
Ignacio Hagopian
61daaa774b
allow using ipfs for retrieval
...
Signed-off-by: Ignacio Hagopian <jsign.uy@gmail.com>
2020-05-26 14:52:52 -03:00
Ignacio Hagopian
d5346f8326
remote ipfs support & automatic env
...
Signed-off-by: Ignacio Hagopian <jsign.uy@gmail.com>
2020-05-26 14:52:51 -03:00
vyzo
314da26da3
unconditionally disable relay
2020-05-25 13:39:50 +03:00
hannahhoward
3264a9faad
feat(deps): update to latest go-fil-markets
...
update to go-fil-markets v0.2.7 with latest changes, modify constructors as needed to accomodate new
DS Prefix customization
2020-05-20 16:01:03 -07:00
shannonwells
e68ab286f6
upgrade lotus to go-fil-markets v0.2.5
2020-05-20 15:56:58 -07:00
Jeromy
d3eb808ff4
add profile for bootstrappers
2020-05-14 09:27:07 -07:00
vyzo
112aca7896
pubsub-specific configuration
2020-05-04 18:30:54 +03:00
Łukasz Magiera
5ec76d4b7b
support making deals with data directly from IPFS nodes
2020-04-30 01:56:45 +02:00
Łukasz Magiera
9dcb42328e
gofmt
2020-04-28 19:27:13 +02:00
ldoublewood
b7c6cc5321
fix wrong special id ( #1615 )
2020-04-27 10:26:28 -07:00
Łukasz Magiera
e6ce6211de
Merge remote-tracking branch 'origin/testnet/3' into feat/dht-upgrade
2020-04-24 00:50:23 +02:00
Whyrusleeping
faa9002cce
working on sector pledge requirements after specs-actors 1.0.0 ( #1584 )
...
* WIP: working on sector pledge requirements after specs-actors 1.0.0
* update storage-fsm with pledge collateral logic
* Set bigger balances for miners
* Return only additional required pledge
* split collateral methods into two methods
Co-authored-by: Łukasz Magiera <magik6k@gmail.com>
2020-04-23 12:39:34 -07:00
Jeromy
18f4e9d828
enable autonat service
2020-04-22 15:28:01 -07:00
Adin Schmahmann
744a02eb5a
update DHT options and use automatic DHT mode switching
2020-04-22 11:13:25 -07:00
Łukasz Magiera
93b2b6d65d
Merge branch 'testnet/3' into feat/windowed-post
2020-04-17 18:38:20 +02:00
Jakub Sztandera
0c5e3e2533
Make tests use mock beacon
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-04-14 20:41:05 +02:00
Jeromy
674be39af1
real drand network integration
2020-04-13 20:06:10 -07:00
Łukasz Magiera
a2554952d1
Some electionPoSt -> winningPoSt renaming
2020-04-11 00:22:45 +02:00
Łukasz Magiera
613e61222b
mostly wire up WindowedPoSt
2020-04-10 23:07:18 +02:00
Łukasz Magiera
0f0015f45c
Merge pull request #1520 from filecoin-project/feat/graphsync-chainsync-extension
...
Update to latest go-fil-markets w/ enhanced Graphsync
2020-04-10 20:27:05 +02:00
Jeromy
ef6fb1b756
rename beacon to randombeacon
2020-04-08 16:10:08 -07:00
hannahhoward
00cd89750d
feat(deps): update fil-markets, graphsync
...
Updates dependencies for graphsync, fil-markets, data-transfer. Moves to new graphsync blockstore
swapping capabilities, and also locks down graphsync impl so it does not accept arbitrary requests
2020-04-07 23:25:29 -07:00
Jeromy
7075eaba26
WIP: random beacon interface
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-04-07 15:32:23 -07:00
laser
110c869dd3
cut over to storage-fsm, deleting local sealing package
2020-04-07 09:34:09 -07:00
Łukasz Magiera
4ee8254133
Merge pull request #1510 from filecoin-project/feat/fsm-updates
...
FSM Updates
2020-04-06 23:11:46 +02:00
Łukasz Magiera
f05be81275
fsm: Get correct interactive randomness if it lands on a nullblock
2020-04-04 04:57:05 +02:00
lanzafame
27e81f37f3
fix todo comment
2020-04-03 15:01:39 +10:00
lanzafame
3ba2b0e365
instead of guessing the address, just use a config value
2020-04-03 14:54:07 +10:00
Łukasz Magiera
f6c260c49f
Merge pull request #1484 from filecoin-project/fix/interop-improvements
...
several fixes and improvements while debugging interop
2020-04-01 17:51:42 +02:00
Jeromy
417d434973
several fixes and improvements while debugging interop
2020-03-31 18:35:23 -07:00
Łukasz Magiera
13f2c21e1d
Get network name from genesis
2020-04-01 01:15:49 +02:00
Łukasz Magiera
95ee1c1cde
Extract sector-storage
2020-03-28 01:32:39 +01:00
Łukasz Magiera
c66d3dfad7
sectorstorage: Untangle from lotus deps
2020-03-27 22:35:33 +01:00
Łukasz Magiera
e050e0307e
Cleanup after dropping sectorbuilder
2020-03-26 20:35:16 +01:00
Łukasz Magiera
4be54a976c
Merge sectorbuilder into sectorstorage
2020-03-26 03:51:06 +01:00
Łukasz Magiera
5de17e903c
storageminer: Config for local worker task types
2020-03-24 20:38:00 +01:00
Łukasz Magiera
726c9c1fe7
workers: Address review
2020-03-24 19:01:04 +01:00
Łukasz Magiera
5e4a7e54df
Rename agvmgr+sealmgr to sectorstorage
2020-03-23 12:47:10 +01:00
Łukasz Magiera
d43f2a2e3b
workers: Address review
2020-03-22 22:39:06 +01:00
Łukasz Magiera
80cca91584
workers: get to executing tasks remotely!
2020-03-19 18:11:45 +01:00
Łukasz Magiera
1ed7779701
Merge remote-tracking branch 'origin/testnet/3' into feat/new-workers
2020-03-19 03:28:55 +01:00
laser
366db2f38c
adjust import order as per PR feedback
2020-03-18 12:43:06 -07:00
laser
f59bf6fab1
wire up dtypes.ClientDatastore
2020-03-18 11:57:22 -07:00
Łukasz Magiera
5f2caffb51
Fix tests after specs-storage changes
2020-03-18 02:08:11 +01:00
hannahhoward
f259bc6a09
feat(graphsync): unified graphsync instance
...
setup a single graphsync that loads from both the chainstore & client blockstore
2020-03-17 17:25:12 -07:00
Łukasz Magiera
d8ce5078d9
Use new specs-storage interface
2020-03-17 21:19:52 +01:00
Łukasz Magiera
7e997e40f3
workers: Simple storage diagnostics
2020-03-16 18:50:07 +01:00
Łukasz Magiera
96730bae75
workers: Report sectors paths after worker creates them
2020-03-13 17:54:55 +01:00
Łukasz Magiera
71afcb0333
workrs: refactor sector store for more composability
2020-03-11 08:22:21 +01:00
Łukasz Magiera
7d3e16986c
sectorbuilder type updates
2020-03-06 06:38:59 +01:00
Łukasz Magiera
7db1dd52bd
storagemgr: Wire up most of AddPiece logic
2020-03-05 01:38:07 +01:00
Łukasz Magiera
e483383a44
node: wire up new storage manager
2020-03-04 20:42:49 +01:00
Łukasz Magiera
a0dbb6bdd6
Storage Manager refactor
2020-03-03 23:19:22 +01:00
whyrusleeping
d8dda1ee66
debugging test failure
2020-02-27 15:14:15 -08:00
Łukasz Magiera
d787aa5007
Merge branch 'testnet/3' into feat/specs-actors
2020-02-24 18:32:02 +01:00
Łukasz Magiera
b12482df89
move peermgr, tracing into lib
2020-02-22 12:36:22 +01:00
Łukasz Magiera
852e888232
cmd/lotus: Fix build
2020-02-21 19:00:10 +01:00
Łukasz Magiera
69ec3c205a
Merge remote-tracking branch 'origin/master' into testnet/3
2020-02-19 22:10:14 +01:00
Jakub Sztandera
8af80169c0
Add graphsync
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-02-17 18:15:30 +01:00
Łukasz Magiera
e1a593c22e
Rename paych -> paychmgr to fix cbor-gen
2020-02-13 01:28:23 +01:00
Jakub Sztandera
352fb9f9ea
Prefer tls
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-02-07 14:04:47 +01:00
Łukasz Magiera
cbf63aab1e
Merge branch 'master' into testnet/3
2020-02-05 21:27:04 +01:00
Jakub Sztandera
ad9e4db3d6
Reduce sig import locations
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-02-04 15:12:10 +01:00
Łukasz Magiera
0e81c1cf7e
Merge branch 'testnet/3' into feat/update-markets
2020-02-04 07:17:22 +01:00
Łukasz Magiera
3f58ffe572
storageminer: New storage config
2020-01-29 20:53:45 +01:00
hannahhoward
71289b58ff
feat(markets): update to support car files
...
Upgrades lotus version of go-fil-markets to its head, which supports car files and handles tracking
of pieces, reducing the size of sectorBlocks
2020-01-28 14:08:13 -08:00
Łukasz Magiera
ffdd436b52
sealing: Handle seed changes more correctly
2020-01-16 02:25:49 +01:00
Łukasz Magiera
604bf64ef6
Move miner sealing logic into a separate package
2020-01-15 21:49:11 +01:00
Łukasz Magiera
a2bcc1fec2
Mostly functional mock sectorbuilder
2020-01-14 03:05:35 +01:00
whyrusleeping
fefd21ad9c
remove private network and put dht into a sub namespace
2020-01-13 15:29:06 -08:00
hannahhoward
0ce1bf706b
refactor(markets): reorg file structure
2020-01-10 10:33:26 -08:00
hannahhoward
65ecb33630
feat(storagemarket): extract storage market
...
remove all shared components, point at go-fil-components repo
2020-01-10 09:49:07 -08:00
hannahhoward
0a4eeb7cb1
refactor(retrievalmarket): switch to go-fil-markets repo
...
Switch go-fil-components to go-fil-markets
2020-01-10 09:13:12 -08:00