770 Commits

Author	SHA1	Message	Date
Steven Allen	c463582528	fix a race and optimize hello messages ... LifecycleCtx can _only_ be called during startup as it appends an fx hook. Worse, this was causing us to append an fx hook on every single hello message, leaking memory (and probably causing other shutdown issues...).	2020-10-10 08:33:06 -07:00
Steven Allen	748d2e82a7	unshare the journal ... Motivation: * Run lotus with the race detector enabled (primary motivation). * Allow multiple lotus nodes in a process (not a high priority). Previously, the journal was shared between all lotus instances, but it was initialized for every new node. This caused safety problems in tests (at a minimum). This patch explicitly passes the journal to all services that need it.	2020-10-09 13:23:07 -07:00
Dirk McCormick	ef73b964fb	feat: add end-to-end test for lite mode	2020-10-09 11:48:35 +02:00
Dirk McCormick	2719adc1b1	feat: lite-mode - thin client for chan & state	2020-10-09 11:43:03 +02:00
Dirk McCormick	8fa4c0a970	feat: gateway - MpoolPush	2020-10-09 11:43:03 +02:00
Dirk McCormick	00a14de094	feat: gateway - StateLookupID	2020-10-09 11:43:03 +02:00
Dirk McCormick	e19cd9ed01	feat: lotus-lite - replace wallet StateManager with thin client to gateway	2020-10-09 11:43:03 +02:00
vyzo	7933cf094f	allow all drand topics	2020-10-08 21:48:55 +03:00
vyzo	4cd73f1560	use subscription filter in pubsub	2020-10-08 21:40:36 +03:00
Łukasz Magiera	0de3051821	Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers	2020-10-08 13:10:41 +02:00
vyzo	de390749fc	set pubsub IPColocationFactor to 5	2020-10-06 09:11:44 +03:00
Łukasz Magiera	0e2f697217	Merge pull request #4133 from filecoin-project/feat/backup ... Miner backup/restore commands	2020-10-06 02:05:03 +02:00
Ingar Shu	1227bf2893	Change max time in future for StartEpoch to 7 days	2020-10-05 12:35:58 -07:00
Ingar Shu	550f3771ea	Reject deals that are > 90 days in the future in the BasicDealFilter	2020-10-05 11:39:02 -07:00
Łukasz Magiera	2dc9a1ee4e	lotus-miner backup command	2020-10-01 17:55:47 +02:00
Łukasz Magiera	5932f28519	Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers	2020-10-01 02:39:48 +02:00
hannahhoward	be884e27be	feat(markets): update markets 0.7.0	2020-09-30 10:26:50 -07:00
Łukasz Magiera	cf71f034dc	Merge remote-tracking branch 'origin/dev' into feat/async-restartable-workers	2020-09-26 12:35:32 +02:00
Łukasz Magiera	ef28ebb14a	Ignition upgrades, much excite.	2020-09-25 23:55:37 -07:00
Łukasz Magiera	03c3d8bdb3	workers: Return unfinished tasks on restart	2020-09-22 00:52:33 +02:00
Łukasz Magiera	5e09581256	sectorstorage: get new work tracker to run	2020-09-16 22:33:58 +02:00
Łukasz Magiera	03cf6cca40	Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers	2020-09-15 17:47:03 +02:00
Łukasz Magiera	6665a9ca69	Merge pull request #3845 from filecoin-project/sync-manager ... syncer: make SyncManager an interface.	2020-09-15 10:28:48 +02:00
Raúl Kripalani	dd841f32db	syncer: make SyncManager an interface.	2020-09-14 21:58:59 +01:00
Raúl Kripalani	954ff32503	fix transitive api dependency on ffi.	2020-09-14 19:01:35 +01:00
Łukasz Magiera	381a6cdfac	Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers	2020-09-14 19:11:50 +02:00
Łukasz Magiera	1ebca8f732	more working code	2020-09-14 19:09:01 +02:00
Raúl Kripalani	09e9d6d778	deal journal events: wire into markets subscriptions.	2020-09-14 16:20:01 +01:00
Raúl Kripalani	6d29d75724	Merge branch 'master' into inmem-journal	2020-09-14 12:17:45 +01:00
Jakub Sztandera	c71e1adc93	Integrate multiple drand networks with pubsub ... Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>	2020-09-10 17:41:55 -04:00
Jakub Sztandera	64fa6fd9e5	Draw the rest of the owl ... Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>	2020-09-10 17:41:55 -04:00
Jakub Sztandera	2d3f92aeed	Introduce beacon Schedule ... Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>	2020-09-10 17:41:55 -04:00
Aayush Rajasekaran	35aa78dad9	Allow marking a certain tipset as checkpointed	2020-09-09 14:34:00 -04:00
Raúl Kripalani	b33db9c1ab	Merge branch 'master' into blocksync-refactor	2020-09-08 14:22:43 +01:00
Aayush Rajasekaran	c77f5f6252	Revert "only subscribe to pubsub topics once we are synced"	2020-09-08 00:32:26 -04:00
hannahhoward	2db4b57013	feat(markets): upgrade markets 0.6.0	2020-09-07 15:48:42 -04:00
Aayush Rajasekaran	39755a294a	Update to specs v0.9.6	2020-09-07 15:48:41 -04:00
Łukasz Magiera	2080458f0d	Merge pull request #3518 from filecoin-project/feat/pubsub-red ... integrate pubsub Random Early Drop	2020-09-07 21:42:14 +02:00
Raúl Kripalani	878ffafb51	rename other Chain{Exchange=>Bitswap}; fix ChainBlock{s=>S}ervice().	2020-09-07 20:20:23 +01:00
Raúl Kripalani	453e826a0f	rename p2p protocol to /fil/chain/xchg/0.0.1 (backwards-compatible); rename more.	2020-09-07 19:45:34 +01:00
Raúl Kripalani	55b1456d45	blocksync: introduce interfaces; rename to chainexchange.	2020-09-07 19:31:43 +01:00
vyzo	0d0dd250ee	use faster decay for bootstrappers	2020-09-07 19:54:38 +03:00
vyzo	81e674ad36	subscribe early in bootstrappers and get rid of ugly test flag	2020-09-07 19:46:35 +03:00
vyzo	e33798ff90	rename variable for better semantics	2020-09-07 15:58:05 +03:00
vyzo	d9faff19a5	fix tests	2020-09-07 15:55:53 +03:00
vyzo	4f0ab4f226	remove notifee after subscribing	2020-09-07 15:55:53 +03:00
vyzo	05740e0f64	silence linter for unnecessary conversion	2020-09-07 15:55:53 +03:00
vyzo	666dc65b8e	only subscribed to pubsub topics once we are synced	2020-09-07 15:55:53 +03:00
vyzo	c616958557	specify topic delivery weights, with priority for blocks	2020-09-07 13:40:48 +03:00
vyzo	453ab95e54	enable pubsub RED	2020-09-07 13:40:48 +03:00
vyzo	1c27a0c1cf	adjust gossipsub gossip factor	2020-09-04 22:04:48 +03:00
Raúl Kripalani	3206f92063	Merge branch 'master' into inmem-journal	2020-09-02 19:50:52 +01:00
Jakub Sztandera	625c6951bb	Don't use context to close bitswap ... Use just the Close Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>	2020-08-31 19:24:04 +02:00
hannahhoward	0a36db06ed	feat(markets): update to markets v0.5.8	2020-08-28 18:03:27 -07:00
Łukasz Magiera	84a632787c	Merge pull request #3313 from filecoin-project/feat/mpool-balance-tracking ... Message Pool Rudimentary Spam Protection Measures	2020-08-28 22:35:30 +02:00
Łukasz Magiera	ec2bc0baf6	Merge pull request #3363 from filecoin-project/fix/pubsub-params-tweaking ... tweak some pubsub parameters	2020-08-28 00:18:26 +02:00
vyzo	20fbd66c90	tweak some pubsub parameters ... - increase Bootstapp prune backoff to 5min from the default 1min - reduce opportunistic graft threshold to 3.5 to account for low peer scores	2020-08-27 21:12:38 +03:00
Jakub Sztandera	b27ee8241a	Add TODO note ... Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>	2020-08-27 19:05:37 +02:00
Jakub Sztandera	6e4889d340	Don't fail if could not resolved drand dnsaddr ... Resolves https://github.com/filecoin-project/lotus/issues/3335 Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>	2020-08-27 17:50:16 +02:00
Raúl Kripalani	efdfd3ee3e	Merge branch 'master' into inmem-journal	2020-08-26 16:38:23 +01:00
Raúl Kripalani	4e1ef09751	make journal a global var.	2020-08-26 16:09:37 +01:00
vyzo	bedbdcaf13	give some score weight to the messages topic	2020-08-26 15:14:15 +03:00
Steven Allen	5733c71c50	Lint everything ... We were ignoring quite a few error cases, and had one case where we weren't actually updating state where we wanted to. Unfortunately, if the linter doesn't pass, nobody has any reason to actually check lint failures in CI. There are three remaining XXXs marked in the code for lint.	2020-08-20 20:46:36 -07:00
vyzo	d1718369a1	Merge pull request #3205 from filecoin-project/fix/update-pubsub ... update pubsub and bump behaviour penalty threshold to 6	2020-08-20 23:37:17 +03:00
vyzo	896edfe072	pubsub metrics for RPCs	2020-08-20 23:14:32 +03:00
vyzo	de05120e69	increase behaviour penalty threshold to 6	2020-08-20 22:32:41 +03:00
vyzo	6193f4e062	pubsub: increase gossip history length to 10 heartbeats	2020-08-20 18:09:17 +03:00
vyzo	98d6d25c74	pubsub: set behaviour penalty threshold, increase IWANT follow up time to 5s	2020-08-20 18:08:02 +03:00
Łukasz Magiera	ed098390cb	Merge pull request #3172 from filecoin-project/feat/lotus-shed-jwt ... lotus-shed: add simple jwt creation support	2020-08-19 23:32:01 +02:00
Travis Person	f1632376e7	lotus-shed: add simple jwt creation support	2020-08-19 19:21:36 +00:00
vyzo	6c5a91735a	fix drand topic first message delivery cap	2020-08-19 18:45:31 +03:00
Łukasz Magiera	a03192a39b	Separate concurrent sealing sector limit for deals	2020-08-18 21:48:18 +02:00
Łukasz Magiera	baf91f08a1	Unbreak tests	2020-08-18 18:27:18 +02:00
Łukasz Magiera	65ffde9e4b	fsm: Config for max WaitDeals sectors	2020-08-18 16:20:31 +02:00
vyzo	ff7f0a9dcd	Merge pull request #3090 from filecoin-project/fix/pubsub-validation-clown-shoes ... Fix clown shoes in pubsub validation	2020-08-17 23:31:45 +03:00
Łukasz Magiera	6ef7a30b19	Merge pull request #3089 from filecoin-project/integrate/storage-fsm ... integrate extern/{storage-fsm,sector-storage} into lotus source tree	2020-08-17 18:37:54 +02:00
Raúl Kripalani	862bafc63a	fix lint errors.	2020-08-17 14:39:33 +01:00
Raúl Kripalani	efdc428d5d	keep storage-fsm (renamed to storage-sealing) and sector-storage in extern.	2020-08-17 14:26:18 +01:00
vyzo	8cf9595d35	collect pubsub metrics through the tracer	2020-08-17 10:46:20 +03:00
vyzo	884d4ad9df	fix clown shoes pubsub validation: we always accept our own self-published messages	2020-08-16 20:46:19 +03:00
Raúl Kripalani	3c17cd655e	integrate extern/sector-storage into lotus proper.	2020-08-16 11:09:58 +01:00
Raúl Kripalani	fb0ccc9260	integrate extern/storage-fsm into lotus proper.	2020-08-16 10:42:13 +01:00
hannahhoward	6b5525b8d2	feat(markets): update markets 0.5.6 ... update markets to 0.5.6, removing use of validators that moved inside markets	2020-08-14 11:14:03 -07:00
Aayush Rajasekaran	d614135ebb	Check repo's genesis against baked-in genesis	2020-08-12 17:22:16 -04:00
Łukasz Magiera	e1a1b325bc	Merge remote-tracking branch 'origin/next' into feat/max-msg-fee-config	2020-08-12 21:55:03 +02:00
vyzo	e17732b365	remove secio support, replace with noise	2020-08-12 21:15:16 +03:00
Łukasz Magiera	6f890a3edd	Miner fee config	2020-08-12 19:47:09 +02:00
Jakub Sztandera	a45febc065	Fix MpoolLocker ... Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>	2020-08-11 19:32:31 +02:00
Raúl Kripalani	2ea5abdfb5	wire journal into miner.	2020-08-11 13:48:32 +01:00
Raúl Kripalani	92598237c3	Merge branch 'next' into inmem-journal	2020-08-11 12:41:11 +01:00
Łukasz Magiera	e2d5451ffb	Merge pull request #2715 from filecoin-project/schomatis/blocksync/review ... Rewrite internal logic of block sync client	2020-08-06 19:46:58 +02:00
Łukasz Magiera	711b626a8b	Merge pull request #2852 from filecoin-project/jeff ... Jeff	2020-08-06 13:01:14 +02:00
Łukasz Magiera	73b8868046	gofmt	2020-08-06 03:32:59 +02:00
Łukasz Magiera	f8b8ecc0c3	Consensus filter	2020-08-06 03:16:39 +02:00
hannahhoward	a89c290f62	feat(markets): update to 0.5.4	2020-08-05 15:35:59 -07:00
Lucas Molas	76d40ec408	first pass, ready for review	2020-08-03 12:20:04 -03:00
hannahhoward	3cac1080cc	feat(retrievalstoremgr): add retrievalstoremgr ... add manager for retrievals to handle different cases for IPFS/non-ipfs	2020-07-31 14:16:18 -07:00
Łukasz Magiera	3ae55d1da3	Merge pull request #2714 from filecoin-project/feat/user-dealfiter ... Support external deal decision logic	2020-07-31 21:56:44 +02:00
Aayush Rajasekaran	c33e38eef2	Update markets	2020-07-31 15:43:34 -04:00
Łukasz Magiera	6d21255678	Merge remote-tracking branch 'origin/master' into next	2020-07-31 21:36:14 +02:00
Łukasz Magiera	fc3c91b738	Support external deal decision logic	2020-07-31 20:29:16 +02:00
Whyrusleeping	bd6a80505b	Merge pull request #2731 from filecoin-project/pubsub-block-tracing ... pubsub: only trace messages for the blocks topic	2020-07-31 09:27:26 -07:00
Łukasz Magiera	b6c9169a87	client cli: Interactive deal command	2020-07-31 18:23:36 +02:00
Łukasz Magiera	4cb4e7c2c2	Merge remote-tracking branch 'origin/master' into next	2020-07-31 14:02:04 +02:00
hannahhoward	e201408d61	feat(markets): better event logging	2020-07-31 12:55:45 +02:00
vyzo	d8ca29dd52	support extended pubsub peer scores	2020-07-31 11:27:22 +03:00
vyzo	1649c32325	pubsub: only trace message for the blocks topic	2020-07-31 10:15:21 +03:00
Łukasz Magiera	4d328cad54	Get things to mostly work	2020-07-30 14:31:50 +02:00
whyrusleeping	4e4fbafbe0	only log hello failure if the other side claims to support hello	2020-07-29 14:28:25 -07:00
Aayush Rajasekaran	5df0ee7935	Merge pull request #2647 from filecoin-project/feat/better-seal-duration-ui ... Feat/better seal duration ui	2020-07-28 21:32:54 -04:00
whyrusleeping	dd8c88b418	improve some seal duration things	2020-07-28 17:40:42 -07:00
Łukasz Magiera	09b90773d8	Merge remote-tracking branch 'origin/next' into feat/cid-builder	2020-07-28 16:06:06 +02:00
hannahhoward	5a623cccb5	feat(markets): update markets mulitple deal stores	2020-07-27 23:13:28 -07:00
hannahhoward	dd885b7302	feat(multistore): extract multistore code to repo ... Extract multistore + multiread blockstore to a seperate repo	2020-07-24 14:47:22 -07:00
Steven Allen	b7a4dbb07f	Support inline CIDs ... And use the new CidBuilder from the spec actors. This patch does not switch over to inline CIDs by default, but paves the way.	2020-07-23 23:12:32 -07:00
whyrusleeping	0594177191	add some better logging for hello handshake failures	2020-07-23 16:58:21 -07:00
Jakub Sztandera	7ae69c70fb	Cleanup DrandBootstrap ... Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>	2020-07-23 18:45:08 +02:00
Jakub Sztandera	ff5ff4d294	Add multiple drand configs ... Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>	2020-07-23 18:45:08 +02:00
Łukasz Magiera	d70edbcb7c	Set things on syscallShim	2020-07-22 13:35:10 -04:00
Raúl Kripalani	d6e6eedd58	pipe sealing events to the journal.	2020-07-21 13:02:51 +01:00
Raúl Kripalani	7459ec6bba	add mpool journal events; fix dependency injection.	2020-07-20 16:37:32 +01:00
Raúl Kripalani	226786c1da	wip	2020-07-20 14:45:17 +01:00
Raúl Kripalani	4d2d8b2d11	Merge branch 'next' into inmem-journal	2020-07-20 10:38:58 +01:00
Łukasz Magiera	d266c665b0	Update sector-storage with windowed scheduler	2020-07-18 00:38:02 +02:00
Jakub Sztandera	cc1d23a94c	Use single multi ds ... Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>	2020-07-17 22:14:37 +02:00
Raúl Kripalani	becbff0b13	add NilJournal; fix call sites to ChainStore constructor.	2020-07-17 19:10:47 +01:00
Raúl Kripalani	695f6cfe45	wip in-memory journal.	2020-07-17 14:34:42 +01:00
Aayush Rajasekaran	a5ef629cef	Add expected seal duration to custom deal logic, reject deals that start too early	2020-07-15 17:31:50 -04:00
hannahhoward	61f120222f	feat(markets): update markets with new retrieval	2020-07-15 14:04:31 -07:00
Łukasz Magiera	0f2043d874	Merge pull request #2317 from filcloud/issue-2304 ... fix issue 2304: ux improvements	2020-07-15 19:38:35 +02:00
Frank	14ec9a2068	update storage miner and seal worker document	2020-07-11 16:55:13 +08:00
Raúl Kripalani	13de81b3b2	introduce the ability to mock time.	2020-07-10 15:51:45 +01:00
Łukasz Magiera	66237415c5	Merge remote-tracking branch 'origin/next' into feat/client-multi-bstore	2020-07-08 22:48:47 +02:00
Łukasz Magiera	2b9c05d395	Merge remote-tracking branch 'origin/next' into feat/upgrade-markets-0.4.0	2020-07-08 15:53:55 +02:00
Łukasz Magiera	b049c5a7d1	Merge remote-tracking branch 'origin/master' into next	2020-07-08 14:35:40 +02:00
Łukasz Magiera	ba0f7d703e	Set lower polling interval for deal client	2020-07-08 12:52:37 +02:00
hannahhoward	24e3a4218b	feat(markets): upgrade to latest ... upgrade to latest markets with fast retrieval, underlying data transfer upgrade	2020-07-08 01:35:50 -07:00
Aayush Rajasekaran	411c82ae8f	Update storage-FSM, add API to set sector seal delay	2020-07-07 15:23:23 -04:00
Łukasz Magiera	55f089d997	client: Unbreak retrieval	2020-07-07 14:35:02 +02:00
Łukasz Magiera	47f0898ce9	Wire up client import manager	2020-07-07 10:52:19 +02:00
Łukasz Magiera	8942967223	Client Import manager	2020-07-07 10:52:04 +02:00
whyrusleeping	42bd4eccbe	implement a persistent journal for lotus node operations	2020-07-06 09:42:00 -07:00
whyrusleeping	ffd012906c	add peer ID to hello protocol failure log	2020-07-01 16:20:05 -07:00
Łukasz Magiera	8f0e04027e	Merge pull request #2154 from laser/feat/1920-selection-commands ... implement toggling of online/offline storage/retrieval deals	2020-07-01 11:06:32 +02:00
Raúl Kripalani	4f9c907248	rename build.{BlockDelay=>BlockDelaySecs}. ... Since this global is not typed as a time.Duration, rather as an int, it makes sense to clarify the unit.	2020-06-30 14:26:49 +01:00
Raúl Kripalani	0fddf3e114	make system constants configurable as vars. ... This configurability is unlocked through the `testground` build tag, which Project Oni will uses. Changes in the usage places of these relaxed constants were required due to the fact that Golang constants are untyped, but vars aren't. Read https://blog.golang.org/constants for more info.	2020-06-30 14:18:26 +01:00
Travis Person	12f10ac414	lotus-shed: organize peer key generate and other key commands under keyinfo	2020-06-29 20:07:39 +00:00
laser	b9180a99d4	toggle consideration of offline storage/retrieval deal proposals	2020-06-26 12:27:41 -07:00
laser	e910a045d0	big rename to allow for later introducing the "consider offline" config	2020-06-26 10:50:54 -07:00
laser	4c760ec1b1	lint: update comments to match type declarations	2020-06-24 08:08:10 -07:00
laser	ef0abf2b98	disable/enable retrieval deal consideration via config	2020-06-24 08:07:12 -07:00
Yusef Napora	5074cf8beb	import DrandConfig from dtypes	2020-06-23 16:23:06 -04:00
Yusef Napora	b448de422e	improve DrandConfig dependency injection	2020-06-23 16:01:10 -04:00
Yusef Napora	628872d0e4	forgot my go fmt hook	2020-06-23 15:10:27 -04:00
Yusef Napora	566a99240d	allow overriding drand config	2020-06-23 13:33:18 -04:00
Raúl Kripalani	d20255b1b4	provide an option to disable loading of built-in assets.	2020-06-22 19:42:04 +01:00
laser	fbeaab466a	obey the linter	2020-06-19 09:20:20 -07:00
laser	de7d6c255c	blacklist -> blocklist	2020-06-18 15:51:01 -07:00
laser	0c8d648998	specify which CID is being blacklisted (it's the piece)	2020-06-18 14:02:22 -07:00
laser	aa18d1985e	reject storage deal proposals containing blacklisted piece CIDs	2020-06-18 13:32:20 -07:00
laser	b0edf924b4	add commands for manipulating storage deal CID blacklist	2020-06-18 13:15:18 -07:00
hannahhoward	9262661135	chore(deps): update to fil-markets 0.3.0 ... Updates to latest fil markets with resumability and other fixes	2020-06-15 15:43:47 -07:00
laser	36b327b57b	various symbol renames	2020-06-11 13:18:18 -07:00
laser	7587e6c08b	get and set storage deal acceptance through CLI	2020-06-11 12:59:50 -07:00
laser	5421d0d1c5	better field and struct names + set default appropriately ... Storage miners, by default, should be configured to accept storage deals.	2020-06-11 12:15:28 -07:00
laser	c458b4712a	better rejection messages	2020-06-11 12:06:38 -07:00
laser	d6b2519843	config-driven IsAcceptingStorageDeals flag ... Makes incremental progress towards #1920.	2020-06-11 11:29:59 -07:00
Jakub Sztandera	7762cd0a68	Assign positive scores to drand bootstrappers ... Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>	2020-06-08 11:34:46 +02:00
Jakub Sztandera	e91cc9cd08	Add drand topic scores ... Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>	2020-06-08 11:34:46 +02:00
Łukasz Magiera	163c2b2544	Merge remote-tracking branch 'origin/master' into next	2020-06-06 00:58:24 +02:00
laser	4855045ea2	pass context to paramfetch.GetParams ... Fixes #1209	2020-06-05 10:28:00 -07:00
Jakub Sztandera	7bee5b3abc	Merge remote-tracking branch 'origin/master' into next ... Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>	2020-06-05 00:33:43 +02:00
vyzo	f210a6e91a	pubsub: set Dout parameter to 3 (from the default of 2) ... we are using a higher D value than the default, so this can be safely increased.	2020-06-04 00:03:31 +03:00
Jakub Sztandera	7f962e19c2	Fix lint ... Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>	2020-06-03 03:19:18 +02:00
Jakub Sztandera	186fd4da74	Add lotus net scores for pubsub score visibility ... Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>	2020-06-03 03:13:49 +02:00
laser	bea9cd2fe2	rename to better convey intent + document	2020-06-02 12:35:11 -07:00
laser	38d714a28a	first take at "daemon stop" command ... Fixes #1827 TODO: plumb the daemon-stopping into lotus-storage-miner, too	2020-06-02 12:29:58 -07:00
Łukasz Magiera	64f4e80446	Include build type in version	2020-06-01 20:49:39 +02:00
Łukasz Magiera	c73326e96d	fsrepo: Use LevelDB for metadata datastore	2020-06-01 20:13:07 +02:00
Łukasz Magiera	7003960fdd	Merge remote-tracking branch 'origin/master' into next	2020-06-01 18:52:06 +02:00
Jakub Sztandera	241c3fa673	Merge pull request #1869 from filecoin-project/feat/drand-pubsub ... Add pubsub support to drand beacon	2020-05-29 18:06:38 +02:00
Łukasz Magiera	785eeb1eee	Merge pull request #1850 from filecoin-project/chore/lint ... Cleanup many lint warnings	2020-05-29 18:06:06 +02:00
Jakub Sztandera	002d021eb7	Enable HashMsgId ... Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>	2020-05-29 17:55:24 +02:00
Jakub Sztandera	71eb41b9aa	Add pubsub support to drand beacon ... Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>	2020-05-29 17:55:17 +02:00
hannahhoward	0c4db8cf6b	fix(storageminer): add missing err check ... Missing an err check in storage miner initialization in the stored ask	2020-05-28 17:05:17 -07:00
Ignacio Hagopian	17c378c18a	fix ... Signed-off-by: Ignacio Hagopian <jsign.uy@gmail.com>	2020-05-28 22:11:49 +02:00
Ignacio Hagopian	0af7cd1448	allow using ipfs for retrieval ... Signed-off-by: Ignacio Hagopian <jsign.uy@gmail.com>	2020-05-28 22:11:49 +02:00
Ignacio Hagopian	de3edc2ec7	remote ipfs support & automatic env ... Signed-off-by: Ignacio Hagopian <jsign.uy@gmail.com>	2020-05-28 22:11:49 +02:00
Jakub Sztandera	b372881e91	Fix more lint warnings ... Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>	2020-05-28 01:15:19 +02:00
Jakub Sztandera	d6615b6286	Cleanup many lint warnings ... Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>	2020-05-27 22:53:20 +02:00
Jakub Sztandera	4604b60fb1	Remove drand on miner side, MinerGetBaseInfo provides the same info ... Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>	2020-05-27 20:24:26 +02:00
Ignacio Hagopian	009cd92010	fix ... Signed-off-by: Ignacio Hagopian <jsign.uy@gmail.com>	2020-05-27 09:50:32 -03:00
Ignacio Hagopian	61daaa774b	allow using ipfs for retrieval ... Signed-off-by: Ignacio Hagopian <jsign.uy@gmail.com>	2020-05-26 14:52:52 -03:00
Ignacio Hagopian	d5346f8326	remote ipfs support & automatic env ... Signed-off-by: Ignacio Hagopian <jsign.uy@gmail.com>	2020-05-26 14:52:51 -03:00
vyzo	314da26da3	unconditionally disable relay	2020-05-25 13:39:50 +03:00
vyzo	5531f27798	sink the FirstMessageDeliveries boost for the messages topic	2020-05-22 17:25:56 +03:00
Whyrusleeping	83436842c5	Merge pull request #1802 from filecoin-project/feat/gfm-v0.2.7 ... Use latest go-fil-markets	2020-05-21 10:05:54 -07:00
vyzo	d597c3fb0d	increase OpportunisticGraftThreshold to 5	2020-05-21 14:38:11 +03:00
vyzo	0cc8446a79	configure Dout=0 for bootstrappers, turn off Mesh Failure Penalty for messages as well	2020-05-21 12:11:22 +03:00
hannahhoward	3264a9faad	feat(deps): update to latest go-fil-markets ... update to go-fil-markets v0.2.7 with latest changes, modify constructors as needed to accomodate new DS Prefix customization	2020-05-20 16:01:03 -07:00
shannonwells	652c257763	passing w/ new namespace wraps	2020-05-20 15:58:59 -07:00
shannonwells	e68ab286f6	upgrade lotus to go-fil-markets v0.2.5	2020-05-20 15:56:58 -07:00
Łukasz Magiera	f7325a69c1	Extract auth utils to go-jsonrpc	2020-05-20 20:37:45 +02:00
Łukasz Magiera	ae60001dcc	post: Handle Recovering sectors	2020-05-20 18:41:20 +02:00
Łukasz Magiera	cea7c41023	Merge pull request #1761 from dtynn/fix/dtynn/use_abs_path_for_client_filestore ... use abs path to construct FileManager	2020-05-20 12:49:53 +02:00
Łukasz Magiera	0fe7a0b2e3	Merge pull request #1764 from filecoin-project/feat/has-cache-bs ... add blockstore 'Has' caching	2020-05-20 12:48:50 +02:00
Jeromy	607bcc401c	very basic api documentation autogeneration	2020-05-18 17:20:54 -07:00
Jeromy	9804bd3c4c	add blockstore 'Has' caching	2020-05-16 11:31:14 -07:00
dtynn	30e2642f4d	use abs path to construct FileManager	2020-05-16 09:36:38 +08:00
Whyrusleeping	70657e35ba	Merge pull request #1708 from filecoin-project/feat/block-validator ... Improved pubsub block validator	2020-05-15 11:26:26 -07:00
vyzo	dbe2a1e2cd	turn off Mesh Delivery Failure penalty	2020-05-15 12:50:20 +03:00
vyzo	6e0dac06f4	utility to retrieve miner worker key from the chain	2020-05-14 20:48:19 +03:00
vyzo	5bd0e92068	remove source flagging from bogus CID blocks ... it's ineffective.	2020-05-14 20:48:19 +03:00
vyzo	b032d3524b	configure behaviour penalty for gsv1.1	2020-05-14 20:48:19 +03:00
Jeromy	d3eb808ff4	add profile for bootstrappers	2020-05-14 09:27:07 -07:00
Łukasz Magiera	e8d92a5f31	node: Use correct network name for DHT	2020-05-12 19:38:04 +02:00
hannahhoward	581e7e6fde	chore(deps): update to fil-markets 0.2.1 ... Update fil-markets to 0.2.1 that no longer keeps streams open	2020-05-08 14:11:40 -07:00
Łukasz Magiera	523a7a9d8d	Merge pull request #1670 from filecoin-project/feat/update-markets-0.2.0 ... Update go-fil-markets	2020-05-06 01:45:33 +02:00
Łukasz Magiera	60b78a74f7	Merge pull request #1676 from filecoin-project/cleanup/multi-addr-miner ... block producers should have only one address	2020-05-05 22:12:32 +02:00
Jeromy	8b58f22c2e	block producers should have only one address	2020-05-05 12:01:44 -07:00
vyzo	eb24baa70c	use go-libp2p-core/peer instead of the deprecated alias, try to pacify the silly linter	2020-05-05 17:26:59 +03:00
vyzo	4e5179557d	flag block source when messages cannot be retrieved	2020-05-05 16:49:43 +03:00
hannahhoward	a9866c757e	feat(deps): update go-fil-markets ... Update to latest 0.2.0 release of go-fil-markets with less-blocking node io	2020-05-04 18:36:51 -07:00
vyzo	e3f6e586ee	use blake2b hash as the message ID function	2020-05-04 19:34:30 +03:00
vyzo	805d07bca6	turn off the mesh in bootstrappers	2020-05-04 19:04:24 +03:00
vyzo	112aca7896	pubsub-specific configuration	2020-05-04 18:30:54 +03:00
Whyrusleeping	ae420fc9f4	Merge branch 'testnet/3' into feat/gossipsub-v1.1	2020-04-30 10:19:42 -07:00
Łukasz Magiera	81e3b714a2	gofmt	2020-04-30 12:51:19 +02:00
Łukasz Magiera	5ec76d4b7b	support making deals with data directly from IPFS nodes	2020-04-30 01:56:45 +02:00
vyzo	43aca717d1	gossipsubv1.1: tweak score parameters	2020-04-29 23:15:29 +03:00
vyzo	7de882b4d0	gossipsubv1.1: use score parameter helpers	2020-04-29 22:50:51 +03:00
vyzo	f8f6e28985	fix linter complaint	2020-04-29 19:01:45 +03:00
vyzo	9570ebfe0a	fix comparison logic for bootstrap peers	2020-04-29 18:56:58 +03:00
vyzo	667fb17b43	gossipsubv1.1: configure larger overlay D params	2020-04-29 17:09:39 +03:00
vyzo	7d7c83ef79	gossipsubv1.1: configure scores for bootstrapper PX	2020-04-29 17:03:41 +03:00
vyzo	6b56652768	gossipsubv1.1: score parameters and flood publishing	2020-04-29 16:41:44 +03:00
Jeromy	6a27c65201	updating to specs actors v0.2.0	2020-04-28 13:52:07 -07:00
Travis Person	c807469a5a	bitswap: disable provider (#1620) ... Co-authored-by: Travis Person <travisperson@users.noreply.github.com>	2020-04-27 15:54:16 -07:00
Aayush Rajasekaran	7c22dabb63	default to setting max piece size to sector size	2020-04-24 01:01:22 -04:00
Łukasz Magiera	e6ce6211de	Merge remote-tracking branch 'origin/testnet/3' into feat/dht-upgrade	2020-04-24 00:50:23 +02:00
Whyrusleeping	faa9002cce	working on sector pledge requirements after specs-actors 1.0.0 (#1584) ... * WIP: working on sector pledge requirements after specs-actors 1.0.0 * update storage-fsm with pledge collateral logic * Set bigger balances for miners * Return only additional required pledge * split collateral methods into two methods Co-authored-by: Łukasz Magiera <magik6k@gmail.com>	2020-04-23 12:39:34 -07:00
Jeromy	18f4e9d828	enable autonat service	2020-04-22 15:28:01 -07:00
Adin Schmahmann	9199c03f0d	disable using the DHT to find provider records or arbitrary values	2020-04-22 11:13:26 -07:00
Adin Schmahmann	744a02eb5a	update DHT options and use automatic DHT mode switching	2020-04-22 11:13:25 -07:00
Łukasz Magiera	b941b29fe5	miner: Use correct randomness for sealing	2020-04-20 20:33:53 +02:00
Łukasz Magiera	93b2b6d65d	Merge branch 'testnet/3' into feat/windowed-post	2020-04-17 18:38:20 +02:00
Łukasz Magiera	bab352fb44	Wireup WinningPost validation	2020-04-17 16:47:19 +02:00
Łukasz Magiera	dc2a67f13f	Fix worker key resolving	2020-04-16 22:38:42 +02:00
Łukasz Magiera	afdfc8807d	api: Single method for static miner info	2020-04-16 19:36:36 +02:00
Jakub Sztandera	08e74a90f9	Add missing files ... Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>	2020-04-15 16:13:20 +02:00
Jeromy	4e6839b5ef	some small cleanup	2020-04-14 15:13:52 -07:00
Jeromy	674be39af1	real drand network integration	2020-04-13 20:06:10 -07:00
Łukasz Magiera	5bf80a60f1	Get proof type in NewWinningPoStProver constructor	2020-04-13 23:25:46 +02:00
Łukasz Magiera	d3ffe48fcb	Get things to mostly build	2020-04-10 23:29:05 +02:00
Łukasz Magiera	e053cd6b9c	Merge remote-tracking branch 'origin/testnet/3' into feat/windowed-post	2020-04-10 23:09:01 +02:00
Łukasz Magiera	613e61222b	mostly wire up WindowedPoSt	2020-04-10 23:07:18 +02:00
Łukasz Magiera	3426611340	Merge pull request #1526 from filecoin-project/feat/pass-deal-schedule-for-pre-commit-expiry-scheduling ... provide deal scheduling info to FSM so that it can set pre-commit expiry	2020-04-10 23:05:50 +02:00
Łukasz Magiera	072dd8b744	Merge remote-tracking branch 'origin/testnet/3' into feat/windowed-post	2020-04-10 20:38:25 +02:00
Łukasz Magiera	0f0015f45c	Merge pull request #1520 from filecoin-project/feat/graphsync-chainsync-extension ... Update to latest go-fil-markets w/ enhanced Graphsync	2020-04-10 20:27:05 +02:00
laser	6dffe9377f	provide deal scheduling info to FSM so that it can set pre-commit expiry	2020-04-10 08:22:28 -07:00
Jeromy	ef6fb1b756	rename beacon to randombeacon	2020-04-08 16:10:08 -07:00
hannahhoward	00cd89750d	feat(deps): update fil-markets, graphsync ... Updates dependencies for graphsync, fil-markets, data-transfer. Moves to new graphsync blockstore swapping capabilities, and also locks down graphsync impl so it does not accept arbitrary requests	2020-04-07 23:25:29 -07:00
Jeromy	7075eaba26	WIP: random beacon interface ... Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>	2020-04-07 15:32:23 -07:00
Łukasz Magiera	e36f356908	wip changes for windowed post	2020-04-07 21:55:34 +02:00
Łukasz Magiera	5524241645	fpost -> windowPost renaming	2020-04-07 19:41:41 +02:00
laser	110c869dd3	cut over to storage-fsm, deleting local sealing package	2020-04-07 09:34:09 -07:00
laser	650a31b050	remove all lotus types from sealing package in preparation for extraction ... events adapter implement StateWaitMsg and StateComputeDataCommitment implement StateGetSectorPreCommitOnChainInfo implement ChainHead and SendMsg implement remaining methods	2020-04-06 12:57:55 -07:00
Łukasz Magiera	f05be81275	fsm: Get correct interactive randomness if it lands on a nullblock	2020-04-04 04:57:05 +02:00
Łukasz Magiera	13f2c21e1d	Get network name from genesis	2020-04-01 01:15:49 +02:00
Łukasz Magiera	95ee1c1cde	Extract sector-storage	2020-03-28 01:32:39 +01:00
Łukasz Magiera	c66d3dfad7	sectorstorage: Untangle from lotus deps	2020-03-27 22:35:33 +01:00
Łukasz Magiera	e050e0307e	Cleanup after dropping sectorbuilder	2020-03-26 20:35:16 +01:00
Łukasz Magiera	4be54a976c	Merge sectorbuilder into sectorstorage	2020-03-26 03:51:06 +01:00
Łukasz Magiera	cfc65f525a	sectorstorage: wire up closing logic	2020-03-25 00:52:55 +01:00
Łukasz Magiera	5de17e903c	storageminer: Config for local worker task types	2020-03-24 20:38:00 +01:00
Łukasz Magiera	66a682b55d	Merge remote-tracking branch 'origin/testnet/3' into feat/new-workers	2020-03-24 19:09:02 +01:00
Łukasz Magiera	726c9c1fe7	workers: Address review	2020-03-24 19:01:04 +01:00
Łukasz Magiera	5e4a7e54df	Rename agvmgr+sealmgr to sectorstorage	2020-03-23 12:47:10 +01:00
hannahhoward	34f755b2b9	feat(chainsync): fixes to make graphsync work for chain fetching ... - store to chain blockstore (ok for now, since storage provider is a seperate process) - simplify request fetching and processing	2020-03-20 21:30:24 -07:00
whyrusleeping	1076a1a89d	WIP: integrate graphsync for chainsync requests	2020-03-20 21:30:24 -07:00
Łukasz Magiera	1ed7779701	Merge remote-tracking branch 'origin/testnet/3' into feat/new-workers	2020-03-19 03:28:55 +01:00
laser	366db2f38c	adjust import order as per PR feedback	2020-03-18 12:43:06 -07:00
laser	f59bf6fab1	wire up dtypes.ClientDatastore	2020-03-18 11:57:22 -07:00
Łukasz Magiera	5f2caffb51	Fix tests after specs-storage changes	2020-03-18 02:08:11 +01:00
hannahhoward	f259bc6a09	feat(graphsync): unified graphsync instance ... setup a single graphsync that loads from both the chainstore & client blockstore	2020-03-17 17:25:12 -07:00
Łukasz Magiera	d8ce5078d9	Use new specs-storage interface	2020-03-17 21:19:52 +01:00
Łukasz Magiera	7e997e40f3	workers: Simple storage diagnostics	2020-03-16 18:50:07 +01:00
whyrusleeping	ab51c7e2d2	Fix fallback post scheduling to hopefully do the right thing	2020-03-08 00:19:38 -08:00
whyrusleeping	24bf720a9a	Merge branch 'master' into testnet/3	2020-03-07 16:46:12 -08:00
Steven Allen	6992fd4dba	chore(dep): update dependencies ... Updates: * cid, multihash, and multiaddr to ensure that minimal varints are used. * log to deduplicate some code between version 2 and version 1. * multistream to avoid writing from multiple threads. * badger/datastore to harden prefix handling in queries. * libp2p to 0.5.2 BREAKING: The new libp2p version now formats addresses with /p2p instead of /ipfs. /ipfs multiaddrs are still supported.	2020-03-05 16:28:42 -08:00
Łukasz Magiera	1461e475da	storage: Support adding paths at runtime	2020-03-05 23:02:01 +01:00
Łukasz Magiera	7db1dd52bd	storagemgr: Wire up most of AddPiece logic	2020-03-05 01:38:07 +01:00
Łukasz Magiera	799ff17c7c	Merge remote-tracking branch 'origin/testnet/3' into feat/4stage-seal	2020-03-04 06:37:11 +01:00
whyrusleeping	37d5baf0b2	fix blocks topic	2020-03-03 21:03:35 -08:00
Łukasz Magiera	4e46d00eb6	Merge remote-tracking branch 'origin/testnet/3' into feat/4stage-seal	2020-03-04 04:01:13 +01:00
whyrusleeping	d6723935b9	fixup to match spec, move constants to common location	2020-03-03 15:48:25 -08:00
Łukasz Magiera	a0dbb6bdd6	Storage Manager refactor	2020-03-03 23:19:22 +01:00
lanzafame	4f2baa8953	conform protocol ids to spec ... Signed-off-by: lanzafame <adrianlanzafame92@gmail.com>	2020-03-03 11:34:43 +10:00
whyrusleeping	00efd097c7	implement basic message filtering	2020-02-27 17:40:16 -08:00
whyrusleeping	d8dda1ee66	debugging test failure	2020-02-27 15:14:15 -08:00