lotus

Author	SHA1	Message	Date
Anton Evangelatov	d89ddb9315	resolve conflicts	2021-07-12 11:34:37 +02:00
Anton Evangelatov	16784aa2cc	remove pieceProvider from DI; small refactors	2021-07-12 11:30:26 +02:00
vyzo	c0a1cfffa1	rename noopstore to discardstore	2021-07-09 19:19:37 +03:00
vyzo	abdf4a161a	explicitly switch marksets for concurrent marking this has very noticeable impact in initial marking time; it also allows us to get rid of the confusing ts monikers.	2021-07-09 04:26:36 +03:00
Łukasz Magiera	ed0cc0b56d	Handle bad peerIDs in MarketListRetrievalDeals	2021-07-08 19:27:03 +02:00
Łukasz Magiera	8f5c0c60f5	Config for deal publishing control addresses	2021-07-07 18:00:54 +02:00
Anton Evangelatov	82efe01c70	fixup	2021-07-07 18:00:28 +02:00
Anton Evangelatov	6b014f57e5	pass Subsystems to StorageMiner option; add enableLibp2p bool in Settings	2021-07-07 13:56:37 +02:00
Anton Evangelatov	42ae876711	remove ApplyIfEnableLibP2P	2021-07-07 13:31:56 +02:00
Anton Evangelatov	7a78527fde	remove not used sa; cleanup	2021-07-06 17:46:21 +02:00
Anton Evangelatov	10dc90f7fe	addressing comments	2021-07-06 17:33:47 +02:00
Anton Evangelatov	898687ea2e	Update node/modules/storageminer.go Co-authored-by: Łukasz Magiera <magik6k@users.noreply.github.com>	2021-07-06 17:28:52 +02:00
Anton Evangelatov	ff2772a58c	resolved conflicts	2021-07-06 16:00:41 +02:00
Łukasz Magiera	97207df705	Merge pull request #6639 from filecoin-project/frrist/context-in-statetree-diff polish(statetree): accept a context in statetree diff for timeouts	2021-07-05 17:30:31 +02:00
Anton Evangelatov	4be0a7a215	resolve conflicts with master	2021-07-05 13:13:32 +02:00
vyzo	190cb18ab0	housekeeping - remove defunct tracking store implementations - update splitstore node config - use mark set type config option (defaulting to mapts); a memory constrained node may want to use an on-disk one	2021-07-04 18:38:28 +03:00
vyzo	5f7ae1f489	update splistore DI constructor	2021-07-04 18:38:28 +03:00
vyzo	68bc5d2291	skip moving cold blocks when running with a noop coldstore it is a noop but it still takes (a lot of) time because it has to read all the cold blocks.	2021-07-04 18:38:28 +03:00
vyzo	649b7dd162	add config option for hot headers	2021-07-04 18:38:28 +03:00
vyzo	997f2c098b	keep headers hot when running with a noop splitstore	2021-07-04 18:38:28 +03:00
vyzo	04f2e102a1	kill full splitstore compaction, simplify splitstore configuration	2021-07-04 18:38:28 +03:00
vyzo	5cca29d1db	hook noop blockstore for splitstore in DI	2021-07-04 18:38:28 +03:00
Łukasz Magiera	8a94ab676e	storage: Fix FinalizeSector with sectors in stoage paths	2021-07-02 19:54:45 +02:00
Anton Evangelatov	9e85492b85	fix test	2021-07-02 12:24:07 +02:00
Anton Evangelatov	96245c3cfa	lint	2021-07-02 12:02:36 +02:00
Anton Evangelatov	4194c7fa24	revert back optional for Miner; remove ActorAddress call in node.MinerHandler	2021-07-02 11:58:31 +02:00
Raúl Kripalani	1869de7662	unwire host from storage.Miner.	2021-07-01 13:53:20 +01:00
Łukasz Magiera	c094aa82ec	commit batch: AggregateAboveBaseFee config	2021-07-01 13:33:54 +02:00
frrist	d02a2a2cfa	polish(statetree): accept a context in statetree diff for timeouts - this operation can take a while, this changes gives users the option to abort if it takes "too long".	2021-06-30 16:40:43 -07:00
Anton Evangelatov	3aa6d03cc1	connect miner to full node , only when running markets	2021-06-30 16:45:11 +02:00
Anton Evangelatov	4f0a96c9c7	resolved conflicts	2021-06-30 13:16:52 +02:00
Anton Evangelatov	9ec7cd7239	enable libp2p options	2021-06-30 12:55:43 +02:00
Łukasz Magiera	e9dd3e8650	Test Miner SimultaneousTransfers	2021-06-28 18:17:29 +02:00
Łukasz Magiera	37c5dd5afc	Miner SimultaneousTransfers config	2021-06-28 14:24:14 +02:00
Łukasz Magiera	3f3336340f	Fix wallet error messages	2021-06-25 10:48:47 +02:00
Łukasz Magiera	c3480dc0e8	Merge remote-tracking branch 'origin/releases' into chore/merge-release	2021-06-24 09:39:11 +02:00
Łukasz Magiera	9521c0b773	Add miner-side MaxDealStartDelay config	2021-06-23 19:45:13 +02:00
Łukasz Magiera	0e4cd3c599	Merge pull request #6563 from filecoin-project/asr/batch-starter Always flush when timer goes off	2021-06-23 19:19:30 +02:00
Aayush Rajasekaran	616e5688fc	Remove MinPreCommitBatch	2021-06-23 12:30:32 -04:00
Łukasz Magiera	fa2be42eb0	Merge remote-tracking branch 'origin/release/v1.10.0' into chore/merge-1.10	2021-06-23 15:51:00 +02:00
Anton Evangelatov	4217ec5308	make auth on remote rpc server optional	2021-06-23 13:27:03 +02:00
Anton Evangelatov	21b51328f9	adding TestDealWithMarketAndMinerNode	2021-06-23 12:44:52 +02:00
Jakub Sztandera	bf82b96fd8	Update default fees for aggregates Resolves #6422 Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>	2021-06-22 20:20:01 +02:00
Anton Evangelatov	6720463799	resolve merge conflicts	2021-06-22 11:28:23 +02:00
Raúl Kripalani	b6147fb27f	extern/storage: retype resource filtering strategy to enum.	2021-06-21 20:28:15 +01:00
Anton Evangelatov	577b730415	wip	2021-06-18 18:42:34 +02:00
Łukasz Magiera	097baeb9b0	Make batch deal input test less flaky	2021-06-17 20:52:09 -04:00
Łukasz Magiera	5c8498b603	storagefsm: Fix batch deal packing behavior	2021-06-17 20:50:14 -04:00
Łukasz Magiera	44de67cf7d	Merge pull request #6175 from filecoin-project/feat/dynamic-retreival-pricing Dynamic Retrieval pricing	2021-06-17 10:25:48 +02:00
Anton Evangelatov	d45bb14015	Merge branch 'master' into nonsense/split-market-miner-processes	2021-06-16 18:49:15 +02:00
Aayush Rajasekaran	520a0091f5	Merge branch 'releases' into release/v1.10.0	2021-06-15 17:40:36 -04:00
Łukasz Magiera	0514f38dc4	Merge remote-tracking branch 'origin/master' into chore/merge-1.10	2021-06-14 13:27:53 +02:00
Anton Evangelatov	31e6fb154e	resolve conflicts	2021-06-14 11:27:54 +02:00
aarshkshah1992	4419205b0e	fix compilation	2021-06-14 10:10:29 +05:30
Aarsh Shah	bed2bc73a3	Update node/config/def.go Co-authored-by: raulk <raul@protocol.ai>	2021-06-14 09:42:22 +05:30
Łukasz Magiera	94be3a973a	Don't enable early finalization by default	2021-06-11 11:45:20 +02:00
Łukasz Magiera	ec06f086ef	sealing: Early finalization option	2021-06-11 11:41:28 +02:00
aarshkshah1992	fed5afa704	merge master	2021-06-11 09:35:20 +05:30
Łukasz Magiera	6f80d9f3c2	Merge pull request #6311 from filecoin-project/raulk/itests consolidate integration tests into `itests` package; create test kit; cleanup	2021-06-10 12:33:29 +02:00
Jennifer Wang	8f426b49ec	updated configuration comments for docs	2021-06-09 23:36:44 -04:00
Jennifer	3a1ad50da5	Merge pull request #6440 from filecoin-project/jen/miner-config-doc updated configuration comments for docs	2021-06-09 23:35:04 -04:00
Jennifer Wang	95ad74a156	updated configuration comments for docs	2021-06-09 20:44:20 -04:00
Raúl Kripalani	6d46be53bd	make tests no longer create auth tokens.	2021-06-10 00:15:29 +01:00
Łukasz Magiera	f0a2e97cb5	fee config for sector batching	2021-06-09 14:23:06 -04:00
Raúl Kripalani	81b3c6e2ab	Merge branch 'master' into raulk/itests	2021-06-09 17:34:46 +01:00
Anton Evangelatov	beb5bffaf6	fix log.Error; rename RemoteStore	2021-06-09 13:05:54 +02:00
Łukasz Magiera	78171055e7	fee config for sector batching	2021-06-08 15:45:32 +02:00
Anton Evangelatov	9f3ec82cc1	initial resolution of conflicts	2021-06-08 13:01:22 +02:00
aarshkshah1992	4e9bb16532	changes as per review	2021-06-08 10:09:27 +05:30
aarshkshah1992	16166504f4	merged master	2021-06-08 09:17:40 +05:30
Raúl Kripalani	a274fcc533	Merge branch 'master' into raulk/itests	2021-06-07 23:44:22 +01:00
Raúl Kripalani	db1a61852d	Merge branch 'master' into raulk/itests	2021-06-07 23:17:44 +01:00
Jakub Sztandera	f9acd07987	Update libp2p to 0.14.1 This does not resolve the CI issue but prepares us for it after https://github.com/libp2p/go-libp2p/pull/1116 Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>	2021-06-07 18:51:48 +02:00
Łukasz Magiera	fadc79a487	Merge pull request #6280 from filecoin-project/feat/pieceread-outside-scheduler Bypass task scheduler for reading unsealed pieces	2021-06-07 18:11:44 +02:00
Łukasz Magiera	8625da3479	Bump miner/worker api versions	2021-06-07 16:57:24 +02:00
aarshkshah1992	21e6b50294	finished rebasing PR	2021-06-07 16:02:15 +05:30
Anton Evangelatov	de646a5b93	fix node builder	2021-06-07 12:16:10 +02:00
aarshkshah1992	4efaa8d688	unit tests for the remote store Reader	2021-06-07 15:02:52 +05:30
aarshkshah1992	65eb610ec3	docs, logs and green ci	2021-06-07 15:02:49 +05:30
aarshkshah1992	670835fca0	bypass task scheduler for reading unsealed pieces	2021-06-07 15:02:04 +05:30
Lion	e4588aed5c	Fix the doc errors of the sealing config funcs	2021-06-07 12:35:43 +08:00
Dirk McCormick	52b90e4c9d	test: offline deals	2021-06-04 22:42:07 +02:00
Łukasz Magiera	a7746961fb	Merge remote-tracking branch 'origin/master' into feat/list-retrievals	2021-06-04 20:49:01 +02:00
Anton Evangelatov	ded5341da0	fixup test node builder	2021-06-04 17:22:36 +02:00
Anton Evangelatov	ed634bc3a4	rebuild docs	2021-06-04 17:06:55 +02:00
Anton Evangelatov	c4d10bc44e	apply messagepool.NewProviderLite to lite nodes	2021-06-04 16:51:07 +02:00
Anton Evangelatov	6f125cc129	add prover to fullnode and miner builders	2021-06-04 16:26:32 +02:00
Anton Evangelatov	d9a7348ae1	use masters filecoin-ffi	2021-06-04 16:20:40 +02:00
Anton Evangelatov	8bd09e39ca	resolve merge conflicts	2021-06-04 16:17:00 +02:00
Anton Evangelatov	c877166b4a	add messagepool to test node constructor	2021-06-04 15:53:33 +02:00
Anton Evangelatov	88756f3ebf	fix TestAPIDeal tests	2021-06-04 15:41:38 +02:00
aarshkshah1992	303ef15a83	fix ci	2021-06-04 17:33:11 +05:30
Łukasz Magiera	6d9779ecae	Merge remote-tracking branch 'origin/master' into feat/nv13-1.11	2021-06-02 15:07:13 +02:00
Łukasz Magiera	a676da8a7e	Merge remote-tracking branch 'origin/master' into feat/nv13-1.11	2021-06-01 21:07:04 +02:00
Łukasz Magiera	dc642d0b7b	Merge remote-tracking branch 'origin/feat/nv13' into feat/nv13-1.11	2021-06-01 21:06:58 +02:00
Dirk McCormick	8997ed508b	feat: update to markets-v1.4.0	2021-06-01 10:16:12 -06:00
Łukasz Magiera	d69032b2f0	Merge pull request #6367 from filecoin-project/fix/robustify-commit-batcher Robustify commit batcher	2021-06-01 17:49:46 +02:00
Łukasz Magiera	5a7f97210f	Merge pull request #6317 from filecoin-project/jen/test-datacap-topup Add test for AddVerifiedClient	2021-06-01 14:41:05 +02:00
Łukasz Magiera	5a9e6c8142	Merge pull request #6364 from filecoin-project/asr/resolve-messages Improve address resolution for messages	2021-06-01 14:38:31 +02:00
Łukasz Magiera	482e1110c2	precommit batcher: Improve error propagation	2021-06-01 14:35:30 +02:00
Łukasz Magiera	cb4eb487f4	commit batcher: Fix min aggregate size check	2021-06-01 12:27:22 +02:00
Łukasz Magiera	9fcb564bef	Make commit batcher more robust	2021-06-01 11:56:19 +02:00
Anton Evangelatov	e4136b0d42	add modules.StorageAuthWithURL to set correct token	2021-06-01 11:42:28 +02:00
Jennifer Wang	fcfc214ed1	Use MockSbBuilder	2021-05-31 20:14:11 -04:00
Aayush Rajasekaran	9ceee6028b	More tweaking of context handling in the messagepool	2021-05-31 18:13:23 -04:00
Aayush Rajasekaran	ed93d0725f	Protect mp.localAddrs and mp.pending behind helper functions	2021-05-31 18:13:23 -04:00
Aayush Rajasekaran	1f03a618f9	Plumb contexts through	2021-05-31 18:13:23 -04:00
Łukasz Magiera	ffa47659a1	Merge remote-tracking branch 'origin/feat/nv13' into feat/nv13-1.11	2021-05-31 21:38:34 +02:00
Łukasz Magiera	c3e8eddb9b	Merge remote-tracking branch 'origin/master' into feat/nv13-1.11	2021-05-31 21:24:56 +02:00
Łukasz Magiera	2a1b35e694	Merge pull request #6361 from filecoin-project/asr/fip-0015 Implement FIP-0015	2021-05-31 20:58:21 +02:00
Łukasz Magiera	2d6a159dcc	Merge pull request #6041 from filecoin-project/fix/batch-deal-packing storagefsm: Fix batch deal packing behavior	2021-05-31 20:45:12 +02:00
Aayush Rajasekaran	7fca1c1ee7	Implement FIP-0015	2021-05-31 14:40:54 -04:00
Peter Rabbitson	1e72d8f14c	Reduce noise from 'peer has different genesis' messages After the unification of all networks behind a build-tag, the amount of these warnings has risen sharply. Reduce it to a debug-level, since it isn't actionable to an operator.	2021-05-31 13:43:24 +02:00
Anton Evangelatov	d195a12565	Merge branch 'master' into nonsense/split-market-miner-processes	2021-05-31 11:26:11 +02:00
Łukasz Magiera	9475079b97	Make batch deal input test less flaky	2021-05-30 17:46:22 +02:00
Łukasz Magiera	c8d603557b	storagefsm: Fix batch deal packing behavior	2021-05-30 17:46:22 +02:00
Jennifer Wang	2b08e9f3a6	Add test AddVerifiedClient	2021-05-28 15:41:57 -04:00
Aayush Rajasekaran	fba5c65ffd	Extend the default deal start epoch delay	2021-05-28 12:35:48 -04:00
hannahhoward	19b6dc8d1e	feat(cli): add a list retrievals command Currently, there is no way to inspect retrievals on a client. This adds said command, allow with corresponding APIs	2021-05-27 11:48:25 -07:00
Łukasz Magiera	1e4456138e	Merge master into feat/nv13	2021-05-27 12:28:20 +02:00
Anton Evangelatov	c311520968	add missing messagepool override	2021-05-27 10:28:41 +02:00
Aayush Rajasekaran	d9e86afa24	Tweak client calcDealExpiration to consider genesis miners	2021-05-26 21:46:37 -04:00
Aayush Rajasekaran	21b4741e30	Fix randomness fetching around null blocks	2021-05-26 21:06:06 -04:00
Aayush Rajasekaran	7714537239	Allow starting networks from arbitrary actor versions	2021-05-26 12:48:14 -04:00
Anton Evangelatov	9979de24db	logs and defaults	2021-05-26 12:47:21 +02:00
Łukasz Magiera	43c62f4406	Revert "Allow starting networks from arbitrary actor versions"	2021-05-26 12:33:08 +02:00
Aayush Rajasekaran	cf574ca9a1	Allow starting networks from arbitrary actor versions	2021-05-25 19:30:20 -04:00
Łukasz Magiera	4c6c9a0edb	Fix windowpost/deadline tests	2021-05-25 21:27:32 +02:00
Łukasz Magiera	04658e1cae	fix lint	2021-05-25 16:26:59 +02:00
Łukasz Magiera	d90ab2b81f	config: Document batching fields	2021-05-25 16:20:49 +02:00
aarshkshah1992	78255eac54	test unsealing prices for default pricing strategy	2021-05-24 15:11:50 +05:30
Raúl Kripalani	c3f45cc836	Merge branch 'raulk/refactor-rpc' into raulk/itests	2021-05-23 14:56:54 +01:00
Raúl Kripalani	2337248aa5	rpc: separate handlers/server; refactor miner rpc.	2021-05-23 14:48:42 +01:00
Raúl Kripalani	627248d610	Merge branch 'raulk/refactor-rpc' into raulk/itests	2021-05-23 12:41:25 +01:00
Raúl Kripalani	de454b8e26	add godocs to ServeRPC.	2021-05-23 12:40:33 +01:00
aarshkshah1992	dc6dbc9a11	dpr changes and test based on new unsealing PR	2021-05-22 22:40:21 +05:30
Raúl Kripalani	5b77dbd06f	decouple rpc server and shutdown logic from cmd.	2021-05-21 21:34:17 +01:00
aarshkshah1992	bd9959070e	unit tests for the remote store Reader	2021-05-20 15:25:46 -06:00
aarshkshah1992	73613ee883	docs, logs and green ci	2021-05-20 15:25:46 -06:00
aarshkshah1992	2a40c802ea	bypass task scheduler for reading unsealed pieces	2021-05-20 15:25:46 -06:00
Dirk McCormick	885564fe24	Revert "chore: update go-libp2p" This reverts commit `f7fbaef361`.	2021-05-20 11:22:19 -06:00
Łukasz Magiera	13ff6ed462	Test pledging before nv13 upgrade	2021-05-20 18:38:33 +02:00
Anton Evangelatov	4693c61305	re-arrange NodeBuilder and add storageminer_svc	2021-05-20 13:10:14 +02:00
Anton Evangelatov	76bb424de0	update StorageMinerAPI	2021-05-20 13:01:14 +02:00
Raúl Kripalani	06b8ee5b95	Merge branch 'master' into raulk/itests	2021-05-20 11:56:43 +01:00
Anton Evangelatov	cb603c62d9	update retrievaladapter ; add piece_provider	2021-05-20 12:49:53 +02:00
Anton Evangelatov	2aad7b6979	update sectorstorage.New (Manager) interface	2021-05-20 12:32:29 +02:00
Dirk McCormick	706fdcbb80	feat: increase data transfer timeouts	2021-05-19 12:56:07 -06:00
Łukasz Magiera	3a99f95f8e	Merge pull request #6149 from filecoin-project/feat/markets-1.3 Update to markets 1.3	2021-05-19 20:51:33 +02:00
Raúl Kripalani	c46d4ae529	wip	2021-05-19 17:30:43 +01:00
Łukasz Magiera	2a1b359ede	config: fmt	2021-05-19 15:20:34 +02:00
Łukasz Magiera	a5677d1b7a	ffiwrapper: Separate Prover interface	2021-05-19 15:20:23 +02:00
Łukasz Magiera	2a0c0e379b	Working default batching config	2021-05-19 14:32:41 +02:00
Anton Evangelatov	a989f60e27	add SectorAddPieceToAny and SectorUnsealPiece to StorageMiner iface; model moved to api package - PieceDealInfo, DealSchedule	2021-05-19 13:05:07 +02:00
Łukasz Magiera	5112b9fe2b	Lower default batch slack	2021-05-18 21:04:47 +02:00
Łukasz Magiera	9690bc882c	Test to trigger batching logic	2021-05-18 18:41:42 +02:00
Łukasz Magiera	81b5d8c671	Make things build with both batchers	2021-05-18 16:53:49 +02:00
Łukasz Magiera	c7ba083fa4	Import precommit batcher	2021-05-18 16:51:06 +02:00
vyzo	7512748b56	wire in sealing config values	2021-05-18 15:31:52 +03:00
vyzo	74bad49068	correctly handle commit batch timer	2021-05-18 14:30:47 +03:00
vyzo	357c0868b7	proper config for termination batching and commit wait	2021-05-18 12:20:19 +03:00
vyzo	febf7cf28f	sane config defaults	2021-05-18 12:02:53 +03:00
Aayush Rajasekaran	9a6e601754	Merge pull request #5961 from filecoin-project/feat/stateless-offline-dealflow Introduce stateless offline dealflow, bypassing the FSM/deallists	2021-05-17 12:35:39 -04:00
Łukasz Magiera	506f39b294	WIP: Integrate FIP0013	2021-05-11 22:10:29 -04:00
Peter Rabbitson	d54ed1b0c6	Merge remote-tracking branch 'origin/master' into feat/stateless-offline-dealflow	2021-05-11 04:54:22 +02:00
Steven Allen	f7fbaef361	chore: update go-libp2p From 0.12.0 to 0.14.0. Headline for lotus: faster yamux.	2021-05-10 19:41:57 -07:00
Peter Rabbitson	6f71eab8ce	Adjust lp2p retry params	2021-05-11 04:26:04 +02:00
Jakub Sztandera	18cbdcfc81	Disable checks API on Lotus Lite Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>	2021-05-07 17:19:17 +02:00
Jakub Sztandera	d777680449	Fix mpool.GetActor for lite node Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>	2021-05-07 15:30:06 +02:00
Jakub Sztandera	8d75da1629	Use MessagePrototype for check API Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>	2021-05-07 15:30:05 +02:00
vyzo	e2d0047a2a	introduce message prototypes This introduces message prototypes to applicable API endpoints, which allows us to invert control of message sending and give the user a chance to intervene with an interactive ui. Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>	2021-05-07 15:30:05 +02:00
vyzo	d782250aba	implement MessagePool.CheckReplaceMessages Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>	2021-05-07 15:30:04 +02:00
vyzo	91e774063e	implement MessagePool.CheckMessages Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>	2021-05-07 15:30:04 +02:00
vyzo	ed61642b3a	implement NodeStatus API Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>	2021-05-07 15:30:04 +02:00
Peter Rabbitson	e648b72d8d	Merge remote-tracking branch 'origin/master' into feat/stateless-offline-dealflow	2021-05-06 15:57:10 +02:00
Dirk McCormick	5b1fab8ffa	feat: markets v1.3	2021-05-06 09:49:44 +02:00
Steven Allen	eb10918470	Merge pull request #6107 from filecoin-project/feat/checkpoint-sync feat: allow checkpointing to forks	2021-04-29 16:30:52 -07:00
Łukasz Magiera	9b87566dbf	Merge pull request #6141 from filecoin-project/split-TestBatchDealInput-from-TestAPIDealFlow flaky tests improvement: separate TestBatchDealInput from TestAPIDealFlow	2021-04-29 19:01:35 +02:00
Steven Allen	f983fa8cd5	Merge pull request #6134 from filecoin-project/asr/emptytsk Use EmptyTSK where appropriate	2021-04-29 09:35:43 -07:00
Anton Evangelatov	c7d74ef16e	separate TestBatchDealInput from TestAPIDealFlow	2021-04-29 17:39:00 +02:00
Łukasz Magiera	a456f394ac	Merge pull request #6007 from filecoin-project/asr/state-list-messages Speed up StateListMessages in some cases	2021-04-29 07:47:26 +02:00
Aayush Rajasekaran	d794b49df3	Use EmptyTSK where appropriate	2021-04-29 01:00:03 -04:00
Steven Allen	69da6a2a29	feat: allow checkpointing to forks Previously, `lotus sync checkpoint` would only checkpoint on the current chain. Now, it can switch to a new fork.	2021-04-28 13:54:26 -07:00
Łukasz Magiera	a24a73bb52	Merge tag 'v1.8.0' into release/v1.9.0	2021-04-27 10:30:33 +02:00
Łukasz Magiera	c4137a438d	Merge commit 'f1ded63d608e1b191d79c780b8065f8cff367c98' into feat/nv12-1.11	2021-04-27 08:22:55 +02:00
Aayush Rajasekaran	f1ded63d60	v4 specs-actors integration, nv12 migration	2021-04-27 02:02:44 -04:00
Reskorey	58bee65bcb	go fmt	2021-04-23 16:10:51 +08:00
Reskorey	7738886936	fix full node painc fix: full node painc when calling RPC Filecoin.ClientRetrieve without the order.Tatol pecified.	2021-04-23 15:43:41 +08:00
Łukasz Magiera	c72eb0ccaf	Merge pull request #6048 from filecoin-project/fix/nonce-getting Fix nonce getting on Lotus lite	2021-04-18 16:25:47 +02:00
Peter Rabbitson	dab2a41792	Raise client MaxFee default The original value is too conservative for the current state of mainnet Resolves (temporarily) #5543	2021-04-17 00:35:40 +02:00
Jakub Sztandera	66c408938b	Fix signature in messagepool, wire in context Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>	2021-04-16 18:43:28 +02:00
Jakub Sztandera	77d004ec06	Fix nonce getting on Lotus lite Resolves #5593 #5995 Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>	2021-04-15 19:57:09 +02:00
Łukasz Magiera	e76935147f	Merge remote-tracking branch 'origin/master' into feat/v1-api	2021-04-13 14:24:22 +02:00
Aayush Rajasekaran	ff48a70ed9	Speed up StateListMessages in some cases	2021-04-10 02:33:34 -04:00
Łukasz Magiera	88bdb591d5	Merge pull request #6003 from filecoin-project/fix/fbs-di Fix fallback chainstore	2021-04-10 01:58:38 +02:00
Łukasz Magiera	7e4cb9da84	Fix fallback chainstore	2021-04-09 16:11:02 +02:00
Dirk McCormick	4a3261a986	feat: go-fil-markets-v1.2.5-rc1	2021-04-08 14:34:35 +02:00
Peter Rabbitson	25a77d905d	Centralize everything on ipfs/go-log/v2 I am not entirely sure this is right, but everything seems to build...	2021-04-06 15:04:32 +02:00
Łukasz Magiera	e8f28d7b9f	Fix tests	2021-04-06 12:24:58 +02:00
Łukasz Magiera	81bd27911f	Propagate StateMsg api changes	2021-04-05 19:56:53 +02:00
Peter Rabbitson	b79be2a2c2	Merge remote-tracking branch 'origin/master' into feat/stateless-offline-dealflow	2021-04-05 16:06:44 +02:00
Łukasz Magiera	deb2b90b6a	Fix lotus/miner build	2021-04-05 13:23:46 +02:00
Peter Rabbitson	7fddbb528d	Introduce stateless offline dealflow, bypassing the FSM/deallists This is aproposal for an additional flag --manual-stateless-deal and a corresponding API endpoint ClientStatelessDeal. This allows firing off an offline-style deal against a miner without keeping further track of it locally. Not keeping any local state introduces the limitation of requiring free storage deals, as there is nothing to tie the payment channel setup to. Rationale/need for this type of flow is the case of incredibly large sets of data nd deals, where the client and providers have prearranged payment ahead of time, and the client has a separate-from-lotus database of deal inventory. This way the client can use their lotus node merely as a network gateway, without running into any limitations currently present in both lotus as a whole and go-fil-markets in particular. Specific context for this work is filecoin-discover, where the requirement is to onboard ~ 12,000,000 individual deals against a pool of miners with whom the client has prearranged a relationship.	2021-04-05 13:11:10 +02:00
Łukasz Magiera	f4e46c9003	implement v1 api with api modules	2021-04-03 13:20:50 +02:00
Łukasz Magiera	1b32d7f52f	cli: fix build with v1 api changes	2021-04-03 12:55:29 +02:00
Łukasz Magiera	0103d2f621	v1 api: Cleanup message wait/search apis	2021-04-02 13:52:24 +02:00
Łukasz Magiera	c9866da688	Merge remote-tracking branch 'origin/master' into feat/v1-api	2021-04-02 13:15:33 +02:00
Łukasz Magiera	4538550999	Merge remote-tracking branch 'origin/master' into feat/local-retrieval	2021-04-02 12:36:28 +02:00
Anton Evangelatov	df003d44d2	include Stages and DealStages only on ClientDealInfo, not on ClientListDeals	2021-04-01 17:08:01 +03:00
Łukasz Magiera	1a5c4d70f4	Merge remote-tracking branch 'origin/master' into feat/v1-api	2021-04-01 15:33:37 +02:00
Anton Evangelatov	967fbf52c6	resolve conflicts	2021-03-31 23:14:29 +03:00
Łukasz Magiera	dfe8a1c1e2	client: Set the client var in the correct scope	2021-03-31 19:38:02 +02:00
Łukasz Magiera	ee04f9b71c	Merge remote-tracking branch 'origin/master' into nonsense/add-cancel-retrieval-deal-cmd	2021-03-31 19:15:21 +02:00
Łukasz Magiera	10ac9039b4	Merge pull request #5853 from filecoin-project/feat/markets-v1.2.0 update to markets v1.2.x	2021-03-31 18:59:20 +02:00
Łukasz Magiera	f2ab316fb1	Local retrieval support	2021-03-30 21:32:06 +02:00
Anton Evangelatov	139ff4ae64	resolved conflicts	2021-03-30 16:15:42 +03:00
Anton Evangelatov	77bc8d6ca3	remove storedCounters	2021-03-29 18:39:07 +03:00
Anton Evangelatov	8ba0bcb375	Merge branch 'master' into nonsense/cli-show-deals-backup	2021-03-29 18:19:28 +03:00
hunjixin	896303c6a2	fix lint	2021-03-29 10:31:31 +08:00
Raúl Kripalani	fd91c095c4	rename command to cancel-retrieval; rename args to follow Lotus style.	2021-03-26 16:37:46 +00:00
Dirk McCormick	b13f6a3209	fix: cancel retrieval deal - disallow negative deal ID	2021-03-26 09:51:07 +01:00
hunjixin	449b33abee	remote calc winningpost proof	2021-03-26 13:32:03 +08:00
Łukasz Magiera	e003977559	apiclient: Version client funcs	2021-03-25 15:39:48 +01:00
Łukasz Magiera	7a23b411ae	Merge apistruct with the api package	2021-03-25 15:10:08 +01:00
Anton Evangelatov	a202f9d19e	add cancel-retrieval-deal cmd	2021-03-24 18:18:49 +02:00
Dirk McCormick	1359fb6cc4	fix: disable pull channel monitoring for now	2021-03-24 13:56:59 +01:00
Łukasz Magiera	c41777dcd2	API proxy struct codegen (#5854 ) * mostly working api proxy gen * api: Consistent api names * fix docsgen * regenerate api struct * api: expand external interfaces * Add missing gen files * apigen: fix perm detection * api: Move perm tags to the interface * gofmt * worker perms * docsgen * docsgen: ignore tag comments * apigen: add codegen warning * gofmt * missing actor type * docsgen * make linter happy * fix lint * apigen: use directives for tags * docsgen * regen openrpc docs	2021-03-23 13:42:56 +01:00
Dirk McCormick	aee9890ee7	feat: update go-data-transfer and go-fil-markets	2021-03-23 13:28:30 +01:00
Anton Evangelatov	22217b7cae	Merge branch 'master' into nonsense/cli-show-deals	2021-03-23 13:58:26 +02:00
frrist	6caafaeee3	polish(node): define settings opts for 3rd party dep injection - motivating use case running a lotus-sentinel node	2021-03-22 15:37:44 -07:00
Jakub Sztandera	5f672c2ed0	perf: add cache for gas permium estimation Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>	2021-03-22 18:06:14 +01:00
Dirk McCormick	9fb1dd43a9	feat: update to markets v1.2.0	2021-03-22 15:31:13 +01:00
Łukasz Magiera	43d9cc36a4	OpenRPC Support (#5843 ) * main: init implement rpc.Discover RPC method This implement the basic functionality for the method over HTTP RPC. Signed-off-by: meows <b5c6@protonmail.com> * main,go.mod,go.sum: init example with go-openrpc-reflect lib Signed-off-by: meows <b5c6@protonmail.com> Conflicts: go.mod go.sum * main: make variable name human-friendly Signed-off-by: meows <b5c6@protonmail.com> * main,go.mod,go.sum: init impl of go-openrp-reflect printing document Signed-off-by: meows <b5c6@protonmail.com> Conflicts: go.mod go.sum * go.mod,go.sum: use go-openrpc-reflect and open-rpc/meta-schema hackforks This is for development only. Versions need to be bumped when they're ready for use as canonical remotes. Signed-off-by: meows <b5c6@protonmail.com> * main,openrpc,main: refactor openrpc supporting code to own package This eliminates code duplication. Signed-off-by: meows <b5c6@protonmail.com> * main: add rpc.Discover to openrpc document Signed-off-by: meows <b5c6@protonmail.com> * openrpc: fix rpc.discover method name casing Also fixes casing stuff for the rest of Filecoin. methods. Signed-off-by: meows <b5c6@protonmail.com> * Revert "main: add rpc.Discover to openrpc document" This reverts commit 116898efb10f33e405ac74acb1aa6daefcd46a62. * main: fix document creation method name This fixes an issue caused with the latest reverting commit. Signed-off-by: meows <b5c6@protonmail.com> * main,docgen,openrpc: refactor to share api parsing, etc as docgen exported stuff Signed-off-by: meows <b5c6@protonmail.com> Makefile: fix docgen refactoring for makefile use of command Signed-off-by: meows <b5c6@protonmail.com> * openrpc: add schema.examples to app reflector There are quite of few of these already registered for the docgen command, so it makes sense to use those! Signed-off-by: meows <b5c6@protonmail.com> * openrpc: init method pairing examples Signed-off-by: meows <b5c6@protonmail.com> * go.mod,go.sum: bump go.mod to use latest meta-schema and openrpc-reflect versions Signed-off-by: meows <b5c6@protonmail.com> * openrpc: init SchemaType mapper function This function will handle the manual configurations for app-specific data types w/r/t their json schema representation. This is useful for cases where the reflect library is unable to provide a sufficient representation automatically. Provided in this commit is an initial implementation for the integerD type (assuming number are represented in the API as hexs), and a commonly used cid.Cid type. Signed-off-by: meows <b5c6@protonmail.com> * go.mod,go.sum: tame dependencies by bumping etclabscore/go-openrpc-reflect This removes a problematic dependency on github.com/ethereum/go-ethereum, which was imported as a dependency for a couple github.com/etclabscore/go-openrpc-reflect tests. etclabscore/go-openrpc-reflect v0.0.36 has removed this dependency, so this commit is the result of bumping that version and then running 'go mod tidy' This is in response to a review at https://github.com/filecoin-project/lotus/pull/4711#pullrequestreview-535686205 Date: 2020-11-21 06:52:48-06:00 Signed-off-by: meows <b5c6@protonmail.com> * main: add 'miner' arg to openrpc gen cmd This allows the command to EITHER generate the doc for Full or Miner APIs. See comment for usage. Date: 2020-11-21 07:48:05-06:00 Signed-off-by: meows <b5c6@protonmail.com> * docgen: add missing examples for Miner API Generating the Miner API OpenRPC doc (via 'go run ./api/openrpc/cmd miner') caused the example logic to panic because some types were missing. This commit adds those missing types, although I'm not an expert in the API so I can't suggest that the example values provided are ideal or well representative. Date: 2020-11-21 07:50:21-06:00 Signed-off-by: meows <b5c6@protonmail.com> * build/openrpc/full.json,build/openrpc/miner.json: add build/openrpc/[full/miner].json docs These will be used as static documents provided by the rpc.discover method. Date: 2020-11-21 07:51:39-06:00 Signed-off-by: meows <b5c6@protonmail.com> * build: init go-rice openrpc static assets Date: 2020-11-21 08:23:06-06:00 Signed-off-by: meows <b5c6@protonmail.com> * main: remove rpc.discover implementation from runtime plugin Instead of generating the doc on the fly, we're going to serve a static asset. Rel https://github.com/filecoin-project/lotus/pull/4711#pullrequestreview-535686205 This removes the runtime implementation from the RPC server construction. Date: 2020-11-21 08:41:20-06:00 Signed-off-by: meows <b5c6@protonmail.com> * api,apistruct,common: add Discover(ctx) method to CommonAPI interface and structs Date: 2020-11-21 08:41:56-06:00 Signed-off-by: meows <b5c6@protonmail.com> * main: use rpc server method aliasing for rpc.discover This depends on a currently-forked change at filecoin-project/go-jsonrpc 8350f9463ee451b187d35c492e32f1b999e80210 which establishes this new method RPCServer.AliasMethod. This solves the problem that the OpenRPC spec says that the document should be served at the system extension-prefixed endpoing rpc.discover (not Filecoin.Discover). In fact, the document will be available at BOTH endpoints, but that duplicity is harmless. Date: 2020-11-21 09:18:26-06:00 Signed-off-by: meows <b5c6@protonmail.com> * api,apistruct,build,common: rpc.discover: return json object instead of string Instead of casting the JSON asset from bytes to string, unmarshal it to a map[string]interface{} so the server will provide it as a JSON object. Date: 2020-11-21 09:27:11-06:00 Signed-off-by: meows <b5c6@protonmail.com> * Makefile: merge resolve: docsgen command path Date: 2020-11-22 07:19:36-06:00 Signed-off-by: meows <b5c6@protonmail.com> * apistruct,main,docgen,openrpc: merge resolve: fix func exporteds, signatures Date: 2020-11-22 07:31:03-06:00 Signed-off-by: meows <b5c6@protonmail.com> * go.mod,go.sum: 'get get' auto-bumps version Date: 2020-11-22 07:31:44-06:00 Signed-off-by: meows <b5c6@protonmail.com> * Makefile,docgen,main,build/openrpc: refactor openrpc documentation generation This creates Makefile command docsgen-openrpc-json, and refactors the docsgen command to generate both the markdown and openrpc json documents, redirecting the output of the openrpc json documentation to the build/openrpc/ directory, where those json files will be compiled as static assets via go-rice boxes. The api/openrpc/cmd now uses usage argumentation congruent to that of the docgen command (switching on API context). Date: 2020-11-22 08:01:18-06:00 Signed-off-by: meows <b5c6@protonmail.com> * main,docgen_openrpc: rename api/openrpc -> api/docgen-openrpc Renames the package as well. This is intended to parallel the existing docgen package and command namespacing. Date: 2020-11-22 10:34:46-06:00 Signed-off-by: meows <b5c6@protonmail.com> * api,apistruct,docgen,build,build/openrpc: use typed Discover response Instead of using a map[string]interface{}, use a typed response for the Discover method implementation. This avoids having to set a docgen Example for the generic map[string]interface{} (as an openrpc document) which both pollutes the generic type and lacks useful information for the Discover method example. Date: 2020-11-22 08:31:16-06:00 Signed-off-by: meows <b5c6@protonmail.com> * apistruct,build,main,impl: implement Discover method for Worker and StorageMiner APIs Methods return static compiled assets respective to the APIs. Date: 2020-11-22 08:57:18-06:00 Signed-off-by: meows <b5c6@protonmail.com> * docgen_openrpc,build/openrpc: remove timestamping from openrpc doc info This should allow openrpc docs generated at different times to be equal. This is important because the CI (Circle) runs the docgen command and tests that the output and the source are unchanged (via git diff). Date: 2020-11-22 10:47:07-06:00 Signed-off-by: meows <b5c6@protonmail.com> * main,docgen_openrpc,main,build: fix lint issues Fixes goimports, staticcheck, golint issues. Date: 2020-11-22 11:06:46-06:00 Signed-off-by: meows <b5c6@protonmail.com> * docgenopenrpc: fix: don't use an underscore in package name (golint) Date: 2020-11-22 11:07:53-06:00 Signed-off-by: meows <b5c6@protonmail.com> * go.sum: fix: mod-tidy-check (run 'go mod tidy') Date: 2020-11-22 11:09:48-06:00 Signed-off-by: meows <b5c6@protonmail.com> * go.mod,go.sum: bump filecoin-project/go-jsonrpc dep to latest This version includes the necessary RPCServer.AliasMethod method. Date: 2020-11-23 12:16:15-06:00 Signed-off-by: meows <b5c6@protonmail.com> * Makefile,main,build,build/openrpc: init gzipped openrpc static docs Date: 2020-11-24 06:15:06-06:00 Signed-off-by: meows <b5c6@protonmail.com> * build: refactor gzip reading Date: 2020-11-24 06:18:34-06:00 Signed-off-by: meows <b5c6@protonmail.com> * build: add basic test for openrpc doc from static assets Date: 2020-11-24 06:30:23-06:00 Signed-off-by: meows <b5c6@protonmail.com> * build: handle reader Close error This keeps the errcheck linter happy. Date: 2020-11-24 06:33:14-06:00 Signed-off-by: meows <b5c6@protonmail.com> * go.sum: run 'go mod tidy' Date: 2020-11-24 06:36:07-06:00 Signed-off-by: meows <b5c6@protonmail.com> * go.mod,go.sum: go mod tidy Tidying up after resolving the merge conflicts with master at go.mod Date: 2020-11-24 06:40:45-06:00 Signed-off-by: meows <b5c6@protonmail.com> * go.mod,go.sum: bump filecoin-project/go-jsonrpc to latest This is a repeat of 76e6fd2, since the latest merge to master seems to have reverted this. Date: 2020-11-24 06:42:30-06:00 Signed-off-by: meows <b5c6@protonmail.com> * docgenopenrpc,build/openrpc: remove method example pairings, improve schema examples Removing method example pairings since they were redundant to schema examples and were not implemented well. Improved schema examples by using the ExampleValue method instead of the map lookup. Made a note in the comment here that this is not ideal, since we have to make a shortcut assumption /workaround by using 'unknown' as the method name and the typea as its own parent. Luckily these values aren't heavily used by the method logic. Date: 2020-11-27 12:57:36-06:00 Signed-off-by: meows <b5c6@protonmail.com> * docgenopenrpc: use generic number jsonschema for number types Previously used an integer schema assuming hex encoding. It appears, based on review some of the examples, that this may not be the case. Obvioussly this schema could be more descriptive, but just shooting for mostly likely to be not wrong at this point. Date: 2020-12-15 14:44:37-06:00 Signed-off-by: meows <b5c6@protonmail.com> * cmd/lotus,go.mod,go.sum: maybe fix straggling merge resolution conflicts Date: 2021-01-19 12:30:42-06:00 Signed-off-by: meows <b5c6@protonmail.com> * build/openrpc/full.json.gz,build/openrpc/miner.json.gz,build/openrpc/worker.json.gz: run 'make docsgen' Date: 2021-01-19 12:33:55-06:00 Signed-off-by: meows <b5c6@protonmail.com> * api/apistruct,node/impl: (lint) gofmt Date: 2021-01-19 12:39:48-06:00 Signed-off-by: meows <b5c6@protonmail.com> * api/docgen: maybe fix parse error: open ./api: no such file or directory Date: 2021-01-19 12:52:04-06:00 Signed-off-by: meows <b5c6@protonmail.com> * api/docgen,build/openrpc: maybe fix no such file error and run 'make docsgen' Date: 2021-01-19 12:55:52-06:00 Signed-off-by: meows <b5c6@protonmail.com> * api/docgen: return if AST comment/groupdoc parsing encounters any error This will returns empty comments/docs maps. This should fix issues like: https://app.circleci.com/pipelines/github/filecoin-project/lotus/12445/workflows/4ebadce9-a298-4ad1-939b-f19ef4c0a5bf/jobs/107218 where the environment makes file lookups hard or impossible. Date: 2021-01-19 13:04:58-06:00 Signed-off-by: meows <b5c6@protonmail.com> * api: Don't depend on build/ * make: support parallel docsgen * openrpc gen: Use simple build version * methodgen * goimports Co-authored-by: meows <b5c6@protonmail.com>	2021-03-19 19:22:46 +01:00
Anton Evangelatov	ac576c75d4	amend restart config	2021-03-19 14:08:50 +02:00
Anton Evangelatov	86772a09c7	use new channelmonitor.Config	2021-03-19 13:53:03 +02:00
Anton Evangelatov	9d6c77d93f	remove interactive UX; add `inspect-deal` cmd	2021-03-18 14:53:03 +02:00
Aayush Rajasekaran	a54c6bfb05	Merge pull request #4653 from filecoin-project/4621-delete-wallet Aftering importing a previously deleted key, be able to delete it again.	2021-03-14 20:36:56 -04:00
Aayush Rajasekaran	c3d1534044	Merge pull request #5743 from filecoin-project/feat/keep-unsealed-by-default Default the AlwaysKeepUnsealedCopy flag to true	2021-03-14 15:47:07 -04:00
Łukasz Magiera	1aea1ebb9d	Merge pull request #5801 from filecoin-project/fix/fsm-input-stuck storagefsm: Trigger input processing when below limits	2021-03-12 19:02:15 +01:00
Łukasz Magiera	08472f4fac	batch deal input processing test	2021-03-12 15:41:46 +01:00
Łukasz Magiera	e5226412fb	builder: set modules.PaychAPI correctly	2021-03-12 11:27:00 +01:00
whyrusleeping	cbc7f1c244	fix paychmgr constructor to take an easier to implement interface	2021-03-12 00:39:20 -08:00
whyrusleeping	e0b650d4ec	make rpcstatemanager its own package, for easy reuse	2021-03-11 18:21:18 -08:00
whyrusleeping	bf42a3be5e	move DI stuff for paychmgr into modules	2021-03-11 17:35:31 -08:00
Łukasz Magiera	bd8864ae43	Merge pull request #5755 from filecoin-project/feat/kvlog Metadata datastore log	2021-03-10 14:13:01 +01:00
Łukasz Magiera	05274943c9	Merge pull request #5620 from filecoin-project/feat/disable-owner-worker-fallback miner: Config to disable owner/worker address fallback	2021-03-10 11:21:39 +01:00
Łukasz Magiera	d11f2def6e	Merge branch 'feat/max-deal-collateral-multiplier' into next	2021-03-10 11:13:15 +01:00
Łukasz Magiera	0a513952c8	better DisableWorkerFallback doc	2021-03-09 23:42:08 +01:00
Łukasz Magiera	d4a981f327	fix lint	2021-03-09 23:38:28 +01:00
Łukasz Magiera	ca7e70bf3a	Metadata datastore log	2021-03-09 22:33:01 +01:00
Łukasz Magiera	260ddacc47	Fix wallet import cycle, better trash key backup	2021-03-09 16:52:51 +01:00
jennijuju	49c44b70c2	Aftering importing a previously deleted key, be able to delete it again. Co-authored-by: Aayush Rajasekaran <arajasek94@gmail.com>	2021-03-09 16:43:01 +01:00
Łukasz Magiera	1c62d7a40f	Merge pull request #5729 from filecoin-project/feat/api-no-dep-build Feat/api no dep build	2021-03-09 16:01:53 +01:00
Łukasz Magiera	5388f3e6f8	Add connmgr metadata to NetPeerInfo	2021-03-09 00:22:48 +01:00
Łukasz Magiera	6591af960f	Merge pull request #4992 from filecoin-project/feat/splitstore hot/cold blockstore segregation (aka. splitstore)	2021-03-08 22:01:06 +01:00
Łukasz Magiera	305c2ec77d	miner: Config to disable owner/worker addcess fallback	2021-03-08 21:33:46 +01:00
Łukasz Magiera	b13046293f	Merge pull request #5735 from filecoin-project/feat/pubsub-ip-colocatio-whitelist Add configuration option for pubsub IPColocationWhitelist subnets	2021-03-08 21:01:39 +01:00
Dirk McCormick	a6c8b56ab6	feat: Default the AlwaysKeepUnsealedCopy flag to true	2021-03-08 16:35:46 +01:00
vyzo	64646de761	add configuration option for pubsub IPColocationWhitelist subnets	2021-03-06 20:05:32 +02:00
vyzo	4a74f752c0	implement extended peer info in net peers cli	2021-03-06 19:14:13 +02:00
whyrusleeping	e7a1d72ba8	extract build/version to api/version, remove api package dep on build	2021-03-05 14:28:13 -08:00
vyzo	6b8c60a659	don't ID wrap the hotstore	2021-03-05 14:46:18 +02:00
vyzo	dd0c308427	move Blockstore config to FullNode, rename to Chainstore and add default for HotStoreType	2021-03-05 14:46:18 +02:00
vyzo	6014273e69	storage miner doesn't need a splitstore	2021-03-05 14:46:18 +02:00
Raúl Kripalani	4b1e1f4b52	rename liveset => markset; rename snoop => tracking store; docs.	2021-03-05 14:46:18 +02:00
Raúl Kripalani	8cfba5b092	renames and polish.	2021-03-05 14:46:18 +02:00
Raúl Kripalani	b1b452bc0f	remove dependency from blockstore/splitstore => chain/store.	2021-03-05 14:46:18 +02:00
Raúl Kripalani	1a804fbdec	move splitstore into blockstore package.	2021-03-05 14:46:18 +02:00
Raúl Kripalani	1b51c10d78	split off lmdb support to a different branch.	2021-03-05 14:46:18 +02:00
vyzo	0fc2f3a26f	fix post-rebase compilation errors	2021-03-05 14:46:18 +02:00
vyzo	97abbe1eca	add (salted) bloom filter liveset	2021-03-05 14:46:17 +02:00
vyzo	73259aa350	add configuration for splitstore and default to a simple compaction algorithm	2021-03-05 14:46:17 +02:00
vyzo	b83994797a	separate LMDB options for hotstore and tracking stores	2021-03-05 14:46:17 +02:00
vyzo	68b6f913c7	propagate useLMDB option to splitstore through DI	2021-03-05 14:46:17 +02:00
vyzo	99c7d8e3eb	more informative names for the hotstore directories	2021-03-05 14:46:17 +02:00
vyzo	a586d42c3b	make hot store DI injectable in the split store, default to badger.	2021-03-05 14:46:17 +02:00
vyzo	622b4f7d9d	hook splitstore into DI	2021-03-05 14:46:17 +02:00
Łukasz Magiera	448813d2fe	Merge pull request #5695 from filecoin-project/feat/segregate-blockstores segregate chain and state blockstores	2021-03-03 10:53:46 +01:00
Dirk McCormick	ced455bba9	feat: add configurable max provider collateral	2021-03-02 10:24:57 +01:00
Łukasz Magiera	8bd5173a54	Merge branch 'next' into refactor/lib/blockstore	2021-03-01 19:04:40 +01:00
Łukasz Magiera	3f5b17dcfc	Merge pull request #5694 from filecoin-project/asr/nits Correct some logs	2021-03-01 18:22:40 +01:00
Raúl Kripalani	3795cc2bd2	segregate chain and state blockstores. This paves the way for better object lifetime management. Concretely, it makes it possible to: - have different stores backing chain and state data. - having the same datastore library, but using different parameters. - attach different caching layers/policies to each class of data, e.g. sizing caches differently. - specifying different retention policies for chain and state data. This separation is important because: - access patterns/frequency of chain and state data are different. - state is derivable from chain, so one could never expunge the chain store, and only retain state objects reachable from the last finality in the state store.	2021-02-28 22:49:44 +00:00
Raúl Kripalani	9f0c68bb70	fix unused import post-merge.	2021-02-28 19:57:37 +00:00
Raúl Kripalani	7f0f7d0b36	Merge branch 'master' into refactor/lib/blockstore	2021-02-28 19:55:23 +00:00
Aayush Rajasekaran	48bce386cd	Correct some logs	2021-02-28 01:18:29 -05:00
Łukasz Magiera	29c9fa3137	Merge pull request #5612 from filecoin-project/feat/cc-fsm-cleanup storagefsm: Cleanup CC sector creation	2021-02-26 11:39:28 +01:00
Łukasz Magiera	e49a412f6d	Merge pull request #5375 from filecoin-project/feat/refactor-fsm-input storagefsm: Rewrite input handling	2021-02-25 14:28:04 +01:00
Łukasz Magiera	26399dba70	Update markets, cbor-gen with soft map decoding	2021-02-19 20:11:43 +01:00
Łukasz Magiera	90b8612cf4	Merge remote-tracking branch 'origin/master' into feat/refactor-fsm-input	2021-02-16 22:39:06 +01:00
Łukasz Magiera	39ad3d3b27	Check format in client commP util	2021-02-16 20:48:31 +01:00
Łukasz Magiera	fd90c03018	Roturn SectorID from PledgeSector	2021-02-16 19:16:35 +01:00
Łukasz Magiera	f719765069	storageminer: exit PledgeSector after sectors enter sealing pipeline	2021-02-16 17:41:58 +01:00
Łukasz Magiera	46b880a6b9	storageminer: Skip uninitialized sectors in SectorsList	2021-02-16 17:34:06 +01:00
Łukasz Magiera	fc5e243c92	storagefsm: Cleanup CC sector creation	2021-02-16 17:14:59 +01:00
Łukasz Magiera	dd82729f60	Merge remote-tracking branch 'origin/master' into feat/refactor-fsm-input	2021-02-16 13:45:39 +01:00
Dirk McCormick	a6e3856776	Revert "feat: deals - show data transfer %" This reverts commit `b6c9ddccff`.	2021-02-16 12:32:45 +01:00
Łukasz Magiera	7111e924cc	Merge remote-tracking branch 'origin/master' into feat/refactor-fsm-input	2021-02-11 13:30:22 +01:00
Łukasz Magiera	95e47cf998	Merge pull request #5553 from filecoin-project/feat/data-xfer-percent show data transfer % for storage deals	2021-02-11 13:29:43 +01:00
Łukasz Magiera	0c6aef221d	Fix error logging format strings	2021-02-11 12:00:26 +01:00
Dirk McCormick	b6c9ddccff	feat: deals - show data transfer %	2021-02-10 09:56:23 +01:00
whyrusleeping	e387f3810e	add code cid to stateReadState output	2021-02-09 14:18:19 -08:00
Łukasz Magiera	e92b8b24b1	Merge remote-tracking branch 'origin/master' into feat/refactor-fsm-input	2021-02-09 14:04:21 +01:00
Łukasz Magiera	adeb4cefee	node builder: Cleanup and add some docstrings	2021-02-09 13:52:03 +01:00
Łukasz Magiera	6de62411c6	Merge pull request #5538 from filecoin-project/feat/deal-publisher-force add commands to list pending deals and force publish	2021-02-05 23:00:52 +01:00
Łukasz Magiera	b3f4e50c58	market: APIs to manage pending deals	2021-02-05 18:58:55 +01:00
Łukasz Magiera	2c772d6fda	skip TestDealMining in short mode	2021-02-05 13:18:41 +01:00
Łukasz Magiera	8f603717a6	Merge remote-tracking branch 'origin/master' into steb/refactor-consistent-tipset-methods	2021-02-05 13:08:49 +01:00
whyrusleeping	0efb4ca3a7	add an api endpoint to get pending transactions for multisigs	2021-02-03 20:46:10 -08:00
Łukasz Magiera	ba571794dc	Merge pull request #5309 from filecoin-project/feat/deal-batch-publish batch publish deal messages	2021-02-04 01:19:56 +01:00
Łukasz Magiera	6e7fcb7ee6	Merge remote-tracking branch 'origin/master' into feat/refactor-fsm-input	2021-02-03 14:01:56 +01:00
Łukasz Magiera	9b65793509	Merge pull request #5404 from filecoin-project/feat/test-window-post Retry proofs if we generate an incorrect one	2021-02-03 13:04:33 +01:00
Łukasz Magiera	1e7a107484	Merge pull request #5433 from filecoin-project/feat/keep-unsealed-cfg Add miner config to always keep ensealed deal copies	2021-02-03 12:40:02 +01:00
Łukasz Magiera	332ea8a126	Merge remote-tracking branch 'origin/master' into feat/deal-batch-publish	2021-02-02 18:21:14 +01:00
Dirk McCormick	a19d6ce8a3	fix: zero price-per-byte retrieval	2021-02-01 16:55:18 +01:00
Dirk McCormick	987f41011a	refactor: move publish msg config inside deals config	2021-02-01 10:23:05 +01:00
Steven Allen	feb24c9684	choose the correct nonce Co-authored-by: Łukasz Magiera <magik6k@users.noreply.github.com>	2021-01-30 10:18:51 -08:00
Łukasz Magiera	56a9d05491	Merge remote-tracking branch 'origin/master' into steb/refactor-consistent-tipset-methods	2021-01-30 12:05:21 +01:00
Raúl Kripalani	d1104fec4c	rename blockstores for consistency.	2021-01-29 23:17:25 +00:00
Raúl Kripalani	af429dba0f	Merge branch 'master' into chore/snake_context_through_blockstore_init	2021-01-29 21:21:46 +00:00
Raúl Kripalani	b0cbc932bd	consolidate all blockstores in blockstore package.	2021-01-29 20:01:00 +00:00
Steven Allen	8d3cc632ac	add support for running pre-migrations and caching their results This can significantly speedup state migrations.	2021-01-27 12:55:53 -08:00
Łukasz Magiera	d4c7b63aac	Add miner config to always keep ensealed deal copies	2021-01-26 17:50:31 +01:00
Raúl Kripalani	a1da1dab85	add context to LockedRepo#Datastore().	2021-01-26 11:01:43 +00:00
Łukasz Magiera	fabcbb621d	Merge remote-tracking branch 'origin/master' into next	2021-01-26 00:47:22 +01:00
Łukasz Magiera	422f0991e9	Merge pull request #5379 from filecoin-project/asr/disputer Build a WindowPoSt disputer	2021-01-26 00:46:26 +01:00
Aayush Rajasekaran	29d3d746a3	Build a WindowPoSt disputer	2021-01-25 17:26:09 -05:00
Raúl Kripalani	ce3af308ed	Merge branch 'master' into chore/snake_context_through_blockstore_init	2021-01-25 19:31:41 +00:00
Dirk McCormick	adac340f3f	feat: batch publish deal messages	2021-01-25 14:25:57 +01:00
Steven Allen	0a294f146f	ensure we can't dispute a correct window post	2021-01-22 14:30:54 -08:00
Steven Allen	8de4e5e005	retry proofs if we generate an incorrect one	2021-01-22 13:31:47 -08:00
Steven Allen	0131b077be	re-enable watchdog	2021-01-22 11:19:37 -08:00
Jakub Sztandera	8c7fda4441	fix(gas): when estimating GasLimit only apply priors up to the nonce The bug is applying all messages from given From address are priors before appling the message that we are estimating. If user tries replacing message in the middle with gas limit estimation then message sequence is off and user will either get an execution error or gas mis-esimation. Resolves #5402 Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>	2021-01-22 18:50:02 +01:00
Steven Allen	1b67eed82c	make the dispute test run by itself It's kind of slow.	2021-01-21 20:16:03 -08:00
Steven Allen	0ba1306969	test prove then dispute	2021-01-21 19:48:34 -08:00
Steven Allen	d412ccdb3f	disable the watchdog It's causing the tests to flake.	2021-01-21 18:28:37 -08:00
Steven Allen	026d236252	more reliably close in tests	2021-01-21 15:21:20 -08:00
Steven Allen	03cd3760bb	correctly pick the seal type based on the network version Of course, we should really just run all of our tests post actors v2.	2021-01-21 15:21:20 -08:00
Aayush Rajasekaran	ab90a3b2bc	Actors update: MinerInfo.SealProofType has been removed	2021-01-21 15:21:19 -08:00
Aayush Rajasekaran	82635f2515	Rename Deadline.PoStSubmissions to PartitionsPoSted	2021-01-21 15:21:19 -08:00
Łukasz Magiera	1070ad2289	storagefsm: Drop unused TargetWaitDealsSectors	2021-01-21 22:20:16 +01:00
Łukasz Magiera	542357a1df	storagefsm: Start packing correctly	2021-01-21 17:40:50 +01:00
Łukasz Magiera	239d6f8f4d	storagefsm: Rewrite input handling	2021-01-21 17:40:50 +01:00
Raúl Kripalani	b9adf95010	watchdog: increase heapprof capture threshold to 90%.	2021-01-21 14:06:18 +00:00
Raúl Kripalani	931cfe1ed1	upgrade to raulk/go-watchdog@v1.0.1 This pulls in the improvements introduced in: - https://github.com/raulk/go-watchdog/releases/tag/v1.0.0 - https://github.com/raulk/go-watchdog/releases/tag/v1.0.1 Lotus tries to initialize the watchdog in the following order of precedence: 1. If a max heap limit has been provided, initialize a heap-driven watchdog. 2. Else, try to initialize a cgroup-driven watchdog. 3. Else, try to initialize a system-driven watchdog. 4. Else, log a warning that the system is flying solo, and return. This PR also enabled automatic heap profile capture when memory usage surpasses 90% of the limit. Profiles are written to <LOTUS_HOME>/heapprof. A single heap profile is captured per episode, with a max of 10 episodes captured during the lifetime of the process. Episode = instance of usage climbing above the 90% threshold.	2021-01-20 18:09:19 +00:00
Łukasz Magiera	7a042ab21f	Merge pull request #5210 from filecoin-project/feat/mkts-miner-dont-dial-client Miner should not dial client on restart	2021-01-20 13:37:09 +01:00
Dirk McCormick	1206154718	feat: update to go-fil-markets v1.1.0 for better retry config	2021-01-20 10:00:02 +01:00
Łukasz Magiera	0a85dc6232	Merge pull request #5369 from filecoin-project/feat/gas-premium-55 Use 55th percentile instead of median for gas-price	2021-01-19 19:10:47 +01:00
Dirk McCormick	827a473391	feat: expose StateSearchMessage on gateway	2021-01-19 11:27:43 +01:00
Jakub Sztandera	eeadfedbe6	Use 55th percentile instead of median for gas-price The aim is to put some negative pressure on gas-premium instead of maintining status quo. 55th percentile instead of median should not make much difference for block inclusion timing. Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>	2021-01-18 15:44:20 +01:00
Dirk McCormick	835fd4b23c	feat: markets - miner should not dial client on restart	2021-01-14 16:38:56 +01:00
Łukasz Magiera	144b5a1350	perning termination API	2021-01-14 12:37:23 +01:00
Łukasz Magiera	1564db1fce	Sector termination test	2021-01-14 00:11:41 +01:00
Łukasz Magiera	3522c8d45a	SectorTerminateFlush API	2021-01-13 23:32:04 +01:00
Łukasz Magiera	52cc2cd3eb	Initial sector termination support	2021-01-13 00:42:01 +01:00
Peter Rabbitson	47141042b6	Add comment Co-authored-by: raulk <raul@protocol.ai>	2021-01-12 18:11:18 +01:00
Dirk McCormick	c58086ee27	feat: better CLI for wallet market withdraw and client info	2021-01-07 10:18:29 +01:00
Dirk McCormick	c6820ec059	feat: lotus wallet market add (adds funds to storage market actor)	2021-01-06 14:32:46 +01:00
Peter Rabbitson	9334e73396	Snake a context through the Chain-blockstore creation	2021-01-04 15:27:52 +01:00
Łukasz Magiera	2e154ef6d0	Merge pull request #5176 from filecoin-project/shaodan-miner-sectors-info Shaodan miner sectors info	2020-12-10 20:09:15 +01:00
Łukasz Magiera	0cb2f51549	Merge pull request #5094 from filecoin-project/asr/verified-only Allow miners to filter (un)verified deals	2020-12-10 19:48:22 +01:00
Łukasz Magiera	564b88af52	docsgen, lint	2020-12-10 19:36:02 +01:00
Łukasz Magiera	d347e7ab8f	Merge branch 'miner-sectors-info' of github.com:shaodan/lotus into shaodan-miner-sectors-info	2020-12-10 19:32:26 +01:00
Steven Allen	e164dbb953	Compute the next nonce from the tipset, instead of actually executing the tipset We could also do this in the message pool itself, but I'm not sure if it's worth it?	2020-12-09 11:29:41 -08:00
Steven Allen	b8e3808c4f	Make state tipset usage consistent in the API _Always_ (almost) use the tipset's parent state, instead of computing. Exceptions: * MinerGetBaseInfo. Fixing this would break things so we need to be careful (although we could bump the API version, fix it, then fix the call sites). * StateReplay. This is replaying a message on top of the given tipset. * GasEstimateGasLimit. This executes the message on-top-of the tipset's computed state (unlike call which executes it on the tipset's parent state). * Having this method and Call apply the message at different heights is really weird.	2020-12-09 11:29:40 -08:00
Łukasz Magiera	2ce5a29004	Merge pull request #5150 from filecoin-project/feat/list-deals-xfer-id show data transfer ID in list-deals	2020-12-09 19:39:46 +01:00
Jakub Sztandera	6ca5caef31	Refactor DefaultMessageSendSpec Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>	2020-12-08 20:51:27 +01:00
Dirk McCormick	72cb130e17	feat: show data transfer ID in list-deals	2020-12-08 15:23:26 +01:00
Dan Shao	d56170d70e	Optimize sectors info loading	2020-12-07 13:42:37 +08:00
Ingar Shu	13c8a235b6	Use FundManager to withdraw funds, add MarketWithdraw to API	2020-12-03 13:08:18 -08:00
Łukasz Magiera	dc06d30f52	Merge pull request #5101 from filecoin-project/raulk/memory-watchdog introduce memory watchdog; LOTUS_MAX_HEAP	2020-12-03 15:46:09 +01:00
Raúl Kripalani	f9cbf6d526	watchdog: add LOTUS_DISABLE_WATCHDOG escape hatch.	2020-12-03 13:16:10 +00:00
Raúl Kripalani	d033f8aab1	watchdog: remove silence period, reduce tick interval to 5 secs.	2020-12-02 22:31:57 +00:00
Raúl Kripalani	e34a759889	avoid global ResourceConstraints.	2020-12-02 22:26:30 +00:00
Raúl Kripalani	2ef8acdfc8	back out index cache usage in badger blockstore.	2020-12-02 21:35:13 +00:00
Łukasz Magiera	c3a0feef96	miner: Improve default address config	2020-12-02 21:54:38 +01:00
Łukasz Magiera	2fd93a55ac	plumb AddressSelector to stoage fsm	2020-12-02 21:47:54 +01:00
Łukasz Magiera	783971d2c8	docsgen, gofmt	2020-12-02 20:46:40 +01:00
Łukasz Magiera	f74a1b70ab	miner: Fix actor control list cli	2020-12-02 20:46:07 +01:00
Łukasz Magiera	7246ef273f	miner: Control address config for (pre)commits	2020-12-02 19:58:00 +01:00
Raúl Kripalani	e8a5e0d2fe	integrate memory watchdog; impose limits on badger caches.	2020-12-02 16:40:28 +00:00
Raúl Kripalani	655aea1018	Merge branch 'master' into raulk/badger-index-cache	2020-12-02 11:46:57 +00:00
Aayush Rajasekaran	370817eb60	Allow miners to filter (un)verified deals	2020-12-02 01:32:34 -05:00
Łukasz Magiera	95eaf13b5a	sectorstorage: Fix tests	2020-12-02 00:36:32 +01:00
Łukasz Magiera	c6f85886bf	miner: Add slow mode to proving check	2020-12-02 00:32:14 +01:00
Łukasz Magiera	82b5cb89cd	Merge pull request #5061 from filecoin-project/fix/err-late-deals Error out deals that are not activated by proposed deal start epoch	2020-12-01 17:02:06 +01:00
Łukasz Magiera	614f45dcfb	Merge pull request #5041 from filecoin-project/feat/5013 Sector check command	2020-12-01 14:59:01 +01:00
Dirk McCormick	cb044f83a7	fix: ensure deal start is far enough in future for tests	2020-12-01 14:25:48 +01:00
Jakub Sztandera	65d50c76d6	bonus: fix WalletSign using t0 addresses in WalletSignMessage Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>	2020-11-27 17:19:41 +01:00
Łukasz Magiera	fcec665267	Merge remote-tracking branch 'origin/master' into feat/deal-await-precommit	2020-11-26 11:51:36 +01:00
s1m0n21	663b3f4f21	add a sector check command	2020-11-26 15:02:43 +08:00
Łukasz Magiera	2e544e3e6a	configure SimultaneousTransfers in node/builder	2020-11-25 19:57:38 +01:00
hannahhoward	694834e8d5	feat(graphsync): configure simultaneous requests allow configuration of the number of simultaneous requests graphsync will process at once	2020-11-24 14:32:30 -08:00
Dirk McCormick	239e180683	feat: markets - separate watching for pre-commit from prove-commit	2020-11-24 13:24:41 -08:00
hannahhoward	afec58f780	feat(markets): add logging on data-transfer to miner	2020-11-23 12:43:30 -08:00
Łukasz Magiera	be2a5942fb	Merge pull request #4082 from leviok/fix-nil-pointer fix nil pointer in StateSectorPreCommitInfo	2020-11-23 18:58:32 +01:00
Łukasz Magiera	0e39e760e5	Merge pull request #4929 from filecoin-project/feat/update-markets-commp-extraction Remove all temp file generation for deals	2020-11-23 18:43:00 +01:00
Łukasz Magiera	7d540905ac	Don't return nil in StateSectorPreCommitInfo	2020-11-23 12:14:49 +01:00
Dirk McCormick	4a8df0c3fa	feat: add data transfer logging	2020-11-23 10:31:39 +01:00
leviok	9fe3649dd2	correct it	2020-11-23 11:08:21 +08:00
leviok	9b199f0476	fix nil pointer	2020-11-23 11:08:21 +08:00
hannahhoward	218f7c2c5d	feat(markets): update markets, extract commp	2020-11-20 13:29:14 -08:00
Łukasz Magiera	4483d94db3	Merge pull request #4902 from GFZRZK/GFZRZK/patch/remove_unuseful_code_in_newstorageask just return storedask.NewStoredAsk to reduce unuseful code	2020-11-20 16:28:03 +01:00
Łukasz Magiera	94763c2aaa	Merge pull request #4849 from filecoin-project/feat/conngater Connection Gater support	2020-11-20 16:25:02 +01:00
Raúl Kripalani	44040f0f3f	badger options: enable IndexCache and CompactL0OnClose.	2020-11-20 00:33:43 +00:00
Raúl Kripalani	55061ae6fb	fix blockstore directory not created automatically.	2020-11-19 15:55:02 +00:00
wangchao	49f8590578	just return storedask.NewStoredAsk to reduce unuseful code	2020-11-18 13:53:48 +08:00
Aayush Rajasekaran	68a16afeda	Merge branch 'master' into release/v1.2.0	2020-11-17 19:40:05 -05:00
Łukasz Magiera	50146fb9b9	Merge pull request #4872 from filecoin-project/raulk/fix-blockstore-import fix badger double open on daemon --import-snapshot; chainstore lifecycle	2020-11-18 01:36:16 +01:00
Łukasz Magiera	3536ec9f85	Merge pull request #4879 from filecoin-project/fix/4833 Fix MaxSealingSectrosForDeals getting reset to 0	2020-11-17 23:41:22 +01:00
hannahhoward	a2abeef727	feat(markets): upgrade to fix cid recording issue	2020-11-16 17:57:57 -08:00
Łukasz Magiera	dd9682f2be	Fix MaxSealingSectrosForDeals getting reset to 0	2020-11-17 00:28:49 +01:00
Raúl Kripalani	0c6072a1a0	chainstore lifecycle: close via Close() instead of context.	2020-11-16 22:28:59 +00:00
Steven Allen	bead8ac38e	use the miner's proof type when proposing storage deals	2020-11-16 19:04:17 +01:00
Steven Allen	638900f97f	Remove static proof type configuration from market subsystem Instead, use proof type from miner actor. This will, in turn, use the upgraded proof type if/when it's switched at runtime. TODO: Consider making this some form of config option instead?	2020-11-16 19:04:17 +01:00
Steven Allen	d8afd71f4c	add a test to demonstrate SDR upgrade while committing sectors	2020-11-16 19:04:17 +01:00
Steven Allen	869867e92e	fix compile	2020-11-16 19:04:17 +01:00
Steven Allen	508375a55c	Upgrade seal proof version in miner info after the upgrade. This is terrible, but we don't (currently) update this in the miner info. Q: Maybe we should delay this by a few epochs? Some pre-commits could fail if we get a reorg.	2020-11-16 19:04:17 +01:00
Łukasz Magiera	915c5e0fdd	Get most tests to pass	2020-11-16 19:03:30 +01:00
Steven Allen	931979809f	get lotus building	2020-11-16 19:03:30 +01:00
Steven Allen	219c695967	fix storage adapter miner	2020-11-16 19:03:30 +01:00
Łukasz Magiera	6bea9dd178	Making sealing logic work with multiple seal proof types	2020-11-16 19:03:30 +01:00
Raúl Kripalani	d7b4f92f1f	add context to ChainStore.	2020-11-16 15:52:19 +00:00
Łukasz Magiera	49d3bb9497	Merge pull request #4851 from filecoin-project/fix/daemon-test-mode-restart Truncate genesis file before generating	2020-11-16 16:13:33 +01:00
Jakub Sztandera	afe6c51016	Merge pull request #4813 from filecoin-project/chore/blockstore_nits Chore/blockstore nits	2020-11-15 19:52:10 +01:00
Aayush Rajasekaran	1af1ceb1e0	Merge pull request #3646 from filecoin-project/feat/delayed-pubsub-subscribe delayed pubsub subscribe for messages topic	2020-11-13 17:44:32 -05:00
vyzo	91e2530e11	remove dtypes dependency from api; move NetBlockList type to api/types.go	2020-11-13 21:11:17 +02:00
Dirk McCormick	f9fc601567	fix: truncate genesis file before generating	2020-11-13 17:30:12 +01:00
vyzo	4b187b85eb	close existing connections that match the filters when adding rules to the connection gater	2020-11-13 14:38:13 +02:00
vyzo	b71f069854	implement connection gater API	2020-11-13 13:59:38 +02:00
vyzo	5a0b9f4197	connectiong gater API scaffolding	2020-11-13 12:17:48 +02:00
vyzo	4b1d1b6540	connection gater for libp2p host	2020-11-13 11:44:29 +02:00
Łukasz Magiera	99031bae17	Merge pull request #4709 from filecoin-project/feat/mute-logs Make some logs quieter	2020-11-12 20:40:10 +01:00
Dirk McCormick	26e12e6f6a	fix: dont crash on startup if funds migration fails	2020-11-12 17:15:05 +01:00
Peter Rabbitson	29817b6617	Remove all Chain GC wrappings/types There is no practical way to do GC against the chainstore given the current state of affairs: remove all GC-related types for the time being.	2020-11-12 06:49:53 +01:00
Peter Rabbitson	7be7a9b5e3	Stop referring to github.com/ipfs/go-ipfs-blockstore outside of lib	2020-11-12 06:01:35 +01:00
Łukasz Magiera	09f9f871a3	Create a command to abort sealing calls	2020-11-11 17:39:12 +01:00
hannahhoward	9f7204ee26	feat(builder): finish new FundManager setup Finish setup of new FundManager and provide a migration for previously reserved funds	2020-11-10 21:11:05 -08:00
Dirk McCormick	0d243bb824	refactor: integrate new FundManager	2020-11-10 21:11:05 -08:00
Aayush Rajasekaran	735c04f999	Merge pull request #4681 from filecoin-project/badger-viewable move to native badger blockstore; leverage zero-copy View() to deserialize in-place	2020-11-10 18:08:12 -05:00
vyzo	185653f85a	improve coalescing	2020-11-09 13:35:42 +02:00
vyzo	6660f81363	minimize coalesce delay for tests	2020-11-06 22:26:47 +02:00
Jakub Sztandera	5a34e5b2bf	Merge pull request #4599 from filecoin-project/feat/sync-manager-redux rewrite sync manager	2020-11-06 21:01:26 +01:00
Raúl Kripalani	3577300aee	Merge branch 'master' into badger-viewable	2020-11-06 19:34:25 +00:00
Raúl Kripalani	0b2a02c8ea	remove redundant import.	2020-11-06 18:57:04 +00:00
Raúl Kripalani	85e37e4b70	make the value log loading mode mmap, to leverage zero-copy access.	2020-11-06 18:39:08 +00:00
Łukasz Magiera	426c2e8c2b	Merge pull request #4717 from filecoin-project/feat/optional-chain-bitswap Optional chain Bitswap	2020-11-06 16:49:39 +01:00
Jakub Sztandera	94438bf3cd	Use TSK passed to GasEstimateGasLimit Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>	2020-11-05 21:14:38 +01:00
vyzo	dab20efc99	add env var controlling msgs sync epochs	2020-11-05 18:09:04 +02:00
vyzo	0e40a04975	nicer check using Time objects	2020-11-05 18:08:52 +02:00
vyzo	c6cd699f0d	fix nearsync check	2020-11-05 18:08:35 +02:00
vyzo	3306bdec29	fix tests	2020-11-05 18:08:13 +02:00
vyzo	32b7797394	only subscribe to messages topic if we are synced within 10 epochs	2020-11-05 18:08:13 +02:00
Łukasz Magiera	a1e1b03ca4	Optionally allow bitswap for chainstore	2020-11-03 23:44:44 +01:00
Raúl Kripalani	809111336a	Merge branch 'master' into badger-viewable	2020-11-03 18:29:10 +00:00
Łukasz Magiera	9270ac6358	Make some logs quieter	2020-11-03 13:28:41 +01:00
Raúl Kripalani	656ece06e5	fix metrics wiring. Some components like go-ds-measure, go-ipfs-blockstore and go-bitswap expose metrics via ipfs/go-metrics-interface, but Lotus never injects the Prometheus exporter (ipfs/go-metrics-prometheus). Therefore, those metrics never surface in instrumentation. Instead, Lotus uses OpenCensus directly. This commit injects the Prometheus exporter for go-metrics-interface, and instructs the OpenCensus Prometheus exporter to use the DefaultRegistry. This has the effect of exposing blending the metrics of both metrics libraries. With this patch, the datastore, cache utilisation, and bitswap metrics are now exported via the /debug/metrics endpoint. This commit also fixes an issue where the metrics scope was empty, making go-metrics-interface default to "<no-scope>". Angle brackets are inadmissible characters for Prometheus, so it was refusing to export the affected metrics. (These were the ARC cache metrics.)	2020-11-02 17:56:49 +00:00
Raúl Kripalani	0b8a21ee16	badger: restore prev. max table size (64MiB; default).	2020-11-01 17:26:37 +00:00
Raúl Kripalani	72e573d98d	fix lint.	2020-11-01 17:09:14 +00:00
Raúl Kripalani	5a98660d1b	make repo.Blockstore() idempotent; wrap in IDStore.	2020-11-01 16:56:20 +00:00
Raúl Kripalani	d8d85373f5	fix lotus-shed datastore commands.	2020-11-01 13:50:41 +00:00
Raúl Kripalani	a16d7f221e	Merge branch 'master' into badger-viewable	2020-11-01 13:10:56 +00:00
Raúl Kripalani	d2e2322fd2	make the lotus node use the new native badger blockstore.	2020-11-01 13:01:26 +00:00
Łukasz Magiera	a5c05f87f1	Merge pull request #4105 from filecoin-project/asr/decode-params Add a StateDecodeParams method	2020-10-31 01:05:50 +01:00
Jakub Sztandera	22742a9ba0	bootstrap: don't return early when one drand resolution fails Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>	2020-10-30 21:58:17 +01:00
Łukasz Magiera	3b16faddad	Merge pull request #4652 from filecoin-project/feat/default-max-fee-cfg Config for default max gas fee	2020-10-30 21:35:10 +01:00
Łukasz Magiera	6cdbf5216e	Merge pull request #4629 from filecoin-project/fix/badger-lsm-trsh Reduce badger ValueTreshold to 128	2020-10-30 21:10:18 +01:00
Łukasz Magiera	7fbb868513	Debug flag to force running sealing scheduler	2020-10-30 11:07:35 +01:00
Aayush Rajasekaran	5ff42505e8	Add a StateDecodeParams method	2020-10-29 22:04:33 -04:00
Łukasz Magiera	c3d00b0ac6	Merge pull request #4650 from jsign/jsign/offlinemode make IPFS online mode configurable	2020-10-29 22:24:58 +01:00
Łukasz Magiera	ae7889f830	Config for default max gas fee	2020-10-29 20:50:11 +01:00
Ignacio Hagopian	7d0f279353	make IPFS online mode configurable Signed-off-by: Ignacio Hagopian <jsign.uy@gmail.com>	2020-10-29 15:16:45 -03:00
vyzo	8d25fd39cf	set BootstrapPeerThreshold to 1 for tests	2020-10-29 19:32:09 +02:00
Jakub Sztandera	0297be4b9a	Add `lotus-shed datastore rewrite` command Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>	2020-10-28 23:24:45 +01:00
Jakub Sztandera	ecc1d94b3a	Reduce badger ValueTreshold to 128 It should significntly size of the LSM index, and thus increase the performance with bigger datastores Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>	2020-10-28 22:17:01 +01:00
Jakub Sztandera	ad905fc310	Expose WorkerID Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>	2020-10-28 20:22:07 +01:00
Łukasz Magiera	413643a712	Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers	2020-10-27 16:56:29 +01:00
Łukasz Magiera	8c60069bb8	Merge pull request #4535 from filecoin-project/feat/clientdeal-cache-commd client deal: Cache CommD when creating multiple deals	2020-10-27 03:58:25 +01:00
Łukasz Magiera	e1da874258	Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers	2020-10-27 03:31:07 +01:00
Steven Allen	0d06f8fa2b	Add commands to change the worker key	2020-10-26 18:16:24 -07:00
Łukasz Magiera	31a474a1ca	Move CommPWriter to lib/	2020-10-26 15:16:28 +01:00
Łukasz Magiera	a37c372d06	Merge pull request #4572 from filecoin-project/feat/data-transfer-utils Flesh out data transfer features	2020-10-26 13:29:26 +01:00
Łukasz Magiera	660236b224	Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers	2020-10-23 23:25:35 +02:00
Łukasz Magiera	de2cbfa8a9	client deal: Cache CommD when creating multiple deals	2020-10-23 22:20:17 +02:00
Łukasz Magiera	36816fb4f3	Fix list-asks, deals with non-genesis miners in lite-mode	2020-10-23 17:08:21 +02:00
Dirk McCormick	906286fdbe	feat: lite-mode - CLI tests for `lotus client` commands	2020-10-23 15:02:49 +02:00
Dirk McCormick	92942d44d1	feat: lite-mode - market storage and retrieval clients	2020-10-23 15:02:26 +02:00
hannahhoward	98297cef4d	feat(data-transfer): fill in utils	2020-10-22 13:40:26 -07:00
Łukasz Magiera	041762a34f	Merge pull request #4383 from filecoin-project/steb/actor-v2-imports Remove most v0 actor imports	2020-10-22 17:17:56 +02:00
Łukasz Magiera	618fed75fe	Merge branch 'hunjixin/feat/batchmsg' of github.com:hunjixin/lotus into hunjixin-hunjixin/feat/batchmsg	2020-10-22 14:45:33 +02:00
Łukasz Magiera	7c16f2182c	Merge branch 'animesh2049/status-api' of github.com:animesh2049/lotus into animesh2049-animesh2049/status-api	2020-10-22 14:14:50 +02:00
Steven Allen	0c2ec04c09	use upgrade schedule from node when getting the network name It doesn't matter now, but may in the future.	2020-10-21 12:18:38 -07:00
Steven Allen	bcabe7b3b5	migrate methods to abstracted methods Method numbers never change anyways. At worst, we'll deprecate old methods and have to explicitly import them from the correct actors version to use them.	2020-10-21 12:18:37 -07:00
Steven Allen	4e730b5ec8	port to v2 imports	2020-10-21 12:16:23 -07:00
Łukasz Magiera	06c0444d45	Merge pull request #4480 from filecoin-project/fix/max-piece-size-reverting-to-default Don't overwrite previously-configured maxPieceSize for a persisted ask	2020-10-19 22:55:55 +02:00
Ingar Shu	1974490ab0	Don't overwrite previously-configured maxPieceSize for a persisted ask	2020-10-19 13:12:28 -07:00
Aayush Rajasekaran	d24d3e420d	Fix StateReplay to use provided tipset	2020-10-19 14:27:04 -04:00
Łukasz Magiera	8d06cca073	sched: Handle workers using sessions instead of connections	2020-10-18 12:36:06 +02:00
Łukasz Magiera	7ac5dc55d0	Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers	2020-10-17 13:45:11 +02:00
Łukasz Magiera	68be28ca6d	Add Session API	2020-10-17 12:53:42 +02:00
Łukasz Magiera	4a057d84b8	Merge pull request #4422 from filecoin-project/fix/message-list fix message list api	2020-10-16 20:52:34 +02:00
Łukasz Magiera	111942b50b	Merge pull request #4424 from filecoin-project/feat/retrieval-cli-deal-filter Custom filters for retrieval deals	2020-10-16 18:41:40 +02:00
Ingar Shu	d0e4150cea	Use separate config for Retrieval Filter	2020-10-16 08:30:55 -07:00
Aayush Rajasekaran	2fd4a97698	Remove StateTransplant, modify StateReplay	2020-10-15 22:54:29 -04:00
Aayush Rajasekaran	6f86b95f62	Remove StateMsgGasCost	2020-10-15 21:03:02 -04:00
Aayush Rajasekaran	99c07703f8	Add a new StateReplay CLI/API endpoint	2020-10-15 19:47:02 -04:00
Aayush Rajasekaran	7826cc0bab	Rename StateReplay to StateTransplant	2020-10-15 19:14:53 -04:00
Aayush Rajasekaran	cb801d47c7	Add GasCost to InvocResult	2020-10-15 18:48:51 -04:00
Ingar Shu	0b7dc6971d	Rebasing	2020-10-15 09:33:01 -07:00
whyrusleeping	a931ff94e9	fix message list api	2020-10-15 08:54:36 -07:00
Łukasz Magiera	c56ef260d5	Merge pull request #4421 from filecoin-project/fix/lite-msig-inspect Ensure msig inspect cli works with lotus-lite	2020-10-15 15:11:34 +02:00
Dirk McCormick	9c99171cb8	fix: ensure msig inspect cli works with lotus-lite	2020-10-15 12:15:21 +02:00
hannahhoward	b29e3b5242	feat(markets): use build.BlockDelaySecs for start buffer instead of constant from spec-actors which uses hardcoded start epoch, use one that factors in possibility of different block time	2020-10-14 21:28:36 -07:00
Łukasz Magiera	52800f5dca	Merge pull request #4222 from filecoin-project/feat/increase-inclusion-premium Change default gas premium to for 10 block inclusion	2020-10-15 02:57:12 +02:00
Jakub Sztandera	df6f4a572c	Change default gas premium to for 6 block inclusion Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>	2020-10-15 02:53:40 +02:00
Łukasz Magiera	698b49b7ef	Improve gas defaults	2020-10-15 02:46:47 +02:00
Steven Allen	ddade32bd3	write bitswap blocks into a temporary, in-memory block cache If they end up validating, we'll write them back to the underlying blockstore. Otherwise, there's no reason to keep them.	2020-10-14 14:43:58 -07:00
Łukasz Magiera	465703b618	Merge pull request #4384 from filecoin-project/feat/4220 Use updated stored ask API	2020-10-14 12:03:07 +02:00
Aarsh Shah	30dd5d9644	use updated stored ask api	2020-10-14 11:39:57 +02:00
Aayush Rajasekaran	bf619862c3	Merge pull request #4382 from filecoin-project/asr/invoc-result Add message CID to InvocResult	2020-10-14 02:06:09 -04:00
Aayush Rajasekaran	ce54110228	Add message CID to InvocResult	2020-10-14 00:06:22 -04:00
hannahhoward	58662b79b3	fix(deps): use tagged go-fil-markets 0.9.0	2020-10-13 19:50:13 -07:00
Łukasz Magiera	b74a3229f8	fsm: process expired-ticket sectors	2020-10-13 21:35:41 +02:00
Łukasz Magiera	71b3b9075d	Merge remote-tracking branch 'origin/master' into feat/async-restartable-workers	2020-10-13 21:33:21 +02:00
hannahhoward	4edebcec2b	feat(markets): update markets 0.9.0 and add data transfer restart command	2020-10-13 03:41:08 -07:00
Aayush Rajasekaran	195d96ccc0	Merge pull request #4148 from filecoin-project/asr/circ-supply Add a StateExactCirculatingSupply command	2020-10-12 17:02:07 -04:00
Ingar Shu	49155ace62	Use seal-duration in calculating the earliest StartEpoch that we will consider (#4337 )	2020-10-12 17:45:37 -03:00
Aayush Rajasekaran	83624a8858	Rename StateVMCirculatingSupply to StateVMCirculatingSupplyInternal	2020-10-12 16:41:27 -04:00
Aayush Rajasekaran	96e1dfd8d7	Add an endpoint for precise circulating supply	2020-10-12 16:38:29 -04:00
Łukasz Magiera	65883cbb6b	Merge pull request #4290 from filecoin-project/feat/ledger-integration adding in ledger support	2020-10-12 15:09:27 +02:00
Steven Allen	dc4e73c737	Test the tape upgrade	2020-10-12 00:01:25 -07:00
Jakub Sztandera	2b21fdef33	Refactor from crypto.SigType to types.KeyType Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>	2020-10-12 00:07:53 +02:00
Łukasz Magiera	6a232e7214	Basic multi-wallet support Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>	2020-10-12 00:07:41 +02:00
Łukasz Magiera	00620aac57	Merge pull request #4296 from filecoin-project/feat/sync-unmarkbad-all sync unmark-bad --all	2020-10-10 22:35:56 +02:00
Steven Allen	c463582528	fix a race and optimize hello messages LifecycleCtx can _only_ be called during startup as it appends an fx hook. Worse, this was causing us to append an fx hook on every single hello message, leaking memory (and probably causing other shutdown issues...).	2020-10-10 08:33:06 -07:00
Łukasz Magiera	651522cbaa	Merge pull request #4274 from filecoin-project/feat/msig-remove-api add an api for removing multisig signers	2020-10-10 12:56:07 +02:00
Łukasz Magiera	18e58467f8	sync unmark-bad --all	2020-10-10 10:26:42 +02:00
Łukasz Magiera	a6d9b302fa	Merge pull request #3583 from filecoin-project/feat/signing-backends Remote wallet backends	2020-10-10 02:58:02 +02:00
Steven Allen	283fd054e8	fix a race when retrieving pieces We'd read the deal ID without synchronizing. This could (and probably did given the history of flaky deal tests) cause us to miss events. This patch also makes sure to always unsubscribe from events, even on error.	2020-10-09 15:35:44 -07:00
Steven Allen	748d2e82a7	unshare the journal Motivation: * Run lotus with the race detector enabled (primary motivation). * Allow multiple lotus nodes in a process (not a high priority). Previously, the journal was shared between all lotus instances, but it was initialized for every new node. This caused safety problems in tests (at a minimum). This patch explicitly passes the journal to all services that need it.	2020-10-09 13:23:07 -07:00
Łukasz Magiera	fdaa9c14ad	Merge remote-tracking branch 'origin/master' into feat/signing-backends	2020-10-09 20:36:51 +02:00
Łukasz Magiera	ab8286fa38	Fix docsgen, lotus-soup build	2020-10-09 18:43:22 +02:00
whyrusleeping	4cca3f19a3	add an api for removing multisig signers	2020-10-09 09:40:25 -07:00
Łukasz Magiera	feb4b3c8b4	Merge remote-tracking branch 'origin/master' into feat/signing-backends	2020-10-09 15:51:25 +02:00
Dirk McCormick	200a95f824	refactor: unify test builder full node options	2020-10-09 11:56:25 +02:00
Dirk McCormick	d69e4c7cf2	refactor: lite-mode - simplify organization of dep injection	2020-10-09 11:54:42 +02:00
Dirk McCormick	b2834baa4b	feat: add msig available balance and vested to lite mode	2020-10-09 11:51:20 +02:00
Dirk McCormick	e9e27cbbb0	feat: put gateway in middle of end-to-end test for lite mode	2020-10-09 11:48:35 +02:00
Dirk McCormick	ef73b964fb	feat: add end-to-end test for lite mode	2020-10-09 11:48:35 +02:00
Dirk McCormick	b32d25c562	feat: add RPC for GasEstimateMessageGas	2020-10-09 11:45:16 +02:00
Dirk McCormick	767611247c	feat: add RPC for StateWaitMsg	2020-10-09 11:45:16 +02:00

... 9 10 11 12 13 ...

2668 Commits