Commit Graph

1738 Commits

Author SHA1 Message Date
Łukasz Magiera
ba3ad75670 remote-worker: wire up storage miner endpoints 2019-11-21 15:10:51 +01:00
Łukasz Magiera
9725eb78bf wip remote sectorbuilder workers 2019-11-21 01:53:06 +01:00
Łukasz Magiera
37792b149f sync: fix some issues 2019-11-20 20:49:29 +01:00
whyrusleeping
71923c691d dont publish nil message removed 2019-11-20 17:47:44 +01:00
Łukasz Magiera
06d498b45b chainwatch: log mpool message 2019-11-20 17:47:44 +01:00
Łukasz Magiera
4ee2fc4d9f chain: call unsub in Incoming* methods 2019-11-20 17:47:44 +01:00
Łukasz Magiera
ced47a11e7 chainwatch: more improvements 2019-11-20 17:47:44 +01:00
Łukasz Magiera
d3b980ef58 api.SyncIncomingBlocks 2019-11-20 17:47:44 +01:00
Łukasz Magiera
333847f7c9 chainwatch: store mpool message additions 2019-11-20 17:45:02 +01:00
Łukasz Magiera
f40a1afac8 chainwatch: store mpool message additions 2019-11-20 17:45:02 +01:00
Łukasz Magiera
80095fdf3c chainwatch: make target 2019-11-20 17:45:02 +01:00
Łukasz Magiera
d235e7f20e chainwatch: very, very basic key info view 2019-11-20 17:45:02 +01:00
Łukasz Magiera
3dd9691467 chainwatch: Store more detailed miner info 2019-11-20 17:45:02 +01:00
Łukasz Magiera
820f7bfb8a chainwatch: Capture more state 2019-11-20 17:45:02 +01:00
Łukasz Magiera
70956589ef Begin implementing ChainWatch 2019-11-20 17:45:02 +01:00
wanghui
ba889391b5 update imports and path 2019-11-16 14:47:04 +08:00
Frank
c9714b1708
Update cmd/lotus-storage-miner/init.go
Co-Authored-By: Łukasz Magiera <magik6k@users.noreply.github.com>
2019-11-16 14:16:18 +08:00
wanghui
b28ce76e8a clean up repo if miner init fail and use log 2019-11-15 19:54:12 +08:00
whyrusleeping
797d92b463 persist blocks as they come in 2019-11-14 19:19:16 -08:00
Łukasz Magiera
636c4f7671
Merge pull request #604 from filecoin-project/feat/townhall-lag-delta
townhall: Show update time delta
2019-11-14 21:53:24 +01:00
Łukasz Magiera
d684300713
Merge pull request #600 from filecoin-project/feat/tests-also
Add --tests-also for fetch-params
2019-11-14 18:16:12 +01:00
Łukasz Magiera
dbf8dff8e3 townhall: Show lag delta 2019-11-14 17:56:13 +01:00
Łukasz Magiera
f39a5f4a05 Mute pubsub logs 2019-11-14 17:32:00 +01:00
Jakub Sztandera
bc3dac0426
Add --tests-also for fetch-params
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-11-14 02:15:33 +01:00
Łukasz Magiera
37c0967fa8
Merge pull request #595 from filecoin-project/feat/small-fixes
Bunch of small fixes / improvements, gofmt
2019-11-13 19:15:50 +01:00
Jakub Sztandera
a58e165339
Restore api flags
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-11-13 16:37:40 +01:00
Jakub Sztandera
70419c0f55
Use API ListenAddress from config
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-11-13 16:37:40 +01:00
Łukasz Magiera
8f0e3ede24 Bunch of small fixes / improvements, gofmt 2019-11-13 15:48:57 +01:00
whyrusleeping
e1cb19da0a Exit 1 on error 2019-11-12 15:36:49 -08:00
Whyrusleeping
aa26935533
Merge pull request #573 from filecoin-project/feat/mark-bad-chains
sync: Mark chains with bad blocks as bad too
2019-11-13 05:12:06 +09:00
Łukasz Magiera
73ab6c0c66 WorkerCount on storageminer config 2019-11-12 18:59:38 +01:00
Łukasz Magiera
92b9f67327 Reduce log spam more 2019-11-12 11:05:18 +01:00
Łukasz Magiera
b6f4e53d43
Merge pull request #559 from filecoin-project/feat/faucet-miner-wait
Better miner create waiting logic in fountain
2019-11-11 21:49:12 +01:00
Łukasz Magiera
0b2ed8e9bb Better miner create waiting logic in fountain 2019-11-11 21:47:30 +01:00
Łukasz Magiera
35b44f08c4 townhall: Compare numbers 2019-11-11 21:13:14 +01:00
Łukasz Magiera
55247b366c townhall: Display previous weight diff 2019-11-11 21:13:14 +01:00
Łukasz Magiera
3c2cbb04c9 townhall: Display more timing info 2019-11-11 21:13:14 +01:00
Łukasz Magiera
55697209a7
Merge pull request #556 from filecoin-project/fix/post-restart
Fix PoSt after storage miner restart
2019-11-11 18:33:33 +01:00
Łukasz Magiera
b8f46bff26 storageminer: Drop sortedSectorInfo log 2019-11-11 18:32:46 +01:00
Łukasz Magiera
b8e18ed773 storageminer: Don't print PP in info cmd if not proving 2019-11-11 12:10:48 +01:00
Łukasz Magiera
c18127bf00 townhall: More colors, weight/height diff 2019-11-09 18:51:04 +01:00
Łukasz Magiera
81bd0bc517 Test to reproduce post error after restart 2019-11-09 11:42:36 +01:00
Łukasz Magiera
3f4d454f6e storageminer: Print proving period in info cmd 2019-11-09 10:49:43 +01:00
Łukasz Magiera
59fbc976d0 storageminer: Missing new line in info cmd 2019-11-09 10:02:55 +01:00
Łukasz Magiera
ed64e52e3a sectorbuilder: apply some review suggestions 2019-11-09 00:21:04 +01:00
Łukasz Magiera
27485777f0 Merge remote-tracking branch 'origin/master' into feat/interactive-porep 2019-11-08 21:45:06 +01:00
Łukasz Magiera
8c39486736 some import fixes 2019-11-08 21:11:56 +01:00
Łukasz Magiera
071f05fa95 Storage miner API improvements 2019-11-08 19:23:58 +01:00
whyrusleeping
e226071c20 disable GPU by default 2019-11-08 08:43:23 -08:00
wanghui
66f8e348a2 update size and unit 2019-11-07 20:05:03 +08:00
Frank
08ff772cf4
Update cmd/lotus-storage-miner/info.go
update sector size format

Co-Authored-By: Łukasz Magiera <magik6k@users.noreply.github.com>
2019-11-07 19:33:44 +08:00
wanghui
f221c05a33 add sector size info 2019-11-07 18:46:11 +08:00
whyrusleeping
9863942fe2 WIP: trying to write a test to reproduce the storage deal error 2019-11-07 00:39:34 +01:00
Jakub Sztandera
58229defcd
Fix faucet ip limiting to use X-Real-IP
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-11-06 16:10:27 +01:00
Łukasz Magiera
ed5ccfd750 Merge remote-tracking branch 'origin/devnet/7' into feat/interactive-porep 2019-11-05 18:53:19 +01:00
Łukasz Magiera
c76ce2a2eb rate-limit some sectorbuilder ops 2019-11-04 18:36:29 +01:00
Łukasz Magiera
13da5a5966 Put WorkerThreads on sectorbuilder.Config 2019-11-04 17:47:08 +01:00
whyrusleeping
fc9091cc89 Get interactive porep sector sealing mostly working 2019-10-31 20:57:10 -07:00
Łukasz Magiera
bad7b76165
Merge pull request #516 from filecoin-project/feat/invert-rate-limits
Invert faucet rate limiting
2019-10-31 19:13:11 +01:00
Travis Person
b9f8addd21 Invert faucet rate limiting
Rate limits needs to be ordered from specific to generic to ensure that
a single user will not exhaust the generic limiter before being limited
by the more specific.

Resolves #517
2019-10-31 10:43:01 -07:00
Łukasz Magiera
46d782b30b storageminer: Drop commitment tracker 2019-10-30 18:37:38 +01:00
Jakub Sztandera
3ea0997c93
Add support for different configs
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-10-30 17:38:39 +01:00
Łukasz Magiera
413314b44b
Merge pull request #494 from filecoin-project/feat/handle-uncommited
storageminer: Handle uncommited sectors on start
2019-10-30 15:32:34 +01:00
Łukasz Magiera
44f4ee0de1 storageminer: cmd to list sector commitments 2019-10-29 21:41:30 +01:00
Łukasz Magiera
391c73774d Set swarm log level to WARN 2019-10-29 20:51:44 +01:00
Jakub Sztandera
6d594bab67
Merge pull request #491 from filecoin-project/feat/bg-store-garbage
Run store-garbage in background
2019-10-29 19:33:48 +01:00
Łukasz Magiera
6a999d348a fountain: Allow picking sector size 2019-10-29 19:28:54 +01:00
Łukasz Magiera
8e1a9a71e6 Run store-garbage in background 2019-10-29 18:52:07 +01:00
Łukasz Magiera
788b0f5908 docs: Update mining instructions 2019-10-29 14:34:33 +01:00
Łukasz Magiera
640b889aa6 fountain: Fix create button in /miner.html 2019-10-29 14:26:15 +01:00
Łukasz Magiera
23b7cf305f fountain: Default to 1GiB sectors 2019-10-29 14:10:53 +01:00
Łukasz Magiera
e46ae15dfd townhall: Don't hard-code stuff 2019-10-29 14:06:02 +01:00
Łukasz Magiera
874be79958 very basic sector seal scheduling 2019-10-27 09:56:53 +01:00
whyrusleeping
874ab1456c WIP: updating to new proofs code 2019-10-25 18:07:34 +02:00
Łukasz Magiera
a20255d606 Fancier faucet 2019-10-25 17:43:55 +02:00
Łukasz Magiera
43e1752816 fountain: Create miner enpoint 2019-10-25 17:43:55 +02:00
Łukasz Magiera
d753c39133 Add rate limits to the fountain by @travisperson 2019-10-25 17:42:14 +02:00
whyrusleeping
4890f577f5 give miners the ability to select different sector sizes 2019-10-25 17:26:15 +02:00
Łukasz Magiera
eeca3d86df
Merge pull request #415 from filecoin-project/feat/deals-on-chain
On-Chain deals
2019-10-25 17:03:25 +02:00
Łukasz Magiera
5175d8541e peer manager: Handle bootstrap in peermgr 2019-10-23 13:11:18 +02:00
Łukasz Magiera
c41dd4efeb actora: register storagemarket 2019-10-23 12:44:00 +02:00
Łukasz Magiera
aab3bd617a REST file import endpoint 2019-10-23 11:39:44 +02:00
whyrusleeping
cc689ab920 shut down rpc server before node 2019-10-20 15:17:03 +09:00
Whyrusleeping
d891589cef
Merge pull request #412 from filecoin-project/feat/init-fail-cleanup
Clean up after failed storage miner init
2019-10-18 16:08:18 +09:00
whyrusleeping
098e05c4d7 Clean up after failed storage miner init 2019-10-18 14:13:36 +09:00
Jakub Sztandera
1bf713cb0a
Cleanup imports after rename
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-10-18 13:47:41 +09:00
Łukasz Magiera
f620ecea5e Devnet 6 2019-10-17 03:09:17 +02:00
whyrusleeping
2ac4ce122f check return code of create storage miner call 2019-10-16 16:45:48 +09:00
Łukasz Magiera
71182f69cc
Merge pull request #378 from filecoin-project/fix/miner-info-format
Fix percentage display
2019-10-15 17:30:31 +02:00
Jakub Sztandera
b582620e77
Fix percentage display
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-10-15 16:51:47 +02:00
Łukasz Magiera
f0ff51ff8e Devnet 5 2019-10-15 15:46:24 +02:00
Łukasz Magiera
f15d527a35
Merge pull request #343 from filecoin-project/feat/spec-sync
Sync with the new spec
2019-10-15 15:20:56 +02:00
Łukasz Magiera
98b4533247
Merge pull request #353 from filecoin-project/feat/node-deploy
Quick miner deploy util
2019-10-15 15:09:53 +02:00
Łukasz Magiera
a576b72364 actors: Sync with the new spec, storage actors 2019-10-15 14:31:34 +02:00
Łukasz Magiera
7f2f28d87b
Merge pull request #358 from filecoin-project/feat/chain-noise
Add simple program to generate random chain noise
2019-10-15 04:50:08 +02:00
Łukasz Magiera
75680ae502 Quick miner deploy util 2019-10-15 02:54:00 +02:00
whyrusleeping
e8a1b54740 Add more info to storage-miner info command output 2019-10-14 11:32:32 +09:00
whyrusleeping
495506f725 Add simple program to generate random chain noise 2019-10-14 10:20:49 +09:00
Łukasz Magiera
30198b4105 townhall: show tipset propagation 2019-10-12 16:05:41 +02:00
Łukasz Magiera
5fbbc8dd18
Merge pull request #338 from filecoin-project/feat/th-build
townhall: Single-binary build
2019-10-12 09:38:39 +02:00
Łukasz Magiera
5861332f40 sminer: info command 2019-10-12 01:47:29 +02:00
Łukasz Magiera
20cf5ba54c townhall: Single-binary build 2019-10-11 08:41:45 +02:00
Łukasz Magiera
387adae115 townhall: Node names 2019-10-11 04:45:45 +02:00
Łukasz Magiera
40267e15b2
Merge pull request #326 from filecoin-project/feat/periodic-bootstrap
Periodic bootstrap
2019-10-11 04:09:01 +02:00
Łukasz Magiera
c0179bd4fa Periodic bootstrap 2019-10-11 02:31:26 +02:00
Łukasz Magiera
4c5157d270 Lotus Townhall 2019-10-10 14:02:43 +02:00
whyrusleeping
14c4a8bee6 implement looking in the past for messages 2019-10-09 09:33:18 +02:00
Łukasz Magiera
752654ab03 Devnet 3; Builtin bootstrap; NAT Port Map 2019-10-09 05:16:35 +02:00
Whyrusleeping
3c68e66b4c
Merge pull request #285 from filecoin-project/fix/event-null-blocks
events: Handle null blocks correctly
2019-10-08 11:34:01 +09:00
whyrusleeping
e17fc950b3 Add pprof server to storage miner 2019-10-05 10:08:55 -06:00
Łukasz Magiera
7170e1893f events: Handle null blocks correctly 2019-10-05 00:43:04 +02:00
whyrusleeping
6dd8ed7d7a pass those tests 2019-10-04 10:06:05 -06:00
whyrusleeping
697bed27a6 fix websocket closing 2019-10-04 10:06:05 -06:00
Łukasz Magiera
1534536590 Store libp2p key in keystore 2019-10-03 02:11:31 +02:00
Łukasz Magiera
713f08e9bf move genesis loading to build pkg 2019-10-02 22:40:14 +02:00
Łukasz Magiera
05878f4320 Built in paramfetch 2019-10-02 19:20:30 +02:00
whyrusleeping
6de61424e4 add pprof server 2019-09-30 17:25:45 -06:00
Łukasz Magiera
1024812559 storageminer: Update post scheduling 2019-09-26 23:32:47 +02:00
Łukasz Magiera
18211b7bee storageminer: Fix PledgeCollateral calc on init 2019-09-26 12:13:43 -07:00
Łukasz Magiera
a2a2169ef8 Setup first devnet params 2019-09-26 12:13:43 -07:00
Łukasz Magiera
ad1265cad0 storageminer: Flags to allow specyfying keys to use 2019-09-26 16:31:13 +02:00
Łukasz Magiera
78e1ea14ad storageminer: Make worker key creation optional 2019-09-26 02:47:53 +02:00
Łukasz Magiera
9a990dbd8a use new sectorbuilder file interfaces 2019-09-23 12:50:28 +02:00
Łukasz Magiera
82dc6fa527 Very basic foutain 2019-09-20 23:36:43 +02:00
Łukasz Magiera
5e2c100f4d storageminer: Better context handling 2019-09-17 20:36:06 +02:00
Łukasz Magiera
037fa84e68 storageminer: Remove node shutdown hack 2019-09-17 20:28:21 +02:00
Łukasz Magiera
f2ecb772fa repo: Close datastore in Close 2019-09-17 16:34:22 +02:00
Łukasz Magiera
83f1a336a6 node: Basic graceful shutdown 2019-09-17 16:23:08 +02:00
Łukasz Magiera
5ea1459275 Use atomic moppl API in more places 2019-09-17 10:15:26 +02:00
whyrusleeping
a47969c76b finish up making the new serializations work 2019-09-10 16:03:17 -07:00
whyrusleeping
ed45d1c2b4 refactor state utilities into StateManager package, implement proper election proofs 2019-09-09 19:14:00 -07:00
Łukasz Magiera
6a4af984af storageminer: Fix init 2019-09-06 19:42:03 +02:00
Łukasz Magiera
c0566399c6 retrieval: Way to get the data 2019-08-29 17:50:19 +02:00
Łukasz Magiera
cad3efb9ba Command to list sealed blocks 2019-08-29 17:48:19 +02:00
Łukasz Magiera
28409a60b1 Use BLS in more places 2019-08-22 00:47:44 +02:00
Łukasz Magiera
f43757f9f2 storageminer: Unregister genesis miner in init 2019-08-20 20:17:59 +02:00
Łukasz Magiera
eda26faf21 Register miner address from storageminer process 2019-08-20 19:19:24 +02:00
Łukasz Magiera
89ea5a4750 pond: logs window 2019-08-19 23:31:25 +02:00
whyrusleeping
5920537bc5 fix gas limit in create storage miner call 2019-08-19 11:06:39 -07:00
whyrusleeping
4f91550851 fix waiting for bls signed message 2019-08-16 15:10:34 -07:00
whyrusleeping
b271e5231a set up lotus-storage-miner to be able to use an existing miner actor 2019-08-16 14:50:00 -07:00
Łukasz Magiera
f99c8e032d pond: +1k button for addresses 2019-08-09 17:59:12 +02:00
whyrusleeping
959fe371b0 move storage miner keys to full node 2019-08-08 10:56:14 -07:00
Łukasz Magiera
cdc535394d deals: fix statestore 2019-08-07 20:01:51 -07:00
Łukasz Magiera
5811f18b5e Address some review comments 2019-08-07 20:01:22 -07:00
Łukasz Magiera
37a7ee08ec Bootstrap storageminer with full node 2019-08-07 20:01:22 -07:00
Łukasz Magiera
322031d8e4 Fix storageminer cli 2019-08-07 20:01:22 -07:00
Łukasz Magiera
282654bf7b pond: storage miner init 2019-08-02 16:15:14 +02:00
Whyrusleeping
eb854467c8
Update cmd/lotus-storage-miner/run.go
Co-Authored-By: Łukasz Magiera <magik6k@users.noreply.github.com>
2019-07-30 10:18:01 -07:00
whyrusleeping
ee224e5b21 Implement 'storage miner' module, wire up a few bits it needs to start 2019-07-29 17:46:56 -07:00
whyrusleeping
8e840139bd appease go's format checker 2019-07-29 12:08:47 -07:00
whyrusleeping
b83ff6b9dc Wire up sector builder commands through the api 2019-07-29 12:08:47 -07:00
Łukasz Magiera
26232f0b9a storageminer: GetStorageMinerAPI for cli 2019-07-29 12:08:47 -07:00
whyrusleeping
4fb4835b35 can we store it? YES WE CAN 2019-07-29 12:08:47 -07:00
whyrusleeping
0c67d66198 Make message wait work and use it for the storage-miner init 2019-07-29 11:58:30 -07:00
Whyrusleeping
508e19f52f
Merge pull request #89 from filecoin-project/feat/chain-gen
Implement a chain generator
2019-07-29 09:57:40 -07:00
whyrusleeping
9ccd06b060 start method IDs at 1, to allow 0 for basic transfers 2019-07-26 14:42:38 -07:00
Łukasz Magiera
9ea5dbf902 chain: Benchmark chain gen 2019-07-26 13:47:29 -07:00
Jakub Sztandera
0e35240fe9 Wire in context to VMContext
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2019-07-26 21:01:02 +02:00
whyrusleeping
a0c1afff57 clean up which addresses get used where 2019-07-26 10:33:54 -07:00
Łukasz Magiera
a825b3b550 storageminer: Post-rebase update 2019-07-26 15:26:01 +02:00
Łukasz Magiera
283c4e4194 storageminer: Setup actor on init 2019-07-26 15:26:01 +02:00
Jakub Sztandera
81b5f46062 Implement RPC tracing
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2019-07-26 08:50:21 +02:00
Łukasz Magiera
f2abb33933 Generate single genesis in tests 2019-07-25 01:23:06 +02:00
Łukasz Magiera
8d58c0a2fd Only set genesis once 2019-07-25 01:12:22 +02:00
Łukasz Magiera
93a8ee11db jsonrpc: Work with browsers 2019-07-24 19:09:00 +02:00
Łukasz Magiera
c7b2bf8100 Fix reading auth headers 2019-07-24 15:40:42 +02:00
Łukasz Magiera
4fa9e45eb7 repo: check for config in exists 2019-07-24 13:20:00 +02:00
Łukasz Magiera
c6b4fadba1 Fix permissions after split and rebase 2019-07-24 03:10:26 +02:00
Łukasz Magiera
772dd6c549 Implement storage miner API in node 2019-07-24 02:58:31 +02:00
Łukasz Magiera
f0e807dabb Fix jsonrpc client after splitting apis 2019-07-24 02:40:19 +02:00
Łukasz Magiera
eda03095b0 Separate API for storageminer 2019-07-24 02:09:34 +02:00
Łukasz Magiera
d0cbf02d36 Don't build full API in storage miner 2019-07-24 01:48:59 +02:00
Łukasz Magiera
8d529d1ae7 gofmt 2019-07-24 01:47:36 +02:00
Łukasz Magiera
4c8b028887 Return error form Repo.Exists 2019-07-24 01:47:36 +02:00
Łukasz Magiera
4f1946d5a2 Address review 2019-07-24 01:47:36 +02:00
Łukasz Magiera
677f5c3e30 Check full node version in storageminer init 2019-07-24 01:47:36 +02:00
Łukasz Magiera
0e570c0b19 StorageMiner init code 2019-07-24 01:47:36 +02:00
Łukasz Magiera
486598ef53 storageminer: separate env var for storage repo 2019-07-24 01:47:36 +02:00
Łukasz Magiera
a5441f8d17 Add missing daemon files 2019-07-24 01:47:36 +02:00
Łukasz Magiera
b73f29286b Begin implementing storage miner 2019-07-24 01:47:36 +02:00
Whyrusleeping
3f61488e3c
Merge pull request #17 from filecoin-project/feat/mining-1
Implement basic mining logic
2019-07-11 10:09:15 -07:00
whyrusleeping
d381025ccc Implement initial mining logic 2019-07-10 19:36:43 -07:00
Łukasz Magiera
2e8dfc759b daemon: wire up fsrepo 2019-07-10 19:10:19 +02:00
Jakub Sztandera
f9a34b3f9c Cleanup lint
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2019-07-09 14:46:06 +02:00
Łukasz Magiera
cdca2ff2c7 Some net commands / apis 2019-07-08 21:07:16 +02:00
Łukasz Magiera
3375a72aea RPC server
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2019-07-01 23:11:33 +02:00
Łukasz Magiera
8417f515a1 Initial structure
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2019-07-01 23:11:33 +02:00