cerc-io/lotus
16
0
Fork 0
Code Issues Pull Requests Packages Projects Releases 27 Wiki Activity
16,862 Commits 24 Branches 342 Tags 314 MiB
bf6541857e
Commit Graph

2806 Commits

Author SHA1 Message Date
Łukasz Magiera
f9be73c73e storageminer: Fix 'storage list' with disconnected storage 2020-05-01 20:43:39 +02:00
Łukasz Magiera
d9acd484c0 storageminer: Improve CLI UX 2020-05-01 14:06:19 +02:00
Łukasz Magiera
5026091623 Merge remote-tracking branch 'origin/testnet/3' into feat/storage-better-fetch 2020-04-30 20:56:52 +02:00
Łukasz Magiera
89b19af43f specs-actors v0.3 2020-04-29 20:06:05 +02:00
Łukasz Magiera
068e9a29d2 Merge remote-tracking branch 'origin/testnet/3' into feat/storage-better-fetch 2020-04-29 13:27:49 +02:00
Łukasz Magiera
5c6cf8b619 Merge pull request #1625 from filecoin-project/feat/shed-bitfields 
shed: Add some bitfield tools
 2020-04-28 22:01:34 +02:00
Łukasz Magiera
6014530145 shed bitfield: use Count to check for overflows 2020-04-28 21:36:58 +02:00
Łukasz Magiera
9dcb42328e gofmt 2020-04-28 19:27:13 +02:00
Łukasz Magiera
8d35aacd31 Update sector-storage with better fetch logic 2020-04-28 14:57:53 +02:00
Łukasz Magiera
4579e9bb84 shed: add some bitfield tools 2020-04-28 10:44:10 +02:00
Łukasz Magiera
0522af155d chainwatch: Record drand entries 2020-04-25 00:25:33 +02:00
Łukasz Magiera
af794a6281 storageminer: Print some balances in info 2020-04-24 23:02:27 +02:00
Łukasz Magiera
55f7c81aaf specs-actors: Fix miner cron on null blocks 2020-04-24 19:12:30 +02:00
Travis Person
1b6aa537d3 fountain: decode peer id (#1593) 
Co-authored-by: Travis Person <travisperson@users.noreply.github.com>
 2020-04-23 17:34:31 -07:00
Łukasz Magiera
db2e1fc2c4 Merge pull request #1591 from filecoin-project/feat/import-analyze 
add command to analyze import bench output
 2020-04-24 02:14:49 +02:00
Jeromy
7ee42e61d5 add command to analyze import bench output 2020-04-23 16:48:54 -07:00
Jeromy
86ccaa1981 properly load in registered proof type when benchmarking existing sectors 2020-04-24 01:16:26 +02:00
Jeromy
a9b62bcc5c small amount of cleanup for lotus bench 2020-04-24 01:16:26 +02:00
Jeromy
f4948dcba0 remove api dependency on sealing fsm package 2020-04-23 15:33:59 -07:00
Łukasz Magiera
309f54aa0c Update sector-storage 2020-04-23 15:29:31 -07:00
Whyrusleeping
faa9002cce working on sector pledge requirements after specs-actors 1.0.0 (#1584) 
* WIP: working on sector pledge requirements after specs-actors 1.0.0

* update storage-fsm with pledge collateral logic

* Set bigger balances for miners

* Return only additional required pledge

* split collateral methods into two methods

Co-authored-by: Łukasz Magiera <magik6k@gmail.com>
 2020-04-23 12:39:34 -07:00
Yu Da
9b598e5ec3 fix #1574 (#1583) 
* fix #1566

* fix #1566

Co-authored-by: Da Yu <dayu26@dadeMacBook-Pro.local>
 2020-04-23 09:44:25 -07:00
Whyrusleeping
b761a2994b Merge pull request #1582 from filecoin-project/fix/fountain-proper-peerid 
fountain: use proper peerid
 2020-04-22 20:20:16 -07:00
Travis Person
332b6b9e0a fountain: use proper peerid 2020-04-23 02:57:47 +00:00
Travis Person
4e1dddab67 chainwatch: fix sql syntax error 2020-04-22 22:57:17 +00:00
Travis Person
3285dd0cf1 lotus-seed: preserve first peerid during merge 2020-04-22 02:05:35 +00:00
Whyrusleeping
f960cccc51 Merge pull request #1568 from filecoin-project/feat/fix-reward-redeem 
fix reward redeem command to work again
 2020-04-21 15:23:49 -07:00
Jeromy
e3f2dfaec0 fix reward redeem command to work again 2020-04-21 14:45:33 -07:00
Łukasz Magiera
9f9ae155e3 windowed post: Review cleanup 2020-04-21 23:38:33 +02:00
Łukasz Magiera
eba0743d47 bench: --num-sectors option 2020-04-21 21:47:07 +02:00
Łukasz Magiera
24c764c91e Don't print QAPower as bytes 2020-04-21 21:46:50 +02:00
Łukasz Magiera
9923c909c1 Merge remote-tracking branch 'origin/testnet/3' into feat/windowed-post 2020-04-21 19:28:00 +02:00
Łukasz Magiera
c406b875fa gofmt, mod tidy 2020-04-21 19:23:49 +02:00
Łukasz Magiera
8be9494672 windowed post: Get correct sector set 2020-04-21 19:22:53 +02:00
Łukasz Magiera
a86595bc88 Use nicer DeadlineInfo struct 2020-04-20 19:34:08 +02:00
Łukasz Magiera
32e45557fa Merge pull request #1558 from filecoin-project/fix/faucet-rate-limit 
Rate limit fix
 2020-04-18 02:28:52 +02:00
Jeromy
3962194fad parse input as hex 2020-04-17 17:09:09 -07:00
Łukasz Magiera
fe6d666150 Get all tests to pass 2020-04-18 01:14:39 +02:00
Łukasz Magiera
3b7ae0d6d9 mod tidy, gofmt 2020-04-18 00:02:43 +02:00
Łukasz Magiera
712e2683d6 miner: proving info commands 2020-04-18 00:02:18 +02:00
Jeromy
24b7661837 fix up some tests 2020-04-17 13:44:13 -07:00
Travis Person
850803f138 Rate limit fix 2020-04-17 18:24:29 +00:00
Łukasz Magiera
93b2b6d65d Merge branch 'testnet/3' into feat/windowed-post 2020-04-17 18:38:20 +02:00
Łukasz Magiera
769cf43b52 seed: Set valid PeerIDs 2020-04-17 18:22:17 +02:00
Łukasz Magiera
cdbf79fff5 non-debug 2k sector build mode 2020-04-17 17:58:20 +02:00
Łukasz Magiera
bab352fb44 Wireup WinningPost validation 2020-04-17 16:47:19 +02:00
Łukasz Magiera
afdfc8807d api: Single method for static miner info 2020-04-16 19:36:36 +02:00
Łukasz Magiera
f88e400d74 make things build 2020-04-16 00:17:39 +02:00
Whyrusleeping
8a83415596 Merge pull request #1541 from filecoin-project/feat/drand-2 
real drand network integration
 2020-04-15 11:22:00 -07:00
Aayush Rajasekaran
c0204cdd83 Add a shed command to turn raw commPs into CIDs 2020-04-15 14:01:00 -04:00
Jeromy
674be39af1 real drand network integration 2020-04-13 20:06:10 -07:00
Łukasz Magiera
e4641fc7ed bench: Also bench windowed post 2020-04-14 00:17:37 +02:00
Łukasz Magiera
5bf80a60f1 Get proof type in NewWinningPoStProver constructor 2020-04-13 23:25:46 +02:00
Łukasz Magiera
349b2890bf Drop 'rewards list' for now 2020-04-13 22:43:27 +02:00
Łukasz Magiera
a2554952d1 Some electionPoSt -> winningPoSt renaming 2020-04-11 00:22:45 +02:00
Łukasz Magiera
d3ffe48fcb Get things to mostly build 2020-04-10 23:29:05 +02:00
Łukasz Magiera
e053cd6b9c Merge remote-tracking branch 'origin/testnet/3' into feat/windowed-post 2020-04-10 23:09:01 +02:00
Łukasz Magiera
613e61222b mostly wire up WindowedPoSt 2020-04-10 23:07:18 +02:00
Łukasz Magiera
1c75bf30ac genesis: Try updating for QA power 2020-04-10 22:04:04 +02:00
Łukasz Magiera
072dd8b744 Merge remote-tracking branch 'origin/testnet/3' into feat/windowed-post 2020-04-10 20:38:25 +02:00
laser
6dffe9377f provide deal scheduling info to FSM so that it can set pre-commit expiry 2020-04-10 08:22:28 -07:00
Łukasz Magiera
b0fe8b8b4c v25: get bench to almost work 2020-04-10 14:19:06 +02:00
Łukasz Magiera
37e7c512e6 Update ffi (v25 proofs) 2020-04-09 23:17:23 +02:00
Łukasz Magiera
70d654e4a6 Merge pull request #1527 from filecoin-project/feat/drand 
Initial randomness beacon implementation
 2020-04-09 19:48:09 +02:00
Jeromy
83416e2758 remove deadcode 2020-04-09 10:34:54 -07:00
Jeromy
c5c18659a4 address some review 2020-04-08 17:24:10 -07:00
Jakub Sztandera
d909119bb6 Make debug_advance build, still doesn't work 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-04-08 21:19:17 +02:00
Jakub Sztandera
f4f649acf4 Fix chainwatch 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-04-08 21:17:44 +02:00
Jakub Sztandera
2d2b89fcd8 make debug_advance build 
Still doesn't work

Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-04-08 18:46:57 +02:00
Łukasz Magiera
2b0bf372a7 Merge pull request #1507 from filecoin-project/feat/completions 
Shell completions
 2020-04-08 16:29:18 +02:00
Jakub Sztandera
c16806eb78 gofmt 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-04-08 14:54:06 +02:00
Jeromy
7075eaba26 WIP: random beacon interface 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-04-07 15:32:23 -07:00
laser
110c869dd3 cut over to storage-fsm, deleting local sealing package 2020-04-07 09:34:09 -07:00
laser
43f4db2308 SectorID -> SectorNumber 2020-04-06 15:31:33 -07:00
laser
f53250ee90 reorder imports 2020-04-06 13:27:14 -07:00
laser
dcd9e7da27 miscellaneous fixes post-rebase 2020-04-06 13:23:37 -07:00
laser
650a31b050 remove all lotus types from sealing package in preparation for extraction 
events adapter

implement StateWaitMsg and StateComputeDataCommitment

implement StateGetSectorPreCommitOnChainInfo

implement ChainHead and SendMsg

implement remaining methods
 2020-04-06 12:57:55 -07:00
Łukasz Magiera
a1b35aa9d5 Change api.SectorState to a string 2020-04-03 18:29:31 +02:00
Łukasz Magiera
dd6adcd240 rewards cli: Print amount in list as Fil 2020-04-03 06:31:59 +02:00
Łukasz Magiera
2bdedefa05 Shell completions 2020-04-03 04:03:53 +02:00
Łukasz Magiera
11777c5f24 Merge pull request #1502 from filecoin-project/feat/import-bench 
add a command to lotus-bench to benchmark importing and validating
 2020-04-03 01:30:12 +02:00
Jeromy
beaa3dffab add a command to lotus-bench to benchmark importing and validating a chain 2020-04-02 16:18:38 -07:00
Łukasz Magiera
acfb7cee07 shed: import-car for state debugging 2020-04-02 05:28:35 +02:00
Łukasz Magiera
fa86359549 storageminer: Parse pretty sector sizes in init 2020-04-01 23:56:49 +02:00
Jeromy
417d434973 several fixes and improvements while debugging interop 2020-03-31 18:35:23 -07:00
Whyrusleeping
ea135991e3 Merge pull request #1480 from filecoin-project/feat/better-deal-info 
Better deal info at the command line
 2020-03-31 13:29:07 -07:00
hannahhoward
ae3f7522f0 feat(cli): use MarketListIncompleteDeals for miner deals cmd 
Switch from DealsList to MarketListIncompleteDeals which (while poorly named) provides much more
information about what's happening with a miners deals
 2020-03-31 11:54:37 -07:00
Pedro Costa
5e2a94e22f Fix offline deal import command arguments check 
Why:

* It is failing if the number of arguments is the expected one.
 2020-03-31 19:18:13 +01:00
Łukasz Magiera
95ee1c1cde Extract sector-storage 2020-03-28 01:32:39 +01:00
Łukasz Magiera
c66d3dfad7 sectorstorage: Untangle from lotus deps 2020-03-27 22:35:33 +01:00
Łukasz Magiera
de1f2be505 Merge pull request #1458 from filecoin-project/feat/merge-sectorbuilder 
Merge sectorbuilder into sectorstorage
 2020-03-27 18:53:58 +01:00
Jeromy
3470ed7847 re add storage miner api flag 2020-03-26 22:19:29 -07:00
Travis Person
838a50be39 Increase low gas limits everywhere to 10000 2020-03-27 03:24:35 +00:00
Łukasz Magiera
e050e0307e Cleanup after dropping sectorbuilder 2020-03-26 20:35:16 +01:00
Łukasz Magiera
4be54a976c Merge sectorbuilder into sectorstorage 2020-03-26 03:51:06 +01:00
Łukasz Magiera
ae69e0fef1 seal-worker: Task type flags 2020-03-25 22:15:10 +01:00
Łukasz Magiera
cfc65f525a sectorstorage: wire up closing logic 2020-03-25 00:52:55 +01:00
Łukasz Magiera
ecf53f88ce workers: More review related fixes 2020-03-25 00:37:40 +01:00
Łukasz Magiera
5de17e903c storageminer: Config for local worker task types 2020-03-24 20:38:00 +01:00
Łukasz Magiera
726c9c1fe7 workers: Address review 2020-03-24 19:01:04 +01:00
Łukasz Magiera
8559c89560 storageminer: More storage stats in storage list 2020-03-23 23:43:38 +01:00
Łukasz Magiera
a3ba8eb0d7 workers: Basic monitoring tools 2020-03-23 15:56:22 +01:00
Łukasz Magiera
80d0f1f2c1 storageminer: Cleanup CLI 2020-03-23 13:29:24 +01:00
Łukasz Magiera
5e4a7e54df Rename agvmgr+sealmgr to sectorstorage 2020-03-23 12:47:10 +01:00
Łukasz Magiera
d43f2a2e3b workers: Address review 2020-03-22 22:39:06 +01:00
Łukasz Magiera
df9aa0e357 storagemitner: manage ulimit on start 2020-03-22 22:08:22 +01:00
Łukasz Magiera
971fe6fdfd workers: Drop sectors from origin after transfers 2020-03-22 05:27:28 +01:00
Łukasz Magiera
c6f67911de storageminer: Improve storage find cmd 2020-03-20 23:39:07 +01:00
Łukasz Magiera
c57c0e7f55 workers: Memory based scheduling 2020-03-20 23:30:17 +01:00
Łukasz Magiera
076cc428af workers: Fix moving storage around in later steps 2020-03-20 01:55:49 +01:00
Łukasz Magiera
e0c15b24fc storageminer: Fix preseal meta import for genesis miners 2020-03-20 01:20:01 +01:00
Łukasz Magiera
978a718159 storage: storage find command 2020-03-19 20:51:33 +01:00
Łukasz Magiera
80cca91584 workers: get to executing tasks remotely! 2020-03-19 18:11:45 +01:00
Łukasz Magiera
d87b7c264d stores: Use index in local store 2020-03-19 16:11:04 +01:00
Łukasz Magiera
1ed7779701 Merge remote-tracking branch 'origin/testnet/3' into feat/new-workers 2020-03-19 03:28:55 +01:00
Łukasz Magiera
2d1e30ae3b workers: Call find* on remote 2020-03-19 03:23:21 +01:00
Łukasz Magiera
94ebbd9d90 workers: Actually register in miner 2020-03-19 00:23:32 +01:00
whyrusleeping
ddf1beac6c change gas limit to be a normal int64 2020-03-18 13:45:37 -07:00
Łukasz Magiera
b2d4d37539 Merge pull request #1416 from filecoin-project/feat/import-data-usage 
Feat/import data usage
 2020-03-18 19:06:37 +01:00
whyrusleeping
66a950942e add a usage text to import-data command 2020-03-17 22:08:14 -07:00
Łukasz Magiera
d8c8832a37 stores: fix StorageList 2020-03-18 05:40:25 +01:00
Łukasz Magiera
5f2caffb51 Fix tests after specs-storage changes 2020-03-18 02:08:11 +01:00
Łukasz Magiera
d8ce5078d9 Use new specs-storage interface 2020-03-17 21:19:52 +01:00
Łukasz Magiera
de1c984b48 workers: Handle init on first run 2020-03-16 19:46:02 +01:00
Łukasz Magiera
7e997e40f3 workers: Simple storage diagnostics 2020-03-16 18:50:07 +01:00
Łukasz Magiera
416a0d2722 Merge branch 'feat/proofs-v24' into feat/new-workers 2020-03-16 10:45:22 +01:00
Łukasz Magiera
1f9fdf0c5c gofmt 2020-03-16 10:43:27 +01:00
Łukasz Magiera
a71906525a seed: Support parsing string sector-size 2020-03-15 21:42:44 +01:00
Łukasz Magiera
630df050c0 bench: Option to skip commit2 2020-03-15 18:48:53 +01:00
Łukasz Magiera
e6ec20b4ca Merge branch 'testnet/3' into feat/new-workers 2020-03-13 17:58:13 +01:00
Łukasz Magiera
96730bae75 workers: Report sectors paths after worker creates them 2020-03-13 17:54:55 +01:00
Łukasz Magiera
2c7f579838 workers: Implement SectorIndex 2020-03-13 12:59:19 +01:00
Łukasz Magiera
bc7fede68b workers: Wire up most pieces 2020-03-13 02:37:38 +01:00
Łukasz Magiera
86871e5abc workers: Basic Remote store 2020-03-13 01:23:05 +01:00
Łukasz Magiera
56968d858c workers: Make LocalWorker public 2020-03-11 22:23:16 +01:00
Łukasz Magiera
71afcb0333 workrs: refactor sector store for more composability 2020-03-11 08:22:21 +01:00
whyrusleeping
16d087cce4 get fallback post running successfully! 2020-03-10 23:30:48 -07:00
Łukasz Magiera
7e2e30f94b workers: Transfer logic refactoring 2020-03-11 06:49:17 +01:00
Łukasz Magiera
eb61a36fd7 workers: RPC scaffolding 2020-03-11 02:58:02 +01:00
Travis Person
c655162dd6 fountain: add 32GiB sectors 2020-03-10 02:21:37 +00:00
Łukasz Magiera
47e3b5b902 shed: make non-auto nonce-fix safer 2020-03-10 02:11:07 +01:00
Łukasz Magiera
9daaaa3ec2 shed: corect start nonce in nc-fix 2020-03-10 01:28:59 +01:00
Łukasz Magiera
e396454138 shed: auto mode for nonce-fix 2020-03-10 01:26:10 +01:00
Łukasz Magiera
0c3f4eb7dd storageminer: Create dir with --init 2020-03-09 23:00:29 +01:00
Łukasz Magiera
24956a49f4 gofmt 2020-03-09 22:47:58 +01:00
Łukasz Magiera
01087e01d2 storage: Improve thread safety 2020-03-09 20:22:30 +01:00
Łukasz Magiera
946fff39a6 chainwatch: Fix message index creation 2020-03-09 19:18:30 +01:00
Whyrusleeping
70552e3e0d Merge pull request #1368 from filecoin-project/feat/build-cleanup 
build: Remove unused vars, fix debug build
 2020-03-09 11:03:27 -07:00
Łukasz Magiera
5902daf3b5 chainwatch: Add to/from message indexes 2020-03-09 09:34:04 +01:00
Łukasz Magiera
1647798396 build: Remove unused vars, fix debug build 2020-03-09 07:54:29 +01:00
Łukasz Magiera
2ff4a2846b Merge pull request #1366 from filecoin-project/fix/set-price-units 
Add units to set price command
 2020-03-09 07:28:42 +01:00
Łukasz Magiera
6981cfb8bc Merge pull request #1365 from filecoin-project/feat/miner-storage-add 
storageminer: 'storage attach' command
 2020-03-09 07:28:11 +01:00
Łukasz Magiera
0b14ab8000 fountain: Fix miner wait page title 2020-03-09 07:27:07 +01:00
whyrusleeping
33aa9bd03f Add units to set price command 2020-03-08 23:22:11 -07:00
Łukasz Magiera
c10142816e Merge pull request #1363 from filecoin-project/feat/cwatch-update 
Update chainwatch
 2020-03-09 07:16:40 +01:00
Whyrusleeping
f9c38ac35e Merge pull request #1362 from filecoin-project/fix/no-storage-init 
storageminer: Correctly initialize storage.json with --no-local-storage
 2020-03-08 23:16:20 -07:00
Łukasz Magiera
33fcf8eb44 gofmt, mod tidy 2020-03-09 07:13:45 +01:00
Łukasz Magiera
c87ebe8590 storageminer: storage attach cmd 2020-03-09 07:13:22 +01:00
Łukasz Magiera
7c94f2f3be storageminer: Correctly initialize storage.json with --no-local-storage 2020-03-09 06:45:12 +01:00
Łukasz Magiera
a46296d340 Update chainwatch 2020-03-09 06:43:32 +01:00
whyrusleeping
ab51c7e2d2 Fix fallback post scheduling to hopefully do the right thing 2020-03-08 00:19:38 -08:00
whyrusleeping
24bf720a9a Merge branch 'master' into testnet/3 2020-03-07 16:46:12 -08:00
Whyrusleeping
0b5991850c Merge pull request #1346 from filecoin-project/feat/stat-cmd 
Add stat-obj to API and a few extras
 2020-03-06 18:55:48 -08:00
Travis Person
1a31571493 lotu-shed: add stateroot stats command 2020-03-07 00:55:11 +00:00
Whyrusleeping
f17962182f Merge pull request #1343 from filecoin-project/feat/sb-pc1-mkdir-fix 
Update sectorbuilder to fix the mkdir bug in precommit1
 2020-03-06 14:38:32 -08:00
Aayush Rajasekaran
55f155a72c fix make debug 2020-03-06 14:31:16 -08:00
Łukasz Magiera
a962479ce7 Update sectorbuilder to fix the mkdir bug in precommit1 2020-03-06 23:26:22 +01:00
whyrusleeping
4101147a5b one more miner init issue 2020-03-06 14:23:21 -08:00
Aayush Rajasekaran
2d63b007f2 Unify MethodCall and ReplayResults into SimulationResult 
- Call and Replay now return the same type, which includes both Message and MessageReceipt
 2020-03-06 11:10:40 -08:00
Łukasz Magiera
3cab8bd5d1 gofmt 2020-03-06 20:01:28 +01:00
Łukasz Magiera
38241d66cb Merge branch 'testnet/3' into feat/miner-rewards-cmd 2020-03-06 19:04:36 +01:00
Łukasz Magiera
b019e41f1c Merge pull request #1339 from filecoin-project/fix/fountain-create-miner-return 
fountain: decode create miner results correctly
 2020-03-06 09:14:05 +01:00
Łukasz Magiera
ea0dcdcfac Merge pull request #1338 from filecoin-project/fix/miner-init 
fix storage miner init logic
 2020-03-06 09:11:27 +01:00
Whyrusleeping
05a95cace5 Merge pull request #1336 from filecoin-project/vet/some-go-vet-fixes 
some go vet fixes
 2020-03-06 00:11:13 -08:00
Travis Person
277c037676 fountain: decode create miner results correctly 2020-03-06 08:08:07 +00:00
whyrusleeping
09c543c526 fix storage miner init logic 2020-03-06 00:06:59 -08:00
whyrusleeping
16096e2c71 some go vet fixes 2020-03-05 22:46:07 -08:00
Łukasz Magiera
7d3e16986c sectorbuilder type updates 2020-03-06 06:38:59 +01:00
whyrusleeping
1183e082af add command to inspect and redeem block rewards 2020-03-05 21:32:52 -08:00
Łukasz Magiera
ac3d0dc30c Config fauces for inteop devnet 2020-03-06 01:42:59 +01:00
Łukasz Magiera
a5c6d83cd9 gofmt; mod tidy 2020-03-05 23:43:41 +01:00
Łukasz Magiera
d10b84d8cd worker: Fix build 2020-03-05 23:40:40 +01:00
Łukasz Magiera
a5e5918fc5 mod tidy; gofmt 2020-03-05 20:21:06 +01:00
Łukasz Magiera
fa5bc3a5a9 Merge remote-tracking branch 'origin/testnet/3' into feat/4stage-seal 2020-03-05 20:20:47 +01:00
Łukasz Magiera
7d95e134eb storageminer: Print what we can in info cmd 2020-03-05 19:26:05 +01:00
Łukasz Magiera
c91d970c41 storageminer: Init with default local storage 2020-03-05 02:12:52 +01:00
Łukasz Magiera
7db1dd52bd storagemgr: Wire up most of AddPiece logic 2020-03-05 01:38:07 +01:00
whyrusleeping
5076b2b950 fix reward actor and block reward application 2020-03-04 13:21:24 -08:00
Łukasz Magiera
799ff17c7c Merge remote-tracking branch 'origin/testnet/3' into feat/4stage-seal 2020-03-04 06:37:11 +01:00
Travis Person
9b98ef5de4 chainwatch: add stateroot index on miner_heads 2020-03-04 04:50:53 +00:00
Łukasz Magiera
4e46d00eb6 Merge remote-tracking branch 'origin/testnet/3' into feat/4stage-seal 2020-03-04 04:01:13 +01:00
whyrusleeping
9169a073b6 add miner side commands and a few other goodies 2020-03-03 18:49:00 -08:00
Łukasz Magiera
12d870e274 sealmgr: Read only multi-path file manager 2020-03-04 03:24:08 +01:00
whyrusleeping
99c842e027 integrate client interface to allow for offline deals 2020-03-03 16:18:08 -08:00
Łukasz Magiera
a0dbb6bdd6 Storage Manager refactor 2020-03-03 23:19:22 +01:00
Whyrusleeping
41bf668189
Merge pull request #1294 from natewalck/more-opencensus-metrics 
More opencensus metrics
 2020-03-03 12:02:13 -08:00
whyrusleeping
60b19c51ef more misc fixes 2020-03-01 17:09:38 -08:00
Łukasz Magiera
98dbb2f70f bench: set correct registered proofs on things 2020-03-01 22:05:13 +01:00
Łukasz Magiera
f4310e8f69 bench: set sector size in saved commit2 inputs 2020-03-01 05:26:10 +01:00
Łukasz Magiera
ee3e631b1a bench: Prove command 2020-03-01 03:52:46 +01:00
Łukasz Magiera
342e85d378 bench: flag to save commit2 input 2020-02-29 03:31:25 +01:00
Łukasz Magiera
f54a555aa8 Merge remote-tracking branch 'origin/testnet/3' into feat/4stage-seal 2020-02-29 03:21:01 +01:00
whyrusleeping
194093469a fix subtool builds 2020-02-28 18:05:19 -08:00
whyrusleeping
c7508a0512 self review fixes 2020-02-28 18:02:40 -08:00
Aayush Rajasekaran
fe8db295e7 Re: #1290: Add a lotus wallet verify API and CLI command 
- The command takes an address, message, and signature, and returns true if the sig is valid
 2020-02-28 15:56:15 -08:00
whyrusleeping
5b657a2905 pass on proper sector types 2020-02-28 12:52:14 -08:00
whyrusleeping
0945d8725e fixing miner logic to make more tests pass 2020-02-28 11:31:28 -08:00
Łukasz Magiera
5a4f917c60 4-stage v23 lotus-bench 2020-02-28 19:06:59 +01:00
Nate Walck
353c5d8b12 Relocation opencensus metrics to its own package and add more node stats 2020-02-27 21:49:18 -05:00
Łukasz Magiera
4dc35285dd Minimum sector size is now 2k 2020-02-28 01:48:34 +01:00
whyrusleeping
e4dcb7441b fixup lotus-bench 2020-02-27 14:23:05 -08:00
whyrusleeping
df6e3e83bf make it all build finally 2020-02-27 13:45:31 -08:00
whyrusleeping
6c12068fb7 more fixes for random garbage 2020-02-26 16:42:39 -08:00
whyrusleeping
767392332e WIP: update sectorbuilder 2020-02-26 14:54:34 -08:00
Łukasz Magiera
cb09e48e8c Some test fixes 2020-02-26 10:05:22 +01:00
Nate Walck
a3504dd51e Change lotusInfo opencensus key back to info 2020-02-25 20:11:55 -05:00
Nate Walck
0ce86e999a Add commit tag so we have that info as well 2020-02-25 19:59:51 -05:00
Nate Walck
2d2aefea16 Change lotus info counter name to version 2020-02-25 19:54:46 -05:00
Nate Walck
6b1e781602 export data under /debug/metrics to mirror go-ipfs 2020-02-25 19:49:32 -05:00
Nate Walck
f9dac3a291 Swap to opencensus for publishing data to prometheus 2020-02-25 19:40:07 -05:00
Łukasz Magiera
0a9e0acc6f types: Drop some redundant alias types 2020-02-25 22:09:22 +01:00
Łukasz Magiera
ae634ef7df actors: Remove addrass aliases 2020-02-25 21:54:58 +01:00
Łukasz Magiera
cd10a3126b actors: drop a bunch of type aliases 2020-02-25 21:35:15 +01:00
Łukasz Magiera
5d9b869d93 gofmt; mod tidy 2020-02-24 18:45:42 +01:00
Łukasz Magiera
794429dd55 post-upstream-merge fixes 2020-02-24 18:45:25 +01:00
Łukasz Magiera
d787aa5007 Merge branch 'testnet/3' into feat/specs-actors 2020-02-24 18:32:02 +01:00
Łukasz Magiera
def0e0a7a1 Merge remote-tracking branch 'origin/master' into testnet/3 2020-02-24 17:30:46 +01:00
Łukasz Magiera
ba6d1091f2 pond: Fix node startup 2020-02-24 00:39:45 +01:00
Nate Walck
cff1fcfe9d Move promhttp above manet.Listen 2020-02-23 17:54:49 -05:00
Nate Walck
6df2cf552a Remove commented out imports 2020-02-23 17:38:44 -05:00
Nate Walck
c0ef65f442 Enable Prometheus metrics endpoint and add lotus version 2020-02-23 17:35:29 -05:00
whyrusleeping
66624b1a8f fixup debug advance cmd 2020-02-23 13:30:42 -08:00
Łukasz Magiera
226685dc1c Implement committed capacity sectors 2020-02-23 01:47:47 +01:00
Łukasz Magiera
b8428423a1 get chain to runnable state 2020-02-22 14:10:46 +01:00
Łukasz Magiera
b12482df89 move peermgr, tracing into lib 2020-02-22 12:36:22 +01:00
Łukasz Magiera
111d35deef seed: New genesis creation commands 2020-02-21 21:57:00 +01:00
Łukasz Magiera
3b29aacfdc Fix debug build 2020-02-21 20:31:45 +01:00
Łukasz Magiera
18627e77ff gofmt; mod tidy 2020-02-21 20:28:20 +01:00
Travis Person
837dd0d241 chainsync: make batch size configurable 2020-02-21 18:49:49 +00:00
Travis Person
ec50048a29 chainsync: add http debug 2020-02-21 18:49:21 +00:00
Travis Person
54315ce50f chainsync: move address map into batch cycle 2020-02-21 18:48:52 +00:00
Łukasz Magiera
49ece5fddf storageminer: Fix build 2020-02-21 19:20:22 +01:00
Łukasz Magiera
852e888232 cmd/lotus: Fix build 2020-02-21 19:00:10 +01:00
Łukasz Magiera
57c43183e6 update specs-actors 2020-02-21 17:57:40 +01:00
Travis Person
28ec00500b chainwatch: reduce memory usage during large chain gaps 2020-02-20 03:06:41 +00:00
Łukasz Magiera
69ec3c205a Merge remote-tracking branch 'origin/master' into testnet/3 2020-02-19 22:10:14 +01:00
Aayush Rajasekaran
61401e5e82 Fix #1278: debug_advance should have its API calls updated 
- This was forgotten in commit 6097000
 2020-02-18 23:14:08 -05:00
Aayush Rajasekaran
60970008c8 Re: #1250: API methods should receive TipSetKeys, not TipSets, as input 2020-02-17 19:53:43 -05:00
Whyrusleeping
fc227561ba
Merge pull request #1254 from filecoin-project/feat/no-ffi-in-types 
Remove ffi from types package
 2020-02-17 11:13:56 -08:00
Łukasz Magiera
d5027bfbb2 Fix amt bug 2020-02-14 21:33:41 +01:00
Aayush Rajasekaran
f24d947388 Faucet: Provide more info when a user tries to create a miner with a non-BLS address 2020-02-12 18:41:23 -08:00
Łukasz Magiera
0d6cfc879d Use specs-actors ignatures 2020-02-13 00:52:36 +01:00
Łukasz Magiera
220bd376b4 seed: Update lotus-seed for new genesis types 2020-02-12 22:41:59 +01:00
Jakub Sztandera
c7ffaad763
Expand "repo" string before logging 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-02-12 21:00:07 +01:00
Jakub Sztandera
14580b6144
Import go-systemd properly 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-02-12 20:44:35 +01:00
Łukasz Magiera
a4f6b739be genesis: Change template types 2020-02-12 01:58:55 +01:00
Whyrusleeping
5133ff16ba
Merge pull request #1247 from filecoin-project/fix/lotus-shed-keyinfo 
lotus-shed: add back support for bls and secp after sig changes
 2020-02-11 13:40:42 -08:00
Łukasz Magiera
63e801e00f genesis: Cleanup the structure 2020-02-11 21:48:03 +01:00
Łukasz Magiera
e326a444b1
Merge pull request #1222 from filecoin-project/feat/support-multi-storage-miner-init 
Support multi storage directories in miner init
 2020-02-11 02:16:55 +01:00
Łukasz Magiera
fa2c6605c2 Fix compilation after dep updates 2020-02-11 02:11:58 +01:00
Travis Person
bc15d5234e lotus-shed: add back support for bls and secp after sig changes 2020-02-11 01:04:50 +00:00
Łukasz Magiera
c0ed0dda8e specs-actors: Fis some test compilation errors 2020-02-10 20:16:36 +01:00
Łukasz Magiera
7e70536bf1 specs-actors: Finish type cleanup 2020-02-10 19:21:10 +01:00
Łukasz Magiera
c72727b4fd specs-actors: Fix most compilation errors 2020-02-09 07:06:32 +01:00
Łukasz Magiera
41daf5ad28 gofmt 2020-02-08 03:18:37 +01:00
Łukasz Magiera
13435aebdc Spec Actors integration 2020-02-08 03:18:32 +01:00
Łukasz Magiera
3d3c1dbbb4 import key algs in wallet 2020-02-06 20:56:56 +01:00
Łukasz Magiera
604c234484 Merge remote-tracking branch 'origin/master' into testnet/3 2020-02-06 20:32:25 +01:00
Łukasz Magiera
72c89ab89b Merge pull request #1223 from filecoin-project/fix/squash-forks 
squash forks and use correct amt library everywhere
 2020-02-06 20:14:55 +01:00
Łukasz Magiera
85f91a1114 debug: Check error in AdvanceBlockCmd 2020-02-06 03:09:52 +01:00
Łukasz Magiera
cbf63aab1e Merge branch 'master' into testnet/3 2020-02-05 21:27:04 +01:00
hannahhoward
97b645cd55 fix(go-fil-markets): fix integration 
remove broken aspects of go-fil-markets integration and update versins
 2020-02-04 20:08:08 -08:00
whyrusleeping
faf05cafcf squash forks and use correct amt library everywhere 2020-02-04 18:26:42 -08:00
Łukasz Magiera
e7a1be4dde
Merge pull request #1217 from filecoin-project/feat/worker-prefetch 
worker: Prefetch data in background
 2020-02-05 03:09:24 +01:00
Travis Person
cf8e90fa3e Load sectorbuilder config during storage miner init 2020-02-05 00:07:44 +00:00
Travis Person
62146b7bb3 Add pre-sealed-metadata flag to miner init 
Metadata for presealed sectors now must be specified
 2020-02-04 23:16:10 +00:00
Jakub Sztandera
70da3e124a
Fix lotus-seed with sigs changes 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-02-04 23:49:10 +01:00
Łukasz Magiera
63af9f2a9e worker: Paramfetch once 2020-02-04 20:17:18 +01:00
Łukasz Magiera
1a9c775407 worker: Prefetch data in background 2020-02-04 20:09:08 +01:00
Łukasz Magiera
0e81c1cf7e Merge branch 'testnet/3' into feat/update-markets 2020-02-04 07:17:22 +01:00
Łukasz Magiera
1b6ad6d2a1 worker: Fix transfer urls 2020-01-31 19:56:48 +01:00
Łukasz Magiera
a62572bb76 Merge remote-tracking branch 'origin/master' into feat/new-sb-fs 2020-01-31 08:36:47 +01:00
Whyrusleeping
f752770a47
Merge pull request #1185 from filecoin-project/fork/snowball 
WIP, fork, fix slashing power calc
 2020-01-30 21:31:37 -08:00
whyrusleeping
19a65319ee test and fix fork, add bigint parsing to lotus shed 2020-01-30 18:14:20 -08:00
Łukasz Magiera
95f344540e Fix tests 2020-01-31 02:27:38 +01:00
Łukasz Magiera
aefc463586 build: Lazy ParametersJson 2020-01-30 23:50:24 +01:00
Łukasz Magiera
316b11445e storageminer: Print fault data in info 2020-01-30 19:38:03 +01:00
Yang
e5a48800ab fix:a bug of the power percentage in lotus-storage-miner info 2020-01-30 15:02:50 +08:00
Łukasz Magiera
db50d01db9 Merge remote-tracking branch 'origin/master' into feat/new-sb-fs 2020-01-30 07:46:47 +01:00
Jakub Sztandera
1e9f293994
Return errors 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-01-29 17:35:32 -08:00
Jakub Sztandera
bcbfc931ba
Intoroduce advance-block command 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-01-29 14:40:19 -08:00
Łukasz Magiera
3f58ffe572 storageminer: New storage config 2020-01-29 20:53:45 +01:00
Łukasz Magiera
5af64c53b6 initial sectorbuilder FS refactor integration 2020-01-29 00:08:02 +01:00
hannahhoward
b8077fadaa fix(dealstate): update deal states to match current 2020-01-28 14:08:13 -08:00
Jakub Sztandera
eb4b85aea5
Merge pull request #1161 from filecoin-project/feat/chainwatch-challe 
Add all challenges to chainwatch
 2020-01-27 20:32:41 -08:00
Jakub Sztandera
050d552b9d
Add log to show where is the lotus running 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-01-27 13:39:35 -08:00
Jakub Sztandera
cf86bc6e23
fix insert 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-01-27 13:10:13 -08:00
Jakub Sztandera
af61dfd8cd
Fix order 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-01-27 13:09:00 -08:00
Jakub Sztandera
2a2a18a163
Add candidate 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-01-27 13:07:32 -08:00
Jakub Sztandera
29f3d6aa28
fix typo 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-01-27 13:03:09 -08:00
Jakub Sztandera
4379ff60f6
Create them table 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-01-27 13:01:24 -08:00
Jakub Sztandera
a55a37c17b
Pass the error 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-01-27 13:00:13 -08:00
Jakub Sztandera
5532093d58
Commit only once 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-01-27 12:59:07 -08:00
Jakub Sztandera
752be27815
Add all challenges to chainwatch 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-01-27 12:16:08 -08:00
Łukasz Magiera
9fc5f0cd9d
Merge pull request #1124 from filecoin-project/feat/sector-recovery 
sealing: Implement some common error states
 2020-01-24 21:25:03 +01:00
Whyrusleeping
351a683812
Merge pull request #1151 from filecoin-project/lotus-health-v2 
refactor lotus-health agent for robustness
 2020-01-24 11:44:47 -08:00
ognots
445b7f3388 refactor lotus-health agent for robustness 
add retry logic when calls to API fail.
if API reconnects fail, restart lotus-daemon as it means lotus-daemon is likely unhealthy.

wait for lotus node's chain to sync during each check cycle, to avoid restarting lotus-daemon if needing to sync.

handle SIGTERM properly.

general cleanup and refactor of code, getting ready of unnecessary channels
 2020-01-24 11:46:47 -05:00
Łukasz Magiera
b5660b58b3 Merge remote-tracking branch 'origin/master' into feat/sector-recovery 2020-01-24 01:53:58 +01:00
Jakub Sztandera
7f1b12d29e
Merge pull request #1137 from filecoin-project/feat/chainwatch-active-deals 
chainwatch: Track deal activations
 2020-01-23 13:21:39 -08:00
Łukasz Magiera
de52d3cadd sealing: Handlef for PreCommitFailed 2020-01-23 18:34:04 +01:00
Łukasz Magiera
7e43c40529 storageminer: Use tabwriter in sectors list 2020-01-23 17:15:45 +01:00
Łukasz Magiera
94f2948020 sealing: implement handler for sealFailed 2020-01-23 16:38:10 +01:00
Łukasz Magiera
f5540195de worker: Fix progress bars 2020-01-23 15:38:36 +01:00
Łukasz Magiera
c3a5da8586 storageminer: log flag for sector status 2020-01-23 15:18:05 +01:00
whyrusleeping
dcd01df2d3 wire up tracing into state tree flush, add pprof flag 2020-01-22 11:53:06 -08:00
Łukasz Magiera
4654d9c192 chainwatch: Util routines / views 2020-01-22 16:12:47 +01:00
Łukasz Magiera
52718e514c chainwatch: Track deal activations 2020-01-22 03:22:12 +01:00
ognots
effacec817 range over right index to prevent bounds errors 
the test scenario 'healthyHeadCheckWindow5' was causing index out of bounds errors.
the second range function in checkWindow was iterating over the incorrect slice of cids.
should be comparing latest items in slices first
 2020-01-21 16:07:53 -05:00
Łukasz Magiera
7b295d7bb0
Merge pull request #1115 from filecoin-project/feat/chainwatch-json-states 
chainwatch: Store json states
 2020-01-21 17:15:33 +01:00
Łukasz Magiera
f5bfaff003
Merge pull request #1128 from filecoin-project/feat/chain-export-2 
Implement chain import and exporting
 2020-01-21 03:35:24 +01:00
whyrusleeping
d9f5f6e2c6 add flag to halt after chain importing 2020-01-20 17:58:58 -08:00
whyrusleeping
955b755055 wire up importing 2020-01-20 17:53:55 -08:00
ognots
0c6e4c6c40 fixes health agent bug 
was passing wrong variable to updateWindow function argument.
also updates duplicate function comment
 2020-01-20 20:34:13 -05:00
Łukasz Magiera
a46a9bb42e chainwatch: Store deals 2020-01-20 01:49:52 +01:00
Łukasz Magiera
62d661f898 chainwatch: Store json states 2020-01-19 22:48:19 +01:00
Jakub Sztandera
28604f5a4c
Merge pull request #1114 from filecoin-project/feat/bench-nits 
bench: Don't print unseal results when unsealing is skipped
 2020-01-19 15:58:38 +01:00
Łukasz Magiera
533081454a bench: Don't print unseal results when unsealing is skipped 2020-01-19 15:56:37 +01:00
Łukasz Magiera
1e782b3de2 Merge branch 'master' into feat/event-states 2020-01-18 14:40:59 +01:00
whyrusleeping
f9ea6969c3 Catch cases where new old miners with bad code were getting made 2020-01-17 21:20:56 -08:00
Łukasz Magiera
0aebec6697 Merge branch 'master' into feat/event-states 2020-01-16 03:59:14 +01:00
Travis Person
ec9286eb4b Add more collateral to CreateStorageMiner call in fountain 2020-01-16 01:04:04 +00:00
Łukasz Magiera
604bf64ef6 Move miner sealing logic into a separate package 2020-01-15 21:49:11 +01:00
Jiarui.Huang
6354a8ce03 So we should pass a bit more than the minimum collateral at the time of miner creation 
Even 0.1% more would be enough# Please enter the commit message for your changes. Lines starting
 2020-01-16 01:30:01 +08:00
Łukasz Magiera
cf9275a2a2 worker: Remove staging sectors in PreCommit 2020-01-15 02:37:37 +01:00
Łukasz Magiera
1163e46622 worker: Cleanup sealed sector data in commit 2020-01-15 02:24:13 +01:00
ognots
3953227702 use lotus cli and GetFullNodeAPI 
also some other minor bug fixes
 2020-01-14 12:18:45 -05:00
ognots
d8d8ce7526 health agent to monitor lotus 
watch if chain head changes in a given window of api polls
allows setting a threshold of how many times the chain head can remain
unchanged before failing health check
also can set interval for polling chain head
on failure, restarts systemd unit
 2020-01-14 12:18:45 -05:00
Łukasz Magiera
0011c321e2
Merge pull request #1071 from filecoin-project/feat/chainwatch-pg 
Use postgres in chainwatch
 2020-01-14 14:14:02 +01:00
Łukasz Magiera
2dc2e0ba56 Drop 1g sector option from faucet 2020-01-14 06:23:10 +01:00
Łukasz Magiera
14128819de Correctly handle multi parent blocks 2020-01-14 06:17:31 +01:00
Łukasz Magiera
11ac026b62 Merge branch 'feat/testnet2' into feat/chainwatch-pg 2020-01-14 04:20:39 +01:00
Łukasz Magiera
a2bcc1fec2 Mostly functional mock sectorbuilder 2020-01-14 03:05:35 +01:00
Łukasz Magiera
0bf41bcd10 Drop pnet from townhall 2020-01-14 00:36:05 +01:00
Łukasz Magiera
0402abe36b Fix tests 2020-01-13 21:59:21 +01:00
Łukasz Magiera
d78a5e0a9f Decimal types for some miner columns 2020-01-13 14:01:11 +01:00
Łukasz Magiera
719171faa3 Set smaller batch size 2020-01-13 00:46:54 +01:00
Łukasz Magiera
50bac00329 Merge branch 'master' into feat/testnet2 2020-01-10 20:55:40 +01:00
hannahhoward
0ce1bf706b refactor(markets): reorg file structure 2020-01-10 10:33:26 -08:00
hannahhoward
65ecb33630 feat(storagemarket): extract storage market 
remove all shared components, point at go-fil-components repo
 2020-01-10 09:49:07 -08:00
whyrusleeping
7534ac1e1a add ability to control seal operations completion time 2020-01-09 12:50:45 -08:00
Łukasz Magiera
fac47bfc54 Pass correct datastore into sectorbuilder 2020-01-09 14:23:44 +01:00
Łukasz Magiera
8cbcbbd7a4 Merge branch 'feat/testnet2' of github.com:filecoin-project/go-lotus into feat/testnet2 2020-01-08 22:44:54 +01:00
Łukasz Magiera
da38822dfd paramfetch: bring parameters.json back to this repo 2020-01-08 21:31:35 +01:00
Jakub Sztandera
1ed62628a7
Update go-log to v2 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-01-08 20:22:31 +01:00
Jakub Sztandera
886898b137
Update to badger v2 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-01-08 19:56:45 +01:00
Łukasz Magiera
79028397ad chainwatch: sync in batches 2020-01-08 17:29:46 +01:00
Łukasz Magiera
1b5e1c4753 gofmt 2020-01-08 15:18:30 +01:00
Łukasz Magiera
ab922ed1ba Merge remote-tracking branch 'origin/master' into feat/chainwatch-pg 2020-01-08 15:08:34 +01:00
Łukasz Magiera
31173ff4b4 Set logging levels in a single place 2020-01-08 14:49:34 +01:00
whyrusleeping
62db7a6dda fix build 2020-01-07 21:10:43 -08:00
laser
20321bb476 handle rebase 2020-01-07 08:18:35 -08:00
acruikshank
7873213b11 switch sectorbuilder from lib to external module 
point to correct version of sectorbuilder + ensure go-datastore stays at 0.1.1

replace local address type with go-address

consume paramfetch.GetParams instead of local paramfetch.go

remove constants now defined in sectorbuilder
 2020-01-07 07:48:43 -08:00
Łukasz Magiera
1e7f10e387 gofmt 2020-01-07 15:00:10 +01:00
hannahhoward
718acb0a86 refactor(cborutil): extract cborutil library 
Use extracted cborutil library
 2020-01-07 14:59:35 +01:00
hannahhoward
8418464d91 refactor(address): use extracted address library 
Switch to using extracted address library
 2020-01-07 14:53:27 +01:00
laser
6a740a6d67 consume newly-extracted paramfetch 2020-01-02 11:08:49 -08:00
whyrusleeping
83fb2eff98 add a flag for bench to not run unseal 2019-12-19 11:45:15 -08:00
Łukasz Magiera
81233b894d Implement 'chain get' for easier ipld digging 2019-12-19 17:58:02 +01:00
Łukasz Magiera
6f10183878
Merge pull request #974 from filecoin-project/feat/chainwatch-nulls 
chainwatch: show null blocks
 2019-12-18 22:05:27 +01:00
Jim
a028f22ee6
Merge pull request #962 from filecoin-project/docs/gpu-troubleshooting 
add some notes on troubleshooting GPU usage
 2019-12-18 19:18:17 +01:00
Łukasz Magiera
9f886a7eb0 chainwatch: show null blocks 2019-12-18 18:40:05 +01:00
whyrusleeping
3cb4a60db4 some log cleanup and an extra trace value 2019-12-17 14:15:51 -08:00
whyrusleeping
faad2485ee add some notes on troubleshooting GPU usage 2019-12-17 11:59:14 -08:00
Jakub Sztandera
9bd0072d5c
Nicer error print 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-12-17 16:27:41 +01:00
Jakub Sztandera
0eb7991bbd
Fix version check 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-12-17 16:26:16 +01:00
Łukasz Magiera
11d11c88ae
Revert "Refactor versions" 2019-12-17 16:16:57 +01:00
Jakub Sztandera
17d0fe96a4
Fix version references 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-12-17 00:44:56 +01:00
Jakub Sztandera
867cba610b
Refactor versions 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-12-17 00:43:43 +01:00
Łukasz Magiera
3fda442bb3
Merge pull request #934 from filecoin-project/feat/sb-diskmgr 
sectorbuilder: Check free space before creating sectors
 2019-12-16 21:37:18 +01:00
Łukasz Magiera
e0c6247ac9 Use power of 2 sizes when parsing byte counts 2019-12-16 20:44:48 +01:00
Łukasz Magiera
1383bfa0eb sectorbuilder: fs: address review 2019-12-16 20:19:26 +01:00
Łukasz Magiera
825e3a0774 sectorbuilder: check free space before creating sectors 2019-12-16 17:16:08 +01:00
Łukasz Magiera
d6f543ce87 gofmt 2019-12-16 13:00:43 +01:00
Łukasz Magiera
97cf3f70a5 chainwatch: sub to mpool/blocks afetr initial sync 2019-12-13 15:47:51 +01:00
Jakub Sztandera
9907f7b7fb
Add script for fixing nocne 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-12-13 15:47:21 +01:00
Łukasz Magiera
2e9655a4e0 More fixes 2019-12-13 14:42:01 +01:00
Łukasz Magiera
3d666b3992 Merge branch 'feat/chainwatch-stuff' into feat/chainwatch-pg 2019-12-13 12:57:59 +01:00
Łukasz Magiera
a246be587e chainwatch: fix ui queries 2019-12-13 12:48:42 +01:00
Łukasz Magiera
f2ea12571f Optimise mpool update processing 2019-12-13 12:04:24 +01:00
Łukasz Magiera
1018999096 WIP fixing queries 2019-12-13 10:30:51 +01:00
Łukasz Magiera
04691a13da chainwatch: Fix postgres data import 2019-12-12 19:34:28 +01:00
Łukasz Magiera
e34e5b27ba Merge branch 'master' into feat/chainwatch-pg 2019-12-12 17:57:35 +01:00
Łukasz Magiera
cf9edae000
Merge pull request #878 from filecoin-project/feat/cw-sset-counts 
chainwatch: Collect sector set sizes
 2019-12-12 17:32:12 +01:00
Łukasz Magiera
7556d44b15 More data in chainwatch 2019-12-12 14:53:38 +01:00
Łukasz Magiera
ee979a20f8 Show sectorset info in storageminer info 2019-12-12 13:02:20 +01:00
Łukasz Magiera
fc6073d13b chainwatch: Collect sector set sizes 2019-12-12 00:32:09 +01:00
Łukasz Magiera
66ee9d209d wip 2019-12-11 23:17:44 +01:00
Jakub Sztandera
9589fc0762
Add version commit string 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-12-11 23:00:39 +01:00
Łukasz Magiera
830f2cbdd3 Merge branch 'master' into feat/chainwatch-pg 2019-12-11 22:13:08 +01:00
Jakub Sztandera
4d49473616
Increase faucet limits 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-12-11 16:23:11 +01:00
Łukasz Magiera
bcbcaba57b
Merge pull request #861 from filecoin-project/feat/genesis-timestamp-flag 
allow setting genesis timestamp when initializing network
 2019-12-11 15:49:27 +01:00
Jakub Sztandera
b655ba1ac1
Fix build 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-12-11 15:44:42 +01:00
whyrusleeping
d6bfbe5a26 allow setting genesis timestamp when initializing network 2019-12-11 15:36:39 +01:00
Łukasz Magiera
43f5ba1eb4
Merge pull request #847 from lanzafame/feat/accept-human-sizes 
accept humanized size values to cli flags
 2019-12-11 13:18:05 +01:00
lanzafame
1888b68e38 accept humanized size values to cli flags 2019-12-11 12:06:28 +10:00
Łukasz Magiera
b6b06f67dc chainwatch: Postgres 2019-12-11 00:42:36 +01:00
Łukasz Magiera
7d5709f4e2
Merge pull request #840 from filecoin-project/feat/bench-bps 
bench: print bps speeds
 2019-12-10 21:21:13 +01:00
Jakub Sztandera
bfdfd4023e
Cleanup math 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-12-10 20:53:39 +01:00
Łukasz Magiera
0fa20f6074 bench: print bps speeds 2019-12-10 20:02:42 +01:00
Whyrusleeping
53999643f7
Merge pull request #837 from filecoin-project/feat/symlink-import-preseal 
Feat/symlink import preseal
 2019-12-10 19:22:16 +01:00
Łukasz Magiera
739a41e834 faucet: drop unsupported sector sizes 2019-12-10 18:54:34 +01:00
whyrusleeping
4d86a4bd4a fixup 2019-12-10 09:32:50 -08:00
whyrusleeping
08cc689293 add option to symlink to presealed sectors 2019-12-10 18:11:59 +01:00
whyrusleeping
df52f8981d Add missing newline 2019-12-10 15:11:21 +01:00
whyrusleeping
384b0bdf49 add option for json output 2019-12-10 15:05:41 +01:00
whyrusleeping
3f1d8f0ed4 perform homedir expansion on input directory 2019-12-10 14:47:49 +01:00
whyrusleeping
ce5c76c6d6 load sector info from pre seal file 2019-12-10 14:22:39 +01:00
whyrusleeping
5d12659266 allow lotus-bench to benchmark existing sectorbuilders 2019-12-10 14:01:17 +01:00
Łukasz Magiera
cbf945d013 Merge remote-tracking branch 'origin/feat/lotus-shed' into testnet-staging 2019-12-10 11:19:59 +01:00
whyrusleeping
e52c927d0a delete unnecessary thing 2019-12-09 14:09:07 -08:00
whyrusleeping
8fdece1b3f make badger readonly when initializing storage miner from sector set 2019-12-09 14:05:09 -08:00
Łukasz Magiera
0de9991dcd
Merge pull request #816 from filecoin-project/feat/api-cleanup 
Move api struct to a seprate pkg
 2019-12-09 18:33:13 +01:00
Łukasz Magiera
ff963dfea5
Merge pull request #780 from filecoin-project/feat/storage-deal-cleanup 
Clean up storage deal structures
 2019-12-09 18:31:18 +01:00
Łukasz Magiera
c49dc28a04 Move api struct to a seprate pkg 2019-12-09 18:22:11 +01:00
Travis Person
8d42ca4933 A place for all the lotus tools 2019-12-09 16:09:23 +01:00
Łukasz Magiera
d18179d347
Merge pull request #792 from filecoin-project/fix/precommit-cancel-commit 
Handle reverts in precommit more correctly
 2019-12-09 15:53:25 +01:00
Łukasz Magiera
17c112acc0
Merge pull request #796 from filecoin-project/feat/seed-aggregation 
implement lotus-seed aggregation commands
 2019-12-09 15:24:13 +01:00
Łukasz Magiera
464d06ac44
Merge pull request #806 from filecoin-project/feat/api-env 
Add env var for API token and location
 2019-12-09 14:56:22 +01:00
Jakub Sztandera
fb7850803e
Add env var for API token and location 
Usage: FULLNODE_API_INFO or STORAGE_API_INFO
Content of env var: `<token>:<api multiaddr>`
Example: `FULLNODE_API_INFO="$(cat ~/.lotus/token)dsds:$(cat ~/.lotus/api)"`

License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-12-09 13:36:56 +01:00
whyrusleeping
eba3f4af86 address PR review 2019-12-08 23:39:08 +01:00
Łukasz Magiera
7d68d9a029 storage: print sector retries in sector info 2019-12-08 23:35:46 +01:00
Łukasz Magiera
dec458718f
Merge pull request #793 from filecoin-project/feat/chainwatch-block-add-ts 
chainwatch: Collect incoming block tstamps
 2019-12-08 23:31:55 +01:00
Jakub Sztandera
7f537dce2d
More renames 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-12-08 22:48:20 +01:00
whyrusleeping
ba55aa117f open badger from source dirs as readonly 2019-12-08 22:24:41 +01:00
whyrusleeping
c8cef8d92f fix loading of genminer files 2019-12-08 22:14:16 +01:00
whyrusleeping
ce9be69d91 implement sector dir aggregator 2019-12-08 21:06:40 +01:00
whyrusleeping
2dc12e8bb3 implement lotus-seed aggregate-manifests 2019-12-08 19:35:44 +01:00
Łukasz Magiera
7dcee8c1e3 chainwatch: Collect incoming block tstamps 2019-12-08 16:49:13 +01:00
Jakub Sztandera
e2bd4b658b
Rename pledge-sector 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-12-08 15:28:27 +01:00
Łukasz Magiera
3edc93f117 wip chainwatch ui 2019-12-07 23:44:45 +01:00
whyrusleeping
f0653decf3 Clean up storage deal structures 2019-12-07 21:29:37 +01:00
Łukasz Magiera
83924e6b97
sectorbuilder: Allow to restrict task types 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-12-07 19:05:15 +01:00
Łukasz Magiera
c907e78e4e
Merge pull request #782 from filecoin-project/fix/dont-fetch-params 
Don't fetch params for pre-seal
 2019-12-07 17:41:51 +01:00
Jakub Sztandera
8b9dd91103
Don't fetch params for pre-seal 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-12-07 16:40:55 +01:00
Łukasz Magiera
21a8e4c8d6 worker: nogpu flag 2019-12-07 15:19:46 +01:00
Łukasz Magiera
bbc61a8f86
Merge pull request #766 from filecoin-project/feat/holes 
Pre-sealing holes
 2019-12-07 10:29:17 +01:00
Jakub Sztandera
92e7b4afbf
Fix tests, circle and make ux nicer 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-12-06 22:49:44 +01:00
Łukasz Magiera
7ed63fb7f8 seed: Trim cache 2019-12-06 22:18:52 +01:00
Jakub Sztandera
d53e43c24d
Fix test, improve log 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-12-06 19:47:55 +01:00
Jakub Sztandera
e07ab00fbb
Fix Uint64 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-12-06 18:55:46 +01:00
Jakub Sztandera
80592a87cf
Pre-sealing holes 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-12-06 18:53:33 +01:00
Whyrusleeping
e9ab233566
Update cmd/lotus-seed/seed/seed.go 2019-12-06 01:19:17 -08:00
whyrusleeping
2a8dd6dd46 one more occurance of the bug 2019-12-06 01:00:16 -08:00
Łukasz Magiera
5dd6d52894 Bump some numbers 2019-12-05 14:41:10 +01:00
Łukasz Magiera
6f024bee58
Merge pull request #736 from filecoin-project/feat/params-v20 
Params v20
 2019-12-05 14:03:37 +01:00
Łukasz Magiera
318f5ad76e
Merge pull request #749 from filcloud/fix/make-db-config 
make chainwatch db source config
 2019-12-05 13:01:37 +01:00
wanghui
5d5bc1bd39 make chainwatch db source config 2019-12-05 19:58:19 +08:00
Łukasz Magiera
3673a9110f
Merge pull request #743 from filecoin-project/feat/static-check-2 
more of that sweet staticcheck goodness
 2019-12-05 12:21:43 +01:00
Łukasz Magiera
69834a3cf3
Merge pull request #748 from filcloud/fix/dot-usage 
add usage descript for chainwatch dot
 2019-12-05 12:16:43 +01:00
Łukasz Magiera
310b07cc9c
Fix typo 2019-12-05 12:15:39 +01:00
wanghui
96548bef0e add usage descript for chainwatch dot 2019-12-05 19:12:08 +08:00
whyrusleeping
40be53c9f9 add command for power users to manually update sector state 2019-12-04 20:43:54 -08:00
whyrusleeping
613a0a05a0 more of that sweet staticcheck goodness 2019-12-04 18:04:09 -08:00
Łukasz Magiera
3daf9103a8 paramfetch: Only pull necessary params 2019-12-04 20:44:15 +01:00
Łukasz Magiera
b2001db9d5 worker: Fix rebaining bugs 2019-12-04 17:53:32 +01:00
Łukasz Magiera
28dde1a2d3 worker: Use system tar for moving cache around 2019-12-04 15:58:28 +01:00
Łukasz Magiera
edd30c7aa1 Merge branch 'master' into feat/remote-workers 2019-12-04 14:10:15 +01:00
Łukasz Magiera
0adfff9ae7
Merge pull request #705 from filecoin-project/feat/cw-receipts 
chainwatch: Gather receipts
 2019-12-04 02:27:20 +01:00
Łukasz Magiera
42b59342ab
Merge pull request #717 from filecoin-project/feat/sminer-sync-wait 
storageminer: Wait for sync
 2019-12-04 02:26:30 +01:00
Łukasz Magiera
d112fd18b1 Persist sector sealing errors 2019-12-04 01:44:29 +01:00
Łukasz Magiera
6467a982bc storageminer: Wait for sync 2019-12-04 01:25:18 +01:00
Łukasz Magiera
13c39452c1 storageminer: States for common failure modes 2019-12-04 00:59:40 +01:00
Łukasz Magiera
ac11fb6d7f chainwatch: gather receipts 2019-12-03 12:05:12 +01:00
Łukasz Magiera
a7239d7f01 allow setting api host in storageminer 2019-12-03 11:05:35 +01:00
Łukasz Magiera
160e11ce8c Merge branch 'master' into feat/remote-workers 2019-12-03 03:24:00 +01:00
Łukasz Magiera
dab80b30f6 storageminer: print fallback start in info 2019-12-03 02:46:29 +01:00
Łukasz Magiera
5ba4dfdf14 Devnet 9 2019-12-03 01:44:52 +01:00
Łukasz Magiera
923748e551 Expand paths in node init 2019-12-02 23:10:22 +01:00
whyrusleeping
22f96e626b add flag to disable gpu to lotus-bench 2019-12-02 11:25:16 -08:00
Łukasz Magiera
24be85e8ec Fix storage miner info for ePoSt 2019-12-02 17:47:09 +01:00
Łukasz Magiera
d5b94884c8 Buch of lint fixes 2019-12-02 13:51:16 +01:00
Łukasz Magiera
d9840c05db bench: Measure unseal time 2019-12-01 23:37:53 +01:00
Łukasz Magiera
fd8f65248b deals: Correctly set deal ID in provider states 2019-12-01 21:07:57 +01:00
Łukasz Magiera
a59d0f0f8c Fix unsealing, sector based data refs 2019-12-01 18:58:31 +01:00
whyrusleeping
c92b9d5a0d fix storage miner sectorbuilder construction 2019-11-30 23:55:20 -06:00
whyrusleeping
59d9c681ad Rework miner test setups to fix tests 2019-11-30 17:21:11 -06:00
Łukasz Magiera
89556819ae seal-worker: Handle cache 2019-11-30 14:22:50 +01:00
Łukasz Magiera
ed9279cf0c Some fixes and dev utils 2019-11-30 10:25:31 +01:00
Łukasz Magiera
8767d8c16b Merge branch 'feat/election-post' into feat/remote-workers 2019-11-30 09:42:28 +01:00
whyrusleeping
3b533ed76c Genesis miner config actually sets the created miner address now 2019-11-29 22:31:26 -06:00
Łukasz Magiera
ad978949db import sector/deal into state machines on init 2019-11-29 20:11:42 +01:00
whyrusleeping
0ca92bdca0 track hot and cold times for epost 2019-11-29 10:48:07 -08:00
whyrusleeping
ce89ddbd6a fixing some tests 2019-11-28 21:38:18 -06:00
Łukasz Magiera
cb7d15e67e genesis setup improvements 2019-11-28 23:50:58 +01:00
Łukasz Magiera
6098db4f51
Merge pull request #682 from filecoin-project/feat/election-post-fallback 
Feat/election post fallback
 2019-11-28 19:10:50 +01:00
Łukasz Magiera
920fd3ba9b storageminer: New fallback post scheduler 2019-11-28 18:44:57 +01:00
Łukasz Magiera
aefd432422 actors: Fallback post progress 2019-11-28 13:46:56 +01:00
Łukasz Magiera
b75767e678 seed: get default sector size from build.SectorSizes 2019-11-28 11:55:34 +01:00
whyrusleeping
8fae155cf6 Add timings for proof verification 2019-11-27 19:43:52 -06:00
Łukasz Magiera
5d30106f5a More v18 updates 2019-11-27 18:10:34 +01:00
Łukasz Magiera
d2412f4f00 Fix pond 2019-11-27 15:18:51 +01:00
Łukasz Magiera
23e0008b81 Merge remote-tracking branch 'origin/master' into feat/election-post 2019-11-27 13:31:44 +01:00
Łukasz Magiera
4a77fdac4c bench: Fix after filecoin-ffi switch 2019-11-27 13:12:42 +01:00
Łukasz Magiera
03b1d2329f seed: Call AcquireID for sectorIDs 2019-11-27 12:58:16 +01:00
whyrusleeping
718d681f73 Add lotus-bench for testing hardware specs 2019-11-26 20:47:08 -06:00
whyrusleeping
249bd8389f Copy over last sector ID key when migrating sectorbuilder 2019-11-26 19:39:07 -06:00
Łukasz Magiera
fc72da1d0c chain: Pass correct prover to VerifyPost 2019-11-26 18:06:05 +01:00
Łukasz Magiera
871c30d2a0 WIP trying to get election post to compute 2019-11-26 16:15:41 +01:00
Łukasz Magiera
72c7ec748f seed: Get params 2019-11-26 14:52:59 +01:00
Łukasz Magiera
265b90e95b update parameters.json 2019-11-25 23:17:39 +01:00
whyrusleeping
a0588d513d Add lotus-gen, rewire genesis mining 2019-11-24 22:45:13 -06:00
Łukasz Magiera
05e631235c Rename to lotus-seal-worker 2019-11-22 17:25:56 +01:00
Jakub Sztandera
36b7c5a32a
Swtich to xerrors 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-11-22 10:20:56 -06:00
Łukasz Magiera
3281e9448a fix rspco serialization 2019-11-22 16:48:02 +01:00
Łukasz Magiera
b726b95298 WIP remote sector CommitSseal 2019-11-21 20:51:53 +01:00
Łukasz Magiera
d4197bbadc Working remote PreCommit 2019-11-21 19:38:50 +01:00
Łukasz Magiera
98b1de33b6 Stats for remote workers 2019-11-21 17:23:42 +01:00
Łukasz Magiera
88bbcd80ea support remote SealPreCommit 2019-11-21 17:10:09 +01:00
Łukasz Magiera
ba3ad75670 remote-worker: wire up storage miner endpoints 2019-11-21 15:10:51 +01:00
Łukasz Magiera
9725eb78bf wip remote sectorbuilder workers 2019-11-21 01:53:06 +01:00
Łukasz Magiera
37792b149f sync: fix some issues 2019-11-20 20:49:29 +01:00
whyrusleeping
71923c691d dont publish nil message removed 2019-11-20 17:47:44 +01:00
Łukasz Magiera
06d498b45b chainwatch: log mpool message 2019-11-20 17:47:44 +01:00
Łukasz Magiera
4ee2fc4d9f chain: call unsub in Incoming* methods 2019-11-20 17:47:44 +01:00
Łukasz Magiera
ced47a11e7 chainwatch: more improvements 2019-11-20 17:47:44 +01:00
Łukasz Magiera
d3b980ef58 api.SyncIncomingBlocks 2019-11-20 17:47:44 +01:00
Łukasz Magiera
333847f7c9 chainwatch: store mpool message additions 2019-11-20 17:45:02 +01:00
Łukasz Magiera
f40a1afac8 chainwatch: store mpool message additions 2019-11-20 17:45:02 +01:00
Łukasz Magiera
80095fdf3c chainwatch: make target 2019-11-20 17:45:02 +01:00
Łukasz Magiera
d235e7f20e chainwatch: very, very basic key info view 2019-11-20 17:45:02 +01:00
Łukasz Magiera
3dd9691467 chainwatch: Store more detailed miner info 2019-11-20 17:45:02 +01:00
Łukasz Magiera
820f7bfb8a chainwatch: Capture more state 2019-11-20 17:45:02 +01:00
Łukasz Magiera
70956589ef Begin implementing ChainWatch 2019-11-20 17:45:02 +01:00
wanghui
ba889391b5 update imports and path 2019-11-16 14:47:04 +08:00
Frank
c9714b1708
Update cmd/lotus-storage-miner/init.go 
Co-Authored-By: Łukasz Magiera <magik6k@users.noreply.github.com>
 2019-11-16 14:16:18 +08:00
wanghui
b28ce76e8a clean up repo if miner init fail and use log 2019-11-15 19:54:12 +08:00
whyrusleeping
797d92b463 persist blocks as they come in 2019-11-14 19:19:16 -08:00
Łukasz Magiera
636c4f7671
Merge pull request #604 from filecoin-project/feat/townhall-lag-delta 
townhall: Show update time delta
 2019-11-14 21:53:24 +01:00
Łukasz Magiera
d684300713
Merge pull request #600 from filecoin-project/feat/tests-also 
Add --tests-also for fetch-params
 2019-11-14 18:16:12 +01:00
Łukasz Magiera
dbf8dff8e3 townhall: Show lag delta 2019-11-14 17:56:13 +01:00
Łukasz Magiera
f39a5f4a05 Mute pubsub logs 2019-11-14 17:32:00 +01:00
Jakub Sztandera
bc3dac0426
Add --tests-also for fetch-params 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-11-14 02:15:33 +01:00
Łukasz Magiera
37c0967fa8
Merge pull request #595 from filecoin-project/feat/small-fixes 
Bunch of small fixes / improvements, gofmt
 2019-11-13 19:15:50 +01:00
Jakub Sztandera
a58e165339
Restore api flags 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-11-13 16:37:40 +01:00
Jakub Sztandera
70419c0f55
Use API ListenAddress from config 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-11-13 16:37:40 +01:00
Łukasz Magiera
8f0e3ede24 Bunch of small fixes / improvements, gofmt 2019-11-13 15:48:57 +01:00
whyrusleeping
e1cb19da0a Exit 1 on error 2019-11-12 15:36:49 -08:00
Whyrusleeping
aa26935533
Merge pull request #573 from filecoin-project/feat/mark-bad-chains 
sync: Mark chains with bad blocks as bad too
 2019-11-13 05:12:06 +09:00
Łukasz Magiera
73ab6c0c66 WorkerCount on storageminer config 2019-11-12 18:59:38 +01:00
Łukasz Magiera
92b9f67327 Reduce log spam more 2019-11-12 11:05:18 +01:00
Łukasz Magiera
b6f4e53d43
Merge pull request #559 from filecoin-project/feat/faucet-miner-wait 
Better miner create waiting logic in fountain
 2019-11-11 21:49:12 +01:00
Łukasz Magiera
0b2ed8e9bb Better miner create waiting logic in fountain 2019-11-11 21:47:30 +01:00
Łukasz Magiera
35b44f08c4 townhall: Compare numbers 2019-11-11 21:13:14 +01:00
Łukasz Magiera
55247b366c townhall: Display previous weight diff 2019-11-11 21:13:14 +01:00
Łukasz Magiera
3c2cbb04c9 townhall: Display more timing info 2019-11-11 21:13:14 +01:00
Łukasz Magiera
55697209a7
Merge pull request #556 from filecoin-project/fix/post-restart 
Fix PoSt after storage miner restart
 2019-11-11 18:33:33 +01:00
Łukasz Magiera
b8f46bff26 storageminer: Drop sortedSectorInfo log 2019-11-11 18:32:46 +01:00
Łukasz Magiera
b8e18ed773 storageminer: Don't print PP in info cmd if not proving 2019-11-11 12:10:48 +01:00
Łukasz Magiera
c18127bf00 townhall: More colors, weight/height diff 2019-11-09 18:51:04 +01:00
Łukasz Magiera
81bd0bc517 Test to reproduce post error after restart 2019-11-09 11:42:36 +01:00
Łukasz Magiera
3f4d454f6e storageminer: Print proving period in info cmd 2019-11-09 10:49:43 +01:00
Łukasz Magiera
59fbc976d0 storageminer: Missing new line in info cmd 2019-11-09 10:02:55 +01:00
Łukasz Magiera
ed64e52e3a sectorbuilder: apply some review suggestions 2019-11-09 00:21:04 +01:00
Łukasz Magiera
27485777f0 Merge remote-tracking branch 'origin/master' into feat/interactive-porep 2019-11-08 21:45:06 +01:00
Łukasz Magiera
8c39486736 some import fixes 2019-11-08 21:11:56 +01:00
Łukasz Magiera
071f05fa95 Storage miner API improvements 2019-11-08 19:23:58 +01:00
whyrusleeping
e226071c20 disable GPU by default 2019-11-08 08:43:23 -08:00
wanghui
66f8e348a2 update size and unit 2019-11-07 20:05:03 +08:00
Frank
08ff772cf4
Update cmd/lotus-storage-miner/info.go 
update sector size format

Co-Authored-By: Łukasz Magiera <magik6k@users.noreply.github.com>
 2019-11-07 19:33:44 +08:00
wanghui
f221c05a33 add sector size info 2019-11-07 18:46:11 +08:00
whyrusleeping
9863942fe2 WIP: trying to write a test to reproduce the storage deal error 2019-11-07 00:39:34 +01:00
Jakub Sztandera
58229defcd
Fix faucet ip limiting to use X-Real-IP 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-11-06 16:10:27 +01:00
Łukasz Magiera
ed5ccfd750 Merge remote-tracking branch 'origin/devnet/7' into feat/interactive-porep 2019-11-05 18:53:19 +01:00
Łukasz Magiera
c76ce2a2eb rate-limit some sectorbuilder ops 2019-11-04 18:36:29 +01:00
Łukasz Magiera
13da5a5966 Put WorkerThreads on sectorbuilder.Config 2019-11-04 17:47:08 +01:00
whyrusleeping
fc9091cc89 Get interactive porep sector sealing mostly working 2019-10-31 20:57:10 -07:00
Łukasz Magiera
bad7b76165
Merge pull request #516 from filecoin-project/feat/invert-rate-limits 
Invert faucet rate limiting
 2019-10-31 19:13:11 +01:00
Travis Person
b9f8addd21 Invert faucet rate limiting 
Rate limits needs to be ordered from specific to generic to ensure that
a single user will not exhaust the generic limiter before being limited
by the more specific.

Resolves #517
 2019-10-31 10:43:01 -07:00
Łukasz Magiera
46d782b30b storageminer: Drop commitment tracker 2019-10-30 18:37:38 +01:00
Jakub Sztandera
3ea0997c93
Add support for different configs 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-10-30 17:38:39 +01:00
Łukasz Magiera
413314b44b
Merge pull request #494 from filecoin-project/feat/handle-uncommited 
storageminer: Handle uncommited sectors on start
 2019-10-30 15:32:34 +01:00
Łukasz Magiera
44f4ee0de1 storageminer: cmd to list sector commitments 2019-10-29 21:41:30 +01:00
Łukasz Magiera
391c73774d Set swarm log level to WARN 2019-10-29 20:51:44 +01:00
Jakub Sztandera
6d594bab67
Merge pull request #491 from filecoin-project/feat/bg-store-garbage 
Run store-garbage in background
 2019-10-29 19:33:48 +01:00
Łukasz Magiera
6a999d348a fountain: Allow picking sector size 2019-10-29 19:28:54 +01:00
Łukasz Magiera
8e1a9a71e6 Run store-garbage in background 2019-10-29 18:52:07 +01:00
Łukasz Magiera
788b0f5908 docs: Update mining instructions 2019-10-29 14:34:33 +01:00
Łukasz Magiera
640b889aa6 fountain: Fix create button in /miner.html 2019-10-29 14:26:15 +01:00
Łukasz Magiera
23b7cf305f fountain: Default to 1GiB sectors 2019-10-29 14:10:53 +01:00
Łukasz Magiera
e46ae15dfd townhall: Don't hard-code stuff 2019-10-29 14:06:02 +01:00
Łukasz Magiera
874be79958 very basic sector seal scheduling 2019-10-27 09:56:53 +01:00
whyrusleeping
874ab1456c WIP: updating to new proofs code 2019-10-25 18:07:34 +02:00
Łukasz Magiera
a20255d606 Fancier faucet 2019-10-25 17:43:55 +02:00
Łukasz Magiera
43e1752816 fountain: Create miner enpoint 2019-10-25 17:43:55 +02:00
Łukasz Magiera
d753c39133 Add rate limits to the fountain by @travisperson 2019-10-25 17:42:14 +02:00
whyrusleeping
4890f577f5 give miners the ability to select different sector sizes 2019-10-25 17:26:15 +02:00
Łukasz Magiera
eeca3d86df
Merge pull request #415 from filecoin-project/feat/deals-on-chain 
On-Chain deals
 2019-10-25 17:03:25 +02:00
Łukasz Magiera
5175d8541e peer manager: Handle bootstrap in peermgr 2019-10-23 13:11:18 +02:00
Łukasz Magiera
c41dd4efeb actora: register storagemarket 2019-10-23 12:44:00 +02:00
Łukasz Magiera
aab3bd617a REST file import endpoint 2019-10-23 11:39:44 +02:00
whyrusleeping
cc689ab920 shut down rpc server before node 2019-10-20 15:17:03 +09:00
Whyrusleeping
d891589cef
Merge pull request #412 from filecoin-project/feat/init-fail-cleanup 
Clean up after failed storage miner init
 2019-10-18 16:08:18 +09:00
whyrusleeping
098e05c4d7 Clean up after failed storage miner init 2019-10-18 14:13:36 +09:00
Jakub Sztandera
1bf713cb0a
Cleanup imports after rename 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-10-18 13:47:41 +09:00
Łukasz Magiera
f620ecea5e Devnet 6 2019-10-17 03:09:17 +02:00
whyrusleeping
2ac4ce122f check return code of create storage miner call 2019-10-16 16:45:48 +09:00
Łukasz Magiera
71182f69cc
Merge pull request #378 from filecoin-project/fix/miner-info-format 
Fix percentage display
 2019-10-15 17:30:31 +02:00
Jakub Sztandera
b582620e77
Fix percentage display 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-10-15 16:51:47 +02:00
Łukasz Magiera
f0ff51ff8e Devnet 5 2019-10-15 15:46:24 +02:00
Łukasz Magiera
f15d527a35
Merge pull request #343 from filecoin-project/feat/spec-sync 
Sync with the new spec
 2019-10-15 15:20:56 +02:00
Łukasz Magiera
98b4533247
Merge pull request #353 from filecoin-project/feat/node-deploy 
Quick miner deploy util
 2019-10-15 15:09:53 +02:00
Łukasz Magiera
a576b72364 actors: Sync with the new spec, storage actors 2019-10-15 14:31:34 +02:00
Łukasz Magiera
7f2f28d87b
Merge pull request #358 from filecoin-project/feat/chain-noise 
Add simple program to generate random chain noise
 2019-10-15 04:50:08 +02:00
Łukasz Magiera
75680ae502 Quick miner deploy util 2019-10-15 02:54:00 +02:00
whyrusleeping
e8a1b54740 Add more info to storage-miner info command output 2019-10-14 11:32:32 +09:00
whyrusleeping
495506f725 Add simple program to generate random chain noise 2019-10-14 10:20:49 +09:00
Łukasz Magiera
30198b4105 townhall: show tipset propagation 2019-10-12 16:05:41 +02:00
Łukasz Magiera
5fbbc8dd18
Merge pull request #338 from filecoin-project/feat/th-build 
townhall: Single-binary build
 2019-10-12 09:38:39 +02:00
Łukasz Magiera
5861332f40 sminer: info command 2019-10-12 01:47:29 +02:00
Łukasz Magiera
20cf5ba54c townhall: Single-binary build 2019-10-11 08:41:45 +02:00
Łukasz Magiera
387adae115 townhall: Node names 2019-10-11 04:45:45 +02:00
Łukasz Magiera
40267e15b2
Merge pull request #326 from filecoin-project/feat/periodic-bootstrap 
Periodic bootstrap
 2019-10-11 04:09:01 +02:00
Łukasz Magiera
c0179bd4fa Periodic bootstrap 2019-10-11 02:31:26 +02:00
Łukasz Magiera
4c5157d270 Lotus Townhall 2019-10-10 14:02:43 +02:00
whyrusleeping
14c4a8bee6 implement looking in the past for messages 2019-10-09 09:33:18 +02:00
Łukasz Magiera
752654ab03 Devnet 3; Builtin bootstrap; NAT Port Map 2019-10-09 05:16:35 +02:00
Whyrusleeping
3c68e66b4c
Merge pull request #285 from filecoin-project/fix/event-null-blocks 
events: Handle null blocks correctly
 2019-10-08 11:34:01 +09:00
whyrusleeping
e17fc950b3 Add pprof server to storage miner 2019-10-05 10:08:55 -06:00
Łukasz Magiera
7170e1893f events: Handle null blocks correctly 2019-10-05 00:43:04 +02:00
whyrusleeping
6dd8ed7d7a pass those tests 2019-10-04 10:06:05 -06:00
whyrusleeping
697bed27a6 fix websocket closing 2019-10-04 10:06:05 -06:00
Łukasz Magiera
1534536590 Store libp2p key in keystore 2019-10-03 02:11:31 +02:00
Łukasz Magiera
713f08e9bf move genesis loading to build pkg 2019-10-02 22:40:14 +02:00
Łukasz Magiera
05878f4320 Built in paramfetch 2019-10-02 19:20:30 +02:00
whyrusleeping
6de61424e4 add pprof server 2019-09-30 17:25:45 -06:00
Łukasz Magiera
1024812559 storageminer: Update post scheduling 2019-09-26 23:32:47 +02:00
Łukasz Magiera
18211b7bee storageminer: Fix PledgeCollateral calc on init 2019-09-26 12:13:43 -07:00
Łukasz Magiera
a2a2169ef8 Setup first devnet params 2019-09-26 12:13:43 -07:00
Łukasz Magiera
ad1265cad0 storageminer: Flags to allow specyfying keys to use 2019-09-26 16:31:13 +02:00
Łukasz Magiera
78e1ea14ad storageminer: Make worker key creation optional 2019-09-26 02:47:53 +02:00
Łukasz Magiera
9a990dbd8a use new sectorbuilder file interfaces 2019-09-23 12:50:28 +02:00
Łukasz Magiera
82dc6fa527 Very basic foutain 2019-09-20 23:36:43 +02:00
Łukasz Magiera
5e2c100f4d storageminer: Better context handling 2019-09-17 20:36:06 +02:00
Łukasz Magiera
037fa84e68 storageminer: Remove node shutdown hack 2019-09-17 20:28:21 +02:00
Łukasz Magiera
f2ecb772fa repo: Close datastore in Close 2019-09-17 16:34:22 +02:00
Łukasz Magiera
83f1a336a6 node: Basic graceful shutdown 2019-09-17 16:23:08 +02:00
Łukasz Magiera
5ea1459275 Use atomic moppl API in more places 2019-09-17 10:15:26 +02:00
whyrusleeping
a47969c76b finish up making the new serializations work 2019-09-10 16:03:17 -07:00
whyrusleeping
ed45d1c2b4 refactor state utilities into StateManager package, implement proper election proofs 2019-09-09 19:14:00 -07:00
Łukasz Magiera
6a4af984af storageminer: Fix init 2019-09-06 19:42:03 +02:00
Łukasz Magiera
c0566399c6 retrieval: Way to get the data 2019-08-29 17:50:19 +02:00
Łukasz Magiera
cad3efb9ba Command to list sealed blocks 2019-08-29 17:48:19 +02:00
Łukasz Magiera
28409a60b1 Use BLS in more places 2019-08-22 00:47:44 +02:00
Łukasz Magiera
f43757f9f2 storageminer: Unregister genesis miner in init 2019-08-20 20:17:59 +02:00
Łukasz Magiera
eda26faf21 Register miner address from storageminer process 2019-08-20 19:19:24 +02:00
Łukasz Magiera
89ea5a4750 pond: logs window 2019-08-19 23:31:25 +02:00
whyrusleeping
5920537bc5 fix gas limit in create storage miner call 2019-08-19 11:06:39 -07:00
whyrusleeping
4f91550851 fix waiting for bls signed message 2019-08-16 15:10:34 -07:00
whyrusleeping
b271e5231a set up lotus-storage-miner to be able to use an existing miner actor 2019-08-16 14:50:00 -07:00
Łukasz Magiera
f99c8e032d pond: +1k button for addresses 2019-08-09 17:59:12 +02:00
whyrusleeping
959fe371b0 move storage miner keys to full node 2019-08-08 10:56:14 -07:00
Łukasz Magiera
cdc535394d deals: fix statestore 2019-08-07 20:01:51 -07:00
Łukasz Magiera
5811f18b5e Address some review comments 2019-08-07 20:01:22 -07:00
Łukasz Magiera
37a7ee08ec Bootstrap storageminer with full node 2019-08-07 20:01:22 -07:00
Łukasz Magiera
322031d8e4 Fix storageminer cli 2019-08-07 20:01:22 -07:00
Łukasz Magiera
282654bf7b pond: storage miner init 2019-08-02 16:15:14 +02:00
Whyrusleeping
eb854467c8
Update cmd/lotus-storage-miner/run.go 
Co-Authored-By: Łukasz Magiera <magik6k@users.noreply.github.com>
 2019-07-30 10:18:01 -07:00
whyrusleeping
ee224e5b21 Implement 'storage miner' module, wire up a few bits it needs to start 2019-07-29 17:46:56 -07:00
whyrusleeping
8e840139bd appease go's format checker 2019-07-29 12:08:47 -07:00
whyrusleeping
b83ff6b9dc Wire up sector builder commands through the api 2019-07-29 12:08:47 -07:00
Łukasz Magiera
26232f0b9a storageminer: GetStorageMinerAPI for cli 2019-07-29 12:08:47 -07:00
whyrusleeping
4fb4835b35 can we store it? YES WE CAN 2019-07-29 12:08:47 -07:00
whyrusleeping
0c67d66198 Make message wait work and use it for the storage-miner init 2019-07-29 11:58:30 -07:00
Whyrusleeping
508e19f52f
Merge pull request #89 from filecoin-project/feat/chain-gen 
Implement a chain generator
 2019-07-29 09:57:40 -07:00
whyrusleeping
9ccd06b060 start method IDs at 1, to allow 0 for basic transfers 2019-07-26 14:42:38 -07:00
Łukasz Magiera
9ea5dbf902 chain: Benchmark chain gen 2019-07-26 13:47:29 -07:00
Jakub Sztandera
0e35240fe9 Wire in context to VMContext 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
 2019-07-26 21:01:02 +02:00
whyrusleeping
a0c1afff57 clean up which addresses get used where 2019-07-26 10:33:54 -07:00
Łukasz Magiera
a825b3b550 storageminer: Post-rebase update 2019-07-26 15:26:01 +02:00
Łukasz Magiera
283c4e4194 storageminer: Setup actor on init 2019-07-26 15:26:01 +02:00
Jakub Sztandera
81b5f46062 Implement RPC tracing 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
 2019-07-26 08:50:21 +02:00
Łukasz Magiera
f2abb33933 Generate single genesis in tests 2019-07-25 01:23:06 +02:00
Łukasz Magiera
8d58c0a2fd Only set genesis once 2019-07-25 01:12:22 +02:00
Łukasz Magiera
93a8ee11db jsonrpc: Work with browsers 2019-07-24 19:09:00 +02:00
Łukasz Magiera
c7b2bf8100 Fix reading auth headers 2019-07-24 15:40:42 +02:00
Łukasz Magiera
4fa9e45eb7 repo: check for config in exists 2019-07-24 13:20:00 +02:00
Łukasz Magiera
c6b4fadba1 Fix permissions after split and rebase 2019-07-24 03:10:26 +02:00
Łukasz Magiera
772dd6c549 Implement storage miner API in node 2019-07-24 02:58:31 +02:00
Łukasz Magiera
f0e807dabb Fix jsonrpc client after splitting apis 2019-07-24 02:40:19 +02:00
Łukasz Magiera
eda03095b0 Separate API for storageminer 2019-07-24 02:09:34 +02:00
Łukasz Magiera
d0cbf02d36 Don't build full API in storage miner 2019-07-24 01:48:59 +02:00
Łukasz Magiera
8d529d1ae7 gofmt 2019-07-24 01:47:36 +02:00
Łukasz Magiera
4c8b028887 Return error form Repo.Exists 2019-07-24 01:47:36 +02:00
Łukasz Magiera
4f1946d5a2 Address review 2019-07-24 01:47:36 +02:00
Łukasz Magiera
677f5c3e30 Check full node version in storageminer init 2019-07-24 01:47:36 +02:00
Łukasz Magiera
0e570c0b19 StorageMiner init code 2019-07-24 01:47:36 +02:00
Łukasz Magiera
486598ef53 storageminer: separate env var for storage repo 2019-07-24 01:47:36 +02:00
Łukasz Magiera
a5441f8d17 Add missing daemon files 2019-07-24 01:47:36 +02:00
Łukasz Magiera
b73f29286b Begin implementing storage miner 2019-07-24 01:47:36 +02:00
Whyrusleeping
3f61488e3c
Merge pull request #17 from filecoin-project/feat/mining-1 
Implement basic mining logic
 2019-07-11 10:09:15 -07:00
whyrusleeping
d381025ccc Implement initial mining logic 2019-07-10 19:36:43 -07:00
Łukasz Magiera
2e8dfc759b daemon: wire up fsrepo 2019-07-10 19:10:19 +02:00
Jakub Sztandera
f9a34b3f9c Cleanup lint 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
 2019-07-09 14:46:06 +02:00
Łukasz Magiera
cdca2ff2c7 Some net commands / apis 2019-07-08 21:07:16 +02:00
Łukasz Magiera
3375a72aea RPC server 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
 2019-07-01 23:11:33 +02:00
Łukasz Magiera
8417f515a1 Initial structure 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
 2019-07-01 23:11:33 +02:00