cerc-io/lotus
16
0
Fork 0
Code Issues Pull Requests Packages Projects Releases 27 Wiki Activity
13,850 Commits 24 Branches 342 Tags 314 MiB
9964f80bb7
Commit Graph

150 Commits

Author SHA1 Message Date
Łukasz Magiera
9e6f974f3c storage: Fix build 2020-09-07 16:12:55 +02:00
Łukasz Magiera
0e6ff668eb worker: Cli to attach storage paths 2020-08-30 20:33:02 +02:00
Steven Allen
5733c71c50 Lint everything 
We were ignoring quite a few error cases, and had one case where we weren't
actually updating state where we wanted to. Unfortunately, if the linter doesn't
pass, nobody has any reason to actually check lint failures in CI.

There are three remaining XXXs marked in the code for lint.
 2020-08-20 20:46:36 -07:00
Łukasz Magiera
29db7047a3
Merge pull request #3112 from filecoin-project/fix/sched-hang 
Fix sealing sched hands on unclean worker disconnect
 2020-08-17 18:43:25 +02:00
Łukasz Magiera
6ef7a30b19
Merge pull request #3089 from filecoin-project/integrate/storage-fsm 
integrate extern/{storage-fsm,sector-storage} into lotus source tree
 2020-08-17 18:37:54 +02:00
Łukasz Magiera
f31473c4cf Update jsonrpc to fix sealing sched hangs 2020-08-17 17:36:21 +02:00
Raúl Kripalani
862bafc63a fix lint errors. 2020-08-17 14:39:33 +01:00
Raúl Kripalani
efdc428d5d keep storage-fsm (renamed to storage-sealing) and sector-storage in extern. 2020-08-17 14:26:18 +01:00
yaohcn
aded4b4199 add missing restart flag 2020-08-17 16:04:50 +08:00
Raúl Kripalani
3c17cd655e integrate extern/sector-storage into lotus proper. 2020-08-16 11:09:58 +01:00
Łukasz Magiera
0c75dd3865 Support AddPiece on workers 2020-08-14 16:06:53 +02:00
Łukasz Magiera
4f509d9b67
Merge pull request #2813 from filecoin-project/feat/unseal-on-workers 
workers: Enable unseal support
 2020-08-06 22:03:43 +02:00
Travis Person
ca53bf9097
lotus-worker: change address flag to listen (#2848) 
* lotus-worker: change address flag to listen

Clarify the flag on the worker process to be the local address and port
the worker will listen on, and not the address of the miner.

* fixup! lotus-worker: change address flag to listen

Co-authored-by: Travis Person <travisperson@users.noreply.github.com>
 2020-08-06 02:54:00 +02:00
Łukasz Magiera
de18d5521e workers: Enable unseal support 2020-08-04 14:32:09 +02:00
ldoublewood
40b7783c77 fix missing flag for restarting worker 2020-07-31 15:30:41 +02:00
Łukasz Magiera
958cc8b947 Update sector-storage, parallel fetch limit 2020-07-24 22:11:11 +02:00
ognots
ebe197b0a8 extract and assign routable assign earlier on and add timeout 
unspecified address should be calculated before use.
add a new timeout flag and add a timeout to TCP dial
 2020-07-23 22:00:25 +02:00
ognots
6fda21d717 make address flag optional 
use unspecified address as default value.
this will extract a routable IP to listen on and advertise
 2020-07-23 22:00:25 +02:00
ognots
36472802f7 support unspecified addresses for worker 
allow operators to set an unspecified address - 0.0.0.0 - when setting address flag in 'lotus-worker run'
to extract worker ip, dial the miner api.
if the dial succeeds, a valid route between miner and worker can be inferred
 2020-07-23 22:00:25 +02:00
Łukasz Magiera
06acda0ab9 mod tidy, gofmt 2020-07-17 15:18:40 +02:00
Łukasz Magiera
0f2043d874
Merge pull request #2317 from filcloud/issue-2304 
fix issue 2304: ux improvements
 2020-07-15 19:38:35 +02:00
Frank
14ec9a2068 update storage miner and seal worker document 2020-07-11 16:55:13 +08:00
Łukasz Magiera
65648e6469 Fix seal-worker init 2020-07-10 16:13:35 +02:00
Frank
5dfb8c9474 add deprecation support 2020-07-10 20:18:09 +08:00
Frank
ce0f9922ee Update lotus-seal-worker to lotus-worker 2020-07-09 11:04:45 +08:00
Frank
5b9baba900 fix issue 2304: ux improvements 2020-07-09 10:20:25 +08:00
Łukasz Magiera
2761872ea7 seal-worker: Auto-restart when API connection is lost 2020-06-17 17:47:18 +02:00
Łukasz Magiera
fc7195f19a seal-worker: Wait for miner API on start 2020-06-17 17:47:18 +02:00
Łukasz Magiera
3b13397165 gofmt 2020-06-06 00:59:01 +02:00
Łukasz Magiera
163c2b2544 Merge remote-tracking branch 'origin/master' into next 2020-06-06 00:58:24 +02:00
laser
4855045ea2 pass context to paramfetch.GetParams 
Fixes #1209
 2020-06-05 10:28:00 -07:00
Łukasz Magiera
7ae9d26cd1 Merge remote-tracking branch 'origin/next' into fix/sealing-betterering 2020-06-05 14:00:47 +02:00
Jakub Sztandera
7bee5b3abc
Merge remote-tracking branch 'origin/master' into next 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-06-05 00:33:43 +02:00
Łukasz Magiera
fa3b1552cf Update sector-storage intefraces 2020-06-04 21:26:29 +02:00
Jakub Sztandera
29dbc26dbd
Update cli 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-06-04 01:01:41 +02:00
laser
36a93c90eb use a real ellipsis, kinda 2020-06-02 12:30:45 -07:00
Łukasz Magiera
64f4e80446 Include build type in version 2020-06-01 20:49:39 +02:00
Jakub Sztandera
d6615b6286
Cleanup many lint warnings 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-05-27 22:53:20 +02:00
Łukasz Magiera
f7325a69c1 Extract auth utils to go-jsonrpc 2020-05-20 20:37:45 +02:00
Łukasz Magiera
eeca031525 extract lib/jsonrpc to go-jsonrpc 2020-05-20 19:49:09 +02:00
Łukasz Magiera
8d35aacd31 Update sector-storage with better fetch logic 2020-04-28 14:57:53 +02:00
Łukasz Magiera
a2554952d1 Some electionPoSt -> winningPoSt renaming 2020-04-11 00:22:45 +02:00
Łukasz Magiera
d3ffe48fcb Get things to mostly build 2020-04-10 23:29:05 +02:00
Łukasz Magiera
613e61222b mostly wire up WindowedPoSt 2020-04-10 23:07:18 +02:00
Łukasz Magiera
95ee1c1cde Extract sector-storage 2020-03-28 01:32:39 +01:00
Łukasz Magiera
c66d3dfad7 sectorstorage: Untangle from lotus deps 2020-03-27 22:35:33 +01:00
Łukasz Magiera
ae69e0fef1 seal-worker: Task type flags 2020-03-25 22:15:10 +01:00
Łukasz Magiera
ecf53f88ce workers: More review related fixes 2020-03-25 00:37:40 +01:00
Łukasz Magiera
726c9c1fe7 workers: Address review 2020-03-24 19:01:04 +01:00
Łukasz Magiera
5e4a7e54df Rename agvmgr+sealmgr to sectorstorage 2020-03-23 12:47:10 +01:00
Łukasz Magiera
d43f2a2e3b workers: Address review 2020-03-22 22:39:06 +01:00
Łukasz Magiera
971fe6fdfd workers: Drop sectors from origin after transfers 2020-03-22 05:27:28 +01:00
Łukasz Magiera
80cca91584 workers: get to executing tasks remotely! 2020-03-19 18:11:45 +01:00
Łukasz Magiera
d87b7c264d stores: Use index in local store 2020-03-19 16:11:04 +01:00
Łukasz Magiera
94ebbd9d90 workers: Actually register in miner 2020-03-19 00:23:32 +01:00
Łukasz Magiera
d8c8832a37 stores: fix StorageList 2020-03-18 05:40:25 +01:00
Łukasz Magiera
de1c984b48 workers: Handle init on first run 2020-03-16 19:46:02 +01:00
Łukasz Magiera
7e997e40f3 workers: Simple storage diagnostics 2020-03-16 18:50:07 +01:00
Łukasz Magiera
96730bae75 workers: Report sectors paths after worker creates them 2020-03-13 17:54:55 +01:00
Łukasz Magiera
bc7fede68b workers: Wire up most pieces 2020-03-13 02:37:38 +01:00
Łukasz Magiera
86871e5abc workers: Basic Remote store 2020-03-13 01:23:05 +01:00
Łukasz Magiera
56968d858c workers: Make LocalWorker public 2020-03-11 22:23:16 +01:00
Łukasz Magiera
71afcb0333 workrs: refactor sector store for more composability 2020-03-11 08:22:21 +01:00
Łukasz Magiera
7e2e30f94b workers: Transfer logic refactoring 2020-03-11 06:49:17 +01:00
Łukasz Magiera
eb61a36fd7 workers: RPC scaffolding 2020-03-11 02:58:02 +01:00
Łukasz Magiera
a5c6d83cd9 gofmt; mod tidy 2020-03-05 23:43:41 +01:00
Łukasz Magiera
d10b84d8cd worker: Fix build 2020-03-05 23:40:40 +01:00
whyrusleeping
df6e3e83bf make it all build finally 2020-02-27 13:45:31 -08:00
Łukasz Magiera
fa2c6605c2 Fix compilation after dep updates 2020-02-11 02:11:58 +01:00
Łukasz Magiera
7e70536bf1 specs-actors: Finish type cleanup 2020-02-10 19:21:10 +01:00
Łukasz Magiera
63af9f2a9e worker: Paramfetch once 2020-02-04 20:17:18 +01:00
Łukasz Magiera
1a9c775407 worker: Prefetch data in background 2020-02-04 20:09:08 +01:00
Łukasz Magiera
1b6ad6d2a1 worker: Fix transfer urls 2020-01-31 19:56:48 +01:00
Łukasz Magiera
a62572bb76 Merge remote-tracking branch 'origin/master' into feat/new-sb-fs 2020-01-31 08:36:47 +01:00
Łukasz Magiera
aefc463586 build: Lazy ParametersJson 2020-01-30 23:50:24 +01:00
Łukasz Magiera
5af64c53b6 initial sectorbuilder FS refactor integration 2020-01-29 00:08:02 +01:00
Łukasz Magiera
94f2948020 sealing: implement handler for sealFailed 2020-01-23 16:38:10 +01:00
Łukasz Magiera
f5540195de worker: Fix progress bars 2020-01-23 15:38:36 +01:00
Łukasz Magiera
cf9275a2a2 worker: Remove staging sectors in PreCommit 2020-01-15 02:37:37 +01:00
Łukasz Magiera
1163e46622 worker: Cleanup sealed sector data in commit 2020-01-15 02:24:13 +01:00
whyrusleeping
7534ac1e1a add ability to control seal operations completion time 2020-01-09 12:50:45 -08:00
Łukasz Magiera
8cbcbbd7a4 Merge branch 'feat/testnet2' of github.com:filecoin-project/go-lotus into feat/testnet2 2020-01-08 22:44:54 +01:00
Łukasz Magiera
da38822dfd paramfetch: bring parameters.json back to this repo 2020-01-08 21:31:35 +01:00
Jakub Sztandera
1ed62628a7
Update go-log to v2 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-01-08 20:22:31 +01:00
Łukasz Magiera
31173ff4b4 Set logging levels in a single place 2020-01-08 14:49:34 +01:00
laser
20321bb476 handle rebase 2020-01-07 08:18:35 -08:00
acruikshank
7873213b11 switch sectorbuilder from lib to external module 
point to correct version of sectorbuilder + ensure go-datastore stays at 0.1.1

replace local address type with go-address

consume paramfetch.GetParams instead of local paramfetch.go

remove constants now defined in sectorbuilder
 2020-01-07 07:48:43 -08:00
laser
6a740a6d67 consume newly-extracted paramfetch 2020-01-02 11:08:49 -08:00
Łukasz Magiera
1383bfa0eb sectorbuilder: fs: address review 2019-12-16 20:19:26 +01:00
Łukasz Magiera
825e3a0774 sectorbuilder: check free space before creating sectors 2019-12-16 17:16:08 +01:00
Jakub Sztandera
9589fc0762
Add version commit string 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-12-11 23:00:39 +01:00
Jakub Sztandera
fb7850803e
Add env var for API token and location 
Usage: FULLNODE_API_INFO or STORAGE_API_INFO
Content of env var: `<token>:<api multiaddr>`
Example: `FULLNODE_API_INFO="$(cat ~/.lotus/token)dsds:$(cat ~/.lotus/api)"`

License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-12-09 13:36:56 +01:00
Łukasz Magiera
83924e6b97
sectorbuilder: Allow to restrict task types 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-12-07 19:05:15 +01:00
Łukasz Magiera
21a8e4c8d6 worker: nogpu flag 2019-12-07 15:19:46 +01:00
Łukasz Magiera
b2001db9d5 worker: Fix rebaining bugs 2019-12-04 17:53:32 +01:00
Łukasz Magiera
28dde1a2d3 worker: Use system tar for moving cache around 2019-12-04 15:58:28 +01:00
Łukasz Magiera
160e11ce8c Merge branch 'master' into feat/remote-workers 2019-12-03 03:24:00 +01:00
Łukasz Magiera
89556819ae seal-worker: Handle cache 2019-11-30 14:22:50 +01:00
Łukasz Magiera
ed9279cf0c Some fixes and dev utils 2019-11-30 10:25:31 +01:00
Łukasz Magiera
05e631235c Rename to lotus-seal-worker 2019-11-22 17:25:56 +01:00