Raúl Kripalani
3c17cd655e
integrate extern/sector-storage into lotus proper.
2020-08-16 11:09:58 +01:00
Łukasz Magiera
0c75dd3865
Support AddPiece on workers
2020-08-14 16:06:53 +02:00
Łukasz Magiera
4f509d9b67
Merge pull request #2813 from filecoin-project/feat/unseal-on-workers
...
workers: Enable unseal support
2020-08-06 22:03:43 +02:00
Travis Person
ca53bf9097
lotus-worker: change address flag to listen ( #2848 )
...
* lotus-worker: change address flag to listen
Clarify the flag on the worker process to be the local address and port
the worker will listen on, and not the address of the miner.
* fixup! lotus-worker: change address flag to listen
Co-authored-by: Travis Person <travisperson@users.noreply.github.com>
2020-08-06 02:54:00 +02:00
Łukasz Magiera
de18d5521e
workers: Enable unseal support
2020-08-04 14:32:09 +02:00
ldoublewood
40b7783c77
fix missing flag for restarting worker
2020-07-31 15:30:41 +02:00
Łukasz Magiera
958cc8b947
Update sector-storage, parallel fetch limit
2020-07-24 22:11:11 +02:00
ognots
ebe197b0a8
extract and assign routable assign earlier on and add timeout
...
unspecified address should be calculated before use.
add a new timeout flag and add a timeout to TCP dial
2020-07-23 22:00:25 +02:00
ognots
6fda21d717
make address flag optional
...
use unspecified address as default value.
this will extract a routable IP to listen on and advertise
2020-07-23 22:00:25 +02:00
ognots
36472802f7
support unspecified addresses for worker
...
allow operators to set an unspecified address - 0.0.0.0 - when setting address flag in 'lotus-worker run'
to extract worker ip, dial the miner api.
if the dial succeeds, a valid route between miner and worker can be inferred
2020-07-23 22:00:25 +02:00
Łukasz Magiera
06acda0ab9
mod tidy, gofmt
2020-07-17 15:18:40 +02:00
Łukasz Magiera
0f2043d874
Merge pull request #2317 from filcloud/issue-2304
...
fix issue 2304: ux improvements
2020-07-15 19:38:35 +02:00
Frank
14ec9a2068
update storage miner and seal worker document
2020-07-11 16:55:13 +08:00
Łukasz Magiera
65648e6469
Fix seal-worker init
2020-07-10 16:13:35 +02:00
Frank
5dfb8c9474
add deprecation support
2020-07-10 20:18:09 +08:00
Frank
ce0f9922ee
Update lotus-seal-worker to lotus-worker
2020-07-09 11:04:45 +08:00
Frank
5b9baba900
fix issue 2304: ux improvements
2020-07-09 10:20:25 +08:00
Łukasz Magiera
2761872ea7
seal-worker: Auto-restart when API connection is lost
2020-06-17 17:47:18 +02:00
Łukasz Magiera
fc7195f19a
seal-worker: Wait for miner API on start
2020-06-17 17:47:18 +02:00
Łukasz Magiera
3b13397165
gofmt
2020-06-06 00:59:01 +02:00
Łukasz Magiera
163c2b2544
Merge remote-tracking branch 'origin/master' into next
2020-06-06 00:58:24 +02:00
laser
4855045ea2
pass context to paramfetch.GetParams
...
Fixes #1209
2020-06-05 10:28:00 -07:00
Łukasz Magiera
7ae9d26cd1
Merge remote-tracking branch 'origin/next' into fix/sealing-betterering
2020-06-05 14:00:47 +02:00
Jakub Sztandera
7bee5b3abc
Merge remote-tracking branch 'origin/master' into next
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-05 00:33:43 +02:00
Łukasz Magiera
fa3b1552cf
Update sector-storage intefraces
2020-06-04 21:26:29 +02:00
Jakub Sztandera
29dbc26dbd
Update cli
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-06-04 01:01:41 +02:00
laser
36a93c90eb
use a real ellipsis, kinda
2020-06-02 12:30:45 -07:00
Łukasz Magiera
64f4e80446
Include build type in version
2020-06-01 20:49:39 +02:00
Jakub Sztandera
d6615b6286
Cleanup many lint warnings
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-05-27 22:53:20 +02:00
Łukasz Magiera
f7325a69c1
Extract auth utils to go-jsonrpc
2020-05-20 20:37:45 +02:00
Łukasz Magiera
eeca031525
extract lib/jsonrpc to go-jsonrpc
2020-05-20 19:49:09 +02:00
Łukasz Magiera
8d35aacd31
Update sector-storage with better fetch logic
2020-04-28 14:57:53 +02:00
Łukasz Magiera
a2554952d1
Some electionPoSt -> winningPoSt renaming
2020-04-11 00:22:45 +02:00
Łukasz Magiera
d3ffe48fcb
Get things to mostly build
2020-04-10 23:29:05 +02:00
Łukasz Magiera
613e61222b
mostly wire up WindowedPoSt
2020-04-10 23:07:18 +02:00
Łukasz Magiera
95ee1c1cde
Extract sector-storage
2020-03-28 01:32:39 +01:00
Łukasz Magiera
c66d3dfad7
sectorstorage: Untangle from lotus deps
2020-03-27 22:35:33 +01:00
Łukasz Magiera
ae69e0fef1
seal-worker: Task type flags
2020-03-25 22:15:10 +01:00
Łukasz Magiera
ecf53f88ce
workers: More review related fixes
2020-03-25 00:37:40 +01:00
Łukasz Magiera
726c9c1fe7
workers: Address review
2020-03-24 19:01:04 +01:00
Łukasz Magiera
5e4a7e54df
Rename agvmgr+sealmgr to sectorstorage
2020-03-23 12:47:10 +01:00
Łukasz Magiera
d43f2a2e3b
workers: Address review
2020-03-22 22:39:06 +01:00
Łukasz Magiera
971fe6fdfd
workers: Drop sectors from origin after transfers
2020-03-22 05:27:28 +01:00
Łukasz Magiera
80cca91584
workers: get to executing tasks remotely!
2020-03-19 18:11:45 +01:00
Łukasz Magiera
d87b7c264d
stores: Use index in local store
2020-03-19 16:11:04 +01:00
Łukasz Magiera
94ebbd9d90
workers: Actually register in miner
2020-03-19 00:23:32 +01:00
Łukasz Magiera
d8c8832a37
stores: fix StorageList
2020-03-18 05:40:25 +01:00
Łukasz Magiera
de1c984b48
workers: Handle init on first run
2020-03-16 19:46:02 +01:00
Łukasz Magiera
7e997e40f3
workers: Simple storage diagnostics
2020-03-16 18:50:07 +01:00
Łukasz Magiera
96730bae75
workers: Report sectors paths after worker creates them
2020-03-13 17:54:55 +01:00
Łukasz Magiera
bc7fede68b
workers: Wire up most pieces
2020-03-13 02:37:38 +01:00
Łukasz Magiera
86871e5abc
workers: Basic Remote store
2020-03-13 01:23:05 +01:00
Łukasz Magiera
56968d858c
workers: Make LocalWorker public
2020-03-11 22:23:16 +01:00
Łukasz Magiera
71afcb0333
workrs: refactor sector store for more composability
2020-03-11 08:22:21 +01:00
Łukasz Magiera
7e2e30f94b
workers: Transfer logic refactoring
2020-03-11 06:49:17 +01:00
Łukasz Magiera
eb61a36fd7
workers: RPC scaffolding
2020-03-11 02:58:02 +01:00
Łukasz Magiera
a5c6d83cd9
gofmt; mod tidy
2020-03-05 23:43:41 +01:00
Łukasz Magiera
d10b84d8cd
worker: Fix build
2020-03-05 23:40:40 +01:00
whyrusleeping
df6e3e83bf
make it all build finally
2020-02-27 13:45:31 -08:00
Łukasz Magiera
fa2c6605c2
Fix compilation after dep updates
2020-02-11 02:11:58 +01:00
Łukasz Magiera
7e70536bf1
specs-actors: Finish type cleanup
2020-02-10 19:21:10 +01:00
Łukasz Magiera
63af9f2a9e
worker: Paramfetch once
2020-02-04 20:17:18 +01:00
Łukasz Magiera
1a9c775407
worker: Prefetch data in background
2020-02-04 20:09:08 +01:00
Łukasz Magiera
1b6ad6d2a1
worker: Fix transfer urls
2020-01-31 19:56:48 +01:00
Łukasz Magiera
a62572bb76
Merge remote-tracking branch 'origin/master' into feat/new-sb-fs
2020-01-31 08:36:47 +01:00
Łukasz Magiera
aefc463586
build: Lazy ParametersJson
2020-01-30 23:50:24 +01:00
Łukasz Magiera
5af64c53b6
initial sectorbuilder FS refactor integration
2020-01-29 00:08:02 +01:00
Łukasz Magiera
94f2948020
sealing: implement handler for sealFailed
2020-01-23 16:38:10 +01:00
Łukasz Magiera
f5540195de
worker: Fix progress bars
2020-01-23 15:38:36 +01:00
Łukasz Magiera
cf9275a2a2
worker: Remove staging sectors in PreCommit
2020-01-15 02:37:37 +01:00
Łukasz Magiera
1163e46622
worker: Cleanup sealed sector data in commit
2020-01-15 02:24:13 +01:00
whyrusleeping
7534ac1e1a
add ability to control seal operations completion time
2020-01-09 12:50:45 -08:00
Łukasz Magiera
8cbcbbd7a4
Merge branch 'feat/testnet2' of github.com:filecoin-project/go-lotus into feat/testnet2
2020-01-08 22:44:54 +01:00
Łukasz Magiera
da38822dfd
paramfetch: bring parameters.json back to this repo
2020-01-08 21:31:35 +01:00
Jakub Sztandera
1ed62628a7
Update go-log to v2
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-08 20:22:31 +01:00
Łukasz Magiera
31173ff4b4
Set logging levels in a single place
2020-01-08 14:49:34 +01:00
laser
20321bb476
handle rebase
2020-01-07 08:18:35 -08:00
acruikshank
7873213b11
switch sectorbuilder from lib to external module
...
point to correct version of sectorbuilder + ensure go-datastore stays at 0.1.1
replace local address type with go-address
consume paramfetch.GetParams instead of local paramfetch.go
remove constants now defined in sectorbuilder
2020-01-07 07:48:43 -08:00
laser
6a740a6d67
consume newly-extracted paramfetch
2020-01-02 11:08:49 -08:00
Łukasz Magiera
1383bfa0eb
sectorbuilder: fs: address review
2019-12-16 20:19:26 +01:00
Łukasz Magiera
825e3a0774
sectorbuilder: check free space before creating sectors
2019-12-16 17:16:08 +01:00
Jakub Sztandera
9589fc0762
Add version commit string
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-11 23:00:39 +01:00
Jakub Sztandera
fb7850803e
Add env var for API token and location
...
Usage: FULLNODE_API_INFO or STORAGE_API_INFO
Content of env var: `<token>:<api multiaddr>`
Example: `FULLNODE_API_INFO="$(cat ~/.lotus/token)dsds:$(cat ~/.lotus/api)"`
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-09 13:36:56 +01:00
Łukasz Magiera
83924e6b97
sectorbuilder: Allow to restrict task types
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-07 19:05:15 +01:00
Łukasz Magiera
21a8e4c8d6
worker: nogpu flag
2019-12-07 15:19:46 +01:00
Łukasz Magiera
b2001db9d5
worker: Fix rebaining bugs
2019-12-04 17:53:32 +01:00
Łukasz Magiera
28dde1a2d3
worker: Use system tar for moving cache around
2019-12-04 15:58:28 +01:00
Łukasz Magiera
160e11ce8c
Merge branch 'master' into feat/remote-workers
2019-12-03 03:24:00 +01:00
Łukasz Magiera
89556819ae
seal-worker: Handle cache
2019-11-30 14:22:50 +01:00
Łukasz Magiera
ed9279cf0c
Some fixes and dev utils
2019-11-30 10:25:31 +01:00
Łukasz Magiera
05e631235c
Rename to lotus-seal-worker
2019-11-22 17:25:56 +01:00