Łukasz Magiera
94f2948020
sealing: implement handler for sealFailed
2020-01-23 16:38:10 +01:00
Łukasz Magiera
f5540195de
worker: Fix progress bars
2020-01-23 15:38:36 +01:00
Łukasz Magiera
c3a5da8586
storageminer: log flag for sector status
2020-01-23 15:18:05 +01:00
whyrusleeping
dcd01df2d3
wire up tracing into state tree flush, add pprof flag
2020-01-22 11:53:06 -08:00
Łukasz Magiera
4654d9c192
chainwatch: Util routines / views
2020-01-22 16:12:47 +01:00
Łukasz Magiera
52718e514c
chainwatch: Track deal activations
2020-01-22 03:22:12 +01:00
ognots
effacec817
range over right index to prevent bounds errors
...
the test scenario 'healthyHeadCheckWindow5' was causing index out of bounds errors.
the second range function in checkWindow was iterating over the incorrect slice of cids.
should be comparing latest items in slices first
2020-01-21 16:07:53 -05:00
Łukasz Magiera
7b295d7bb0
Merge pull request #1115 from filecoin-project/feat/chainwatch-json-states
...
chainwatch: Store json states
2020-01-21 17:15:33 +01:00
Łukasz Magiera
f5bfaff003
Merge pull request #1128 from filecoin-project/feat/chain-export-2
...
Implement chain import and exporting
2020-01-21 03:35:24 +01:00
whyrusleeping
d9f5f6e2c6
add flag to halt after chain importing
2020-01-20 17:58:58 -08:00
whyrusleeping
955b755055
wire up importing
2020-01-20 17:53:55 -08:00
ognots
0c6e4c6c40
fixes health agent bug
...
was passing wrong variable to updateWindow function argument.
also updates duplicate function comment
2020-01-20 20:34:13 -05:00
Łukasz Magiera
a46a9bb42e
chainwatch: Store deals
2020-01-20 01:49:52 +01:00
Łukasz Magiera
62d661f898
chainwatch: Store json states
2020-01-19 22:48:19 +01:00
Jakub Sztandera
28604f5a4c
Merge pull request #1114 from filecoin-project/feat/bench-nits
...
bench: Don't print unseal results when unsealing is skipped
2020-01-19 15:58:38 +01:00
Łukasz Magiera
533081454a
bench: Don't print unseal results when unsealing is skipped
2020-01-19 15:56:37 +01:00
Łukasz Magiera
1e782b3de2
Merge branch 'master' into feat/event-states
2020-01-18 14:40:59 +01:00
whyrusleeping
f9ea6969c3
Catch cases where new old miners with bad code were getting made
2020-01-17 21:20:56 -08:00
Łukasz Magiera
0aebec6697
Merge branch 'master' into feat/event-states
2020-01-16 03:59:14 +01:00
Travis Person
ec9286eb4b
Add more collateral to CreateStorageMiner call in fountain
2020-01-16 01:04:04 +00:00
Łukasz Magiera
604bf64ef6
Move miner sealing logic into a separate package
2020-01-15 21:49:11 +01:00
Jiarui.Huang
6354a8ce03
So we should pass a bit more than the minimum collateral at the time of miner creation
...
Even 0.1% more would be enough# Please enter the commit message for your changes. Lines starting
2020-01-16 01:30:01 +08:00
Łukasz Magiera
cf9275a2a2
worker: Remove staging sectors in PreCommit
2020-01-15 02:37:37 +01:00
Łukasz Magiera
1163e46622
worker: Cleanup sealed sector data in commit
2020-01-15 02:24:13 +01:00
ognots
3953227702
use lotus cli and GetFullNodeAPI
...
also some other minor bug fixes
2020-01-14 12:18:45 -05:00
ognots
d8d8ce7526
health agent to monitor lotus
...
watch if chain head changes in a given window of api polls
allows setting a threshold of how many times the chain head can remain
unchanged before failing health check
also can set interval for polling chain head
on failure, restarts systemd unit
2020-01-14 12:18:45 -05:00
Łukasz Magiera
0011c321e2
Merge pull request #1071 from filecoin-project/feat/chainwatch-pg
...
Use postgres in chainwatch
2020-01-14 14:14:02 +01:00
Łukasz Magiera
2dc2e0ba56
Drop 1g sector option from faucet
2020-01-14 06:23:10 +01:00
Łukasz Magiera
14128819de
Correctly handle multi parent blocks
2020-01-14 06:17:31 +01:00
Łukasz Magiera
11ac026b62
Merge branch 'feat/testnet2' into feat/chainwatch-pg
2020-01-14 04:20:39 +01:00
Łukasz Magiera
a2bcc1fec2
Mostly functional mock sectorbuilder
2020-01-14 03:05:35 +01:00
Łukasz Magiera
0bf41bcd10
Drop pnet from townhall
2020-01-14 00:36:05 +01:00
Łukasz Magiera
0402abe36b
Fix tests
2020-01-13 21:59:21 +01:00
Łukasz Magiera
d78a5e0a9f
Decimal types for some miner columns
2020-01-13 14:01:11 +01:00
Łukasz Magiera
719171faa3
Set smaller batch size
2020-01-13 00:46:54 +01:00
Łukasz Magiera
50bac00329
Merge branch 'master' into feat/testnet2
2020-01-10 20:55:40 +01:00
hannahhoward
0ce1bf706b
refactor(markets): reorg file structure
2020-01-10 10:33:26 -08:00
hannahhoward
65ecb33630
feat(storagemarket): extract storage market
...
remove all shared components, point at go-fil-components repo
2020-01-10 09:49:07 -08:00
whyrusleeping
7534ac1e1a
add ability to control seal operations completion time
2020-01-09 12:50:45 -08:00
Łukasz Magiera
fac47bfc54
Pass correct datastore into sectorbuilder
2020-01-09 14:23:44 +01:00
Łukasz Magiera
8cbcbbd7a4
Merge branch 'feat/testnet2' of github.com:filecoin-project/go-lotus into feat/testnet2
2020-01-08 22:44:54 +01:00
Łukasz Magiera
da38822dfd
paramfetch: bring parameters.json back to this repo
2020-01-08 21:31:35 +01:00
Jakub Sztandera
1ed62628a7
Update go-log to v2
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-08 20:22:31 +01:00
Jakub Sztandera
886898b137
Update to badger v2
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-08 19:56:45 +01:00
Łukasz Magiera
79028397ad
chainwatch: sync in batches
2020-01-08 17:29:46 +01:00
Łukasz Magiera
1b5e1c4753
gofmt
2020-01-08 15:18:30 +01:00
Łukasz Magiera
ab922ed1ba
Merge remote-tracking branch 'origin/master' into feat/chainwatch-pg
2020-01-08 15:08:34 +01:00
Łukasz Magiera
31173ff4b4
Set logging levels in a single place
2020-01-08 14:49:34 +01:00
whyrusleeping
62db7a6dda
fix build
2020-01-07 21:10:43 -08:00
laser
20321bb476
handle rebase
2020-01-07 08:18:35 -08:00
acruikshank
7873213b11
switch sectorbuilder from lib to external module
...
point to correct version of sectorbuilder + ensure go-datastore stays at 0.1.1
replace local address type with go-address
consume paramfetch.GetParams instead of local paramfetch.go
remove constants now defined in sectorbuilder
2020-01-07 07:48:43 -08:00
Łukasz Magiera
1e7f10e387
gofmt
2020-01-07 15:00:10 +01:00
hannahhoward
718acb0a86
refactor(cborutil): extract cborutil library
...
Use extracted cborutil library
2020-01-07 14:59:35 +01:00
hannahhoward
8418464d91
refactor(address): use extracted address library
...
Switch to using extracted address library
2020-01-07 14:53:27 +01:00
laser
6a740a6d67
consume newly-extracted paramfetch
2020-01-02 11:08:49 -08:00
whyrusleeping
83fb2eff98
add a flag for bench to not run unseal
2019-12-19 11:45:15 -08:00
Łukasz Magiera
81233b894d
Implement 'chain get' for easier ipld digging
2019-12-19 17:58:02 +01:00
Łukasz Magiera
6f10183878
Merge pull request #974 from filecoin-project/feat/chainwatch-nulls
...
chainwatch: show null blocks
2019-12-18 22:05:27 +01:00
Jim
a028f22ee6
Merge pull request #962 from filecoin-project/docs/gpu-troubleshooting
...
add some notes on troubleshooting GPU usage
2019-12-18 19:18:17 +01:00
Łukasz Magiera
9f886a7eb0
chainwatch: show null blocks
2019-12-18 18:40:05 +01:00
whyrusleeping
3cb4a60db4
some log cleanup and an extra trace value
2019-12-17 14:15:51 -08:00
whyrusleeping
faad2485ee
add some notes on troubleshooting GPU usage
2019-12-17 11:59:14 -08:00
Jakub Sztandera
9bd0072d5c
Nicer error print
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-17 16:27:41 +01:00
Jakub Sztandera
0eb7991bbd
Fix version check
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-17 16:26:16 +01:00
Łukasz Magiera
11d11c88ae
Revert "Refactor versions"
2019-12-17 16:16:57 +01:00
Jakub Sztandera
17d0fe96a4
Fix version references
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-17 00:44:56 +01:00
Jakub Sztandera
867cba610b
Refactor versions
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-17 00:43:43 +01:00
Łukasz Magiera
3fda442bb3
Merge pull request #934 from filecoin-project/feat/sb-diskmgr
...
sectorbuilder: Check free space before creating sectors
2019-12-16 21:37:18 +01:00
Łukasz Magiera
e0c6247ac9
Use power of 2 sizes when parsing byte counts
2019-12-16 20:44:48 +01:00
Łukasz Magiera
1383bfa0eb
sectorbuilder: fs: address review
2019-12-16 20:19:26 +01:00
Łukasz Magiera
825e3a0774
sectorbuilder: check free space before creating sectors
2019-12-16 17:16:08 +01:00
Łukasz Magiera
d6f543ce87
gofmt
2019-12-16 13:00:43 +01:00
Łukasz Magiera
97cf3f70a5
chainwatch: sub to mpool/blocks afetr initial sync
2019-12-13 15:47:51 +01:00
Jakub Sztandera
9907f7b7fb
Add script for fixing nocne
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-13 15:47:21 +01:00
Łukasz Magiera
2e9655a4e0
More fixes
2019-12-13 14:42:01 +01:00
Łukasz Magiera
3d666b3992
Merge branch 'feat/chainwatch-stuff' into feat/chainwatch-pg
2019-12-13 12:57:59 +01:00
Łukasz Magiera
a246be587e
chainwatch: fix ui queries
2019-12-13 12:48:42 +01:00
Łukasz Magiera
f2ea12571f
Optimise mpool update processing
2019-12-13 12:04:24 +01:00
Łukasz Magiera
1018999096
WIP fixing queries
2019-12-13 10:30:51 +01:00
Łukasz Magiera
04691a13da
chainwatch: Fix postgres data import
2019-12-12 19:34:28 +01:00
Łukasz Magiera
e34e5b27ba
Merge branch 'master' into feat/chainwatch-pg
2019-12-12 17:57:35 +01:00
Łukasz Magiera
cf9edae000
Merge pull request #878 from filecoin-project/feat/cw-sset-counts
...
chainwatch: Collect sector set sizes
2019-12-12 17:32:12 +01:00
Łukasz Magiera
7556d44b15
More data in chainwatch
2019-12-12 14:53:38 +01:00
Łukasz Magiera
ee979a20f8
Show sectorset info in storageminer info
2019-12-12 13:02:20 +01:00
Łukasz Magiera
fc6073d13b
chainwatch: Collect sector set sizes
2019-12-12 00:32:09 +01:00
Łukasz Magiera
66ee9d209d
wip
2019-12-11 23:17:44 +01:00
Jakub Sztandera
9589fc0762
Add version commit string
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-11 23:00:39 +01:00
Łukasz Magiera
830f2cbdd3
Merge branch 'master' into feat/chainwatch-pg
2019-12-11 22:13:08 +01:00
Jakub Sztandera
4d49473616
Increase faucet limits
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-11 16:23:11 +01:00
Łukasz Magiera
bcbcaba57b
Merge pull request #861 from filecoin-project/feat/genesis-timestamp-flag
...
allow setting genesis timestamp when initializing network
2019-12-11 15:49:27 +01:00
Jakub Sztandera
b655ba1ac1
Fix build
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-11 15:44:42 +01:00
whyrusleeping
d6bfbe5a26
allow setting genesis timestamp when initializing network
2019-12-11 15:36:39 +01:00
Łukasz Magiera
43f5ba1eb4
Merge pull request #847 from lanzafame/feat/accept-human-sizes
...
accept humanized size values to cli flags
2019-12-11 13:18:05 +01:00
lanzafame
1888b68e38
accept humanized size values to cli flags
2019-12-11 12:06:28 +10:00
Łukasz Magiera
b6b06f67dc
chainwatch: Postgres
2019-12-11 00:42:36 +01:00
Łukasz Magiera
7d5709f4e2
Merge pull request #840 from filecoin-project/feat/bench-bps
...
bench: print bps speeds
2019-12-10 21:21:13 +01:00
Jakub Sztandera
bfdfd4023e
Cleanup math
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-10 20:53:39 +01:00
Łukasz Magiera
0fa20f6074
bench: print bps speeds
2019-12-10 20:02:42 +01:00
Whyrusleeping
53999643f7
Merge pull request #837 from filecoin-project/feat/symlink-import-preseal
...
Feat/symlink import preseal
2019-12-10 19:22:16 +01:00
Łukasz Magiera
739a41e834
faucet: drop unsupported sector sizes
2019-12-10 18:54:34 +01:00
whyrusleeping
4d86a4bd4a
fixup
2019-12-10 09:32:50 -08:00
whyrusleeping
08cc689293
add option to symlink to presealed sectors
2019-12-10 18:11:59 +01:00
whyrusleeping
df52f8981d
Add missing newline
2019-12-10 15:11:21 +01:00
whyrusleeping
384b0bdf49
add option for json output
2019-12-10 15:05:41 +01:00
whyrusleeping
3f1d8f0ed4
perform homedir expansion on input directory
2019-12-10 14:47:49 +01:00
whyrusleeping
ce5c76c6d6
load sector info from pre seal file
2019-12-10 14:22:39 +01:00
whyrusleeping
5d12659266
allow lotus-bench to benchmark existing sectorbuilders
2019-12-10 14:01:17 +01:00
Łukasz Magiera
cbf945d013
Merge remote-tracking branch 'origin/feat/lotus-shed' into testnet-staging
2019-12-10 11:19:59 +01:00
whyrusleeping
e52c927d0a
delete unnecessary thing
2019-12-09 14:09:07 -08:00
whyrusleeping
8fdece1b3f
make badger readonly when initializing storage miner from sector set
2019-12-09 14:05:09 -08:00
Łukasz Magiera
0de9991dcd
Merge pull request #816 from filecoin-project/feat/api-cleanup
...
Move api struct to a seprate pkg
2019-12-09 18:33:13 +01:00
Łukasz Magiera
ff963dfea5
Merge pull request #780 from filecoin-project/feat/storage-deal-cleanup
...
Clean up storage deal structures
2019-12-09 18:31:18 +01:00
Łukasz Magiera
c49dc28a04
Move api struct to a seprate pkg
2019-12-09 18:22:11 +01:00
Travis Person
8d42ca4933
A place for all the lotus tools
2019-12-09 16:09:23 +01:00
Łukasz Magiera
d18179d347
Merge pull request #792 from filecoin-project/fix/precommit-cancel-commit
...
Handle reverts in precommit more correctly
2019-12-09 15:53:25 +01:00
Łukasz Magiera
17c112acc0
Merge pull request #796 from filecoin-project/feat/seed-aggregation
...
implement lotus-seed aggregation commands
2019-12-09 15:24:13 +01:00
Łukasz Magiera
464d06ac44
Merge pull request #806 from filecoin-project/feat/api-env
...
Add env var for API token and location
2019-12-09 14:56:22 +01:00
Jakub Sztandera
fb7850803e
Add env var for API token and location
...
Usage: FULLNODE_API_INFO or STORAGE_API_INFO
Content of env var: `<token>:<api multiaddr>`
Example: `FULLNODE_API_INFO="$(cat ~/.lotus/token)dsds:$(cat ~/.lotus/api)"`
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-09 13:36:56 +01:00
whyrusleeping
eba3f4af86
address PR review
2019-12-08 23:39:08 +01:00
Łukasz Magiera
7d68d9a029
storage: print sector retries in sector info
2019-12-08 23:35:46 +01:00
Łukasz Magiera
dec458718f
Merge pull request #793 from filecoin-project/feat/chainwatch-block-add-ts
...
chainwatch: Collect incoming block tstamps
2019-12-08 23:31:55 +01:00
Jakub Sztandera
7f537dce2d
More renames
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-08 22:48:20 +01:00
whyrusleeping
ba55aa117f
open badger from source dirs as readonly
2019-12-08 22:24:41 +01:00
whyrusleeping
c8cef8d92f
fix loading of genminer files
2019-12-08 22:14:16 +01:00
whyrusleeping
ce9be69d91
implement sector dir aggregator
2019-12-08 21:06:40 +01:00
whyrusleeping
2dc12e8bb3
implement lotus-seed aggregate-manifests
2019-12-08 19:35:44 +01:00
Łukasz Magiera
7dcee8c1e3
chainwatch: Collect incoming block tstamps
2019-12-08 16:49:13 +01:00
Jakub Sztandera
e2bd4b658b
Rename pledge-sector
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-08 15:28:27 +01:00
Łukasz Magiera
3edc93f117
wip chainwatch ui
2019-12-07 23:44:45 +01:00
whyrusleeping
f0653decf3
Clean up storage deal structures
2019-12-07 21:29:37 +01:00
Łukasz Magiera
83924e6b97
sectorbuilder: Allow to restrict task types
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-07 19:05:15 +01:00
Łukasz Magiera
c907e78e4e
Merge pull request #782 from filecoin-project/fix/dont-fetch-params
...
Don't fetch params for pre-seal
2019-12-07 17:41:51 +01:00
Jakub Sztandera
8b9dd91103
Don't fetch params for pre-seal
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-07 16:40:55 +01:00
Łukasz Magiera
21a8e4c8d6
worker: nogpu flag
2019-12-07 15:19:46 +01:00
Łukasz Magiera
bbc61a8f86
Merge pull request #766 from filecoin-project/feat/holes
...
Pre-sealing holes
2019-12-07 10:29:17 +01:00
Jakub Sztandera
92e7b4afbf
Fix tests, circle and make ux nicer
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-06 22:49:44 +01:00
Łukasz Magiera
7ed63fb7f8
seed: Trim cache
2019-12-06 22:18:52 +01:00
Jakub Sztandera
d53e43c24d
Fix test, improve log
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-06 19:47:55 +01:00
Jakub Sztandera
e07ab00fbb
Fix Uint64
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-06 18:55:46 +01:00
Jakub Sztandera
80592a87cf
Pre-sealing holes
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-06 18:53:33 +01:00
Whyrusleeping
e9ab233566
Update cmd/lotus-seed/seed/seed.go
2019-12-06 01:19:17 -08:00
whyrusleeping
2a8dd6dd46
one more occurance of the bug
2019-12-06 01:00:16 -08:00
Łukasz Magiera
5dd6d52894
Bump some numbers
2019-12-05 14:41:10 +01:00
Łukasz Magiera
6f024bee58
Merge pull request #736 from filecoin-project/feat/params-v20
...
Params v20
2019-12-05 14:03:37 +01:00
Łukasz Magiera
318f5ad76e
Merge pull request #749 from filcloud/fix/make-db-config
...
make chainwatch db source config
2019-12-05 13:01:37 +01:00
wanghui
5d5bc1bd39
make chainwatch db source config
2019-12-05 19:58:19 +08:00
Łukasz Magiera
3673a9110f
Merge pull request #743 from filecoin-project/feat/static-check-2
...
more of that sweet staticcheck goodness
2019-12-05 12:21:43 +01:00
Łukasz Magiera
69834a3cf3
Merge pull request #748 from filcloud/fix/dot-usage
...
add usage descript for chainwatch dot
2019-12-05 12:16:43 +01:00
Łukasz Magiera
310b07cc9c
Fix typo
2019-12-05 12:15:39 +01:00
wanghui
96548bef0e
add usage descript for chainwatch dot
2019-12-05 19:12:08 +08:00