Commit Graph

450 Commits

Author SHA1 Message Date
ognots
445b7f3388 refactor lotus-health agent for robustness
add retry logic when calls to API fail.
if API reconnects fail, restart lotus-daemon as it means lotus-daemon is likely unhealthy.

wait for lotus node's chain to sync during each check cycle, to avoid restarting lotus-daemon if needing to sync.

handle SIGTERM properly.

general cleanup and refactor of code, getting ready of unnecessary channels
2020-01-24 11:46:47 -05:00
Łukasz Magiera
b5660b58b3 Merge remote-tracking branch 'origin/master' into feat/sector-recovery 2020-01-24 01:53:58 +01:00
Jakub Sztandera
7f1b12d29e
Merge pull request #1137 from filecoin-project/feat/chainwatch-active-deals
chainwatch: Track deal activations
2020-01-23 13:21:39 -08:00
Łukasz Magiera
de52d3cadd sealing: Handlef for PreCommitFailed 2020-01-23 18:34:04 +01:00
Łukasz Magiera
7e43c40529 storageminer: Use tabwriter in sectors list 2020-01-23 17:15:45 +01:00
Łukasz Magiera
94f2948020 sealing: implement handler for sealFailed 2020-01-23 16:38:10 +01:00
Łukasz Magiera
f5540195de worker: Fix progress bars 2020-01-23 15:38:36 +01:00
Łukasz Magiera
c3a5da8586 storageminer: log flag for sector status 2020-01-23 15:18:05 +01:00
whyrusleeping
dcd01df2d3 wire up tracing into state tree flush, add pprof flag 2020-01-22 11:53:06 -08:00
Łukasz Magiera
4654d9c192 chainwatch: Util routines / views 2020-01-22 16:12:47 +01:00
Łukasz Magiera
52718e514c chainwatch: Track deal activations 2020-01-22 03:22:12 +01:00
ognots
effacec817 range over right index to prevent bounds errors
the test scenario 'healthyHeadCheckWindow5' was causing index out of bounds errors.
the second range function in checkWindow was iterating over the incorrect slice of cids.
should be comparing latest items in slices first
2020-01-21 16:07:53 -05:00
Łukasz Magiera
7b295d7bb0
Merge pull request #1115 from filecoin-project/feat/chainwatch-json-states
chainwatch: Store json states
2020-01-21 17:15:33 +01:00
Łukasz Magiera
f5bfaff003
Merge pull request #1128 from filecoin-project/feat/chain-export-2
Implement chain import and exporting
2020-01-21 03:35:24 +01:00
whyrusleeping
d9f5f6e2c6 add flag to halt after chain importing 2020-01-20 17:58:58 -08:00
whyrusleeping
955b755055 wire up importing 2020-01-20 17:53:55 -08:00
ognots
0c6e4c6c40 fixes health agent bug
was passing wrong variable to updateWindow function argument.
also updates duplicate function comment
2020-01-20 20:34:13 -05:00
Łukasz Magiera
a46a9bb42e chainwatch: Store deals 2020-01-20 01:49:52 +01:00
Łukasz Magiera
62d661f898 chainwatch: Store json states 2020-01-19 22:48:19 +01:00
Jakub Sztandera
28604f5a4c
Merge pull request #1114 from filecoin-project/feat/bench-nits
bench: Don't print unseal results when unsealing is skipped
2020-01-19 15:58:38 +01:00
Łukasz Magiera
533081454a bench: Don't print unseal results when unsealing is skipped 2020-01-19 15:56:37 +01:00
Łukasz Magiera
1e782b3de2 Merge branch 'master' into feat/event-states 2020-01-18 14:40:59 +01:00
whyrusleeping
f9ea6969c3 Catch cases where new old miners with bad code were getting made 2020-01-17 21:20:56 -08:00
Łukasz Magiera
0aebec6697 Merge branch 'master' into feat/event-states 2020-01-16 03:59:14 +01:00
Travis Person
ec9286eb4b Add more collateral to CreateStorageMiner call in fountain 2020-01-16 01:04:04 +00:00
Łukasz Magiera
604bf64ef6 Move miner sealing logic into a separate package 2020-01-15 21:49:11 +01:00
Jiarui.Huang
6354a8ce03 So we should pass a bit more than the minimum collateral at the time of miner creation
Even 0.1% more would be enough# Please enter the commit message for your changes. Lines starting
2020-01-16 01:30:01 +08:00
Łukasz Magiera
cf9275a2a2 worker: Remove staging sectors in PreCommit 2020-01-15 02:37:37 +01:00
Łukasz Magiera
1163e46622 worker: Cleanup sealed sector data in commit 2020-01-15 02:24:13 +01:00
ognots
3953227702 use lotus cli and GetFullNodeAPI
also some other minor bug fixes
2020-01-14 12:18:45 -05:00
ognots
d8d8ce7526 health agent to monitor lotus
watch if chain head changes in a given window of api polls
allows setting a threshold of how many times the chain head can remain
unchanged before failing health check
also can set interval for polling chain head
on failure, restarts systemd unit
2020-01-14 12:18:45 -05:00
Łukasz Magiera
0011c321e2
Merge pull request #1071 from filecoin-project/feat/chainwatch-pg
Use postgres in chainwatch
2020-01-14 14:14:02 +01:00
Łukasz Magiera
2dc2e0ba56 Drop 1g sector option from faucet 2020-01-14 06:23:10 +01:00
Łukasz Magiera
14128819de Correctly handle multi parent blocks 2020-01-14 06:17:31 +01:00
Łukasz Magiera
11ac026b62 Merge branch 'feat/testnet2' into feat/chainwatch-pg 2020-01-14 04:20:39 +01:00
Łukasz Magiera
a2bcc1fec2 Mostly functional mock sectorbuilder 2020-01-14 03:05:35 +01:00
Łukasz Magiera
0bf41bcd10 Drop pnet from townhall 2020-01-14 00:36:05 +01:00
Łukasz Magiera
0402abe36b Fix tests 2020-01-13 21:59:21 +01:00
Łukasz Magiera
d78a5e0a9f Decimal types for some miner columns 2020-01-13 14:01:11 +01:00
Łukasz Magiera
719171faa3 Set smaller batch size 2020-01-13 00:46:54 +01:00
Łukasz Magiera
50bac00329 Merge branch 'master' into feat/testnet2 2020-01-10 20:55:40 +01:00
hannahhoward
0ce1bf706b refactor(markets): reorg file structure 2020-01-10 10:33:26 -08:00
hannahhoward
65ecb33630 feat(storagemarket): extract storage market
remove all shared components, point at go-fil-components repo
2020-01-10 09:49:07 -08:00
whyrusleeping
7534ac1e1a add ability to control seal operations completion time 2020-01-09 12:50:45 -08:00
Łukasz Magiera
fac47bfc54 Pass correct datastore into sectorbuilder 2020-01-09 14:23:44 +01:00
Łukasz Magiera
8cbcbbd7a4 Merge branch 'feat/testnet2' of github.com:filecoin-project/go-lotus into feat/testnet2 2020-01-08 22:44:54 +01:00
Łukasz Magiera
da38822dfd paramfetch: bring parameters.json back to this repo 2020-01-08 21:31:35 +01:00
Jakub Sztandera
1ed62628a7
Update go-log to v2
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-08 20:22:31 +01:00
Jakub Sztandera
886898b137
Update to badger v2
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-08 19:56:45 +01:00
Łukasz Magiera
79028397ad chainwatch: sync in batches 2020-01-08 17:29:46 +01:00
Łukasz Magiera
1b5e1c4753 gofmt 2020-01-08 15:18:30 +01:00
Łukasz Magiera
ab922ed1ba Merge remote-tracking branch 'origin/master' into feat/chainwatch-pg 2020-01-08 15:08:34 +01:00
Łukasz Magiera
31173ff4b4 Set logging levels in a single place 2020-01-08 14:49:34 +01:00
whyrusleeping
62db7a6dda fix build 2020-01-07 21:10:43 -08:00
laser
20321bb476 handle rebase 2020-01-07 08:18:35 -08:00
acruikshank
7873213b11 switch sectorbuilder from lib to external module
point to correct version of sectorbuilder + ensure go-datastore stays at 0.1.1

replace local address type with go-address

consume paramfetch.GetParams instead of local paramfetch.go

remove constants now defined in sectorbuilder
2020-01-07 07:48:43 -08:00
Łukasz Magiera
1e7f10e387 gofmt 2020-01-07 15:00:10 +01:00
hannahhoward
718acb0a86 refactor(cborutil): extract cborutil library
Use extracted cborutil library
2020-01-07 14:59:35 +01:00
hannahhoward
8418464d91 refactor(address): use extracted address library
Switch to using extracted address library
2020-01-07 14:53:27 +01:00
laser
6a740a6d67 consume newly-extracted paramfetch 2020-01-02 11:08:49 -08:00
whyrusleeping
83fb2eff98 add a flag for bench to not run unseal 2019-12-19 11:45:15 -08:00
Łukasz Magiera
81233b894d Implement 'chain get' for easier ipld digging 2019-12-19 17:58:02 +01:00
Łukasz Magiera
6f10183878
Merge pull request #974 from filecoin-project/feat/chainwatch-nulls
chainwatch: show null blocks
2019-12-18 22:05:27 +01:00
Jim
a028f22ee6
Merge pull request #962 from filecoin-project/docs/gpu-troubleshooting
add some notes on troubleshooting GPU usage
2019-12-18 19:18:17 +01:00
Łukasz Magiera
9f886a7eb0 chainwatch: show null blocks 2019-12-18 18:40:05 +01:00
whyrusleeping
3cb4a60db4 some log cleanup and an extra trace value 2019-12-17 14:15:51 -08:00
whyrusleeping
faad2485ee add some notes on troubleshooting GPU usage 2019-12-17 11:59:14 -08:00
Jakub Sztandera
9bd0072d5c
Nicer error print
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-17 16:27:41 +01:00
Jakub Sztandera
0eb7991bbd
Fix version check
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-17 16:26:16 +01:00
Łukasz Magiera
11d11c88ae
Revert "Refactor versions" 2019-12-17 16:16:57 +01:00
Jakub Sztandera
17d0fe96a4
Fix version references
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-17 00:44:56 +01:00
Jakub Sztandera
867cba610b
Refactor versions
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-17 00:43:43 +01:00
Łukasz Magiera
3fda442bb3
Merge pull request #934 from filecoin-project/feat/sb-diskmgr
sectorbuilder: Check free space before creating sectors
2019-12-16 21:37:18 +01:00
Łukasz Magiera
e0c6247ac9 Use power of 2 sizes when parsing byte counts 2019-12-16 20:44:48 +01:00
Łukasz Magiera
1383bfa0eb sectorbuilder: fs: address review 2019-12-16 20:19:26 +01:00
Łukasz Magiera
825e3a0774 sectorbuilder: check free space before creating sectors 2019-12-16 17:16:08 +01:00
Łukasz Magiera
d6f543ce87 gofmt 2019-12-16 13:00:43 +01:00
Łukasz Magiera
97cf3f70a5 chainwatch: sub to mpool/blocks afetr initial sync 2019-12-13 15:47:51 +01:00
Jakub Sztandera
9907f7b7fb
Add script for fixing nocne
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-13 15:47:21 +01:00
Łukasz Magiera
2e9655a4e0 More fixes 2019-12-13 14:42:01 +01:00
Łukasz Magiera
3d666b3992 Merge branch 'feat/chainwatch-stuff' into feat/chainwatch-pg 2019-12-13 12:57:59 +01:00
Łukasz Magiera
a246be587e chainwatch: fix ui queries 2019-12-13 12:48:42 +01:00
Łukasz Magiera
f2ea12571f Optimise mpool update processing 2019-12-13 12:04:24 +01:00
Łukasz Magiera
1018999096 WIP fixing queries 2019-12-13 10:30:51 +01:00
Łukasz Magiera
04691a13da chainwatch: Fix postgres data import 2019-12-12 19:34:28 +01:00
Łukasz Magiera
e34e5b27ba Merge branch 'master' into feat/chainwatch-pg 2019-12-12 17:57:35 +01:00
Łukasz Magiera
cf9edae000
Merge pull request #878 from filecoin-project/feat/cw-sset-counts
chainwatch: Collect sector set sizes
2019-12-12 17:32:12 +01:00
Łukasz Magiera
7556d44b15 More data in chainwatch 2019-12-12 14:53:38 +01:00
Łukasz Magiera
ee979a20f8 Show sectorset info in storageminer info 2019-12-12 13:02:20 +01:00
Łukasz Magiera
fc6073d13b chainwatch: Collect sector set sizes 2019-12-12 00:32:09 +01:00
Łukasz Magiera
66ee9d209d wip 2019-12-11 23:17:44 +01:00
Jakub Sztandera
9589fc0762
Add version commit string
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-11 23:00:39 +01:00
Łukasz Magiera
830f2cbdd3 Merge branch 'master' into feat/chainwatch-pg 2019-12-11 22:13:08 +01:00
Jakub Sztandera
4d49473616
Increase faucet limits
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-11 16:23:11 +01:00
Łukasz Magiera
bcbcaba57b
Merge pull request #861 from filecoin-project/feat/genesis-timestamp-flag
allow setting genesis timestamp when initializing network
2019-12-11 15:49:27 +01:00
Jakub Sztandera
b655ba1ac1
Fix build
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-11 15:44:42 +01:00
whyrusleeping
d6bfbe5a26 allow setting genesis timestamp when initializing network 2019-12-11 15:36:39 +01:00
Łukasz Magiera
43f5ba1eb4
Merge pull request #847 from lanzafame/feat/accept-human-sizes
accept humanized size values to cli flags
2019-12-11 13:18:05 +01:00
lanzafame
1888b68e38 accept humanized size values to cli flags 2019-12-11 12:06:28 +10:00
Łukasz Magiera
b6b06f67dc chainwatch: Postgres 2019-12-11 00:42:36 +01:00