Commit Graph

883 Commits

Author SHA1 Message Date
Łukasz Magiera
de1c984b48 workers: Handle init on first run 2020-03-16 19:46:02 +01:00
Łukasz Magiera
7e997e40f3 workers: Simple storage diagnostics 2020-03-16 18:50:07 +01:00
Łukasz Magiera
416a0d2722 Merge branch 'feat/proofs-v24' into feat/new-workers 2020-03-16 10:45:22 +01:00
Łukasz Magiera
1f9fdf0c5c gofmt 2020-03-16 10:43:27 +01:00
Łukasz Magiera
a71906525a seed: Support parsing string sector-size 2020-03-15 21:42:44 +01:00
Łukasz Magiera
630df050c0 bench: Option to skip commit2 2020-03-15 18:48:53 +01:00
Łukasz Magiera
e6ec20b4ca Merge branch 'testnet/3' into feat/new-workers 2020-03-13 17:58:13 +01:00
Łukasz Magiera
96730bae75 workers: Report sectors paths after worker creates them 2020-03-13 17:54:55 +01:00
Łukasz Magiera
2c7f579838 workers: Implement SectorIndex 2020-03-13 12:59:19 +01:00
Łukasz Magiera
bc7fede68b workers: Wire up most pieces 2020-03-13 02:37:38 +01:00
Łukasz Magiera
86871e5abc workers: Basic Remote store 2020-03-13 01:23:05 +01:00
Łukasz Magiera
56968d858c workers: Make LocalWorker public 2020-03-11 22:23:16 +01:00
Łukasz Magiera
71afcb0333 workrs: refactor sector store for more composability 2020-03-11 08:22:21 +01:00
whyrusleeping
16d087cce4 get fallback post running successfully! 2020-03-10 23:30:48 -07:00
Łukasz Magiera
7e2e30f94b workers: Transfer logic refactoring 2020-03-11 06:49:17 +01:00
Łukasz Magiera
eb61a36fd7 workers: RPC scaffolding 2020-03-11 02:58:02 +01:00
Travis Person
c655162dd6 fountain: add 32GiB sectors 2020-03-10 02:21:37 +00:00
Łukasz Magiera
47e3b5b902 shed: make non-auto nonce-fix safer 2020-03-10 02:11:07 +01:00
Łukasz Magiera
9daaaa3ec2 shed: corect start nonce in nc-fix 2020-03-10 01:28:59 +01:00
Łukasz Magiera
e396454138 shed: auto mode for nonce-fix 2020-03-10 01:26:10 +01:00
Łukasz Magiera
0c3f4eb7dd storageminer: Create dir with --init 2020-03-09 23:00:29 +01:00
Łukasz Magiera
24956a49f4 gofmt 2020-03-09 22:47:58 +01:00
Łukasz Magiera
01087e01d2 storage: Improve thread safety 2020-03-09 20:22:30 +01:00
Łukasz Magiera
946fff39a6 chainwatch: Fix message index creation 2020-03-09 19:18:30 +01:00
Whyrusleeping
70552e3e0d Merge pull request #1368 from filecoin-project/feat/build-cleanup
build: Remove unused vars, fix debug build
2020-03-09 11:03:27 -07:00
Łukasz Magiera
5902daf3b5 chainwatch: Add to/from message indexes 2020-03-09 09:34:04 +01:00
Łukasz Magiera
1647798396 build: Remove unused vars, fix debug build 2020-03-09 07:54:29 +01:00
Łukasz Magiera
2ff4a2846b Merge pull request #1366 from filecoin-project/fix/set-price-units
Add units to set price command
2020-03-09 07:28:42 +01:00
Łukasz Magiera
6981cfb8bc Merge pull request #1365 from filecoin-project/feat/miner-storage-add
storageminer: 'storage attach' command
2020-03-09 07:28:11 +01:00
Łukasz Magiera
0b14ab8000 fountain: Fix miner wait page title 2020-03-09 07:27:07 +01:00
whyrusleeping
33aa9bd03f Add units to set price command 2020-03-08 23:22:11 -07:00
Łukasz Magiera
c10142816e Merge pull request #1363 from filecoin-project/feat/cwatch-update
Update chainwatch
2020-03-09 07:16:40 +01:00
Whyrusleeping
f9c38ac35e Merge pull request #1362 from filecoin-project/fix/no-storage-init
storageminer: Correctly initialize storage.json with --no-local-storage
2020-03-08 23:16:20 -07:00
Łukasz Magiera
33fcf8eb44 gofmt, mod tidy 2020-03-09 07:13:45 +01:00
Łukasz Magiera
c87ebe8590 storageminer: storage attach cmd 2020-03-09 07:13:22 +01:00
Łukasz Magiera
7c94f2f3be storageminer: Correctly initialize storage.json with --no-local-storage 2020-03-09 06:45:12 +01:00
Łukasz Magiera
a46296d340 Update chainwatch 2020-03-09 06:43:32 +01:00
whyrusleeping
ab51c7e2d2 Fix fallback post scheduling to hopefully do the right thing 2020-03-08 00:19:38 -08:00
whyrusleeping
24bf720a9a Merge branch 'master' into testnet/3 2020-03-07 16:46:12 -08:00
Whyrusleeping
0b5991850c Merge pull request #1346 from filecoin-project/feat/stat-cmd
Add stat-obj to API and a few extras
2020-03-06 18:55:48 -08:00
Travis Person
1a31571493 lotu-shed: add stateroot stats command 2020-03-07 00:55:11 +00:00
Whyrusleeping
f17962182f Merge pull request #1343 from filecoin-project/feat/sb-pc1-mkdir-fix
Update sectorbuilder to fix the mkdir bug in precommit1
2020-03-06 14:38:32 -08:00
Aayush Rajasekaran
55f155a72c fix make debug 2020-03-06 14:31:16 -08:00
Łukasz Magiera
a962479ce7 Update sectorbuilder to fix the mkdir bug in precommit1 2020-03-06 23:26:22 +01:00
whyrusleeping
4101147a5b one more miner init issue 2020-03-06 14:23:21 -08:00
Aayush Rajasekaran
2d63b007f2 Unify MethodCall and ReplayResults into SimulationResult
- Call and Replay now return the same type, which includes both Message and MessageReceipt
2020-03-06 11:10:40 -08:00
Łukasz Magiera
3cab8bd5d1 gofmt 2020-03-06 20:01:28 +01:00
Łukasz Magiera
38241d66cb Merge branch 'testnet/3' into feat/miner-rewards-cmd 2020-03-06 19:04:36 +01:00
Łukasz Magiera
b019e41f1c Merge pull request #1339 from filecoin-project/fix/fountain-create-miner-return
fountain: decode create miner results correctly
2020-03-06 09:14:05 +01:00
Łukasz Magiera
ea0dcdcfac Merge pull request #1338 from filecoin-project/fix/miner-init
fix storage miner init logic
2020-03-06 09:11:27 +01:00
Whyrusleeping
05a95cace5 Merge pull request #1336 from filecoin-project/vet/some-go-vet-fixes
some go vet fixes
2020-03-06 00:11:13 -08:00
Travis Person
277c037676 fountain: decode create miner results correctly 2020-03-06 08:08:07 +00:00
whyrusleeping
09c543c526 fix storage miner init logic 2020-03-06 00:06:59 -08:00
whyrusleeping
16096e2c71 some go vet fixes 2020-03-05 22:46:07 -08:00
Łukasz Magiera
7d3e16986c sectorbuilder type updates 2020-03-06 06:38:59 +01:00
whyrusleeping
1183e082af add command to inspect and redeem block rewards 2020-03-05 21:32:52 -08:00
Łukasz Magiera
ac3d0dc30c Config fauces for inteop devnet 2020-03-06 01:42:59 +01:00
Łukasz Magiera
a5c6d83cd9 gofmt; mod tidy 2020-03-05 23:43:41 +01:00
Łukasz Magiera
d10b84d8cd worker: Fix build 2020-03-05 23:40:40 +01:00
Łukasz Magiera
a5e5918fc5 mod tidy; gofmt 2020-03-05 20:21:06 +01:00
Łukasz Magiera
fa5bc3a5a9 Merge remote-tracking branch 'origin/testnet/3' into feat/4stage-seal 2020-03-05 20:20:47 +01:00
Łukasz Magiera
7d95e134eb storageminer: Print what we can in info cmd 2020-03-05 19:26:05 +01:00
Łukasz Magiera
c91d970c41 storageminer: Init with default local storage 2020-03-05 02:12:52 +01:00
Łukasz Magiera
7db1dd52bd storagemgr: Wire up most of AddPiece logic 2020-03-05 01:38:07 +01:00
whyrusleeping
5076b2b950 fix reward actor and block reward application 2020-03-04 13:21:24 -08:00
Łukasz Magiera
799ff17c7c Merge remote-tracking branch 'origin/testnet/3' into feat/4stage-seal 2020-03-04 06:37:11 +01:00
Travis Person
9b98ef5de4 chainwatch: add stateroot index on miner_heads 2020-03-04 04:50:53 +00:00
Łukasz Magiera
4e46d00eb6 Merge remote-tracking branch 'origin/testnet/3' into feat/4stage-seal 2020-03-04 04:01:13 +01:00
whyrusleeping
9169a073b6 add miner side commands and a few other goodies 2020-03-03 18:49:00 -08:00
Łukasz Magiera
12d870e274 sealmgr: Read only multi-path file manager 2020-03-04 03:24:08 +01:00
whyrusleeping
99c842e027 integrate client interface to allow for offline deals 2020-03-03 16:18:08 -08:00
Łukasz Magiera
a0dbb6bdd6 Storage Manager refactor 2020-03-03 23:19:22 +01:00
Whyrusleeping
41bf668189
Merge pull request #1294 from natewalck/more-opencensus-metrics
More opencensus metrics
2020-03-03 12:02:13 -08:00
whyrusleeping
60b19c51ef more misc fixes 2020-03-01 17:09:38 -08:00
Łukasz Magiera
98dbb2f70f bench: set correct registered proofs on things 2020-03-01 22:05:13 +01:00
Łukasz Magiera
f4310e8f69 bench: set sector size in saved commit2 inputs 2020-03-01 05:26:10 +01:00
Łukasz Magiera
ee3e631b1a bench: Prove command 2020-03-01 03:52:46 +01:00
Łukasz Magiera
342e85d378 bench: flag to save commit2 input 2020-02-29 03:31:25 +01:00
Łukasz Magiera
f54a555aa8 Merge remote-tracking branch 'origin/testnet/3' into feat/4stage-seal 2020-02-29 03:21:01 +01:00
whyrusleeping
194093469a fix subtool builds 2020-02-28 18:05:19 -08:00
whyrusleeping
c7508a0512 self review fixes 2020-02-28 18:02:40 -08:00
Aayush Rajasekaran
fe8db295e7 Re: #1290: Add a lotus wallet verify API and CLI command
- The command takes an address, message, and signature, and returns true if the sig is valid
2020-02-28 15:56:15 -08:00
whyrusleeping
5b657a2905 pass on proper sector types 2020-02-28 12:52:14 -08:00
whyrusleeping
0945d8725e fixing miner logic to make more tests pass 2020-02-28 11:31:28 -08:00
Łukasz Magiera
5a4f917c60 4-stage v23 lotus-bench 2020-02-28 19:06:59 +01:00
Nate Walck
353c5d8b12 Relocation opencensus metrics to its own package and add more node stats 2020-02-27 21:49:18 -05:00
Łukasz Magiera
4dc35285dd Minimum sector size is now 2k 2020-02-28 01:48:34 +01:00
whyrusleeping
e4dcb7441b fixup lotus-bench 2020-02-27 14:23:05 -08:00
whyrusleeping
df6e3e83bf make it all build finally 2020-02-27 13:45:31 -08:00
whyrusleeping
6c12068fb7 more fixes for random garbage 2020-02-26 16:42:39 -08:00
whyrusleeping
767392332e WIP: update sectorbuilder 2020-02-26 14:54:34 -08:00
Łukasz Magiera
cb09e48e8c Some test fixes 2020-02-26 10:05:22 +01:00
Nate Walck
a3504dd51e Change lotusInfo opencensus key back to info 2020-02-25 20:11:55 -05:00
Nate Walck
0ce86e999a Add commit tag so we have that info as well 2020-02-25 19:59:51 -05:00
Nate Walck
2d2aefea16 Change lotus info counter name to version 2020-02-25 19:54:46 -05:00
Nate Walck
6b1e781602 export data under /debug/metrics to mirror go-ipfs 2020-02-25 19:49:32 -05:00
Nate Walck
f9dac3a291 Swap to opencensus for publishing data to prometheus 2020-02-25 19:40:07 -05:00
Łukasz Magiera
0a9e0acc6f types: Drop some redundant alias types 2020-02-25 22:09:22 +01:00
Łukasz Magiera
ae634ef7df actors: Remove addrass aliases 2020-02-25 21:54:58 +01:00
Łukasz Magiera
cd10a3126b actors: drop a bunch of type aliases 2020-02-25 21:35:15 +01:00
Łukasz Magiera
5d9b869d93 gofmt; mod tidy 2020-02-24 18:45:42 +01:00
Łukasz Magiera
794429dd55 post-upstream-merge fixes 2020-02-24 18:45:25 +01:00
Łukasz Magiera
d787aa5007 Merge branch 'testnet/3' into feat/specs-actors 2020-02-24 18:32:02 +01:00
Łukasz Magiera
def0e0a7a1 Merge remote-tracking branch 'origin/master' into testnet/3 2020-02-24 17:30:46 +01:00
Łukasz Magiera
ba6d1091f2 pond: Fix node startup 2020-02-24 00:39:45 +01:00
Nate Walck
cff1fcfe9d Move promhttp above manet.Listen 2020-02-23 17:54:49 -05:00
Nate Walck
6df2cf552a Remove commented out imports 2020-02-23 17:38:44 -05:00
Nate Walck
c0ef65f442 Enable Prometheus metrics endpoint and add lotus version 2020-02-23 17:35:29 -05:00
whyrusleeping
66624b1a8f fixup debug advance cmd 2020-02-23 13:30:42 -08:00
Łukasz Magiera
226685dc1c Implement committed capacity sectors 2020-02-23 01:47:47 +01:00
Łukasz Magiera
b8428423a1 get chain to runnable state 2020-02-22 14:10:46 +01:00
Łukasz Magiera
b12482df89 move peermgr, tracing into lib 2020-02-22 12:36:22 +01:00
Łukasz Magiera
111d35deef seed: New genesis creation commands 2020-02-21 21:57:00 +01:00
Łukasz Magiera
3b29aacfdc Fix debug build 2020-02-21 20:31:45 +01:00
Łukasz Magiera
18627e77ff gofmt; mod tidy 2020-02-21 20:28:20 +01:00
Travis Person
837dd0d241 chainsync: make batch size configurable 2020-02-21 18:49:49 +00:00
Travis Person
ec50048a29 chainsync: add http debug 2020-02-21 18:49:21 +00:00
Travis Person
54315ce50f chainsync: move address map into batch cycle 2020-02-21 18:48:52 +00:00
Łukasz Magiera
49ece5fddf storageminer: Fix build 2020-02-21 19:20:22 +01:00
Łukasz Magiera
852e888232 cmd/lotus: Fix build 2020-02-21 19:00:10 +01:00
Łukasz Magiera
57c43183e6 update specs-actors 2020-02-21 17:57:40 +01:00
Travis Person
28ec00500b chainwatch: reduce memory usage during large chain gaps 2020-02-20 03:06:41 +00:00
Łukasz Magiera
69ec3c205a Merge remote-tracking branch 'origin/master' into testnet/3 2020-02-19 22:10:14 +01:00
Aayush Rajasekaran
61401e5e82 Fix #1278: debug_advance should have its API calls updated
- This was forgotten in commit 6097000
2020-02-18 23:14:08 -05:00
Aayush Rajasekaran
60970008c8 Re: #1250: API methods should receive TipSetKeys, not TipSets, as input 2020-02-17 19:53:43 -05:00
Whyrusleeping
fc227561ba
Merge pull request #1254 from filecoin-project/feat/no-ffi-in-types
Remove ffi from types package
2020-02-17 11:13:56 -08:00
Łukasz Magiera
d5027bfbb2 Fix amt bug 2020-02-14 21:33:41 +01:00
Aayush Rajasekaran
f24d947388 Faucet: Provide more info when a user tries to create a miner with a non-BLS address 2020-02-12 18:41:23 -08:00
Łukasz Magiera
0d6cfc879d Use specs-actors ignatures 2020-02-13 00:52:36 +01:00
Łukasz Magiera
220bd376b4 seed: Update lotus-seed for new genesis types 2020-02-12 22:41:59 +01:00
Jakub Sztandera
c7ffaad763
Expand "repo" string before logging
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-02-12 21:00:07 +01:00
Jakub Sztandera
14580b6144
Import go-systemd properly
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-02-12 20:44:35 +01:00
Łukasz Magiera
a4f6b739be genesis: Change template types 2020-02-12 01:58:55 +01:00
Whyrusleeping
5133ff16ba
Merge pull request #1247 from filecoin-project/fix/lotus-shed-keyinfo
lotus-shed: add back support for bls and secp after sig changes
2020-02-11 13:40:42 -08:00
Łukasz Magiera
63e801e00f genesis: Cleanup the structure 2020-02-11 21:48:03 +01:00
Łukasz Magiera
e326a444b1
Merge pull request #1222 from filecoin-project/feat/support-multi-storage-miner-init
Support multi storage directories in miner init
2020-02-11 02:16:55 +01:00
Łukasz Magiera
fa2c6605c2 Fix compilation after dep updates 2020-02-11 02:11:58 +01:00
Travis Person
bc15d5234e lotus-shed: add back support for bls and secp after sig changes 2020-02-11 01:04:50 +00:00
Łukasz Magiera
c0ed0dda8e specs-actors: Fis some test compilation errors 2020-02-10 20:16:36 +01:00
Łukasz Magiera
7e70536bf1 specs-actors: Finish type cleanup 2020-02-10 19:21:10 +01:00
Łukasz Magiera
c72727b4fd specs-actors: Fix most compilation errors 2020-02-09 07:06:32 +01:00
Łukasz Magiera
41daf5ad28 gofmt 2020-02-08 03:18:37 +01:00
Łukasz Magiera
13435aebdc Spec Actors integration 2020-02-08 03:18:32 +01:00
Łukasz Magiera
3d3c1dbbb4 import key algs in wallet 2020-02-06 20:56:56 +01:00
Łukasz Magiera
604c234484 Merge remote-tracking branch 'origin/master' into testnet/3 2020-02-06 20:32:25 +01:00
Łukasz Magiera
72c89ab89b Merge pull request #1223 from filecoin-project/fix/squash-forks
squash forks and use correct amt library everywhere
2020-02-06 20:14:55 +01:00
Łukasz Magiera
85f91a1114 debug: Check error in AdvanceBlockCmd 2020-02-06 03:09:52 +01:00
Łukasz Magiera
cbf63aab1e Merge branch 'master' into testnet/3 2020-02-05 21:27:04 +01:00
hannahhoward
97b645cd55 fix(go-fil-markets): fix integration
remove broken aspects of go-fil-markets integration and update versins
2020-02-04 20:08:08 -08:00
whyrusleeping
faf05cafcf squash forks and use correct amt library everywhere 2020-02-04 18:26:42 -08:00
Łukasz Magiera
e7a1be4dde
Merge pull request #1217 from filecoin-project/feat/worker-prefetch
worker: Prefetch data in background
2020-02-05 03:09:24 +01:00
Travis Person
cf8e90fa3e Load sectorbuilder config during storage miner init 2020-02-05 00:07:44 +00:00
Travis Person
62146b7bb3 Add pre-sealed-metadata flag to miner init
Metadata for presealed sectors now must be specified
2020-02-04 23:16:10 +00:00
Jakub Sztandera
70da3e124a
Fix lotus-seed with sigs changes
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-02-04 23:49:10 +01:00
Łukasz Magiera
63af9f2a9e worker: Paramfetch once 2020-02-04 20:17:18 +01:00
Łukasz Magiera
1a9c775407 worker: Prefetch data in background 2020-02-04 20:09:08 +01:00
Łukasz Magiera
0e81c1cf7e Merge branch 'testnet/3' into feat/update-markets 2020-02-04 07:17:22 +01:00
Łukasz Magiera
1b6ad6d2a1 worker: Fix transfer urls 2020-01-31 19:56:48 +01:00
Łukasz Magiera
a62572bb76 Merge remote-tracking branch 'origin/master' into feat/new-sb-fs 2020-01-31 08:36:47 +01:00
Whyrusleeping
f752770a47
Merge pull request #1185 from filecoin-project/fork/snowball
WIP, fork, fix slashing power calc
2020-01-30 21:31:37 -08:00
whyrusleeping
19a65319ee test and fix fork, add bigint parsing to lotus shed 2020-01-30 18:14:20 -08:00
Łukasz Magiera
95f344540e Fix tests 2020-01-31 02:27:38 +01:00
Łukasz Magiera
aefc463586 build: Lazy ParametersJson 2020-01-30 23:50:24 +01:00
Łukasz Magiera
316b11445e storageminer: Print fault data in info 2020-01-30 19:38:03 +01:00
Yang
e5a48800ab fix:a bug of the power percentage in lotus-storage-miner info 2020-01-30 15:02:50 +08:00
Łukasz Magiera
db50d01db9 Merge remote-tracking branch 'origin/master' into feat/new-sb-fs 2020-01-30 07:46:47 +01:00
Jakub Sztandera
1e9f293994
Return errors
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-29 17:35:32 -08:00
Jakub Sztandera
bcbfc931ba
Intoroduce advance-block command
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-29 14:40:19 -08:00
Łukasz Magiera
3f58ffe572 storageminer: New storage config 2020-01-29 20:53:45 +01:00
Łukasz Magiera
5af64c53b6 initial sectorbuilder FS refactor integration 2020-01-29 00:08:02 +01:00
hannahhoward
b8077fadaa fix(dealstate): update deal states to match current 2020-01-28 14:08:13 -08:00
Jakub Sztandera
eb4b85aea5
Merge pull request #1161 from filecoin-project/feat/chainwatch-challe
Add all challenges to chainwatch
2020-01-27 20:32:41 -08:00
Jakub Sztandera
050d552b9d
Add log to show where is the lotus running
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-27 13:39:35 -08:00
Jakub Sztandera
cf86bc6e23
fix insert
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-27 13:10:13 -08:00
Jakub Sztandera
af61dfd8cd
Fix order
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-27 13:09:00 -08:00
Jakub Sztandera
2a2a18a163
Add candidate
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-27 13:07:32 -08:00
Jakub Sztandera
29f3d6aa28
fix typo
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-27 13:03:09 -08:00
Jakub Sztandera
4379ff60f6
Create them table
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-27 13:01:24 -08:00
Jakub Sztandera
a55a37c17b
Pass the error
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-27 13:00:13 -08:00
Jakub Sztandera
5532093d58
Commit only once
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-27 12:59:07 -08:00
Jakub Sztandera
752be27815
Add all challenges to chainwatch
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-27 12:16:08 -08:00
Łukasz Magiera
9fc5f0cd9d
Merge pull request #1124 from filecoin-project/feat/sector-recovery
sealing: Implement some common error states
2020-01-24 21:25:03 +01:00
Whyrusleeping
351a683812
Merge pull request #1151 from filecoin-project/lotus-health-v2
refactor lotus-health agent for robustness
2020-01-24 11:44:47 -08:00
ognots
445b7f3388 refactor lotus-health agent for robustness
add retry logic when calls to API fail.
if API reconnects fail, restart lotus-daemon as it means lotus-daemon is likely unhealthy.

wait for lotus node's chain to sync during each check cycle, to avoid restarting lotus-daemon if needing to sync.

handle SIGTERM properly.

general cleanup and refactor of code, getting ready of unnecessary channels
2020-01-24 11:46:47 -05:00
Łukasz Magiera
b5660b58b3 Merge remote-tracking branch 'origin/master' into feat/sector-recovery 2020-01-24 01:53:58 +01:00
Jakub Sztandera
7f1b12d29e
Merge pull request #1137 from filecoin-project/feat/chainwatch-active-deals
chainwatch: Track deal activations
2020-01-23 13:21:39 -08:00
Łukasz Magiera
de52d3cadd sealing: Handlef for PreCommitFailed 2020-01-23 18:34:04 +01:00
Łukasz Magiera
7e43c40529 storageminer: Use tabwriter in sectors list 2020-01-23 17:15:45 +01:00
Łukasz Magiera
94f2948020 sealing: implement handler for sealFailed 2020-01-23 16:38:10 +01:00
Łukasz Magiera
f5540195de worker: Fix progress bars 2020-01-23 15:38:36 +01:00
Łukasz Magiera
c3a5da8586 storageminer: log flag for sector status 2020-01-23 15:18:05 +01:00
whyrusleeping
dcd01df2d3 wire up tracing into state tree flush, add pprof flag 2020-01-22 11:53:06 -08:00
Łukasz Magiera
4654d9c192 chainwatch: Util routines / views 2020-01-22 16:12:47 +01:00
Łukasz Magiera
52718e514c chainwatch: Track deal activations 2020-01-22 03:22:12 +01:00
ognots
effacec817 range over right index to prevent bounds errors
the test scenario 'healthyHeadCheckWindow5' was causing index out of bounds errors.
the second range function in checkWindow was iterating over the incorrect slice of cids.
should be comparing latest items in slices first
2020-01-21 16:07:53 -05:00
Łukasz Magiera
7b295d7bb0
Merge pull request #1115 from filecoin-project/feat/chainwatch-json-states
chainwatch: Store json states
2020-01-21 17:15:33 +01:00
Łukasz Magiera
f5bfaff003
Merge pull request #1128 from filecoin-project/feat/chain-export-2
Implement chain import and exporting
2020-01-21 03:35:24 +01:00
whyrusleeping
d9f5f6e2c6 add flag to halt after chain importing 2020-01-20 17:58:58 -08:00
whyrusleeping
955b755055 wire up importing 2020-01-20 17:53:55 -08:00
ognots
0c6e4c6c40 fixes health agent bug
was passing wrong variable to updateWindow function argument.
also updates duplicate function comment
2020-01-20 20:34:13 -05:00
Łukasz Magiera
a46a9bb42e chainwatch: Store deals 2020-01-20 01:49:52 +01:00
Łukasz Magiera
62d661f898 chainwatch: Store json states 2020-01-19 22:48:19 +01:00
Jakub Sztandera
28604f5a4c
Merge pull request #1114 from filecoin-project/feat/bench-nits
bench: Don't print unseal results when unsealing is skipped
2020-01-19 15:58:38 +01:00
Łukasz Magiera
533081454a bench: Don't print unseal results when unsealing is skipped 2020-01-19 15:56:37 +01:00
Łukasz Magiera
1e782b3de2 Merge branch 'master' into feat/event-states 2020-01-18 14:40:59 +01:00
whyrusleeping
f9ea6969c3 Catch cases where new old miners with bad code were getting made 2020-01-17 21:20:56 -08:00
Łukasz Magiera
0aebec6697 Merge branch 'master' into feat/event-states 2020-01-16 03:59:14 +01:00
Travis Person
ec9286eb4b Add more collateral to CreateStorageMiner call in fountain 2020-01-16 01:04:04 +00:00
Łukasz Magiera
604bf64ef6 Move miner sealing logic into a separate package 2020-01-15 21:49:11 +01:00
Jiarui.Huang
6354a8ce03 So we should pass a bit more than the minimum collateral at the time of miner creation
Even 0.1% more would be enough# Please enter the commit message for your changes. Lines starting
2020-01-16 01:30:01 +08:00
Łukasz Magiera
cf9275a2a2 worker: Remove staging sectors in PreCommit 2020-01-15 02:37:37 +01:00
Łukasz Magiera
1163e46622 worker: Cleanup sealed sector data in commit 2020-01-15 02:24:13 +01:00
ognots
3953227702 use lotus cli and GetFullNodeAPI
also some other minor bug fixes
2020-01-14 12:18:45 -05:00
ognots
d8d8ce7526 health agent to monitor lotus
watch if chain head changes in a given window of api polls
allows setting a threshold of how many times the chain head can remain
unchanged before failing health check
also can set interval for polling chain head
on failure, restarts systemd unit
2020-01-14 12:18:45 -05:00
Łukasz Magiera
0011c321e2
Merge pull request #1071 from filecoin-project/feat/chainwatch-pg
Use postgres in chainwatch
2020-01-14 14:14:02 +01:00
Łukasz Magiera
2dc2e0ba56 Drop 1g sector option from faucet 2020-01-14 06:23:10 +01:00
Łukasz Magiera
14128819de Correctly handle multi parent blocks 2020-01-14 06:17:31 +01:00
Łukasz Magiera
11ac026b62 Merge branch 'feat/testnet2' into feat/chainwatch-pg 2020-01-14 04:20:39 +01:00
Łukasz Magiera
a2bcc1fec2 Mostly functional mock sectorbuilder 2020-01-14 03:05:35 +01:00
Łukasz Magiera
0bf41bcd10 Drop pnet from townhall 2020-01-14 00:36:05 +01:00
Łukasz Magiera
0402abe36b Fix tests 2020-01-13 21:59:21 +01:00
Łukasz Magiera
d78a5e0a9f Decimal types for some miner columns 2020-01-13 14:01:11 +01:00
Łukasz Magiera
719171faa3 Set smaller batch size 2020-01-13 00:46:54 +01:00
Łukasz Magiera
50bac00329 Merge branch 'master' into feat/testnet2 2020-01-10 20:55:40 +01:00
hannahhoward
0ce1bf706b refactor(markets): reorg file structure 2020-01-10 10:33:26 -08:00
hannahhoward
65ecb33630 feat(storagemarket): extract storage market
remove all shared components, point at go-fil-components repo
2020-01-10 09:49:07 -08:00
whyrusleeping
7534ac1e1a add ability to control seal operations completion time 2020-01-09 12:50:45 -08:00
Łukasz Magiera
fac47bfc54 Pass correct datastore into sectorbuilder 2020-01-09 14:23:44 +01:00
Łukasz Magiera
8cbcbbd7a4 Merge branch 'feat/testnet2' of github.com:filecoin-project/go-lotus into feat/testnet2 2020-01-08 22:44:54 +01:00
Łukasz Magiera
da38822dfd paramfetch: bring parameters.json back to this repo 2020-01-08 21:31:35 +01:00
Jakub Sztandera
1ed62628a7
Update go-log to v2
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-08 20:22:31 +01:00
Jakub Sztandera
886898b137
Update to badger v2
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-08 19:56:45 +01:00
Łukasz Magiera
79028397ad chainwatch: sync in batches 2020-01-08 17:29:46 +01:00
Łukasz Magiera
1b5e1c4753 gofmt 2020-01-08 15:18:30 +01:00
Łukasz Magiera
ab922ed1ba Merge remote-tracking branch 'origin/master' into feat/chainwatch-pg 2020-01-08 15:08:34 +01:00
Łukasz Magiera
31173ff4b4 Set logging levels in a single place 2020-01-08 14:49:34 +01:00
whyrusleeping
62db7a6dda fix build 2020-01-07 21:10:43 -08:00
laser
20321bb476 handle rebase 2020-01-07 08:18:35 -08:00
acruikshank
7873213b11 switch sectorbuilder from lib to external module
point to correct version of sectorbuilder + ensure go-datastore stays at 0.1.1

replace local address type with go-address

consume paramfetch.GetParams instead of local paramfetch.go

remove constants now defined in sectorbuilder
2020-01-07 07:48:43 -08:00
Łukasz Magiera
1e7f10e387 gofmt 2020-01-07 15:00:10 +01:00
hannahhoward
718acb0a86 refactor(cborutil): extract cborutil library
Use extracted cborutil library
2020-01-07 14:59:35 +01:00
hannahhoward
8418464d91 refactor(address): use extracted address library
Switch to using extracted address library
2020-01-07 14:53:27 +01:00
laser
6a740a6d67 consume newly-extracted paramfetch 2020-01-02 11:08:49 -08:00
whyrusleeping
83fb2eff98 add a flag for bench to not run unseal 2019-12-19 11:45:15 -08:00
Łukasz Magiera
81233b894d Implement 'chain get' for easier ipld digging 2019-12-19 17:58:02 +01:00
Łukasz Magiera
6f10183878
Merge pull request #974 from filecoin-project/feat/chainwatch-nulls
chainwatch: show null blocks
2019-12-18 22:05:27 +01:00
Jim
a028f22ee6
Merge pull request #962 from filecoin-project/docs/gpu-troubleshooting
add some notes on troubleshooting GPU usage
2019-12-18 19:18:17 +01:00
Łukasz Magiera
9f886a7eb0 chainwatch: show null blocks 2019-12-18 18:40:05 +01:00
whyrusleeping
3cb4a60db4 some log cleanup and an extra trace value 2019-12-17 14:15:51 -08:00
whyrusleeping
faad2485ee add some notes on troubleshooting GPU usage 2019-12-17 11:59:14 -08:00
Jakub Sztandera
9bd0072d5c
Nicer error print
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-17 16:27:41 +01:00
Jakub Sztandera
0eb7991bbd
Fix version check
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-17 16:26:16 +01:00
Łukasz Magiera
11d11c88ae
Revert "Refactor versions" 2019-12-17 16:16:57 +01:00
Jakub Sztandera
17d0fe96a4
Fix version references
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-17 00:44:56 +01:00
Jakub Sztandera
867cba610b
Refactor versions
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-17 00:43:43 +01:00
Łukasz Magiera
3fda442bb3
Merge pull request #934 from filecoin-project/feat/sb-diskmgr
sectorbuilder: Check free space before creating sectors
2019-12-16 21:37:18 +01:00
Łukasz Magiera
e0c6247ac9 Use power of 2 sizes when parsing byte counts 2019-12-16 20:44:48 +01:00
Łukasz Magiera
1383bfa0eb sectorbuilder: fs: address review 2019-12-16 20:19:26 +01:00
Łukasz Magiera
825e3a0774 sectorbuilder: check free space before creating sectors 2019-12-16 17:16:08 +01:00
Łukasz Magiera
d6f543ce87 gofmt 2019-12-16 13:00:43 +01:00
Łukasz Magiera
97cf3f70a5 chainwatch: sub to mpool/blocks afetr initial sync 2019-12-13 15:47:51 +01:00
Jakub Sztandera
9907f7b7fb
Add script for fixing nocne
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-13 15:47:21 +01:00
Łukasz Magiera
2e9655a4e0 More fixes 2019-12-13 14:42:01 +01:00
Łukasz Magiera
3d666b3992 Merge branch 'feat/chainwatch-stuff' into feat/chainwatch-pg 2019-12-13 12:57:59 +01:00
Łukasz Magiera
a246be587e chainwatch: fix ui queries 2019-12-13 12:48:42 +01:00
Łukasz Magiera
f2ea12571f Optimise mpool update processing 2019-12-13 12:04:24 +01:00
Łukasz Magiera
1018999096 WIP fixing queries 2019-12-13 10:30:51 +01:00
Łukasz Magiera
04691a13da chainwatch: Fix postgres data import 2019-12-12 19:34:28 +01:00
Łukasz Magiera
e34e5b27ba Merge branch 'master' into feat/chainwatch-pg 2019-12-12 17:57:35 +01:00
Łukasz Magiera
cf9edae000
Merge pull request #878 from filecoin-project/feat/cw-sset-counts
chainwatch: Collect sector set sizes
2019-12-12 17:32:12 +01:00
Łukasz Magiera
7556d44b15 More data in chainwatch 2019-12-12 14:53:38 +01:00
Łukasz Magiera
ee979a20f8 Show sectorset info in storageminer info 2019-12-12 13:02:20 +01:00
Łukasz Magiera
fc6073d13b chainwatch: Collect sector set sizes 2019-12-12 00:32:09 +01:00
Łukasz Magiera
66ee9d209d wip 2019-12-11 23:17:44 +01:00
Jakub Sztandera
9589fc0762
Add version commit string
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-11 23:00:39 +01:00
Łukasz Magiera
830f2cbdd3 Merge branch 'master' into feat/chainwatch-pg 2019-12-11 22:13:08 +01:00
Jakub Sztandera
4d49473616
Increase faucet limits
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-11 16:23:11 +01:00
Łukasz Magiera
bcbcaba57b
Merge pull request #861 from filecoin-project/feat/genesis-timestamp-flag
allow setting genesis timestamp when initializing network
2019-12-11 15:49:27 +01:00
Jakub Sztandera
b655ba1ac1
Fix build
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-11 15:44:42 +01:00
whyrusleeping
d6bfbe5a26 allow setting genesis timestamp when initializing network 2019-12-11 15:36:39 +01:00
Łukasz Magiera
43f5ba1eb4
Merge pull request #847 from lanzafame/feat/accept-human-sizes
accept humanized size values to cli flags
2019-12-11 13:18:05 +01:00
lanzafame
1888b68e38 accept humanized size values to cli flags 2019-12-11 12:06:28 +10:00
Łukasz Magiera
b6b06f67dc chainwatch: Postgres 2019-12-11 00:42:36 +01:00
Łukasz Magiera
7d5709f4e2
Merge pull request #840 from filecoin-project/feat/bench-bps
bench: print bps speeds
2019-12-10 21:21:13 +01:00
Jakub Sztandera
bfdfd4023e
Cleanup math
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-10 20:53:39 +01:00
Łukasz Magiera
0fa20f6074 bench: print bps speeds 2019-12-10 20:02:42 +01:00
Whyrusleeping
53999643f7
Merge pull request #837 from filecoin-project/feat/symlink-import-preseal
Feat/symlink import preseal
2019-12-10 19:22:16 +01:00
Łukasz Magiera
739a41e834 faucet: drop unsupported sector sizes 2019-12-10 18:54:34 +01:00
whyrusleeping
4d86a4bd4a fixup 2019-12-10 09:32:50 -08:00
whyrusleeping
08cc689293 add option to symlink to presealed sectors 2019-12-10 18:11:59 +01:00
whyrusleeping
df52f8981d Add missing newline 2019-12-10 15:11:21 +01:00
whyrusleeping
384b0bdf49 add option for json output 2019-12-10 15:05:41 +01:00
whyrusleeping
3f1d8f0ed4 perform homedir expansion on input directory 2019-12-10 14:47:49 +01:00
whyrusleeping
ce5c76c6d6 load sector info from pre seal file 2019-12-10 14:22:39 +01:00
whyrusleeping
5d12659266 allow lotus-bench to benchmark existing sectorbuilders 2019-12-10 14:01:17 +01:00
Łukasz Magiera
cbf945d013 Merge remote-tracking branch 'origin/feat/lotus-shed' into testnet-staging 2019-12-10 11:19:59 +01:00
whyrusleeping
e52c927d0a delete unnecessary thing 2019-12-09 14:09:07 -08:00
whyrusleeping
8fdece1b3f make badger readonly when initializing storage miner from sector set 2019-12-09 14:05:09 -08:00
Łukasz Magiera
0de9991dcd
Merge pull request #816 from filecoin-project/feat/api-cleanup
Move api struct to a seprate pkg
2019-12-09 18:33:13 +01:00
Łukasz Magiera
ff963dfea5
Merge pull request #780 from filecoin-project/feat/storage-deal-cleanup
Clean up storage deal structures
2019-12-09 18:31:18 +01:00
Łukasz Magiera
c49dc28a04 Move api struct to a seprate pkg 2019-12-09 18:22:11 +01:00
Travis Person
8d42ca4933 A place for all the lotus tools 2019-12-09 16:09:23 +01:00
Łukasz Magiera
d18179d347
Merge pull request #792 from filecoin-project/fix/precommit-cancel-commit
Handle reverts in precommit more correctly
2019-12-09 15:53:25 +01:00
Łukasz Magiera
17c112acc0
Merge pull request #796 from filecoin-project/feat/seed-aggregation
implement lotus-seed aggregation commands
2019-12-09 15:24:13 +01:00
Łukasz Magiera
464d06ac44
Merge pull request #806 from filecoin-project/feat/api-env
Add env var for API token and location
2019-12-09 14:56:22 +01:00
Jakub Sztandera
fb7850803e
Add env var for API token and location
Usage: FULLNODE_API_INFO or STORAGE_API_INFO
Content of env var: `<token>:<api multiaddr>`
Example: `FULLNODE_API_INFO="$(cat ~/.lotus/token)dsds:$(cat ~/.lotus/api)"`

License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-09 13:36:56 +01:00
whyrusleeping
eba3f4af86 address PR review 2019-12-08 23:39:08 +01:00
Łukasz Magiera
7d68d9a029 storage: print sector retries in sector info 2019-12-08 23:35:46 +01:00
Łukasz Magiera
dec458718f
Merge pull request #793 from filecoin-project/feat/chainwatch-block-add-ts
chainwatch: Collect incoming block tstamps
2019-12-08 23:31:55 +01:00
Jakub Sztandera
7f537dce2d
More renames
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-08 22:48:20 +01:00
whyrusleeping
ba55aa117f open badger from source dirs as readonly 2019-12-08 22:24:41 +01:00
whyrusleeping
c8cef8d92f fix loading of genminer files 2019-12-08 22:14:16 +01:00
whyrusleeping
ce9be69d91 implement sector dir aggregator 2019-12-08 21:06:40 +01:00
whyrusleeping
2dc12e8bb3 implement lotus-seed aggregate-manifests 2019-12-08 19:35:44 +01:00
Łukasz Magiera
7dcee8c1e3 chainwatch: Collect incoming block tstamps 2019-12-08 16:49:13 +01:00
Jakub Sztandera
e2bd4b658b
Rename pledge-sector
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-08 15:28:27 +01:00
Łukasz Magiera
3edc93f117 wip chainwatch ui 2019-12-07 23:44:45 +01:00
whyrusleeping
f0653decf3 Clean up storage deal structures 2019-12-07 21:29:37 +01:00
Łukasz Magiera
83924e6b97
sectorbuilder: Allow to restrict task types
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-07 19:05:15 +01:00
Łukasz Magiera
c907e78e4e
Merge pull request #782 from filecoin-project/fix/dont-fetch-params
Don't fetch params for pre-seal
2019-12-07 17:41:51 +01:00
Jakub Sztandera
8b9dd91103
Don't fetch params for pre-seal
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-07 16:40:55 +01:00
Łukasz Magiera
21a8e4c8d6 worker: nogpu flag 2019-12-07 15:19:46 +01:00
Łukasz Magiera
bbc61a8f86
Merge pull request #766 from filecoin-project/feat/holes
Pre-sealing holes
2019-12-07 10:29:17 +01:00
Jakub Sztandera
92e7b4afbf
Fix tests, circle and make ux nicer
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-06 22:49:44 +01:00
Łukasz Magiera
7ed63fb7f8 seed: Trim cache 2019-12-06 22:18:52 +01:00
Jakub Sztandera
d53e43c24d
Fix test, improve log
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-06 19:47:55 +01:00
Jakub Sztandera
e07ab00fbb
Fix Uint64
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-06 18:55:46 +01:00
Jakub Sztandera
80592a87cf
Pre-sealing holes
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-06 18:53:33 +01:00
Whyrusleeping
e9ab233566
Update cmd/lotus-seed/seed/seed.go 2019-12-06 01:19:17 -08:00
whyrusleeping
2a8dd6dd46 one more occurance of the bug 2019-12-06 01:00:16 -08:00
Łukasz Magiera
5dd6d52894 Bump some numbers 2019-12-05 14:41:10 +01:00
Łukasz Magiera
6f024bee58
Merge pull request #736 from filecoin-project/feat/params-v20
Params v20
2019-12-05 14:03:37 +01:00
Łukasz Magiera
318f5ad76e
Merge pull request #749 from filcloud/fix/make-db-config
make chainwatch db source config
2019-12-05 13:01:37 +01:00
wanghui
5d5bc1bd39 make chainwatch db source config 2019-12-05 19:58:19 +08:00
Łukasz Magiera
3673a9110f
Merge pull request #743 from filecoin-project/feat/static-check-2
more of that sweet staticcheck goodness
2019-12-05 12:21:43 +01:00
Łukasz Magiera
69834a3cf3
Merge pull request #748 from filcloud/fix/dot-usage
add usage descript for chainwatch dot
2019-12-05 12:16:43 +01:00
Łukasz Magiera
310b07cc9c
Fix typo 2019-12-05 12:15:39 +01:00
wanghui
96548bef0e add usage descript for chainwatch dot 2019-12-05 19:12:08 +08:00
whyrusleeping
40be53c9f9 add command for power users to manually update sector state 2019-12-04 20:43:54 -08:00
whyrusleeping
613a0a05a0 more of that sweet staticcheck goodness 2019-12-04 18:04:09 -08:00
Łukasz Magiera
3daf9103a8 paramfetch: Only pull necessary params 2019-12-04 20:44:15 +01:00
Łukasz Magiera
b2001db9d5 worker: Fix rebaining bugs 2019-12-04 17:53:32 +01:00
Łukasz Magiera
28dde1a2d3 worker: Use system tar for moving cache around 2019-12-04 15:58:28 +01:00
Łukasz Magiera
edd30c7aa1 Merge branch 'master' into feat/remote-workers 2019-12-04 14:10:15 +01:00
Łukasz Magiera
0adfff9ae7
Merge pull request #705 from filecoin-project/feat/cw-receipts
chainwatch: Gather receipts
2019-12-04 02:27:20 +01:00
Łukasz Magiera
42b59342ab
Merge pull request #717 from filecoin-project/feat/sminer-sync-wait
storageminer: Wait for sync
2019-12-04 02:26:30 +01:00
Łukasz Magiera
d112fd18b1 Persist sector sealing errors 2019-12-04 01:44:29 +01:00
Łukasz Magiera
6467a982bc storageminer: Wait for sync 2019-12-04 01:25:18 +01:00
Łukasz Magiera
13c39452c1 storageminer: States for common failure modes 2019-12-04 00:59:40 +01:00
Łukasz Magiera
ac11fb6d7f chainwatch: gather receipts 2019-12-03 12:05:12 +01:00