cerc-io/lotus
16
0
Fork 0
Code Issues Pull Requests Packages Projects Releases 27 Wiki Activity
5,485 Commits 24 Branches 342 Tags 314 MiB
717728f33b
Commit Graph

1031 Commits

Author SHA1 Message Date
Anton Evangelatov
4679c35e61 include headlag in func signature 2020-07-03 19:22:04 +02:00
Łukasz Magiera
655d6f6720 Merge remote-tracking branch 'origin/master' into next 2020-07-03 17:03:09 +02:00
Anton Evangelatov
8b88c17503 extract stats package 2020-07-03 16:52:40 +02:00
Jakub Sztandera
9936439608
Merge remote-tracking branch 'origin/master' into next 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-03 14:56:06 +02:00
Łukasz Magiera
bb3758f648 seed: Support fake preseals 2020-07-03 03:29:21 +02:00
Łukasz Magiera
c3393ee185 seed: Move sector preseal to separate func 2020-07-03 02:47:33 +02:00
Łukasz Magiera
14ae8c7272
Merge pull request #2156 from filecoin-project/fix/bench-analyze 
Improve performance of bench import analyze
 2020-07-02 19:35:18 +02:00
Anton Evangelatov
2a050ca326 override maddr for observability 2020-07-02 18:48:39 +02:00
Jakub Sztandera
3429941639
Add info about OnActorExecDone 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-02 18:47:34 +02:00
Jakub Sztandera
41b775fdd4
Compute time spent in actors 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-02 18:47:34 +02:00
Jakub Sztandera
e9d2a3edd9
Limit float print precision 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-02 18:47:34 +02:00
Jakub Sztandera
42696372ee
Progress to stderr 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-02 18:47:34 +02:00
Jakub Sztandera
39625eada7
Add count 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-02 18:47:34 +02:00
Jakub Sztandera
7a7e5a85ad
Print tt from covar 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-02 18:47:34 +02:00
Jakub Sztandera
254295b9c3
Readd covariance 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-02 18:47:34 +02:00
Jakub Sztandera
4dd79ec6fa
Calculate correlation 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-02 18:47:34 +02:00
Jakub Sztandera
9ccd25b072
Update gas values, compute correlation coefficient 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-02 18:47:33 +02:00
Jakub Sztandera
5e7f561133
Support complex extra, fix small bug in covariance 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-02 18:47:33 +02:00
Jakub Sztandera
29f5f451b3
Add covariance 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-02 18:47:33 +02:00
Jakub Sztandera
2caa7164a6
Midway adding covar 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-02 18:47:33 +02:00
Jakub Sztandera
21148033e2
Change alg for computing variance 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-02 18:47:33 +02:00
Jakub Sztandera
1e17ea3fff
Adjust gas values 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-02 18:47:33 +02:00
Jakub Sztandera
ca7e5f5e16
Set gas to 1 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-02 18:47:32 +02:00
Jakub Sztandera
3a9f1bf9a2
Revert "Try without recurson" 
This reverts commit 76e3663b2b1f1b58f9097f45124add4fa7718199.

Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-02 18:47:32 +02:00
Jakub Sztandera
9094405537
Try without recurson 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-02 18:47:32 +02:00
Jakub Sztandera
a6417dc24b
Add stats test and print observation count 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-02 18:47:32 +02:00
Jakub Sztandera
1bc9fbca20
Ignore virtual 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-02 18:47:32 +02:00
Jakub Sztandera
369ec8221f
Improve edge case handling 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-02 18:47:32 +02:00
Jakub Sztandera
052fc35a91
Maybe avoid NaNs 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-02 18:47:31 +02:00
Jakub Sztandera
b8ab549bcb
Cleanup lint 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-02 18:47:31 +02:00
Jakub Sztandera
4f60c1afe7
If something costs 0 gas, make it 1. 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-02 18:47:31 +02:00
Jakub Sztandera
9cd34509ee
Fix error handling of json 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-02 18:47:31 +02:00
Jakub Sztandera
01e230e810
Fix ratio 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-02 18:46:42 +02:00
Jakub Sztandera
78ee64d9f8
Fix stupid mistake 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-02 18:46:42 +02:00
Jakub Sztandera
e5a7cb635c
Siwtch back to float64 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-02 18:46:42 +02:00
Jakub Sztandera
49ddcdb4b0
Don't pass pointers 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-02 18:46:42 +02:00
Jakub Sztandera
b5ae3c055b
Remove warning 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-02 18:46:41 +02:00
Jakub Sztandera
9712bbc854
Decode in workers 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-02 18:46:41 +02:00
Jakub Sztandera
3134fcb54a
Streaming mean and variance 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-02 18:46:41 +02:00
Jakub Sztandera
87d668390e
Use float32 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-02 18:46:41 +02:00
Jakub Sztandera
710286d6e7
Add pprof 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-02 18:46:41 +02:00
Jakub Sztandera
04edeccbf4
fix trimming 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-02 18:46:41 +02:00
Jakub Sztandera
db5929f4a5
Limit size of expensiveInvocs 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-02 18:46:41 +02:00
Jakub Sztandera
e65215f1b5
Make lotus-bench import analyze multithreaded and less RAM hungry 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-02 18:46:41 +02:00
Jakub Sztandera
c97720e731
Fix import analyze 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-02 18:46:41 +02:00
Dirk McCormick
2c7aa318c1 feat: state API for verified client data cap 2020-07-02 12:10:11 -04:00
whyrusleeping
5fa3021a79 set proper bitwidth for verifreg command hamts 2020-07-01 17:29:11 -07:00
whyrusleeping
a5935486ef have lotus attempt to raise its own file descriptor limit 2020-07-01 17:09:21 -07:00
Łukasz Magiera
82e2cd4746 Basic CC Upgrade support 2020-07-01 17:01:06 +02:00
Łukasz Magiera
5b73b48dc8 Fix tests post actor update 2020-07-01 14:04:37 +02:00
Łukasz Magiera
a359df93c9 chainwatch: Fix getting miner info 2020-07-01 13:50:50 +02:00
Łukasz Magiera
4c422c2d50 specs-actors v0.7.1 2020-07-01 13:47:40 +02:00
Łukasz Magiera
131928ee53 chainwatch: Fix build 2020-07-01 12:05:50 +02:00
Łukasz Magiera
cfdbc2312d Merge branch 'master' into next 2020-07-01 11:22:57 +02:00
Łukasz Magiera
8f0e04027e
Merge pull request #2154 from laser/feat/1920-selection-commands 
implement toggling of online/offline storage/retrieval deals
 2020-07-01 11:06:32 +02:00
Łukasz Magiera
abdafc8ee4
Merge pull request #2140 from filecoin-project/chainwatch/sector-info-schema 
feat: define miner sector schema
 2020-07-01 11:02:57 +02:00
frrist
e576c7a08e "feat": add logic to update miner sector table on term 2020-06-30 21:26:46 -07:00
frrist
8c54c09ab7 pair: work from pair with placer 2020-06-30 13:22:58 -07:00
Frrist
c16ea42fad
fix: update miner_head table with new miner fields (#2142) 2020-06-30 10:26:41 -07:00
Raúl Kripalani
4f9c907248 rename build.{BlockDelay=>BlockDelaySecs}. 
Since this global is not typed as a time.Duration,
rather as an int, it makes sense to clarify the unit.
 2020-06-30 14:26:49 +01:00
Raúl Kripalani
0fddf3e114 make system constants configurable as vars. 
This configurability is unlocked through the `testground`
build tag, which Project Oni will uses.

Changes in the usage places of these relaxed constants
were required due to the fact that Golang constants are
untyped, but vars aren't.

Read https://blog.golang.org/constants for more info.
 2020-06-30 14:18:26 +01:00
Travis Person
12f10ac414 lotus-shed: organize peer key generate and other key commands under keyinfo 2020-06-29 20:07:39 +00:00
Łukasz Magiera
2bab5d1ddd Merge remote-tracking branch 'origin/master' into next 2020-06-29 17:45:58 +02:00
laser
b9180a99d4 toggle consideration of offline storage/retrieval deal proposals 2020-06-26 12:27:41 -07:00
laser
e910a045d0 big rename to allow for later introducing the "consider offline" config 2020-06-26 10:50:54 -07:00
laser
5d9a775699 replace enable/disable commands with selection commands 2020-06-26 10:33:06 -07:00
Łukasz Magiera
d27ff60ae2 Merge remote-tracking branch 'origin/master' into next 2020-06-26 13:08:37 +02:00
frrist
6fe39ef065 fixup! feat: define miner sector schema 2020-06-25 17:03:28 -07:00
frrist
47c3e14d4b fixup! feat: define miner sector schema 2020-06-25 17:00:22 -07:00
frrist
d8b647cc3a fixup! feat: define miner sector schema 2020-06-25 16:07:43 -07:00
frrist
2c0a4914cf feat: define miner sector schema 
- define a miner sector schema to store miner sector details at each tipset the miner experiences a
state change. This solution stores redundant data since a miner state change (head cid changes)
does not necessarily indicate its sectors changes.

- makes progress towards sentinel/issues/10
 2020-06-25 13:16:50 -07:00
Aayush Rajasekaran
e3c897fb68 Change StateReadState to take an address, not an actor 2020-06-25 13:49:15 -04:00
Jakub Sztandera
f98063d604
In this case I want it to be not really safe 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-06-25 16:58:55 +02:00
Jakub Sztandera
10c4fae8c0
Make gas traces smaller, strip callers in import-bench 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-06-25 16:46:50 +02:00
Łukasz Magiera
cae24a226b
Merge pull request #2119 from laser/feat/1920-toggle-retrieval 
allow retrieval miner to enable/disable consideration of retrieval deal proposals
 2020-06-24 21:19:19 +02:00
frrist
a98c4038f4 fix: use tipset corresponding to stateroot 
- Use te tipsetkey corresponding to the stateroot when fetching actor
data from the lotus api.
 2020-06-24 11:01:25 -07:00
laser
176d0bb7c0 add "lotus-storage-miner retrieval-deals" subcommands 
- enable retrieval
- disable retrieval
 2020-06-24 08:08:10 -07:00
laser
bc90b857c9 change "lotus-storage-miner deals" to "lotus-storage-miner storage-deals" 2020-06-24 08:08:10 -07:00
Łukasz Magiera
358b36bc66 chainwatch: state_heights_uindex is not unique 2020-06-24 14:34:53 +02:00
Łukasz Magiera
f1e686f706
Merge pull request #2107 from chunqizhi/zc 
An incorrect sector was detected, but also run windowPoSt
 2020-06-24 12:40:16 +02:00
奇
24c7f47566 Modify print faulty sectors in provingFaultsCmd 2020-06-24 10:14:20 +08:00
Łukasz Magiera
4037d707c9
Merge pull request #2120 from filecoin-project/feat/change-addrs-cmd 
add command to change registered multiaddrs for miner
 2020-06-24 01:02:35 +02:00
Łukasz Magiera
001d4ab002 Appease the linter 2020-06-24 01:00:32 +02:00
Łukasz Magiera
d7bb284e57 miner: Move set-addrs command to a new 'actor' namespace 2020-06-24 00:54:28 +02:00
Łukasz Magiera
6f8c464393 Merge remote-tracking branch 'origin/master' into feat/sector-remove 2020-06-23 23:54:27 +02:00
whyrusleeping
d524821c86 add command to change registered multiaddrs for miner 2020-06-23 14:25:45 -07:00
Jakub Sztandera
1f967c6f63
Fix debug_advance 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-06-23 20:37:35 +02:00
Łukasz Magiera
f8e7901b89 Address review 2020-06-23 14:44:34 +02:00
whyrusleeping
9903eba7fb stream bench import results to disk 2020-06-22 20:08:19 -07:00
Łukasz Magiera
5adc188466 miner: Command to remove sectors 2020-06-22 19:35:14 +02:00
Łukasz Magiera
101ba0b796 Update deps to support removing sectors 2020-06-22 19:03:35 +02:00
Aayush Rajasekaran
4959596527 Clarify expected block win when below minimum power threshold 2020-06-22 11:42:26 -04:00
奇
956c397c3c Add provingFaultsCmd for getting sectors information for the currently known faults 2020-06-22 16:00:29 +08:00
Łukasz Magiera
596ed330dd
Merge pull request #2069 from laser/feat/1920-blocklist-cids 
allow storage miners to manage a blocklist of piece CIDs
 2020-06-19 21:19:15 +02:00
laser
fbeaab466a obey the linter 2020-06-19 09:20:20 -07:00
laser
de7d6c255c blacklist -> blocklist 2020-06-18 15:51:01 -07:00
laser
99060fbb64 eliminate errant debug line 2020-06-18 14:05:59 -07:00
laser
0c8d648998 specify which CID is being blacklisted (it's the piece) 2020-06-18 14:02:22 -07:00
laser
b0edf924b4 add commands for manipulating storage deal CID blacklist 2020-06-18 13:15:18 -07:00
laser
997a46a90f wombat 2020-06-18 10:32:32 -07:00
Łukasz Magiera
cc179c5270
Merge pull request #2047 from filecoin-project/feat/parallel-sealing-bench 
allow sealing bench to run parallel seals
 2020-06-18 01:28:56 +02:00
Jim Pick
c7e470bd5e Spelling: s/winnnig/winning/ 
It was bugging me. :-)
 2020-06-17 12:49:23 -07:00
Łukasz Magiera
d4644a28c1
Merge pull request #2046 from laser/feat/2027-manipulate-ask 
add ask-manipulating (and printing) deal subcommands
 2020-06-17 20:03:51 +02:00
Jeromy
d66c70d1e6 add configurable paralellism for sub portions of the sealing process 2020-06-17 11:02:48 -07:00
laser
fcdfda8ba2 use chain head instead of mining base 2020-06-17 10:56:42 -07:00
Łukasz Magiera
2800fd919b
Merge pull request #2053 from filecoin-project/feat/worker-reconnect 
seal-worker: Auto-restart if miner dies
 2020-06-17 19:48:29 +02:00
laser
791dff5a87 don't go into negative remaining time 2020-06-17 10:30:16 -07:00
laser
402cd8be19 get-ask output should use durations, too 2020-06-17 10:20:42 -07:00
Łukasz Magiera
bdcb1e3592
Merge pull request #2029 from filecoin-project/feat/gas-delta-output 
add some smartness to bench analyze gas output
 2020-06-17 18:44:10 +02:00
laser
9d7be5dcbf modify set-ask to work with human-readable clock time/duration 2020-06-17 09:20:43 -07:00
laser
673a643184 use xerrors, as per feedback in PR 2020-06-17 08:57:18 -07:00
Łukasz Magiera
2761872ea7 seal-worker: Auto-restart when API connection is lost 2020-06-17 17:47:18 +02:00
Łukasz Magiera
fc7195f19a seal-worker: Wait for miner API on start 2020-06-17 17:47:18 +02:00
laser
5d4f1bb3f1 work with bit-padded byte quantities, as per PR feedback 2020-06-17 08:42:30 -07:00
laser
139c3297ab change "duration" help text 2020-06-17 08:34:50 -07:00
laser
5acf5bf102 upper and lower bounds checking 2020-06-16 17:45:11 -07:00
Jeromy
ec693008d7 allow sealing bench to run parallel seals 2020-06-16 17:39:51 -07:00
laser
4ba1846c11 format the piece sizes 2020-06-16 17:32:45 -07:00
laser
5eceed81e1 add "get-ask" command 2020-06-16 17:23:03 -07:00
laser
6253c39100 replace "set-price" with "set-ask" 
Fixes #2027
 2020-06-16 16:13:21 -07:00
Łukasz Magiera
9690bc9c63 seed: Cleanup unsealed sectors 2020-06-17 00:35:51 +02:00
Łukasz Magiera
ab4c11c096 Merge remote-tracking branch 'origin/master' into next 2020-06-16 12:04:29 +02:00
Aayush Rajasekaran
a9abf3ceb2 extract the fake Wpost used for testing 2020-06-15 21:02:53 -04:00
Jeromy
f8c4b64782 improve chain import analyze output, add some rough virtual gas charges 2020-06-15 16:05:29 -07:00
Jeromy
01c4726fd5 add some smartness to bench analyze gas output 2020-06-15 13:02:57 -07:00
Łukasz Magiera
0230362d33
Merge pull request #2025 from filecoin-project/deps/specs-actors-v0.6 
specs-actors v0.6
 2020-06-15 21:30:37 +02:00
Łukasz Magiera
daca8651f4 Fix bench 2020-06-15 19:53:21 +02:00
Łukasz Magiera
01f0bb3124
Merge pull request #1994 from laser/feat/1920-toggle-accepting-storage-deals 
allow miner to disable/enable consideration of received storage deal proposals
 2020-06-15 19:05:39 +02:00
Łukasz Magiera
907364ce67 Update deps, fix more tests 2020-06-15 18:30:49 +02:00
Łukasz Magiera
70c8f7b1ee Merge remote-tracking branch 'origin/master' into feat/merge-master 2020-06-15 14:38:38 +02:00
chunqizhi
12056c8904 go fmt 2020-06-15 17:43:42 +08:00
chunqizhi
6d36c030e0 Add usage information for provingInfoCmd 2020-06-13 18:05:30 +08:00
laser
36b327b57b various symbol renames 2020-06-11 13:18:18 -07:00
laser
7587e6c08b get and set storage deal acceptance through CLI 2020-06-11 12:59:50 -07:00
laser
67110ce739 stub enable/disable storage deal commands 2020-06-11 12:20:11 -07:00
Jakub Sztandera
491f080a37
Merge remote-tracking branch 'origin/master' into feat/merge-master 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-06-11 17:59:27 +02:00
Mike Greenberg
2cd6347a13 Express block validation, cpu/mem usage via OpenCensus 2020-06-11 12:31:04 +02:00
yaohcn
e0a8e993bc bench prove nedd miner-addr flag 2020-06-11 16:35:46 +08:00
Łukasz Magiera
a00df0da90 FFI v27 2020-06-10 01:44:14 +02:00
Łukasz Magiera
28f895cec2 Update sector-storage with better post faults 2020-06-08 23:20:19 +02:00
Mike Greenberg
ae83ca6893 Express block validation, cpu/mem usage via OpenCensus 2020-06-08 14:15:01 -04:00
Łukasz Magiera
3b13397165 gofmt 2020-06-06 00:59:01 +02:00
Łukasz Magiera
163c2b2544 Merge remote-tracking branch 'origin/master' into next 2020-06-06 00:58:24 +02:00
Łukasz Magiera
d27750590a
Merge pull request #1928 from filecoin-project/fix/lsm-prov-deadlines 
Make lotus-storage-miner deadlines correct
 2020-06-06 00:37:09 +02:00
Łukasz Magiera
f765fe36d7 Make lotus-storage-miner deadlines correct 2020-06-06 00:28:32 +02:00
Łukasz Magiera
3f81ff3507 Update specs-actors 2020-06-05 22:06:11 +02:00
laser
4855045ea2 pass context to paramfetch.GetParams 
Fixes #1209
 2020-06-05 10:28:00 -07:00
Łukasz Magiera
7ae9d26cd1 Merge remote-tracking branch 'origin/next' into fix/sealing-betterering 2020-06-05 14:00:47 +02:00
Łukasz Magiera
9e5cc7c910 Update fsm, sector-storage 2020-06-05 10:46:45 +02:00
Jakub Sztandera
7bee5b3abc
Merge remote-tracking branch 'origin/master' into next 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-06-05 00:33:43 +02:00