cerc-io/lotus
16
0
Fork 0
Code Issues Pull Requests Packages Projects Releases 27 Wiki Activity
3,945 Commits 24 Branches 342 Tags 314 MiB
a02bf83332
Commit Graph

693 Commits

Author SHA1 Message Date
Łukasz Magiera
c3a5da8586 storageminer: log flag for sector status 2020-01-23 15:18:05 +01:00
whyrusleeping
dcd01df2d3 wire up tracing into state tree flush, add pprof flag 2020-01-22 11:53:06 -08:00
Łukasz Magiera
4654d9c192 chainwatch: Util routines / views 2020-01-22 16:12:47 +01:00
Łukasz Magiera
52718e514c chainwatch: Track deal activations 2020-01-22 03:22:12 +01:00
ognots
effacec817 range over right index to prevent bounds errors 
the test scenario 'healthyHeadCheckWindow5' was causing index out of bounds errors.
the second range function in checkWindow was iterating over the incorrect slice of cids.
should be comparing latest items in slices first
 2020-01-21 16:07:53 -05:00
Łukasz Magiera
7b295d7bb0
Merge pull request #1115 from filecoin-project/feat/chainwatch-json-states 
chainwatch: Store json states
 2020-01-21 17:15:33 +01:00
Łukasz Magiera
f5bfaff003
Merge pull request #1128 from filecoin-project/feat/chain-export-2 
Implement chain import and exporting
 2020-01-21 03:35:24 +01:00
whyrusleeping
d9f5f6e2c6 add flag to halt after chain importing 2020-01-20 17:58:58 -08:00
whyrusleeping
955b755055 wire up importing 2020-01-20 17:53:55 -08:00
ognots
0c6e4c6c40 fixes health agent bug 
was passing wrong variable to updateWindow function argument.
also updates duplicate function comment
 2020-01-20 20:34:13 -05:00
Łukasz Magiera
a46a9bb42e chainwatch: Store deals 2020-01-20 01:49:52 +01:00
Łukasz Magiera
62d661f898 chainwatch: Store json states 2020-01-19 22:48:19 +01:00
Jakub Sztandera
28604f5a4c
Merge pull request #1114 from filecoin-project/feat/bench-nits 
bench: Don't print unseal results when unsealing is skipped
 2020-01-19 15:58:38 +01:00
Łukasz Magiera
533081454a bench: Don't print unseal results when unsealing is skipped 2020-01-19 15:56:37 +01:00
Łukasz Magiera
1e782b3de2 Merge branch 'master' into feat/event-states 2020-01-18 14:40:59 +01:00
whyrusleeping
f9ea6969c3 Catch cases where new old miners with bad code were getting made 2020-01-17 21:20:56 -08:00
Łukasz Magiera
0aebec6697 Merge branch 'master' into feat/event-states 2020-01-16 03:59:14 +01:00
Travis Person
ec9286eb4b Add more collateral to CreateStorageMiner call in fountain 2020-01-16 01:04:04 +00:00
Łukasz Magiera
604bf64ef6 Move miner sealing logic into a separate package 2020-01-15 21:49:11 +01:00
Jiarui.Huang
6354a8ce03 So we should pass a bit more than the minimum collateral at the time of miner creation 
Even 0.1% more would be enough# Please enter the commit message for your changes. Lines starting
 2020-01-16 01:30:01 +08:00
Łukasz Magiera
cf9275a2a2 worker: Remove staging sectors in PreCommit 2020-01-15 02:37:37 +01:00
Łukasz Magiera
1163e46622 worker: Cleanup sealed sector data in commit 2020-01-15 02:24:13 +01:00
ognots
3953227702 use lotus cli and GetFullNodeAPI 
also some other minor bug fixes
 2020-01-14 12:18:45 -05:00
ognots
d8d8ce7526 health agent to monitor lotus 
watch if chain head changes in a given window of api polls
allows setting a threshold of how many times the chain head can remain
unchanged before failing health check
also can set interval for polling chain head
on failure, restarts systemd unit
 2020-01-14 12:18:45 -05:00
Łukasz Magiera
0011c321e2
Merge pull request #1071 from filecoin-project/feat/chainwatch-pg 
Use postgres in chainwatch
 2020-01-14 14:14:02 +01:00
Łukasz Magiera
2dc2e0ba56 Drop 1g sector option from faucet 2020-01-14 06:23:10 +01:00
Łukasz Magiera
14128819de Correctly handle multi parent blocks 2020-01-14 06:17:31 +01:00
Łukasz Magiera
11ac026b62 Merge branch 'feat/testnet2' into feat/chainwatch-pg 2020-01-14 04:20:39 +01:00
Łukasz Magiera
a2bcc1fec2 Mostly functional mock sectorbuilder 2020-01-14 03:05:35 +01:00
Łukasz Magiera
0bf41bcd10 Drop pnet from townhall 2020-01-14 00:36:05 +01:00
Łukasz Magiera
0402abe36b Fix tests 2020-01-13 21:59:21 +01:00
Łukasz Magiera
d78a5e0a9f Decimal types for some miner columns 2020-01-13 14:01:11 +01:00
Łukasz Magiera
719171faa3 Set smaller batch size 2020-01-13 00:46:54 +01:00
Łukasz Magiera
50bac00329 Merge branch 'master' into feat/testnet2 2020-01-10 20:55:40 +01:00
hannahhoward
0ce1bf706b refactor(markets): reorg file structure 2020-01-10 10:33:26 -08:00
hannahhoward
65ecb33630 feat(storagemarket): extract storage market 
remove all shared components, point at go-fil-components repo
 2020-01-10 09:49:07 -08:00
whyrusleeping
7534ac1e1a add ability to control seal operations completion time 2020-01-09 12:50:45 -08:00
Łukasz Magiera
fac47bfc54 Pass correct datastore into sectorbuilder 2020-01-09 14:23:44 +01:00
Łukasz Magiera
8cbcbbd7a4 Merge branch 'feat/testnet2' of github.com:filecoin-project/go-lotus into feat/testnet2 2020-01-08 22:44:54 +01:00
Łukasz Magiera
da38822dfd paramfetch: bring parameters.json back to this repo 2020-01-08 21:31:35 +01:00
Jakub Sztandera
1ed62628a7
Update go-log to v2 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-01-08 20:22:31 +01:00
Jakub Sztandera
886898b137
Update to badger v2 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-01-08 19:56:45 +01:00
Łukasz Magiera
79028397ad chainwatch: sync in batches 2020-01-08 17:29:46 +01:00
Łukasz Magiera
1b5e1c4753 gofmt 2020-01-08 15:18:30 +01:00
Łukasz Magiera
ab922ed1ba Merge remote-tracking branch 'origin/master' into feat/chainwatch-pg 2020-01-08 15:08:34 +01:00
Łukasz Magiera
31173ff4b4 Set logging levels in a single place 2020-01-08 14:49:34 +01:00
whyrusleeping
62db7a6dda fix build 2020-01-07 21:10:43 -08:00
laser
20321bb476 handle rebase 2020-01-07 08:18:35 -08:00
acruikshank
7873213b11 switch sectorbuilder from lib to external module 
point to correct version of sectorbuilder + ensure go-datastore stays at 0.1.1

replace local address type with go-address

consume paramfetch.GetParams instead of local paramfetch.go

remove constants now defined in sectorbuilder
 2020-01-07 07:48:43 -08:00
Łukasz Magiera
1e7f10e387 gofmt 2020-01-07 15:00:10 +01:00
hannahhoward
718acb0a86 refactor(cborutil): extract cborutil library 
Use extracted cborutil library
 2020-01-07 14:59:35 +01:00
hannahhoward
8418464d91 refactor(address): use extracted address library 
Switch to using extracted address library
 2020-01-07 14:53:27 +01:00
laser
6a740a6d67 consume newly-extracted paramfetch 2020-01-02 11:08:49 -08:00
whyrusleeping
83fb2eff98 add a flag for bench to not run unseal 2019-12-19 11:45:15 -08:00
Łukasz Magiera
81233b894d Implement 'chain get' for easier ipld digging 2019-12-19 17:58:02 +01:00
Łukasz Magiera
6f10183878
Merge pull request #974 from filecoin-project/feat/chainwatch-nulls 
chainwatch: show null blocks
 2019-12-18 22:05:27 +01:00
Jim
a028f22ee6
Merge pull request #962 from filecoin-project/docs/gpu-troubleshooting 
add some notes on troubleshooting GPU usage
 2019-12-18 19:18:17 +01:00
Łukasz Magiera
9f886a7eb0 chainwatch: show null blocks 2019-12-18 18:40:05 +01:00
whyrusleeping
3cb4a60db4 some log cleanup and an extra trace value 2019-12-17 14:15:51 -08:00
whyrusleeping
faad2485ee add some notes on troubleshooting GPU usage 2019-12-17 11:59:14 -08:00
Jakub Sztandera
9bd0072d5c
Nicer error print 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-12-17 16:27:41 +01:00
Jakub Sztandera
0eb7991bbd
Fix version check 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-12-17 16:26:16 +01:00
Łukasz Magiera
11d11c88ae
Revert "Refactor versions" 2019-12-17 16:16:57 +01:00
Jakub Sztandera
17d0fe96a4
Fix version references 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-12-17 00:44:56 +01:00
Jakub Sztandera
867cba610b
Refactor versions 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-12-17 00:43:43 +01:00
Łukasz Magiera
3fda442bb3
Merge pull request #934 from filecoin-project/feat/sb-diskmgr 
sectorbuilder: Check free space before creating sectors
 2019-12-16 21:37:18 +01:00
Łukasz Magiera
e0c6247ac9 Use power of 2 sizes when parsing byte counts 2019-12-16 20:44:48 +01:00
Łukasz Magiera
1383bfa0eb sectorbuilder: fs: address review 2019-12-16 20:19:26 +01:00
Łukasz Magiera
825e3a0774 sectorbuilder: check free space before creating sectors 2019-12-16 17:16:08 +01:00
Łukasz Magiera
d6f543ce87 gofmt 2019-12-16 13:00:43 +01:00
Łukasz Magiera
97cf3f70a5 chainwatch: sub to mpool/blocks afetr initial sync 2019-12-13 15:47:51 +01:00
Jakub Sztandera
9907f7b7fb
Add script for fixing nocne 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-12-13 15:47:21 +01:00
Łukasz Magiera
2e9655a4e0 More fixes 2019-12-13 14:42:01 +01:00
Łukasz Magiera
3d666b3992 Merge branch 'feat/chainwatch-stuff' into feat/chainwatch-pg 2019-12-13 12:57:59 +01:00
Łukasz Magiera
a246be587e chainwatch: fix ui queries 2019-12-13 12:48:42 +01:00
Łukasz Magiera
f2ea12571f Optimise mpool update processing 2019-12-13 12:04:24 +01:00
Łukasz Magiera
1018999096 WIP fixing queries 2019-12-13 10:30:51 +01:00
Łukasz Magiera
04691a13da chainwatch: Fix postgres data import 2019-12-12 19:34:28 +01:00
Łukasz Magiera
e34e5b27ba Merge branch 'master' into feat/chainwatch-pg 2019-12-12 17:57:35 +01:00
Łukasz Magiera
cf9edae000
Merge pull request #878 from filecoin-project/feat/cw-sset-counts 
chainwatch: Collect sector set sizes
 2019-12-12 17:32:12 +01:00
Łukasz Magiera
7556d44b15 More data in chainwatch 2019-12-12 14:53:38 +01:00
Łukasz Magiera
ee979a20f8 Show sectorset info in storageminer info 2019-12-12 13:02:20 +01:00
Łukasz Magiera
fc6073d13b chainwatch: Collect sector set sizes 2019-12-12 00:32:09 +01:00
Łukasz Magiera
66ee9d209d wip 2019-12-11 23:17:44 +01:00
Jakub Sztandera
9589fc0762
Add version commit string 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-12-11 23:00:39 +01:00
Łukasz Magiera
830f2cbdd3 Merge branch 'master' into feat/chainwatch-pg 2019-12-11 22:13:08 +01:00
Jakub Sztandera
4d49473616
Increase faucet limits 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-12-11 16:23:11 +01:00
Łukasz Magiera
bcbcaba57b
Merge pull request #861 from filecoin-project/feat/genesis-timestamp-flag 
allow setting genesis timestamp when initializing network
 2019-12-11 15:49:27 +01:00
Jakub Sztandera
b655ba1ac1
Fix build 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-12-11 15:44:42 +01:00
whyrusleeping
d6bfbe5a26 allow setting genesis timestamp when initializing network 2019-12-11 15:36:39 +01:00
Łukasz Magiera
43f5ba1eb4
Merge pull request #847 from lanzafame/feat/accept-human-sizes 
accept humanized size values to cli flags
 2019-12-11 13:18:05 +01:00
lanzafame
1888b68e38 accept humanized size values to cli flags 2019-12-11 12:06:28 +10:00
Łukasz Magiera
b6b06f67dc chainwatch: Postgres 2019-12-11 00:42:36 +01:00
Łukasz Magiera
7d5709f4e2
Merge pull request #840 from filecoin-project/feat/bench-bps 
bench: print bps speeds
 2019-12-10 21:21:13 +01:00
Jakub Sztandera
bfdfd4023e
Cleanup math 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-12-10 20:53:39 +01:00
Łukasz Magiera
0fa20f6074 bench: print bps speeds 2019-12-10 20:02:42 +01:00
Whyrusleeping
53999643f7
Merge pull request #837 from filecoin-project/feat/symlink-import-preseal 
Feat/symlink import preseal
 2019-12-10 19:22:16 +01:00
Łukasz Magiera
739a41e834 faucet: drop unsupported sector sizes 2019-12-10 18:54:34 +01:00
whyrusleeping
4d86a4bd4a fixup 2019-12-10 09:32:50 -08:00
whyrusleeping
08cc689293 add option to symlink to presealed sectors 2019-12-10 18:11:59 +01:00
whyrusleeping
df52f8981d Add missing newline 2019-12-10 15:11:21 +01:00
whyrusleeping
384b0bdf49 add option for json output 2019-12-10 15:05:41 +01:00
whyrusleeping
3f1d8f0ed4 perform homedir expansion on input directory 2019-12-10 14:47:49 +01:00
whyrusleeping
ce5c76c6d6 load sector info from pre seal file 2019-12-10 14:22:39 +01:00
whyrusleeping
5d12659266 allow lotus-bench to benchmark existing sectorbuilders 2019-12-10 14:01:17 +01:00
Łukasz Magiera
cbf945d013 Merge remote-tracking branch 'origin/feat/lotus-shed' into testnet-staging 2019-12-10 11:19:59 +01:00
whyrusleeping
e52c927d0a delete unnecessary thing 2019-12-09 14:09:07 -08:00
whyrusleeping
8fdece1b3f make badger readonly when initializing storage miner from sector set 2019-12-09 14:05:09 -08:00
Łukasz Magiera
0de9991dcd
Merge pull request #816 from filecoin-project/feat/api-cleanup 
Move api struct to a seprate pkg
 2019-12-09 18:33:13 +01:00
Łukasz Magiera
ff963dfea5
Merge pull request #780 from filecoin-project/feat/storage-deal-cleanup 
Clean up storage deal structures
 2019-12-09 18:31:18 +01:00
Łukasz Magiera
c49dc28a04 Move api struct to a seprate pkg 2019-12-09 18:22:11 +01:00
Travis Person
8d42ca4933 A place for all the lotus tools 2019-12-09 16:09:23 +01:00
Łukasz Magiera
d18179d347
Merge pull request #792 from filecoin-project/fix/precommit-cancel-commit 
Handle reverts in precommit more correctly
 2019-12-09 15:53:25 +01:00
Łukasz Magiera
17c112acc0
Merge pull request #796 from filecoin-project/feat/seed-aggregation 
implement lotus-seed aggregation commands
 2019-12-09 15:24:13 +01:00
Łukasz Magiera
464d06ac44
Merge pull request #806 from filecoin-project/feat/api-env 
Add env var for API token and location
 2019-12-09 14:56:22 +01:00
Jakub Sztandera
fb7850803e
Add env var for API token and location 
Usage: FULLNODE_API_INFO or STORAGE_API_INFO
Content of env var: `<token>:<api multiaddr>`
Example: `FULLNODE_API_INFO="$(cat ~/.lotus/token)dsds:$(cat ~/.lotus/api)"`

License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-12-09 13:36:56 +01:00
whyrusleeping
eba3f4af86 address PR review 2019-12-08 23:39:08 +01:00
Łukasz Magiera
7d68d9a029 storage: print sector retries in sector info 2019-12-08 23:35:46 +01:00
Łukasz Magiera
dec458718f
Merge pull request #793 from filecoin-project/feat/chainwatch-block-add-ts 
chainwatch: Collect incoming block tstamps
 2019-12-08 23:31:55 +01:00
Jakub Sztandera
7f537dce2d
More renames 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-12-08 22:48:20 +01:00
whyrusleeping
ba55aa117f open badger from source dirs as readonly 2019-12-08 22:24:41 +01:00
whyrusleeping
c8cef8d92f fix loading of genminer files 2019-12-08 22:14:16 +01:00
whyrusleeping
ce9be69d91 implement sector dir aggregator 2019-12-08 21:06:40 +01:00
whyrusleeping
2dc12e8bb3 implement lotus-seed aggregate-manifests 2019-12-08 19:35:44 +01:00
Łukasz Magiera
7dcee8c1e3 chainwatch: Collect incoming block tstamps 2019-12-08 16:49:13 +01:00
Jakub Sztandera
e2bd4b658b
Rename pledge-sector 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-12-08 15:28:27 +01:00
Łukasz Magiera
3edc93f117 wip chainwatch ui 2019-12-07 23:44:45 +01:00
whyrusleeping
f0653decf3 Clean up storage deal structures 2019-12-07 21:29:37 +01:00
Łukasz Magiera
83924e6b97
sectorbuilder: Allow to restrict task types 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-12-07 19:05:15 +01:00
Łukasz Magiera
c907e78e4e
Merge pull request #782 from filecoin-project/fix/dont-fetch-params 
Don't fetch params for pre-seal
 2019-12-07 17:41:51 +01:00
Jakub Sztandera
8b9dd91103
Don't fetch params for pre-seal 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-12-07 16:40:55 +01:00
Łukasz Magiera
21a8e4c8d6 worker: nogpu flag 2019-12-07 15:19:46 +01:00
Łukasz Magiera
bbc61a8f86
Merge pull request #766 from filecoin-project/feat/holes 
Pre-sealing holes
 2019-12-07 10:29:17 +01:00
Jakub Sztandera
92e7b4afbf
Fix tests, circle and make ux nicer 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-12-06 22:49:44 +01:00
Łukasz Magiera
7ed63fb7f8 seed: Trim cache 2019-12-06 22:18:52 +01:00
Jakub Sztandera
d53e43c24d
Fix test, improve log 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-12-06 19:47:55 +01:00
Jakub Sztandera
e07ab00fbb
Fix Uint64 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-12-06 18:55:46 +01:00
Jakub Sztandera
80592a87cf
Pre-sealing holes 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-12-06 18:53:33 +01:00
Whyrusleeping
e9ab233566
Update cmd/lotus-seed/seed/seed.go 2019-12-06 01:19:17 -08:00
whyrusleeping
2a8dd6dd46 one more occurance of the bug 2019-12-06 01:00:16 -08:00
Łukasz Magiera
5dd6d52894 Bump some numbers 2019-12-05 14:41:10 +01:00
Łukasz Magiera
6f024bee58
Merge pull request #736 from filecoin-project/feat/params-v20 
Params v20
 2019-12-05 14:03:37 +01:00
Łukasz Magiera
318f5ad76e
Merge pull request #749 from filcloud/fix/make-db-config 
make chainwatch db source config
 2019-12-05 13:01:37 +01:00
wanghui
5d5bc1bd39 make chainwatch db source config 2019-12-05 19:58:19 +08:00
Łukasz Magiera
3673a9110f
Merge pull request #743 from filecoin-project/feat/static-check-2 
more of that sweet staticcheck goodness
 2019-12-05 12:21:43 +01:00
Łukasz Magiera
69834a3cf3
Merge pull request #748 from filcloud/fix/dot-usage 
add usage descript for chainwatch dot
 2019-12-05 12:16:43 +01:00
Łukasz Magiera
310b07cc9c
Fix typo 2019-12-05 12:15:39 +01:00
wanghui
96548bef0e add usage descript for chainwatch dot 2019-12-05 19:12:08 +08:00
whyrusleeping
40be53c9f9 add command for power users to manually update sector state 2019-12-04 20:43:54 -08:00
whyrusleeping
613a0a05a0 more of that sweet staticcheck goodness 2019-12-04 18:04:09 -08:00
Łukasz Magiera
3daf9103a8 paramfetch: Only pull necessary params 2019-12-04 20:44:15 +01:00
Łukasz Magiera
b2001db9d5 worker: Fix rebaining bugs 2019-12-04 17:53:32 +01:00
Łukasz Magiera
28dde1a2d3 worker: Use system tar for moving cache around 2019-12-04 15:58:28 +01:00
Łukasz Magiera
edd30c7aa1 Merge branch 'master' into feat/remote-workers 2019-12-04 14:10:15 +01:00
Łukasz Magiera
0adfff9ae7
Merge pull request #705 from filecoin-project/feat/cw-receipts 
chainwatch: Gather receipts
 2019-12-04 02:27:20 +01:00
Łukasz Magiera
42b59342ab
Merge pull request #717 from filecoin-project/feat/sminer-sync-wait 
storageminer: Wait for sync
 2019-12-04 02:26:30 +01:00
Łukasz Magiera
d112fd18b1 Persist sector sealing errors 2019-12-04 01:44:29 +01:00
Łukasz Magiera
6467a982bc storageminer: Wait for sync 2019-12-04 01:25:18 +01:00
Łukasz Magiera
13c39452c1 storageminer: States for common failure modes 2019-12-04 00:59:40 +01:00
Łukasz Magiera
ac11fb6d7f chainwatch: gather receipts 2019-12-03 12:05:12 +01:00
Łukasz Magiera
a7239d7f01 allow setting api host in storageminer 2019-12-03 11:05:35 +01:00
Łukasz Magiera
160e11ce8c Merge branch 'master' into feat/remote-workers 2019-12-03 03:24:00 +01:00
Łukasz Magiera
dab80b30f6 storageminer: print fallback start in info 2019-12-03 02:46:29 +01:00
Łukasz Magiera
5ba4dfdf14 Devnet 9 2019-12-03 01:44:52 +01:00
Łukasz Magiera
923748e551 Expand paths in node init 2019-12-02 23:10:22 +01:00
whyrusleeping
22f96e626b add flag to disable gpu to lotus-bench 2019-12-02 11:25:16 -08:00
Łukasz Magiera
24be85e8ec Fix storage miner info for ePoSt 2019-12-02 17:47:09 +01:00
Łukasz Magiera
d5b94884c8 Buch of lint fixes 2019-12-02 13:51:16 +01:00
Łukasz Magiera
d9840c05db bench: Measure unseal time 2019-12-01 23:37:53 +01:00
Łukasz Magiera
fd8f65248b deals: Correctly set deal ID in provider states 2019-12-01 21:07:57 +01:00
Łukasz Magiera
a59d0f0f8c Fix unsealing, sector based data refs 2019-12-01 18:58:31 +01:00
whyrusleeping
c92b9d5a0d fix storage miner sectorbuilder construction 2019-11-30 23:55:20 -06:00
whyrusleeping
59d9c681ad Rework miner test setups to fix tests 2019-11-30 17:21:11 -06:00
Łukasz Magiera
89556819ae seal-worker: Handle cache 2019-11-30 14:22:50 +01:00
Łukasz Magiera
ed9279cf0c Some fixes and dev utils 2019-11-30 10:25:31 +01:00
Łukasz Magiera
8767d8c16b Merge branch 'feat/election-post' into feat/remote-workers 2019-11-30 09:42:28 +01:00
whyrusleeping
3b533ed76c Genesis miner config actually sets the created miner address now 2019-11-29 22:31:26 -06:00
Łukasz Magiera
ad978949db import sector/deal into state machines on init 2019-11-29 20:11:42 +01:00
whyrusleeping
0ca92bdca0 track hot and cold times for epost 2019-11-29 10:48:07 -08:00
whyrusleeping
ce89ddbd6a fixing some tests 2019-11-28 21:38:18 -06:00
Łukasz Magiera
cb7d15e67e genesis setup improvements 2019-11-28 23:50:58 +01:00
Łukasz Magiera
6098db4f51
Merge pull request #682 from filecoin-project/feat/election-post-fallback 
Feat/election post fallback
 2019-11-28 19:10:50 +01:00
Łukasz Magiera
920fd3ba9b storageminer: New fallback post scheduler 2019-11-28 18:44:57 +01:00
Łukasz Magiera
aefd432422 actors: Fallback post progress 2019-11-28 13:46:56 +01:00
Łukasz Magiera
b75767e678 seed: get default sector size from build.SectorSizes 2019-11-28 11:55:34 +01:00
whyrusleeping
8fae155cf6 Add timings for proof verification 2019-11-27 19:43:52 -06:00
Łukasz Magiera
5d30106f5a More v18 updates 2019-11-27 18:10:34 +01:00
Łukasz Magiera
d2412f4f00 Fix pond 2019-11-27 15:18:51 +01:00
Łukasz Magiera
23e0008b81 Merge remote-tracking branch 'origin/master' into feat/election-post 2019-11-27 13:31:44 +01:00
Łukasz Magiera
4a77fdac4c bench: Fix after filecoin-ffi switch 2019-11-27 13:12:42 +01:00
Łukasz Magiera
03b1d2329f seed: Call AcquireID for sectorIDs 2019-11-27 12:58:16 +01:00
whyrusleeping
718d681f73 Add lotus-bench for testing hardware specs 2019-11-26 20:47:08 -06:00
whyrusleeping
249bd8389f Copy over last sector ID key when migrating sectorbuilder 2019-11-26 19:39:07 -06:00
Łukasz Magiera
fc72da1d0c chain: Pass correct prover to VerifyPost 2019-11-26 18:06:05 +01:00
Łukasz Magiera
871c30d2a0 WIP trying to get election post to compute 2019-11-26 16:15:41 +01:00
Łukasz Magiera
72c7ec748f seed: Get params 2019-11-26 14:52:59 +01:00
Łukasz Magiera
265b90e95b update parameters.json 2019-11-25 23:17:39 +01:00
whyrusleeping
a0588d513d Add lotus-gen, rewire genesis mining 2019-11-24 22:45:13 -06:00
Łukasz Magiera
05e631235c Rename to lotus-seal-worker 2019-11-22 17:25:56 +01:00
Jakub Sztandera
36b7c5a32a
Swtich to xerrors 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-11-22 10:20:56 -06:00
Łukasz Magiera
3281e9448a fix rspco serialization 2019-11-22 16:48:02 +01:00
Łukasz Magiera
b726b95298 WIP remote sector CommitSseal 2019-11-21 20:51:53 +01:00
Łukasz Magiera
d4197bbadc Working remote PreCommit 2019-11-21 19:38:50 +01:00
Łukasz Magiera
98b1de33b6 Stats for remote workers 2019-11-21 17:23:42 +01:00
Łukasz Magiera
88bbcd80ea support remote SealPreCommit 2019-11-21 17:10:09 +01:00
Łukasz Magiera
ba3ad75670 remote-worker: wire up storage miner endpoints 2019-11-21 15:10:51 +01:00
Łukasz Magiera
9725eb78bf wip remote sectorbuilder workers 2019-11-21 01:53:06 +01:00
Łukasz Magiera
37792b149f sync: fix some issues 2019-11-20 20:49:29 +01:00
whyrusleeping
71923c691d dont publish nil message removed 2019-11-20 17:47:44 +01:00
Łukasz Magiera
06d498b45b chainwatch: log mpool message 2019-11-20 17:47:44 +01:00
Łukasz Magiera
4ee2fc4d9f chain: call unsub in Incoming* methods 2019-11-20 17:47:44 +01:00
Łukasz Magiera
ced47a11e7 chainwatch: more improvements 2019-11-20 17:47:44 +01:00
Łukasz Magiera
d3b980ef58 api.SyncIncomingBlocks 2019-11-20 17:47:44 +01:00
Łukasz Magiera
333847f7c9 chainwatch: store mpool message additions 2019-11-20 17:45:02 +01:00
Łukasz Magiera
f40a1afac8 chainwatch: store mpool message additions 2019-11-20 17:45:02 +01:00
Łukasz Magiera
80095fdf3c chainwatch: make target 2019-11-20 17:45:02 +01:00
Łukasz Magiera
d235e7f20e chainwatch: very, very basic key info view 2019-11-20 17:45:02 +01:00
Łukasz Magiera
3dd9691467 chainwatch: Store more detailed miner info 2019-11-20 17:45:02 +01:00
Łukasz Magiera
820f7bfb8a chainwatch: Capture more state 2019-11-20 17:45:02 +01:00
Łukasz Magiera
70956589ef Begin implementing ChainWatch 2019-11-20 17:45:02 +01:00
wanghui
ba889391b5 update imports and path 2019-11-16 14:47:04 +08:00
Frank
c9714b1708
Update cmd/lotus-storage-miner/init.go 
Co-Authored-By: Łukasz Magiera <magik6k@users.noreply.github.com>
 2019-11-16 14:16:18 +08:00
wanghui
b28ce76e8a clean up repo if miner init fail and use log 2019-11-15 19:54:12 +08:00
whyrusleeping
797d92b463 persist blocks as they come in 2019-11-14 19:19:16 -08:00
Łukasz Magiera
636c4f7671
Merge pull request #604 from filecoin-project/feat/townhall-lag-delta 
townhall: Show update time delta
 2019-11-14 21:53:24 +01:00
Łukasz Magiera
d684300713
Merge pull request #600 from filecoin-project/feat/tests-also 
Add --tests-also for fetch-params
 2019-11-14 18:16:12 +01:00
Łukasz Magiera
dbf8dff8e3 townhall: Show lag delta 2019-11-14 17:56:13 +01:00
Łukasz Magiera
f39a5f4a05 Mute pubsub logs 2019-11-14 17:32:00 +01:00
Jakub Sztandera
bc3dac0426
Add --tests-also for fetch-params 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-11-14 02:15:33 +01:00
Łukasz Magiera
37c0967fa8
Merge pull request #595 from filecoin-project/feat/small-fixes 
Bunch of small fixes / improvements, gofmt
 2019-11-13 19:15:50 +01:00
Jakub Sztandera
a58e165339
Restore api flags 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-11-13 16:37:40 +01:00
Jakub Sztandera
70419c0f55
Use API ListenAddress from config 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-11-13 16:37:40 +01:00
Łukasz Magiera
8f0e3ede24 Bunch of small fixes / improvements, gofmt 2019-11-13 15:48:57 +01:00
whyrusleeping
e1cb19da0a Exit 1 on error 2019-11-12 15:36:49 -08:00
Whyrusleeping
aa26935533
Merge pull request #573 from filecoin-project/feat/mark-bad-chains 
sync: Mark chains with bad blocks as bad too
 2019-11-13 05:12:06 +09:00
Łukasz Magiera
73ab6c0c66 WorkerCount on storageminer config 2019-11-12 18:59:38 +01:00
Łukasz Magiera
92b9f67327 Reduce log spam more 2019-11-12 11:05:18 +01:00
Łukasz Magiera
b6f4e53d43
Merge pull request #559 from filecoin-project/feat/faucet-miner-wait 
Better miner create waiting logic in fountain
 2019-11-11 21:49:12 +01:00
Łukasz Magiera
0b2ed8e9bb Better miner create waiting logic in fountain 2019-11-11 21:47:30 +01:00
Łukasz Magiera
35b44f08c4 townhall: Compare numbers 2019-11-11 21:13:14 +01:00
Łukasz Magiera
55247b366c townhall: Display previous weight diff 2019-11-11 21:13:14 +01:00
Łukasz Magiera
3c2cbb04c9 townhall: Display more timing info 2019-11-11 21:13:14 +01:00
Łukasz Magiera
55697209a7
Merge pull request #556 from filecoin-project/fix/post-restart 
Fix PoSt after storage miner restart
 2019-11-11 18:33:33 +01:00
Łukasz Magiera
b8f46bff26 storageminer: Drop sortedSectorInfo log 2019-11-11 18:32:46 +01:00
Łukasz Magiera
b8e18ed773 storageminer: Don't print PP in info cmd if not proving 2019-11-11 12:10:48 +01:00
Łukasz Magiera
c18127bf00 townhall: More colors, weight/height diff 2019-11-09 18:51:04 +01:00
Łukasz Magiera
81bd0bc517 Test to reproduce post error after restart 2019-11-09 11:42:36 +01:00
Łukasz Magiera
3f4d454f6e storageminer: Print proving period in info cmd 2019-11-09 10:49:43 +01:00
Łukasz Magiera
59fbc976d0 storageminer: Missing new line in info cmd 2019-11-09 10:02:55 +01:00
Łukasz Magiera
ed64e52e3a sectorbuilder: apply some review suggestions 2019-11-09 00:21:04 +01:00
Łukasz Magiera
27485777f0 Merge remote-tracking branch 'origin/master' into feat/interactive-porep 2019-11-08 21:45:06 +01:00
Łukasz Magiera
8c39486736 some import fixes 2019-11-08 21:11:56 +01:00
Łukasz Magiera
071f05fa95 Storage miner API improvements 2019-11-08 19:23:58 +01:00
whyrusleeping
e226071c20 disable GPU by default 2019-11-08 08:43:23 -08:00
wanghui
66f8e348a2 update size and unit 2019-11-07 20:05:03 +08:00
Frank
08ff772cf4
Update cmd/lotus-storage-miner/info.go 
update sector size format

Co-Authored-By: Łukasz Magiera <magik6k@users.noreply.github.com>
 2019-11-07 19:33:44 +08:00
wanghui
f221c05a33 add sector size info 2019-11-07 18:46:11 +08:00
whyrusleeping
9863942fe2 WIP: trying to write a test to reproduce the storage deal error 2019-11-07 00:39:34 +01:00
Jakub Sztandera
58229defcd
Fix faucet ip limiting to use X-Real-IP 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-11-06 16:10:27 +01:00
Łukasz Magiera
ed5ccfd750 Merge remote-tracking branch 'origin/devnet/7' into feat/interactive-porep 2019-11-05 18:53:19 +01:00
Łukasz Magiera
c76ce2a2eb rate-limit some sectorbuilder ops 2019-11-04 18:36:29 +01:00
Łukasz Magiera
13da5a5966 Put WorkerThreads on sectorbuilder.Config 2019-11-04 17:47:08 +01:00
whyrusleeping
fc9091cc89 Get interactive porep sector sealing mostly working 2019-10-31 20:57:10 -07:00
Łukasz Magiera
bad7b76165
Merge pull request #516 from filecoin-project/feat/invert-rate-limits 
Invert faucet rate limiting
 2019-10-31 19:13:11 +01:00
Travis Person
b9f8addd21 Invert faucet rate limiting 
Rate limits needs to be ordered from specific to generic to ensure that
a single user will not exhaust the generic limiter before being limited
by the more specific.

Resolves #517
 2019-10-31 10:43:01 -07:00
Łukasz Magiera
46d782b30b storageminer: Drop commitment tracker 2019-10-30 18:37:38 +01:00
Jakub Sztandera
3ea0997c93
Add support for different configs 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-10-30 17:38:39 +01:00
Łukasz Magiera
413314b44b
Merge pull request #494 from filecoin-project/feat/handle-uncommited 
storageminer: Handle uncommited sectors on start
 2019-10-30 15:32:34 +01:00
Łukasz Magiera
44f4ee0de1 storageminer: cmd to list sector commitments 2019-10-29 21:41:30 +01:00
Łukasz Magiera
391c73774d Set swarm log level to WARN 2019-10-29 20:51:44 +01:00
Jakub Sztandera
6d594bab67
Merge pull request #491 from filecoin-project/feat/bg-store-garbage 
Run store-garbage in background
 2019-10-29 19:33:48 +01:00
Łukasz Magiera
6a999d348a fountain: Allow picking sector size 2019-10-29 19:28:54 +01:00
Łukasz Magiera
8e1a9a71e6 Run store-garbage in background 2019-10-29 18:52:07 +01:00
Łukasz Magiera
788b0f5908 docs: Update mining instructions 2019-10-29 14:34:33 +01:00
Łukasz Magiera
640b889aa6 fountain: Fix create button in /miner.html 2019-10-29 14:26:15 +01:00
Łukasz Magiera
23b7cf305f fountain: Default to 1GiB sectors 2019-10-29 14:10:53 +01:00
Łukasz Magiera
e46ae15dfd townhall: Don't hard-code stuff 2019-10-29 14:06:02 +01:00
Łukasz Magiera
874be79958 very basic sector seal scheduling 2019-10-27 09:56:53 +01:00
whyrusleeping
874ab1456c WIP: updating to new proofs code 2019-10-25 18:07:34 +02:00
Łukasz Magiera
a20255d606 Fancier faucet 2019-10-25 17:43:55 +02:00
Łukasz Magiera
43e1752816 fountain: Create miner enpoint 2019-10-25 17:43:55 +02:00
Łukasz Magiera
d753c39133 Add rate limits to the fountain by @travisperson 2019-10-25 17:42:14 +02:00
whyrusleeping
4890f577f5 give miners the ability to select different sector sizes 2019-10-25 17:26:15 +02:00
Łukasz Magiera
eeca3d86df
Merge pull request #415 from filecoin-project/feat/deals-on-chain 
On-Chain deals
 2019-10-25 17:03:25 +02:00
Łukasz Magiera
5175d8541e peer manager: Handle bootstrap in peermgr 2019-10-23 13:11:18 +02:00
Łukasz Magiera
c41dd4efeb actora: register storagemarket 2019-10-23 12:44:00 +02:00
Łukasz Magiera
aab3bd617a REST file import endpoint 2019-10-23 11:39:44 +02:00
whyrusleeping
cc689ab920 shut down rpc server before node 2019-10-20 15:17:03 +09:00
Whyrusleeping
d891589cef
Merge pull request #412 from filecoin-project/feat/init-fail-cleanup 
Clean up after failed storage miner init
 2019-10-18 16:08:18 +09:00
whyrusleeping
098e05c4d7 Clean up after failed storage miner init 2019-10-18 14:13:36 +09:00
Jakub Sztandera
1bf713cb0a
Cleanup imports after rename 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-10-18 13:47:41 +09:00
Łukasz Magiera
f620ecea5e Devnet 6 2019-10-17 03:09:17 +02:00
whyrusleeping
2ac4ce122f check return code of create storage miner call 2019-10-16 16:45:48 +09:00
Łukasz Magiera
71182f69cc
Merge pull request #378 from filecoin-project/fix/miner-info-format 
Fix percentage display
 2019-10-15 17:30:31 +02:00
Jakub Sztandera
b582620e77
Fix percentage display 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-10-15 16:51:47 +02:00
Łukasz Magiera
f0ff51ff8e Devnet 5 2019-10-15 15:46:24 +02:00
Łukasz Magiera
f15d527a35
Merge pull request #343 from filecoin-project/feat/spec-sync 
Sync with the new spec
 2019-10-15 15:20:56 +02:00
Łukasz Magiera
98b4533247
Merge pull request #353 from filecoin-project/feat/node-deploy 
Quick miner deploy util
 2019-10-15 15:09:53 +02:00
Łukasz Magiera
a576b72364 actors: Sync with the new spec, storage actors 2019-10-15 14:31:34 +02:00
Łukasz Magiera
7f2f28d87b
Merge pull request #358 from filecoin-project/feat/chain-noise 
Add simple program to generate random chain noise
 2019-10-15 04:50:08 +02:00
Łukasz Magiera
75680ae502 Quick miner deploy util 2019-10-15 02:54:00 +02:00
whyrusleeping
e8a1b54740 Add more info to storage-miner info command output 2019-10-14 11:32:32 +09:00
whyrusleeping
495506f725 Add simple program to generate random chain noise 2019-10-14 10:20:49 +09:00
Łukasz Magiera
30198b4105 townhall: show tipset propagation 2019-10-12 16:05:41 +02:00
Łukasz Magiera
5fbbc8dd18
Merge pull request #338 from filecoin-project/feat/th-build 
townhall: Single-binary build
 2019-10-12 09:38:39 +02:00
Łukasz Magiera
5861332f40 sminer: info command 2019-10-12 01:47:29 +02:00
Łukasz Magiera
20cf5ba54c townhall: Single-binary build 2019-10-11 08:41:45 +02:00
Łukasz Magiera
387adae115 townhall: Node names 2019-10-11 04:45:45 +02:00
Łukasz Magiera
40267e15b2
Merge pull request #326 from filecoin-project/feat/periodic-bootstrap 
Periodic bootstrap
 2019-10-11 04:09:01 +02:00
Łukasz Magiera
c0179bd4fa Periodic bootstrap 2019-10-11 02:31:26 +02:00
Łukasz Magiera
4c5157d270 Lotus Townhall 2019-10-10 14:02:43 +02:00
whyrusleeping
14c4a8bee6 implement looking in the past for messages 2019-10-09 09:33:18 +02:00
Łukasz Magiera
752654ab03 Devnet 3; Builtin bootstrap; NAT Port Map 2019-10-09 05:16:35 +02:00
Whyrusleeping
3c68e66b4c
Merge pull request #285 from filecoin-project/fix/event-null-blocks 
events: Handle null blocks correctly
 2019-10-08 11:34:01 +09:00
whyrusleeping
e17fc950b3 Add pprof server to storage miner 2019-10-05 10:08:55 -06:00
Łukasz Magiera
7170e1893f events: Handle null blocks correctly 2019-10-05 00:43:04 +02:00
whyrusleeping
6dd8ed7d7a pass those tests 2019-10-04 10:06:05 -06:00
whyrusleeping
697bed27a6 fix websocket closing 2019-10-04 10:06:05 -06:00
Łukasz Magiera
1534536590 Store libp2p key in keystore 2019-10-03 02:11:31 +02:00
Łukasz Magiera
713f08e9bf move genesis loading to build pkg 2019-10-02 22:40:14 +02:00
Łukasz Magiera
05878f4320 Built in paramfetch 2019-10-02 19:20:30 +02:00
whyrusleeping
6de61424e4 add pprof server 2019-09-30 17:25:45 -06:00
Łukasz Magiera
1024812559 storageminer: Update post scheduling 2019-09-26 23:32:47 +02:00
Łukasz Magiera
18211b7bee storageminer: Fix PledgeCollateral calc on init 2019-09-26 12:13:43 -07:00
Łukasz Magiera
a2a2169ef8 Setup first devnet params 2019-09-26 12:13:43 -07:00
Łukasz Magiera
ad1265cad0 storageminer: Flags to allow specyfying keys to use 2019-09-26 16:31:13 +02:00
Łukasz Magiera
78e1ea14ad storageminer: Make worker key creation optional 2019-09-26 02:47:53 +02:00
Łukasz Magiera
9a990dbd8a use new sectorbuilder file interfaces 2019-09-23 12:50:28 +02:00
Łukasz Magiera
82dc6fa527 Very basic foutain 2019-09-20 23:36:43 +02:00
Łukasz Magiera
5e2c100f4d storageminer: Better context handling 2019-09-17 20:36:06 +02:00
Łukasz Magiera
037fa84e68 storageminer: Remove node shutdown hack 2019-09-17 20:28:21 +02:00
Łukasz Magiera
f2ecb772fa repo: Close datastore in Close 2019-09-17 16:34:22 +02:00
Łukasz Magiera
83f1a336a6 node: Basic graceful shutdown 2019-09-17 16:23:08 +02:00
Łukasz Magiera
5ea1459275 Use atomic moppl API in more places 2019-09-17 10:15:26 +02:00
whyrusleeping
a47969c76b finish up making the new serializations work 2019-09-10 16:03:17 -07:00
whyrusleeping
ed45d1c2b4 refactor state utilities into StateManager package, implement proper election proofs 2019-09-09 19:14:00 -07:00
Łukasz Magiera
6a4af984af storageminer: Fix init 2019-09-06 19:42:03 +02:00
Łukasz Magiera
c0566399c6 retrieval: Way to get the data 2019-08-29 17:50:19 +02:00
Łukasz Magiera
cad3efb9ba Command to list sealed blocks 2019-08-29 17:48:19 +02:00
Łukasz Magiera
28409a60b1 Use BLS in more places 2019-08-22 00:47:44 +02:00
Łukasz Magiera
f43757f9f2 storageminer: Unregister genesis miner in init 2019-08-20 20:17:59 +02:00
Łukasz Magiera
eda26faf21 Register miner address from storageminer process 2019-08-20 19:19:24 +02:00
Łukasz Magiera
89ea5a4750 pond: logs window 2019-08-19 23:31:25 +02:00
whyrusleeping
5920537bc5 fix gas limit in create storage miner call 2019-08-19 11:06:39 -07:00
whyrusleeping
4f91550851 fix waiting for bls signed message 2019-08-16 15:10:34 -07:00
whyrusleeping
b271e5231a set up lotus-storage-miner to be able to use an existing miner actor 2019-08-16 14:50:00 -07:00
Łukasz Magiera
f99c8e032d pond: +1k button for addresses 2019-08-09 17:59:12 +02:00
whyrusleeping
959fe371b0 move storage miner keys to full node 2019-08-08 10:56:14 -07:00
Łukasz Magiera
cdc535394d deals: fix statestore 2019-08-07 20:01:51 -07:00
Łukasz Magiera
5811f18b5e Address some review comments 2019-08-07 20:01:22 -07:00