Commit Graph

452 Commits

Author SHA1 Message Date
Jakub Sztandera
886898b137
Update to badger v2
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-08 19:56:45 +01:00
Łukasz Magiera
79028397ad chainwatch: sync in batches 2020-01-08 17:29:46 +01:00
Łukasz Magiera
1b5e1c4753 gofmt 2020-01-08 15:18:30 +01:00
Łukasz Magiera
ab922ed1ba Merge remote-tracking branch 'origin/master' into feat/chainwatch-pg 2020-01-08 15:08:34 +01:00
Łukasz Magiera
31173ff4b4 Set logging levels in a single place 2020-01-08 14:49:34 +01:00
whyrusleeping
62db7a6dda fix build 2020-01-07 21:10:43 -08:00
laser
20321bb476 handle rebase 2020-01-07 08:18:35 -08:00
acruikshank
7873213b11 switch sectorbuilder from lib to external module
point to correct version of sectorbuilder + ensure go-datastore stays at 0.1.1

replace local address type with go-address

consume paramfetch.GetParams instead of local paramfetch.go

remove constants now defined in sectorbuilder
2020-01-07 07:48:43 -08:00
Łukasz Magiera
1e7f10e387 gofmt 2020-01-07 15:00:10 +01:00
hannahhoward
718acb0a86 refactor(cborutil): extract cborutil library
Use extracted cborutil library
2020-01-07 14:59:35 +01:00
hannahhoward
8418464d91 refactor(address): use extracted address library
Switch to using extracted address library
2020-01-07 14:53:27 +01:00
laser
6a740a6d67 consume newly-extracted paramfetch 2020-01-02 11:08:49 -08:00
whyrusleeping
83fb2eff98 add a flag for bench to not run unseal 2019-12-19 11:45:15 -08:00
Łukasz Magiera
81233b894d Implement 'chain get' for easier ipld digging 2019-12-19 17:58:02 +01:00
Łukasz Magiera
6f10183878
Merge pull request #974 from filecoin-project/feat/chainwatch-nulls
chainwatch: show null blocks
2019-12-18 22:05:27 +01:00
Jim
a028f22ee6
Merge pull request #962 from filecoin-project/docs/gpu-troubleshooting
add some notes on troubleshooting GPU usage
2019-12-18 19:18:17 +01:00
Łukasz Magiera
9f886a7eb0 chainwatch: show null blocks 2019-12-18 18:40:05 +01:00
whyrusleeping
3cb4a60db4 some log cleanup and an extra trace value 2019-12-17 14:15:51 -08:00
whyrusleeping
faad2485ee add some notes on troubleshooting GPU usage 2019-12-17 11:59:14 -08:00
Jakub Sztandera
9bd0072d5c
Nicer error print
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-17 16:27:41 +01:00
Jakub Sztandera
0eb7991bbd
Fix version check
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-17 16:26:16 +01:00
Łukasz Magiera
11d11c88ae
Revert "Refactor versions" 2019-12-17 16:16:57 +01:00
Jakub Sztandera
17d0fe96a4
Fix version references
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-17 00:44:56 +01:00
Jakub Sztandera
867cba610b
Refactor versions
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-17 00:43:43 +01:00
Łukasz Magiera
3fda442bb3
Merge pull request #934 from filecoin-project/feat/sb-diskmgr
sectorbuilder: Check free space before creating sectors
2019-12-16 21:37:18 +01:00
Łukasz Magiera
e0c6247ac9 Use power of 2 sizes when parsing byte counts 2019-12-16 20:44:48 +01:00
Łukasz Magiera
1383bfa0eb sectorbuilder: fs: address review 2019-12-16 20:19:26 +01:00
Łukasz Magiera
825e3a0774 sectorbuilder: check free space before creating sectors 2019-12-16 17:16:08 +01:00
Łukasz Magiera
d6f543ce87 gofmt 2019-12-16 13:00:43 +01:00
Łukasz Magiera
97cf3f70a5 chainwatch: sub to mpool/blocks afetr initial sync 2019-12-13 15:47:51 +01:00
Jakub Sztandera
9907f7b7fb
Add script for fixing nocne
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-13 15:47:21 +01:00
Łukasz Magiera
2e9655a4e0 More fixes 2019-12-13 14:42:01 +01:00
Łukasz Magiera
3d666b3992 Merge branch 'feat/chainwatch-stuff' into feat/chainwatch-pg 2019-12-13 12:57:59 +01:00
Łukasz Magiera
a246be587e chainwatch: fix ui queries 2019-12-13 12:48:42 +01:00
Łukasz Magiera
f2ea12571f Optimise mpool update processing 2019-12-13 12:04:24 +01:00
Łukasz Magiera
1018999096 WIP fixing queries 2019-12-13 10:30:51 +01:00
Łukasz Magiera
04691a13da chainwatch: Fix postgres data import 2019-12-12 19:34:28 +01:00
Łukasz Magiera
e34e5b27ba Merge branch 'master' into feat/chainwatch-pg 2019-12-12 17:57:35 +01:00
Łukasz Magiera
cf9edae000
Merge pull request #878 from filecoin-project/feat/cw-sset-counts
chainwatch: Collect sector set sizes
2019-12-12 17:32:12 +01:00
Łukasz Magiera
7556d44b15 More data in chainwatch 2019-12-12 14:53:38 +01:00
Łukasz Magiera
ee979a20f8 Show sectorset info in storageminer info 2019-12-12 13:02:20 +01:00
Łukasz Magiera
fc6073d13b chainwatch: Collect sector set sizes 2019-12-12 00:32:09 +01:00
Łukasz Magiera
66ee9d209d wip 2019-12-11 23:17:44 +01:00
Jakub Sztandera
9589fc0762
Add version commit string
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-11 23:00:39 +01:00
Łukasz Magiera
830f2cbdd3 Merge branch 'master' into feat/chainwatch-pg 2019-12-11 22:13:08 +01:00
Jakub Sztandera
4d49473616
Increase faucet limits
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-11 16:23:11 +01:00
Łukasz Magiera
bcbcaba57b
Merge pull request #861 from filecoin-project/feat/genesis-timestamp-flag
allow setting genesis timestamp when initializing network
2019-12-11 15:49:27 +01:00
Jakub Sztandera
b655ba1ac1
Fix build
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-11 15:44:42 +01:00
whyrusleeping
d6bfbe5a26 allow setting genesis timestamp when initializing network 2019-12-11 15:36:39 +01:00
Łukasz Magiera
43f5ba1eb4
Merge pull request #847 from lanzafame/feat/accept-human-sizes
accept humanized size values to cli flags
2019-12-11 13:18:05 +01:00
lanzafame
1888b68e38 accept humanized size values to cli flags 2019-12-11 12:06:28 +10:00
Łukasz Magiera
b6b06f67dc chainwatch: Postgres 2019-12-11 00:42:36 +01:00
Łukasz Magiera
7d5709f4e2
Merge pull request #840 from filecoin-project/feat/bench-bps
bench: print bps speeds
2019-12-10 21:21:13 +01:00
Jakub Sztandera
bfdfd4023e
Cleanup math
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-10 20:53:39 +01:00
Łukasz Magiera
0fa20f6074 bench: print bps speeds 2019-12-10 20:02:42 +01:00
Whyrusleeping
53999643f7
Merge pull request #837 from filecoin-project/feat/symlink-import-preseal
Feat/symlink import preseal
2019-12-10 19:22:16 +01:00
Łukasz Magiera
739a41e834 faucet: drop unsupported sector sizes 2019-12-10 18:54:34 +01:00
whyrusleeping
4d86a4bd4a fixup 2019-12-10 09:32:50 -08:00
whyrusleeping
08cc689293 add option to symlink to presealed sectors 2019-12-10 18:11:59 +01:00
whyrusleeping
df52f8981d Add missing newline 2019-12-10 15:11:21 +01:00
whyrusleeping
384b0bdf49 add option for json output 2019-12-10 15:05:41 +01:00
whyrusleeping
3f1d8f0ed4 perform homedir expansion on input directory 2019-12-10 14:47:49 +01:00
whyrusleeping
ce5c76c6d6 load sector info from pre seal file 2019-12-10 14:22:39 +01:00
whyrusleeping
5d12659266 allow lotus-bench to benchmark existing sectorbuilders 2019-12-10 14:01:17 +01:00
Łukasz Magiera
cbf945d013 Merge remote-tracking branch 'origin/feat/lotus-shed' into testnet-staging 2019-12-10 11:19:59 +01:00
whyrusleeping
e52c927d0a delete unnecessary thing 2019-12-09 14:09:07 -08:00
whyrusleeping
8fdece1b3f make badger readonly when initializing storage miner from sector set 2019-12-09 14:05:09 -08:00
Łukasz Magiera
0de9991dcd
Merge pull request #816 from filecoin-project/feat/api-cleanup
Move api struct to a seprate pkg
2019-12-09 18:33:13 +01:00
Łukasz Magiera
ff963dfea5
Merge pull request #780 from filecoin-project/feat/storage-deal-cleanup
Clean up storage deal structures
2019-12-09 18:31:18 +01:00
Łukasz Magiera
c49dc28a04 Move api struct to a seprate pkg 2019-12-09 18:22:11 +01:00
Travis Person
8d42ca4933 A place for all the lotus tools 2019-12-09 16:09:23 +01:00
Łukasz Magiera
d18179d347
Merge pull request #792 from filecoin-project/fix/precommit-cancel-commit
Handle reverts in precommit more correctly
2019-12-09 15:53:25 +01:00
Łukasz Magiera
17c112acc0
Merge pull request #796 from filecoin-project/feat/seed-aggregation
implement lotus-seed aggregation commands
2019-12-09 15:24:13 +01:00
Łukasz Magiera
464d06ac44
Merge pull request #806 from filecoin-project/feat/api-env
Add env var for API token and location
2019-12-09 14:56:22 +01:00
Jakub Sztandera
fb7850803e
Add env var for API token and location
Usage: FULLNODE_API_INFO or STORAGE_API_INFO
Content of env var: `<token>:<api multiaddr>`
Example: `FULLNODE_API_INFO="$(cat ~/.lotus/token)dsds:$(cat ~/.lotus/api)"`

License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-09 13:36:56 +01:00
whyrusleeping
eba3f4af86 address PR review 2019-12-08 23:39:08 +01:00
Łukasz Magiera
7d68d9a029 storage: print sector retries in sector info 2019-12-08 23:35:46 +01:00
Łukasz Magiera
dec458718f
Merge pull request #793 from filecoin-project/feat/chainwatch-block-add-ts
chainwatch: Collect incoming block tstamps
2019-12-08 23:31:55 +01:00
Jakub Sztandera
7f537dce2d
More renames
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-08 22:48:20 +01:00
whyrusleeping
ba55aa117f open badger from source dirs as readonly 2019-12-08 22:24:41 +01:00
whyrusleeping
c8cef8d92f fix loading of genminer files 2019-12-08 22:14:16 +01:00
whyrusleeping
ce9be69d91 implement sector dir aggregator 2019-12-08 21:06:40 +01:00
whyrusleeping
2dc12e8bb3 implement lotus-seed aggregate-manifests 2019-12-08 19:35:44 +01:00
Łukasz Magiera
7dcee8c1e3 chainwatch: Collect incoming block tstamps 2019-12-08 16:49:13 +01:00
Jakub Sztandera
e2bd4b658b
Rename pledge-sector
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-08 15:28:27 +01:00
Łukasz Magiera
3edc93f117 wip chainwatch ui 2019-12-07 23:44:45 +01:00
whyrusleeping
f0653decf3 Clean up storage deal structures 2019-12-07 21:29:37 +01:00
Łukasz Magiera
83924e6b97
sectorbuilder: Allow to restrict task types
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-07 19:05:15 +01:00
Łukasz Magiera
c907e78e4e
Merge pull request #782 from filecoin-project/fix/dont-fetch-params
Don't fetch params for pre-seal
2019-12-07 17:41:51 +01:00
Jakub Sztandera
8b9dd91103
Don't fetch params for pre-seal
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-07 16:40:55 +01:00
Łukasz Magiera
21a8e4c8d6 worker: nogpu flag 2019-12-07 15:19:46 +01:00
Łukasz Magiera
bbc61a8f86
Merge pull request #766 from filecoin-project/feat/holes
Pre-sealing holes
2019-12-07 10:29:17 +01:00
Jakub Sztandera
92e7b4afbf
Fix tests, circle and make ux nicer
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-06 22:49:44 +01:00
Łukasz Magiera
7ed63fb7f8 seed: Trim cache 2019-12-06 22:18:52 +01:00
Jakub Sztandera
d53e43c24d
Fix test, improve log
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-06 19:47:55 +01:00
Jakub Sztandera
e07ab00fbb
Fix Uint64
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-06 18:55:46 +01:00
Jakub Sztandera
80592a87cf
Pre-sealing holes
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-06 18:53:33 +01:00
Whyrusleeping
e9ab233566
Update cmd/lotus-seed/seed/seed.go 2019-12-06 01:19:17 -08:00
whyrusleeping
2a8dd6dd46 one more occurance of the bug 2019-12-06 01:00:16 -08:00
Łukasz Magiera
5dd6d52894 Bump some numbers 2019-12-05 14:41:10 +01:00
Łukasz Magiera
6f024bee58
Merge pull request #736 from filecoin-project/feat/params-v20
Params v20
2019-12-05 14:03:37 +01:00
Łukasz Magiera
318f5ad76e
Merge pull request #749 from filcloud/fix/make-db-config
make chainwatch db source config
2019-12-05 13:01:37 +01:00
wanghui
5d5bc1bd39 make chainwatch db source config 2019-12-05 19:58:19 +08:00
Łukasz Magiera
3673a9110f
Merge pull request #743 from filecoin-project/feat/static-check-2
more of that sweet staticcheck goodness
2019-12-05 12:21:43 +01:00
Łukasz Magiera
69834a3cf3
Merge pull request #748 from filcloud/fix/dot-usage
add usage descript for chainwatch dot
2019-12-05 12:16:43 +01:00
Łukasz Magiera
310b07cc9c
Fix typo 2019-12-05 12:15:39 +01:00
wanghui
96548bef0e add usage descript for chainwatch dot 2019-12-05 19:12:08 +08:00
whyrusleeping
40be53c9f9 add command for power users to manually update sector state 2019-12-04 20:43:54 -08:00
whyrusleeping
613a0a05a0 more of that sweet staticcheck goodness 2019-12-04 18:04:09 -08:00
Łukasz Magiera
3daf9103a8 paramfetch: Only pull necessary params 2019-12-04 20:44:15 +01:00
Łukasz Magiera
b2001db9d5 worker: Fix rebaining bugs 2019-12-04 17:53:32 +01:00
Łukasz Magiera
28dde1a2d3 worker: Use system tar for moving cache around 2019-12-04 15:58:28 +01:00
Łukasz Magiera
edd30c7aa1 Merge branch 'master' into feat/remote-workers 2019-12-04 14:10:15 +01:00
Łukasz Magiera
0adfff9ae7
Merge pull request #705 from filecoin-project/feat/cw-receipts
chainwatch: Gather receipts
2019-12-04 02:27:20 +01:00
Łukasz Magiera
42b59342ab
Merge pull request #717 from filecoin-project/feat/sminer-sync-wait
storageminer: Wait for sync
2019-12-04 02:26:30 +01:00
Łukasz Magiera
d112fd18b1 Persist sector sealing errors 2019-12-04 01:44:29 +01:00
Łukasz Magiera
6467a982bc storageminer: Wait for sync 2019-12-04 01:25:18 +01:00
Łukasz Magiera
13c39452c1 storageminer: States for common failure modes 2019-12-04 00:59:40 +01:00
Łukasz Magiera
ac11fb6d7f chainwatch: gather receipts 2019-12-03 12:05:12 +01:00
Łukasz Magiera
a7239d7f01 allow setting api host in storageminer 2019-12-03 11:05:35 +01:00
Łukasz Magiera
160e11ce8c Merge branch 'master' into feat/remote-workers 2019-12-03 03:24:00 +01:00
Łukasz Magiera
dab80b30f6 storageminer: print fallback start in info 2019-12-03 02:46:29 +01:00
Łukasz Magiera
5ba4dfdf14 Devnet 9 2019-12-03 01:44:52 +01:00
Łukasz Magiera
923748e551 Expand paths in node init 2019-12-02 23:10:22 +01:00
whyrusleeping
22f96e626b add flag to disable gpu to lotus-bench 2019-12-02 11:25:16 -08:00
Łukasz Magiera
24be85e8ec Fix storage miner info for ePoSt 2019-12-02 17:47:09 +01:00
Łukasz Magiera
d5b94884c8 Buch of lint fixes 2019-12-02 13:51:16 +01:00
Łukasz Magiera
d9840c05db bench: Measure unseal time 2019-12-01 23:37:53 +01:00
Łukasz Magiera
fd8f65248b deals: Correctly set deal ID in provider states 2019-12-01 21:07:57 +01:00
Łukasz Magiera
a59d0f0f8c Fix unsealing, sector based data refs 2019-12-01 18:58:31 +01:00
whyrusleeping
c92b9d5a0d fix storage miner sectorbuilder construction 2019-11-30 23:55:20 -06:00
whyrusleeping
59d9c681ad Rework miner test setups to fix tests 2019-11-30 17:21:11 -06:00
Łukasz Magiera
89556819ae seal-worker: Handle cache 2019-11-30 14:22:50 +01:00
Łukasz Magiera
ed9279cf0c Some fixes and dev utils 2019-11-30 10:25:31 +01:00
Łukasz Magiera
8767d8c16b Merge branch 'feat/election-post' into feat/remote-workers 2019-11-30 09:42:28 +01:00
whyrusleeping
3b533ed76c Genesis miner config actually sets the created miner address now 2019-11-29 22:31:26 -06:00
Łukasz Magiera
ad978949db import sector/deal into state machines on init 2019-11-29 20:11:42 +01:00
whyrusleeping
0ca92bdca0 track hot and cold times for epost 2019-11-29 10:48:07 -08:00
whyrusleeping
ce89ddbd6a fixing some tests 2019-11-28 21:38:18 -06:00
Łukasz Magiera
cb7d15e67e genesis setup improvements 2019-11-28 23:50:58 +01:00
Łukasz Magiera
6098db4f51
Merge pull request #682 from filecoin-project/feat/election-post-fallback
Feat/election post fallback
2019-11-28 19:10:50 +01:00
Łukasz Magiera
920fd3ba9b storageminer: New fallback post scheduler 2019-11-28 18:44:57 +01:00
Łukasz Magiera
aefd432422 actors: Fallback post progress 2019-11-28 13:46:56 +01:00
Łukasz Magiera
b75767e678 seed: get default sector size from build.SectorSizes 2019-11-28 11:55:34 +01:00
whyrusleeping
8fae155cf6 Add timings for proof verification 2019-11-27 19:43:52 -06:00
Łukasz Magiera
5d30106f5a More v18 updates 2019-11-27 18:10:34 +01:00
Łukasz Magiera
d2412f4f00 Fix pond 2019-11-27 15:18:51 +01:00
Łukasz Magiera
23e0008b81 Merge remote-tracking branch 'origin/master' into feat/election-post 2019-11-27 13:31:44 +01:00
Łukasz Magiera
4a77fdac4c bench: Fix after filecoin-ffi switch 2019-11-27 13:12:42 +01:00
Łukasz Magiera
03b1d2329f seed: Call AcquireID for sectorIDs 2019-11-27 12:58:16 +01:00