Commit Graph
260 Commits
Author SHA1 Message Date
Whyrusleeping 9eb1371896 Merge pull request #860 from filecoin-project/fix/soft-sectors-load-err
sectors: Handle sector state reload errors more gracefully
2019-12-11 15:48:45 +01:00
Łukasz Magiera 613bb25297 sectors: Handle sector state reload errors more gracefully 2019-12-11 15:17:38 +01:00
dtynn 1030229cb6 use actual symlink flag 2019-12-11 10:25:48 +08:00
Łukasz Magiera 94037395ff sectorbuilder: Fix proving on RO filesystem 2019-12-10 20:27:57 +01:00
whyrusleeping 4d86a4bd4a fixup 2019-12-10 09:32:50 -08:00
whyrusleeping 08cc689293 add option to symlink to presealed sectors 2019-12-10 18:11:59 +01:00
whyrusleeping e27217c6a1 fix sync tests 2019-12-09 22:17:15 +01:00
Henri S 9e363f9266 fix target for ePoSt IsTicketWinner fn
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-09 18:34:15 +01:00
Łukasz Magiera 0de9991dcd Merge pull request #816 from filecoin-project/feat/api-cleanup
Move api struct to a seprate pkg
2019-12-09 18:33:13 +01:00
Łukasz Magiera c49dc28a04 Move api struct to a seprate pkg 2019-12-09 18:22:11 +01:00
Jakub Sztandera 1a2401a816 Add short tests
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-09 17:49:30 +01:00
Łukasz Magiera 17c112acc0 Merge pull request #796 from filecoin-project/feat/seed-aggregation
implement lotus-seed aggregation commands
2019-12-09 15:24:13 +01:00
whyrusleeping 0a68dba256 use a package 2019-12-08 22:53:48 +01:00
whyrusleeping 9c3177c6dc support copying directories 2019-12-08 22:45:34 +01:00
whyrusleeping 39cd25afc7 this will pretty much always be nil 2019-12-08 22:34:46 +01:00
whyrusleeping c3dd9c55e2 use that nice function i wrote 2019-12-08 22:30:17 +01:00
whyrusleeping ce9be69d91 implement sector dir aggregator 2019-12-08 21:06:40 +01:00
Łukasz Magiera 7c2ce93981 Close files in ExtractTar 2019-12-08 18:39:24 +01:00
Łukasz Magiera 83924e6b97 sectorbuilder: Allow to restrict task types
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-07 19:05:15 +01:00
Jakub Sztandera 71b973f830 Some cleanup
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-07 16:20:30 +01:00
Jakub Sztandera 80dbc25b6d Fix typo in overflow check
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-07 15:56:44 +01:00
Jakub Sztandera 32a1940c57 Replace rleplus with rlepluslazy
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-07 15:48:20 +01:00
Jakub Sztandera 353fef3ff6 Improve complex code and comment it
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2019-12-07 15:48:20 +01:00
Jakub Sztandera 794490c490 Remove old bitvector
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2019-12-07 15:48:20 +01:00
Jakub Sztandera 01c0a6ec9f Optimize and start wrapping it up
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2019-12-07 15:48:20 +01:00
Jakub Sztandera d3dfd8a73b Add rle encoder
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2019-12-07 15:48:20 +01:00
Jakub Sztandera 3d6071ed3f Improve benchmarks and fix bitvector iterator
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2019-12-07 15:48:20 +01:00
Jakub Sztandera 9bf871ee53 Improve bitvector performance
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2019-12-07 15:48:19 +01:00
Jakub Sztandera e5b3c4757d More iterative algorithms
- Add RunIterator and decoder from RLE
 - Add BitIterator and BitsFromRuns
 - Add BitsFromSlice
 - Add RunsFromBits

License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2019-12-07 15:48:19 +01:00
Jakub Sztandera c557aa206f Add lazy RLE+ decoding
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2019-12-07 15:48:19 +01:00
Łukasz Magiera bbc61a8f86 Merge pull request #766 from filecoin-project/feat/holes
Pre-sealing holes
2019-12-07 10:29:17 +01:00
Jakub Sztandera 92e7b4afbf Fix tests, circle and make ux nicer
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-06 22:49:44 +01:00
Łukasz Magiera 7ed63fb7f8 seed: Trim cache 2019-12-06 22:18:52 +01:00
Jakub Sztandera 80592a87cf Pre-sealing holes
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-06 18:53:33 +01:00
Łukasz Magiera 969ef179ef Fix AddPiece with disabled local workers 2019-12-05 16:53:29 +01:00
Łukasz Magiera 2ce56dbfcb Allow no local sectorbuilder workers 2019-12-05 16:28:04 +01:00
Łukasz Magiera 6f024bee58 Merge pull request #736 from filecoin-project/feat/params-v20
Params v20
2019-12-05 14:03:37 +01:00
whyrusleeping 5aa7bf6123 there is no real correlation between challenge count and len(winners) 2019-12-05 13:13:45 +01:00
Łukasz Magiera 291fab74c1 sectorbuilder: update PoRepProofPartitions 2019-12-05 12:52:13 +01:00
whyrusleeping b7a89b56b3 more statticcheck! 2019-12-04 21:14:19 -08:00
Łukasz Magiera 3daf9103a8 paramfetch: Only pull necessary params 2019-12-04 20:44:15 +01:00
Łukasz Magiera b2001db9d5 worker: Fix rebaining bugs 2019-12-04 17:53:32 +01:00
Łukasz Magiera 28dde1a2d3 worker: Use system tar for moving cache around 2019-12-04 15:58:28 +01:00
Łukasz Magiera 160e11ce8c Merge branch 'master' into feat/remote-workers 2019-12-03 03:24:00 +01:00
Łukasz Magiera 1cdf6a6f8d use challangeCount as sampleRate in IsTicketWinner 2019-12-02 15:24:27 +01:00
Łukasz Magiera d5b94884c8 Buch of lint fixes 2019-12-02 13:51:16 +01:00
Łukasz Magiera c7cf20843e actually set unsealed path in sectorbuilder 2019-12-01 22:22:39 +01:00
Łukasz Magiera fd8f65248b deals: Correctly set deal ID in provider states 2019-12-01 21:07:57 +01:00
Łukasz Magiera a59d0f0f8c Fix unsealing, sector based data refs 2019-12-01 18:58:31 +01:00
whyrusleeping 422e25c8e6 self review: some cleanup 2019-11-30 22:02:52 -06:00