Łukasz Magiera
4d51980cb5
deps: Use tagged go-ipld-selector-text-lite
2021-11-29 21:22:30 +01:00
Łukasz Magiera
5b5e6b9e44
retrieval: DagSpec.MatchPath -> ExportMerkleProof
2021-11-29 21:14:00 +01:00
Łukasz Magiera
58a084049d
retrieval: Fix traversal in ls
2021-11-29 21:08:53 +01:00
Łukasz Magiera
9538fc9723
mod tidy, docsgen
2021-11-29 20:56:40 +01:00
Łukasz Magiera
227188e908
retrieval: Test non-matching path traversal
2021-11-29 20:52:55 +01:00
Łukasz Magiera
61791b90ea
retrieval: Only output matching nodes, MatchPath dagspec
2021-11-29 20:40:55 +01:00
Łukasz Magiera
77d75b7739
Merge pull request #7688 from filecoin-project/chore/partret_cleanup_comment_and_flow
...
Cleanup partial retrieval codepaths ( zero functional changes )
2021-11-29 16:39:55 +01:00
Łukasz Magiera
26c3752f48
Merge pull request #7693 from filecoin-project/feat/randacc-dagstore-mount
...
Make small retrieval 200x faster
2021-11-29 16:10:18 +01:00
Łukasz Magiera
4bcde2f0ff
dagstore pieceReader: Cleanup reader nil check
2021-11-29 15:32:27 +01:00
Jiaying Wang
160bb0b050
Merge pull request #7698 from filecoin-project/jen/releasetomaster
...
Releases back to master
2021-11-26 18:44:18 -05:00
Łukasz Magiera
05aa860459
Request correct read size with startOffset in pieceProvider
2021-11-27 00:05:45 +01:00
Jiaying Wang
a4c2a20851
Merge pull request #7691 from filecoin-project/misc/rle-dump
...
Add RLE dump code
2021-11-26 17:15:52 -05:00
Jennifer Wang
4df9179d34
Merge branch 'releases' into jen/releasetomaster
2021-11-26 17:09:22 -05:00
Jiaying Wang
8943de27e4
Merge pull request #7695 from filecoin-project/release/v1.13.1
...
Release/v1.13.1
2021-11-26 16:59:54 -05:00
Jiaying Wang
fc728d9e11
Merge pull request #7694 from filecoin-project/jen/v1.13.1-prep
...
v1.13.1 prep
2021-11-26 16:44:46 -05:00
Jennifer Wang
f6131ce3b5
v1.13.1 prep
2021-11-26 16:33:39 -05:00
Łukasz Magiera
9110e6f632
dagstore pieceReader: add debug log on stream restart
2021-11-26 20:24:51 +01:00
Łukasz Magiera
331702cd95
Tweak MaxPieceReaderBurnBytes
2021-11-26 18:49:41 +01:00
Łukasz Magiera
743ce5a40f
Add startOffset support to mock SectorMgr.ReadPiece
2021-11-26 18:48:52 +01:00
Łukasz Magiera
abec7dd3bc
Fix imports
2021-11-26 18:40:27 +01:00
Łukasz Magiera
f6de16e95a
Fix sector-storage tests
2021-11-26 18:16:53 +01:00
Łukasz Magiera
a9ee263682
Fix dagstore pieceReader burn logic
2021-11-26 18:01:09 +01:00
Łukasz Magiera
8d955d5f30
dagstore mount: Add random access support
2021-11-26 17:40:53 +01:00
Jakub Sztandera
4d8be81a8f
Add usage
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2021-11-26 15:01:05 +01:00
Jakub Sztandera
e3c7b8d006
Fix typo
...
Co-authored-by: Aayush Rajasekaran <arajasek94@gmail.com>
2021-11-26 14:42:18 +01:00
Łukasz Magiera
3b1d86b750
Merge pull request #7690 from filecoin-project/misc/updage-archive-script
...
Update archive script
2021-11-26 13:47:40 +01:00
Jakub Sztandera
af113f867d
Add dump code
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2021-11-25 20:53:49 +01:00
Jakub Sztandera
ca230bba09
Add releases to protected
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2021-11-25 20:19:20 +01:00
Jakub Sztandera
a26a2160ae
Fix the script
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2021-11-25 20:14:19 +01:00
Jakub Sztandera
aafdf3d093
Update archive script
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2021-11-25 19:52:04 +01:00
Peter Rabbitson
d5b4d93575
Cleanup partial retrieval codepaths ( zero functional changes )
...
- Adjust the ExportRef comment to reflect change from #7673
- Simplify control flow in parseDagSpec() ( read diff under -w )
2021-11-25 10:35:05 +01:00
Łukasz Magiera
ab55a6fbbe
Merge pull request #7681 from filecoin-project/feat/storage-tar-buf
...
storage: Use 1M buffers for Tar transfers
2021-11-24 20:52:02 +01:00
Łukasz Magiera
0c884734a3
Merge pull request #7673 from filecoin-project/chore/DM-level-tests_plus_merkle-proof-cars
...
Chore/dm level tests plus merkle proof cars
2021-11-24 20:43:39 +01:00
Łukasz Magiera
58dd814765
Merge pull request #7610 from filecoin-project/feat/partret-ux
...
Partial retrieval ux improvements
2021-11-24 20:25:05 +01:00
Łukasz Magiera
bd4927b494
retrieval: Cleanup some comments
2021-11-24 20:13:49 +01:00
Łukasz Magiera
8454abcf45
storage: Use 1M buffers for Tar transfers
2021-11-24 20:08:37 +01:00
Peter Rabbitson
407bf4961c
Modify preexisting test to reflect the simple-path car export behavior
...
I am open to having a flag or something, as long as the behavior reflected in
deals_partial_retrieval_dm-level_test.go can be preserved for v0, and opt-in for v1
2021-11-24 15:31:19 +01:00
Peter Rabbitson
46937a1b9f
Add tests cementing the DM-level behavior on simple paths
2021-11-24 15:31:15 +01:00
Łukasz Magiera
210485d800
Add some description to the retrieve command
2021-11-23 22:44:57 +01:00
Łukasz Magiera
135796d4fa
Merge remote-tracking branch 'origin/master' into feat/partret-ux
2021-11-23 19:08:56 +01:00
Łukasz Magiera
78949d6c05
retrieval: Fix deadlock in ClientGetRetrievalUpdates
2021-11-23 18:32:56 +01:00
Łukasz Magiera
83f65a673b
retrieval: Docsgen
2021-11-23 17:45:56 +01:00
Łukasz Magiera
407c2ed114
retrieval: Drop the RootSelector hack
2021-11-23 17:42:43 +01:00
Łukasz Magiera
37141779ac
Merge pull request #7453 from filecoin-project/feat/storage-groups
...
Sector storage groups
2021-11-23 16:36:12 +01:00
Łukasz Magiera
b522901845
update storage attach allowTo usage
2021-11-23 16:23:06 +01:00
Łukasz Magiera
e362d47903
Add optional group flags to storage attach commands
2021-11-23 16:11:04 +01:00
Łukasz Magiera
b1781c33ce
Show group info in storage list
2021-11-23 16:11:04 +01:00
Łukasz Magiera
2a1505b364
storage: Test StorageFindSector with groups
2021-11-23 16:11:04 +01:00
Łukasz Magiera
8b548ac02f
storage: Check allowlists in StorageFindSector
2021-11-23 16:11:04 +01:00
Łukasz Magiera
5c77c25747
storage: Add Group tags to StorageInfo
2021-11-23 16:11:04 +01:00
