Łukasz Magiera
5ec76d4b7b
support making deals with data directly from IPFS nodes
2020-04-30 01:56:45 +02:00
Jeromy
bfa93bb933
add script to run a local devnet, and helper command
2020-04-27 15:26:46 -07:00
Jeromy
f4948dcba0
remove api dependency on sealing fsm package
2020-04-23 15:33:59 -07:00
Jeromy
216072468f
handle websocket clients disconnecting more properly
2020-04-20 09:52:16 -07:00
Jakub Sztandera
f1c890ca54
Tests pass
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-04-08 18:31:16 +02:00
Łukasz Magiera
0417e4bd0c
pond: Use tipestKeys for state calls
2020-04-03 01:09:31 +02:00
Łukasz Magiera
f15eb8b172
Merge pull request #1487 from filecoin-project/fix/partial-sync-responses
...
properly handle partial sync responses
2020-04-02 00:03:25 +02:00
Łukasz Magiera
f727f1db26
bufbs: Env var to disable blockstore buffering
2020-04-01 22:37:34 +02:00
Jeromy
27d57264d9
properly handle partial sync responses
2020-04-01 11:35:09 -07:00
lijunlong
8c05251cce
simplify code
2020-04-01 09:41:26 +08:00
lijunlong
7c15d1e8c3
add bench mark for bls sign and verify
2020-03-28 12:34:12 +08:00
Łukasz Magiera
c66d3dfad7
sectorstorage: Untangle from lotus deps
2020-03-27 22:35:33 +01:00
Łukasz Magiera
cd618dfdbd
gofmt
2020-03-22 22:39:27 +01:00
Łukasz Magiera
df9aa0e357
storagemitner: manage ulimit on start
2020-03-22 22:08:22 +01:00
Łukasz Magiera
1ed7779701
Merge remote-tracking branch 'origin/testnet/3' into feat/new-workers
2020-03-19 03:28:55 +01:00
Łukasz Magiera
94ebbd9d90
workers: Actually register in miner
2020-03-19 00:23:32 +01:00
Jakub Sztandera
06ce4f21c5
Warn on non zero result with error
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-03-14 15:08:24 +01:00
Jim Pick
b6d5ea629b
Make websocket connection upgrade header check case-insensitive
...
I was having troubles configuring an nginx reverse-proxy when
using Websockets.
It turns out my configuration was sending a "Connection: upgrade"
header, but Lotus expected "Connection: Upgrade".
This commit converts the check to be case-insensitive.
Some of the examples on the MDN page show lower-case "upgrade",
so I think it's not unusual for the usage to vary.
2020-03-13 13:07:39 -07:00
Jakub Sztandera
21b34ba133
Fix chan handling
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-03-11 19:14:49 +01:00
Jakub Sztandera
8d870a03b5
Fix Error and Result being returne at the same time in JSON-RPC
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-03-11 18:48:02 +01:00
whyrusleeping
baca881473
dont panic when replay fails to find a message
2020-03-10 12:44:50 -07:00
whyrusleeping
24bf720a9a
Merge branch 'master' into testnet/3
2020-03-07 16:46:12 -08:00
Łukasz Magiera
3d1a5f4bf3
libs: Use go-statemachine
2020-03-06 20:01:03 +01:00
Łukasz Magiera
79237a9309
libs: Remove rlepluslazy (using specs-actors everywhere)
2020-03-06 19:52:38 +01:00
Łukasz Magiera
e51fa5c9ac
libs: Use zerocomm from sectorbuilder
2020-03-06 19:50:41 +01:00
whyrusleeping
16096e2c71
some go vet fixes
2020-03-05 22:46:07 -08:00
Łukasz Magiera
76698fe2db
jsonrpc: Don't try to reconnect on the server side
2020-03-05 01:34:29 +01:00
Nate Walck
7db39115e8
Fixed ctx issue, changed to track failures instead of success
2020-02-27 23:43:52 -05:00
Nate Walck
353c5d8b12
Relocation opencensus metrics to its own package and add more node stats
2020-02-27 21:49:18 -05:00
Łukasz Magiera
2aeab13aae
zerocomm: 'Fix' the test
2020-02-27 01:56:09 +01:00
whyrusleeping
767392332e
WIP: update sectorbuilder
2020-02-26 14:54:34 -08:00
Łukasz Magiera
d787aa5007
Merge branch 'testnet/3' into feat/specs-actors
2020-02-24 18:32:02 +01:00
Łukasz Magiera
9f0e0ced5e
Merge pull request #1155 from jsign/issue127_2
...
fix issue #127
2020-02-24 17:22:58 +01:00
Łukasz Magiera
226685dc1c
Implement committed capacity sectors
2020-02-23 01:47:47 +01:00
Łukasz Magiera
1381baf088
Generate zero CommP table
2020-02-22 15:06:38 +01:00
Łukasz Magiera
b12482df89
move peermgr, tracing into lib
2020-02-22 12:36:22 +01:00
Łukasz Magiera
4e98f2e438
some test fixes
2020-02-21 20:28:01 +01:00
Łukasz Magiera
c544c2b5c5
Set hamt bitwidth
2020-02-14 15:14:39 +01:00
Łukasz Magiera
0d6cfc879d
Use specs-actors ignatures
2020-02-13 00:52:36 +01:00
Łukasz Magiera
fa2c6605c2
Fix compilation after dep updates
2020-02-11 02:11:58 +01:00
Łukasz Magiera
72c89ab89b
Merge pull request #1223 from filecoin-project/fix/squash-forks
...
squash forks and use correct amt library everywhere
2020-02-06 20:14:55 +01:00
whyrusleeping
faf05cafcf
squash forks and use correct amt library everywhere
2020-02-04 18:26:42 -08:00
Jakub Sztandera
5bc1cb2aa3
Fix CheckBlockSignature, add docks
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-02-04 15:12:10 +01:00
Jakub Sztandera
5e6ab42cb8
Don't depend on ffi
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-02-04 15:12:04 +01:00
Jakub Sztandera
70aaa8fc92
Revert "Fix small bug in RLE"
...
This reverts commit 6ed57ede6a
.
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-30 16:14:32 -08:00
Jakub Sztandera
6ed57ede6a
Fix small bug in RLE
...
Thanks @frrist
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-30 15:18:54 -08:00
jsign
3106f512b2
define method retry freq as a constant
...
Signed-off-by: jsign <jsign.uy@gmail.com>
2020-01-26 21:52:19 -03:00
jsign
54f2e6ea3a
extra fixes
...
Signed-off-by: jsign <jsign.uy@gmail.com>
2020-01-24 22:48:30 -03:00
jsign
dbd51ff8e7
fix issue #127
...
Signed-off-by: jsign <jsign.uy@gmail.com>
2020-01-24 21:15:49 -03:00
Jakub Sztandera
2256e62648
Improve warning
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-23 12:39:23 -08:00
Jakub Sztandera
6b42a78c3f
Cleanup
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-23 12:35:57 -08:00
Jakub Sztandera
cb35625a53
Remove log
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-22 16:04:33 -08:00
Jakub Sztandera
f5d061f34f
Add incremental timeouts to blocksync fetching
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-22 15:57:42 -08:00
Łukasz Magiera
cf153f89df
Merge pull request #1131 from filecoin-project/feat/soft-map-cbg
...
cbor-gen: Soft struct-map unmarshaling
2020-01-21 19:44:39 +01:00
Łukasz Magiera
d2401bc339
Update cbor-gen, error on unknown fields
2020-01-21 17:28:55 +01:00
Łukasz Magiera
2076cb106d
cobr-gen: Soft struct-map unmarshaling
2020-01-21 17:05:10 +01:00
Łukasz Magiera
fbc0330fa8
jsonrpc: Fix channel registration deadlock
2020-01-21 14:48:17 +01:00
Łukasz Magiera
d1f419c9d1
jsonrpc: Fix channel closing race
2020-01-20 19:21:16 +01:00
Łukasz Magiera
3886e050b0
lotuslog: don't override log levels
2020-01-19 21:18:35 +01:00
Łukasz Magiera
ffdd436b52
sealing: Handle seed changes more correctly
2020-01-16 02:25:49 +01:00
Łukasz Magiera
23472aa4f2
statemachine: don't force users to see reflect
2020-01-15 01:08:20 +01:00
Łukasz Magiera
2ef8c1ae0c
statemachine: Better naming
2020-01-13 18:44:59 +01:00
Łukasz Magiera
e06c19b51c
update deps
2020-01-13 17:39:54 +01:00
Łukasz Magiera
34abc3d023
Merge branch 'feat/testnet2' into feat/event-states
2020-01-13 15:52:43 +01:00
Łukasz Magiera
f6d41ee77d
Port sector state maching to evtsm
2020-01-10 20:24:15 +01:00
Łukasz Magiera
da2a11ed76
Event-based state machine
2020-01-09 22:23:31 +01:00
Łukasz Magiera
8cbcbbd7a4
Merge branch 'feat/testnet2' of github.com:filecoin-project/go-lotus into feat/testnet2
2020-01-08 22:44:54 +01:00
Jakub Sztandera
1ed62628a7
Update go-log to v2
...
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2020-01-08 20:22:31 +01:00
Łukasz Magiera
31173ff4b4
Set logging levels in a single place
2020-01-08 14:49:34 +01:00
laser
20321bb476
handle rebase
2020-01-07 08:18:35 -08:00
acruikshank
7873213b11
switch sectorbuilder from lib to external module
...
point to correct version of sectorbuilder + ensure go-datastore stays at 0.1.1
replace local address type with go-address
consume paramfetch.GetParams instead of local paramfetch.go
remove constants now defined in sectorbuilder
2020-01-07 07:48:43 -08:00
Łukasz Magiera
1e7f10e387
gofmt
2020-01-07 15:00:10 +01:00
hannahhoward
718acb0a86
refactor(cborutil): extract cborutil library
...
Use extracted cborutil library
2020-01-07 14:59:35 +01:00
hannahhoward
14ecd1929b
refactor(crypto): use extracted crypto library
2020-01-07 14:53:30 +01:00
hannahhoward
8418464d91
refactor(address): use extracted address library
...
Switch to using extracted address library
2020-01-07 14:53:27 +01:00
laser
6a740a6d67
consume newly-extracted paramfetch
2020-01-02 11:08:49 -08:00
Łukasz Magiera
2e95a53679
Wire up faults in fPoSt
2019-12-17 23:33:08 +01:00
Łukasz Magiera
4f7cc07df5
circle: buildall on macos
2019-12-17 15:28:31 +01:00
Łukasz Magiera
746e08e717
sectorbuilder: Improve not enough space error
2019-12-17 14:47:08 +01:00
Łukasz Magiera
aa4bf9ab46
sectorbuilder: fix getpath
2019-12-17 11:56:45 +01:00
dignifiedquire
32acb66269
fix(sectorbuilder): always cast fsstat.Bsize
...
fixes compilation issue under macos
2019-12-16 22:07:14 +01:00
Łukasz Magiera
1383bfa0eb
sectorbuilder: fs: address review
2019-12-16 20:19:26 +01:00
Łukasz Magiera
825e3a0774
sectorbuilder: check free space before creating sectors
2019-12-16 17:16:08 +01:00
Whyrusleeping
9eb1371896
Merge pull request #860 from filecoin-project/fix/soft-sectors-load-err
...
sectors: Handle sector state reload errors more gracefully
2019-12-11 15:48:45 +01:00
Łukasz Magiera
613bb25297
sectors: Handle sector state reload errors more gracefully
2019-12-11 15:17:38 +01:00
dtynn
1030229cb6
use actual symlink flag
2019-12-11 10:25:48 +08:00
Łukasz Magiera
94037395ff
sectorbuilder: Fix proving on RO filesystem
2019-12-10 20:27:57 +01:00
whyrusleeping
4d86a4bd4a
fixup
2019-12-10 09:32:50 -08:00
whyrusleeping
08cc689293
add option to symlink to presealed sectors
2019-12-10 18:11:59 +01:00
whyrusleeping
e27217c6a1
fix sync tests
2019-12-09 22:17:15 +01:00
Henri S
9e363f9266
fix target for ePoSt IsTicketWinner fn
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-09 18:34:15 +01:00
Łukasz Magiera
0de9991dcd
Merge pull request #816 from filecoin-project/feat/api-cleanup
...
Move api struct to a seprate pkg
2019-12-09 18:33:13 +01:00
Łukasz Magiera
c49dc28a04
Move api struct to a seprate pkg
2019-12-09 18:22:11 +01:00
Jakub Sztandera
1a2401a816
Add short tests
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-09 17:49:30 +01:00
Łukasz Magiera
17c112acc0
Merge pull request #796 from filecoin-project/feat/seed-aggregation
...
implement lotus-seed aggregation commands
2019-12-09 15:24:13 +01:00
whyrusleeping
0a68dba256
use a package
2019-12-08 22:53:48 +01:00
whyrusleeping
9c3177c6dc
support copying directories
2019-12-08 22:45:34 +01:00
whyrusleeping
39cd25afc7
this will pretty much always be nil
2019-12-08 22:34:46 +01:00
whyrusleeping
c3dd9c55e2
use that nice function i wrote
2019-12-08 22:30:17 +01:00
whyrusleeping
ce9be69d91
implement sector dir aggregator
2019-12-08 21:06:40 +01:00
Łukasz Magiera
7c2ce93981
Close files in ExtractTar
2019-12-08 18:39:24 +01:00
Łukasz Magiera
83924e6b97
sectorbuilder: Allow to restrict task types
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-07 19:05:15 +01:00
Jakub Sztandera
71b973f830
Some cleanup
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-07 16:20:30 +01:00
Jakub Sztandera
80dbc25b6d
Fix typo in overflow check
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-07 15:56:44 +01:00
Jakub Sztandera
32a1940c57
Replace rleplus with rlepluslazy
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-07 15:48:20 +01:00
Jakub Sztandera
353fef3ff6
Improve complex code and comment it
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2019-12-07 15:48:20 +01:00
Jakub Sztandera
794490c490
Remove old bitvector
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2019-12-07 15:48:20 +01:00
Jakub Sztandera
01c0a6ec9f
Optimize and start wrapping it up
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2019-12-07 15:48:20 +01:00
Jakub Sztandera
d3dfd8a73b
Add rle encoder
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2019-12-07 15:48:20 +01:00
Jakub Sztandera
3d6071ed3f
Improve benchmarks and fix bitvector iterator
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2019-12-07 15:48:20 +01:00
Jakub Sztandera
9bf871ee53
Improve bitvector performance
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2019-12-07 15:48:19 +01:00
Jakub Sztandera
e5b3c4757d
More iterative algorithms
...
- Add RunIterator and decoder from RLE
- Add BitIterator and BitsFromRuns
- Add BitsFromSlice
- Add RunsFromBits
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2019-12-07 15:48:19 +01:00
Jakub Sztandera
c557aa206f
Add lazy RLE+ decoding
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2019-12-07 15:48:19 +01:00
Łukasz Magiera
bbc61a8f86
Merge pull request #766 from filecoin-project/feat/holes
...
Pre-sealing holes
2019-12-07 10:29:17 +01:00
Jakub Sztandera
92e7b4afbf
Fix tests, circle and make ux nicer
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-06 22:49:44 +01:00
Łukasz Magiera
7ed63fb7f8
seed: Trim cache
2019-12-06 22:18:52 +01:00
Jakub Sztandera
80592a87cf
Pre-sealing holes
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-12-06 18:53:33 +01:00
Łukasz Magiera
969ef179ef
Fix AddPiece with disabled local workers
2019-12-05 16:53:29 +01:00
Łukasz Magiera
2ce56dbfcb
Allow no local sectorbuilder workers
2019-12-05 16:28:04 +01:00
Łukasz Magiera
6f024bee58
Merge pull request #736 from filecoin-project/feat/params-v20
...
Params v20
2019-12-05 14:03:37 +01:00
whyrusleeping
5aa7bf6123
there is no real correlation between challenge count and len(winners)
2019-12-05 13:13:45 +01:00
Łukasz Magiera
291fab74c1
sectorbuilder: update PoRepProofPartitions
2019-12-05 12:52:13 +01:00
whyrusleeping
b7a89b56b3
more statticcheck!
2019-12-04 21:14:19 -08:00
Łukasz Magiera
3daf9103a8
paramfetch: Only pull necessary params
2019-12-04 20:44:15 +01:00
Łukasz Magiera
b2001db9d5
worker: Fix rebaining bugs
2019-12-04 17:53:32 +01:00
Łukasz Magiera
28dde1a2d3
worker: Use system tar for moving cache around
2019-12-04 15:58:28 +01:00
Łukasz Magiera
160e11ce8c
Merge branch 'master' into feat/remote-workers
2019-12-03 03:24:00 +01:00
Łukasz Magiera
1cdf6a6f8d
use challangeCount as sampleRate in IsTicketWinner
2019-12-02 15:24:27 +01:00
Łukasz Magiera
d5b94884c8
Buch of lint fixes
2019-12-02 13:51:16 +01:00
Łukasz Magiera
c7cf20843e
actually set unsealed path in sectorbuilder
2019-12-01 22:22:39 +01:00
Łukasz Magiera
fd8f65248b
deals: Correctly set deal ID in provider states
2019-12-01 21:07:57 +01:00
Łukasz Magiera
a59d0f0f8c
Fix unsealing, sector based data refs
2019-12-01 18:58:31 +01:00
whyrusleeping
422e25c8e6
self review: some cleanup
2019-11-30 22:02:52 -06:00
whyrusleeping
59d9c681ad
Rework miner test setups to fix tests
2019-11-30 17:21:11 -06:00
Łukasz Magiera
89556819ae
seal-worker: Handle cache
2019-11-30 14:22:50 +01:00
Łukasz Magiera
ed9279cf0c
Some fixes and dev utils
2019-11-30 10:25:31 +01:00
Łukasz Magiera
8767d8c16b
Merge branch 'feat/election-post' into feat/remote-workers
2019-11-30 09:42:28 +01:00
Łukasz Magiera
466f1d8cb9
Use ProvingSet for GetSectorsForElectionPost
2019-11-28 19:52:28 +01:00
Łukasz Magiera
920fd3ba9b
storageminer: New fallback post scheduler
2019-11-28 18:44:57 +01:00
Łukasz Magiera
aefd432422
actors: Fallback post progress
2019-11-28 13:46:56 +01:00
whyrusleeping
45288b8810
WIP: uncomment out windowed post code, try to make it work
2019-11-27 21:36:34 -06:00
Łukasz Magiera
99b9dfe18d
filecoin-ffi master
2019-11-27 23:37:02 +01:00
Łukasz Magiera
5d30106f5a
More v18 updates
2019-11-27 18:10:34 +01:00
Łukasz Magiera
1ccfe7d8f7
update filecoin-ffi to v18 params
2019-11-27 16:00:04 +01:00
Łukasz Magiera
23e0008b81
Merge remote-tracking branch 'origin/master' into feat/election-post
2019-11-27 13:31:44 +01:00
laser
3623925f66
replace go-bls-sigs and go-sectorbuilder with filecoin-ffi
...
- remove old submodules and add new submodule
- update build tooling to consume new unified static library
- update consumers of old libs to use new package
2019-11-26 18:16:37 -08:00
whyrusleeping
249bd8389f
Copy over last sector ID key when migrating sectorbuilder
2019-11-26 19:39:07 -06:00
Łukasz Magiera
407f6fa6f8
sync: correct vrfBase for ticket check
2019-11-26 23:54:11 +01:00
Łukasz Magiera
d5a632f644
sectorbuilder: Drop stateful sectorbuilder refs
2019-11-26 23:13:01 +01:00
Łukasz Magiera
871c30d2a0
WIP trying to get election post to compute
2019-11-26 16:15:41 +01:00
Łukasz Magiera
86cd28fa7e
sectorbuilder: Measure thigs in TestSealAndVerify
2019-11-26 13:29:42 +01:00
whyrusleeping
a98295a747
use the correct sector sizes in places
2019-11-25 20:43:43 -06:00
Łukasz Magiera
7a3ffbf9fe
WIP getting post in sectorbuilder_test to work
2019-11-26 00:32:02 +01:00
Łukasz Magiera
df0be815ae
More correct challangeCount calc
2019-11-25 17:18:11 +01:00
whyrusleeping
a0588d513d
Add lotus-gen, rewire genesis mining
2019-11-24 22:45:13 -06:00
Jakub Sztandera
36b7c5a32a
Swtich to xerrors
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-11-22 10:20:56 -06:00
Łukasz Magiera
3281e9448a
fix rspco serialization
2019-11-22 16:48:02 +01:00
whyrusleeping
96482f456a
WIP: election post restructuring
2019-11-21 16:21:45 -06:00
Łukasz Magiera
b726b95298
WIP remote sector CommitSseal
2019-11-21 20:51:53 +01:00
Łukasz Magiera
d4197bbadc
Working remote PreCommit
2019-11-21 19:38:50 +01:00
Łukasz Magiera
98b1de33b6
Stats for remote workers
2019-11-21 17:23:42 +01:00
Łukasz Magiera
88bbcd80ea
support remote SealPreCommit
2019-11-21 17:10:09 +01:00
Łukasz Magiera
ba3ad75670
remote-worker: wire up storage miner endpoints
2019-11-21 15:10:51 +01:00
Łukasz Magiera
9725eb78bf
wip remote sectorbuilder workers
2019-11-21 01:53:06 +01:00
Łukasz Magiera
ca70ac05d7
sectorbuilder: Drop some unused functions
2019-11-20 20:59:10 +01:00
Łukasz Magiera
7690c2f3b7
sectorbuilder: open FD later in AddPiece
2019-11-20 18:28:14 +01:00
Łukasz Magiera
5381d10fe3
StateAPI: account for slashing in StateMinerPower
2019-11-15 02:01:53 +01:00
Łukasz Magiera
727ca2ccb4
Skip sectorbuilder tests on slow hardware
2019-11-14 23:39:00 +01:00
Łukasz Magiera
d5c620dc44
sectorbuilder: Call AcquireSectorId in sync
2019-11-14 23:00:21 +01:00
Łukasz Magiera
b88807b947
Merge remote-tracking branch 'origin/master' into wip/sbfixes-links
2019-11-14 19:31:52 +01:00
Łukasz Magiera
a2c01defab
Merge branch 'master' into wip/sbfixes-links
2019-11-14 19:27:53 +01:00
Łukasz Magiera
d64b21936f
parallel sectorbuilder test
2019-11-14 19:26:09 +01:00
Jakub Sztandera
383c5c0c6f
Rename to --include-test-params
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-11-14 17:43:33 +01:00
Jakub Sztandera
c7b82dbc40
Skip slow tests
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-11-13 23:43:16 +01:00
whyrusleeping
86624c8ed4
fix tests and add some more trace attributes
2019-11-12 22:44:29 -08:00
whyrusleeping
9e464a4b90
more tracing spans
2019-11-12 12:42:22 -08:00
Łukasz Magiera
56d902c1bd
storageminer: Throttle GeneratePieceCommitment in storeGarbage
2019-11-12 19:05:03 +01:00
Łukasz Magiera
73ab6c0c66
WorkerCount on storageminer config
2019-11-12 18:59:38 +01:00
Łukasz Magiera
81bd0bc517
Test to reproduce post error after restart
2019-11-09 11:42:36 +01:00
Łukasz Magiera
ed64e52e3a
sectorbuilder: apply some review suggestions
2019-11-09 00:21:04 +01:00
Łukasz Magiera
3d360167df
sectorbuilder: Call destroy in DI module
2019-11-08 21:30:50 +01:00
Łukasz Magiera
2c66e20a1e
padreader: Some more testcases
2019-11-08 20:55:03 +01:00
Łukasz Magiera
61505b6802
Use the same dir in TestAcquireID
2019-11-08 19:55:23 +01:00
Łukasz Magiera
c729cabef1
keep track of last used sector id across restarts
2019-11-08 19:49:36 +01:00
Łukasz Magiera
071f05fa95
Storage miner API improvements
2019-11-08 19:23:58 +01:00
Łukasz Magiera
34846c538e
sectorbuilder: Use StandaloneWriteWithAlignment
2019-11-07 21:43:57 +01:00
Łukasz Magiera
f6a49ab9f9
Wip fixing a thing
2019-11-07 20:54:24 +01:00
Łukasz Magiera
58c21b4a5e
sectorbuilder: Always create directories
2019-11-07 19:33:46 +01:00
Łukasz Magiera
69b4bd9fb4
sectorbuilder: Also test PoSt
2019-11-07 17:43:59 +01:00
Łukasz Magiera
3e39d6e445
sectorbuilder: use standalone methods
2019-11-07 17:39:27 +01:00
Łukasz Magiera
1549269773
Make multiple deals per almost work
2019-11-07 15:45:53 +01:00
Łukasz Magiera
3fbe0abb75
cborrpc -> cborutil
2019-11-07 15:11:39 +01:00
Łukasz Magiera
8ec37e8728
deals: cleanup client state machine
2019-11-07 14:29:43 +01:00
whyrusleeping
480e7899ef
fail test if deal errors
2019-11-07 00:39:34 +01:00
whyrusleeping
597dbe369c
Add method to query latest deal state
2019-11-07 00:39:34 +01:00
whyrusleeping
9863942fe2
WIP: trying to write a test to reproduce the storage deal error
2019-11-07 00:39:34 +01:00
Łukasz Magiera
f7651f180b
Create filler deals
2019-11-07 00:09:48 +01:00
Łukasz Magiera
68c2d4f58a
deals: Set correct Refs
2019-11-06 18:38:42 +01:00
Łukasz Magiera
cb3965bcf5
Improve errors around deal handling
2019-11-06 13:04:33 +01:00
Łukasz Magiera
630134486d
Mostly fix deals
2019-11-05 19:40:51 +01:00
Łukasz Magiera
3020f7a203
Fix statestore.List
2019-11-05 19:20:12 +01:00
Łukasz Magiera
ed5ccfd750
Merge remote-tracking branch 'origin/devnet/7' into feat/interactive-porep
2019-11-05 18:53:19 +01:00
Łukasz Magiera
6a802cc9db
WIP fixing tests
2019-11-05 18:09:42 +01:00
whyrusleeping
4321256992
fix retrieval protocol error by wrapping stream in peeker
2019-11-05 08:38:54 -08:00
Łukasz Magiera
eb28c45c00
events: Plumb context to callbacks
2019-11-05 15:03:59 +01:00
whyrusleeping
9a398c6260
Track down all the uses of cboripld and eliminate them
2019-11-04 19:42:13 -08:00
Łukasz Magiera
c76ce2a2eb
rate-limit some sectorbuilder ops
2019-11-04 18:36:29 +01:00
Łukasz Magiera
13da5a5966
Put WorkerThreads on sectorbuilder.Config
2019-11-04 17:47:08 +01:00
Łukasz Magiera
2a695611d5
Update sectorbuilder
2019-11-03 21:44:22 +01:00
Łukasz Magiera
c550e030b1
INTERACTIVE PROEP IS ALIVE
2019-11-02 16:07:26 +01:00
Łukasz Magiera
09e8cdc109
Merge pull request #504 from filcloud/fix/312-panic-close-miner
...
fix panic when close miner
2019-11-02 00:59:12 +01:00
Łukasz Magiera
1dcebece71
Some smaller fixes
2019-11-01 23:44:55 +01:00
Łukasz Magiera
82344649d3
Use state store for sectors
2019-11-01 15:06:49 +01:00
Łukasz Magiera
02c3be9099
statestore: More generic keys
2019-11-01 12:14:32 +01:00
Łukasz Magiera
2343ebc5b8
statestore: Use reflect for mutators
2019-11-01 12:07:05 +01:00
Łukasz Magiera
1583cf2593
Strip unused functionality from sectorstore
2019-11-01 11:05:48 +01:00
whyrusleeping
fc9091cc89
Get interactive porep sector sealing mostly working
2019-10-31 20:57:10 -07:00
Łukasz Magiera
3cde267a2a
Move statestore to lib
2019-10-31 22:01:44 +01:00
Łukasz Magiera
ba937cf859
Fix sectorbuilder.VerifySeal
2019-10-31 20:03:26 +01:00
whyrusleeping
4e478330a4
more refactoring for interactive porep scheduling
2019-10-31 09:55:35 -07:00
wanghui
2aa8eebb99
move select
2019-10-31 17:39:42 +08:00
wanghui
8cb14335c3
use reflect select
2019-10-31 13:11:10 +08:00
whyrusleeping
759094198c
Some more progress on interactive porep
2019-10-30 18:22:50 -07:00
Łukasz Magiera
7fa3e2db7a
WIP Interactive PoRep
2019-10-30 19:10:29 +01:00
wanghui
03ca08d9bf
fix panic when close miner
2019-10-30 18:23:13 +08:00
Łukasz Magiera
5a5c66600f
storageminer: More correct listing of sealed sectors
2019-10-30 10:57:00 +01:00
Łukasz Magiera
922d8a90a5
storageminer: Restart sealing on restart
2019-10-29 23:19:58 +01:00
Łukasz Magiera
169c285fb3
storageminer: Handle uncommited sectors on start
2019-10-29 20:46:32 +01:00
Łukasz Magiera
02b67ea6b2
Fix TestSealAndVerify
2019-10-27 12:58:15 +01:00
Łukasz Magiera
874be79958
very basic sector seal scheduling
2019-10-27 09:56:53 +01:00
whyrusleeping
5257b1cce1
should use the new parameters
2019-10-25 18:09:11 +02:00
whyrusleeping
874ab1456c
WIP: updating to new proofs code
2019-10-25 18:07:34 +02:00
Łukasz Magiera
76f1e6e207
on chain deals: Put dealIDs in CommitSector messages
2019-10-24 16:24:31 +02:00
Łukasz Magiera
fabd074165
on chain deals: Deals make it to the chain
2019-10-23 19:39:14 +02:00
Łukasz Magiera
213ac77d08
on chain deals: Expose more chain state in pond
2019-10-23 12:44:00 +02:00
Łukasz Magiera
64bfb38834
on chain deals: Get things to actually run!
2019-10-23 12:44:00 +02:00
Łukasz Magiera
aab3bd617a
REST file import endpoint
2019-10-23 11:39:44 +02:00
whyrusleeping
6e90066a20
dont hang requests if websockets server shuts down
2019-10-20 15:37:51 +09:00
Jakub Sztandera
1bf713cb0a
Cleanup imports after rename
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-10-18 13:47:41 +09:00
whyrusleeping
ab7eafe76c
remove empty const block
2019-10-15 09:56:40 +09:00
whyrusleeping
e8a1b54740
Add more info to storage-miner info command output
2019-10-14 11:32:32 +09:00
Jakub Sztandera
edd7085712
Update filebeat
...
Change log of rpc buffer as I want to set up alert when it goes to high
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
2019-10-11 18:02:21 +02:00
Łukasz Magiera
b3a88a21ce
Merge pull request #299 from filecoin-project/feat/remove-vdfs
...
remove VDFs from tickets
2019-10-09 10:02:51 +02:00
whyrusleeping
19b16077fe
remove VDFs from tickets
2019-10-09 13:38:59 +09:00
Łukasz Magiera
752654ab03
Devnet 3; Builtin bootstrap; NAT Port Map
2019-10-09 05:16:35 +02:00
whyrusleeping
86deb7528c
fix websocket closing again
2019-10-08 17:29:37 +09:00
whyrusleeping
6dd8ed7d7a
pass those tests
2019-10-04 10:06:05 -06:00
whyrusleeping
697bed27a6
fix websocket closing
2019-10-04 10:06:05 -06:00
Łukasz Magiera
2874022251
jsonrpc: Channel buffeering
2019-09-27 13:37:44 +02:00
Łukasz Magiera
fe8e1fe1e4
Almost working new post code
2019-09-27 01:07:40 +02:00
Łukasz Magiera
182b754aa2
fix tests
2019-09-23 15:19:05 +02:00
Łukasz Magiera
9a990dbd8a
use new sectorbuilder file interfaces
2019-09-23 12:50:28 +02:00
Łukasz Magiera
d55e872135
Merge remote-tracking branch 'origin/master' into feat/post-schedule
2019-09-19 16:42:50 +02:00
Jakub Sztandera
9c02f7f839
Rought PoST method
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2019-09-18 17:10:03 +02:00
whyrusleeping
3e45088812
cleaning up a few types
2019-09-17 20:32:52 -07:00
Łukasz Magiera
5e2c100f4d
storageminer: Better context handling
2019-09-17 20:36:06 +02:00
Łukasz Magiera
f2ecb772fa
repo: Close datastore in Close
2019-09-17 16:34:22 +02:00
Łukasz Magiera
83f1a336a6
node: Basic graceful shutdown
2019-09-17 16:23:08 +02:00
Łukasz Magiera
5470fbeb8a
jsonrpc: include method name in error log
2019-09-16 20:08:24 +02:00
Łukasz Magiera
eda72468ce
Sector Commitment tracker
2019-09-16 20:08:24 +02:00
Jakub Sztandera
6eef3a6d64
Update sectorbuilder
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2019-09-16 14:47:55 +02:00
Łukasz Magiera
f79b755c58
retrieval: Make types more spec complaiant
2019-08-29 17:54:35 +02:00
Łukasz Magiera
e28c0c8d80
Fix sectorbuilder poRepProofPartitions
2019-08-29 17:51:06 +02:00
Łukasz Magiera
cad3efb9ba
Command to list sealed blocks
2019-08-29 17:48:19 +02:00
whyrusleeping
7eb89f90d1
Replace most marshaling with codegen
2019-08-22 12:53:32 -07:00
whyrusleeping
5a7f59498e
Wire up more proper ticket generation and verification logic
2019-08-16 12:39:12 -07:00
Łukasz Magiera
1579137236
storageminer: Initial PaymentVerify implementation
2019-08-15 15:52:14 +02:00
Łukasz Magiera
baf4fbe309
sectorstore: Address review feetback
2019-08-15 00:46:15 +02:00
Łukasz Magiera
e6493afd46
move poller to sector store
2019-08-14 23:34:43 +02:00
Łukasz Magiera
e430f86b69
pond: Basic message display in Block window
2019-08-09 19:32:46 +02:00
Łukasz Magiera
b2c3434bcd
deals: Upstream bitswap changes
2019-08-08 19:16:41 +02:00
Łukasz Magiera
3e2d04a540
deals: Use temp files for AddPiece
2019-08-07 20:02:05 -07:00
Łukasz Magiera
c79cb7bf31
deals: Almost sealing client data
2019-08-07 20:01:51 -07:00
Łukasz Magiera
b65041cac1
deals: Sending initial proposal works
2019-08-07 20:01:22 -07:00
Łukasz Magiera
549e7db12f
deals: Implement basic handshake logic
2019-08-07 20:01:22 -07:00
whyrusleeping
95e7b230ec
cleanup from self review
2019-08-07 18:23:44 -07:00
whyrusleeping
ba0d648546
sealing garbage data into a sector that gets accepted by the chain works!
2019-08-07 18:16:58 -07:00
whyrusleeping
5c32725510
sector commitments make it all the way to the chain
2019-08-07 16:22:35 -07:00
whyrusleeping
b7c6333fef
implement sector commitments and proof verification
2019-08-06 23:35:57 -07:00
whyrusleeping
2576853426
begin work on storage miner processes
2019-07-29 14:01:31 -07:00
whyrusleeping
b83ff6b9dc
Wire up sector builder commands through the api
2019-07-29 12:08:47 -07:00
whyrusleeping
f1432826d5
start integrating sector builder
2019-07-29 12:08:05 -07:00
whyrusleeping
4058885df9
switch over to new sector builder library
2019-07-26 15:29:18 -07:00
Jakub Sztandera
81b5f46062
Implement RPC tracing
...
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2019-07-26 08:50:21 +02:00
whyrusleeping
501b2e4640
update to and use fixed cbor rpc code
2019-07-25 17:49:27 -07:00
Łukasz Magiera
6f80ff0800
pond: Connect stuff in ConnMgr
2019-07-25 23:52:15 +02:00
Łukasz Magiera
4054200bdd
jsonrpc: Catch panics in jsonrpc calls
2019-07-25 16:08:41 +02:00
Łukasz Magiera
7ec9d45915
gofmt
2019-07-25 14:54:19 +02:00
Łukasz Magiera
93a8ee11db
jsonrpc: Work with browsers
2019-07-24 19:09:00 +02:00
Łukasz Magiera
77bc243110
jsonrpc: Break NewMergeClient into smaller functions
2019-07-24 14:20:57 +02:00
Łukasz Magiera
81d7c30fac
Couple lint fixes
2019-07-24 03:16:17 +02:00
Łukasz Magiera
f0e807dabb
Fix jsonrpc client after splitting apis
2019-07-24 02:40:19 +02:00
Łukasz Magiera
0a17041221
Fix rpc tests after rebase
2019-07-24 00:39:48 +02:00
Łukasz Magiera
6554db3e5f
auth: Addres review
2019-07-24 00:38:52 +02:00
Łukasz Magiera
a88be8d1df
auth: Store token in repo
2019-07-24 00:38:52 +02:00
Łukasz Magiera
309ecc4052
auth: Put auth methods in API
2019-07-24 00:37:05 +02:00
Łukasz Magiera
fa4bf5178a
auth: Restructure for getting tokens form keystore
2019-07-24 00:37:05 +02:00
Łukasz Magiera
c0f3bdbb61
jsonrpc: verify jwt tokens
2019-07-24 00:37:05 +02:00
Łukasz Magiera
265302f4aa
Implement API-level auth
2019-07-24 00:36:19 +02:00
Łukasz Magiera
9b3ae45f61
jsonrpc: Break handleWsConn into smaller functions
2019-07-23 03:45:10 +02:00