cerc-io/lotus
16
0
Fork 0
Code Issues Pull Requests Packages Projects Releases 27 Wiki Activity
20,652 Commits 24 Branches 342 Tags 314 MiB
af6cecbd32
Commit Graph

1326 Commits

Author SHA1 Message Date
Łukasz Magiera
9d0c8ae3dd sectorstorage: update sched tests for new logic 2020-08-28 21:38:21 +02:00
Łukasz Magiera
4a75e1e4b4 sectorstorage: Don't require tasks within a window to run in order 2020-08-28 19:38:55 +02:00
Łukasz Magiera
11b11e416b sectorstorage: Compact assigned windows 2020-08-28 18:26:38 +02:00
Łukasz Magiera
20ffce5c0d Merge remote-tracking branch 'origin/master' into fix/some-fsm-issues 2020-08-28 16:47:25 +02:00
Łukasz Magiera
5ee85dc263 sectorstorage: Fix tests 2020-08-28 16:33:41 +02:00
刘林欣
93dc33687a ignore resend SectorStartPacking event, and unsealedInfoMap lock 2020-08-28 19:04:23 +08:00
Łukasz Magiera
6d1682a27e storagefsm: wire up RecoverDealIDs fully 2020-08-28 11:44:15 +02:00
Łukasz Magiera
1097d29213 sealing sched: Call trySched less when there are many tasks 2020-08-28 00:03:42 +02:00
Łukasz Magiera
a6492b1ed6 storagefsm: Auto-retry failed remove 2020-08-27 23:59:01 +02:00
Łukasz Magiera
59d2034cbb sealing sched: Wait a bit for tasks to come in on restart 2020-08-27 23:58:37 +02:00
Łukasz Magiera
7fdffc0340 sealing sched: Give more priority to tasks (re)moving data 2020-08-27 23:29:39 +02:00
Łukasz Magiera
f2bd680cc5 gofmt 2020-08-27 23:14:46 +02:00
Łukasz Magiera
59f554b658 sealing sched: Show waiting tasks assigned to workers in sealing jobs cli 2020-08-27 23:14:33 +02:00
Łukasz Magiera
d8e58e67c6 storagefsm: Treat PackingFailed sectors as expired 2020-08-27 22:41:35 +02:00
Łukasz Magiera
15204a9b90 storagefsm: fix tests 2020-08-27 21:34:45 +02:00
Łukasz Magiera
489d5239a5 storagefsm: Attempt to auto-recover from reorged DealIDs 2020-08-27 21:11:11 +02:00
Łukasz Magiera
7806a9885a storagefsm: Record publish deals message CID 2020-08-27 17:50:50 +02:00
Łukasz Magiera
29078aaae9 storagefsm: Retry sending messages on out-of-gas errors 2020-08-27 14:02:00 +02:00
Łukasz Magiera
df635579c4 storagefsm: Handle sectors with expired deals better 2020-08-27 13:51:38 +02:00
Łukasz Magiera
788c7dbf48 storagefsm: Separate satte for submitting commit message 2020-08-27 12:57:28 +02:00
Łukasz Magiera
15191ff80f storagefsm: Allow removing sectors in all states 2020-08-27 12:39:20 +02:00
Whyrusleeping
deb013cecb
Merge pull request #3081 from filecoin-project/conformance-tests 
driver, runner and CI for interoperable test-vector based testing.
 2020-08-26 14:06:39 -07:00
Raúl Kripalani
4709e231b8 drop aurora as dep; upgrade test-vectors. 2020-08-26 18:35:41 +01:00
Steven Allen
0155a31d1f Fix PoSt with bad sectors 
"skipped" sectors must be replaced with a substitute "good" sector, or the
entire partition must be skipped. They should not just be omitted.

This patch also fixes the test to verify the _entire_ proof instead of just
verifying that the proof includes the correct sectors.
 2020-08-26 09:56:51 -07:00
Raúl Kripalani
efdfd3ee3e Merge branch 'master' into inmem-journal 2020-08-26 16:38:23 +01:00
Raúl Kripalani
d3ac243cea Merge remote-tracking branch 'origin/master' into conformance-tests 2020-08-26 15:12:02 +01:00
Alan Shaw
a89faa72ea
feat(conformance): skip incorrect tests (#3310) 
Fixes https://github.com/filecoin-project/test-vectors/issues/72
 2020-08-26 11:45:34 +01:00
Łukasz Magiera
d9796cd25c sectorstorage: Make trySched less very slow 2020-08-24 19:16:16 +02:00
Łukasz Magiera
4311c96a44
Merge pull request #3225 from filecoin-project/fix/sched-missing-worker 
check that worker referenced by task is actually still there.
 2020-08-22 22:16:32 +02:00
Łukasz Magiera
a236957538
Merge pull request #3232 from filecoin-project/asr/marked-for-upgrade 
Indicate whether a sector has been marked for upgrade
 2020-08-22 21:48:45 +02:00
Łukasz Magiera
0806fd651a
Merge pull request #3183 from filecoin-project/steb/lint-all 
Lint everything
 2020-08-22 21:47:41 +02:00
Łukasz Magiera
0df6e1e2c7
Merge pull request #3220 from shaodan/fix-import 
Fix import storage-fsm
 2020-08-22 10:38:36 +02:00
Aayush Rajasekaran
984e52acbc Indicate whether a sector has been marked for upgrade 2020-08-21 15:53:39 -04:00
whyrusleeping
54862be3ff check that worker referenced by task is actually still there. 2020-08-21 10:33:36 -07:00
whyrusleeping
2e78f2c267 If sectorInfo doesnt have CommD or CommR set during commit, don't crash 2020-08-21 09:31:28 -07:00
Dan Shao
f21ce3e8ee Fix import storage-fsm -> extern/storage-sealing 2020-08-21 16:52:33 +08:00
Steven Allen
5733c71c50 Lint everything 
We were ignoring quite a few error cases, and had one case where we weren't
actually updating state where we wanted to. Unfortunately, if the linter doesn't
pass, nobody has any reason to actually check lint failures in CI.

There are three remaining XXXs marked in the code for lint.
 2020-08-20 20:46:36 -07:00
Aayush Rajasekaran
e9c526b218 Do not try to replace CC sectors with a deal-less sector 2020-08-19 22:41:23 -04:00
Raúl Kripalani
e38f4219c5 update test-vectors commit. 2020-08-19 18:19:03 +01:00
Raúl Kripalani
30b6f38704 update test-vectors commit. 2020-08-19 18:14:19 +01:00
Raúl Kripalani
04e4bab313 register chaos actor only if selector says to do so. 2020-08-19 18:10:56 +01:00
Raúl Kripalani
dddf7951ef update test-vectors commit. 2020-08-19 17:33:30 +01:00
Raúl Kripalani
a21234cd54 deploy the chaos actor. 2020-08-19 14:31:34 +01:00
Raúl Kripalani
4f4cebadc7 Merge branch 'master' into conformance-tests 2020-08-19 13:33:15 +01:00
Aayush Rajasekaran
7de7e65dbc Calculate depositMinimum for upgrading as replaced sector's Initialpledge 2020-08-18 19:22:43 -04:00
Aayush Rajasekaran
98f00b510f re-mark replaced sectors as for upgrade if precommit fails 2020-08-18 18:53:56 -04:00
Łukasz Magiera
a03192a39b Separate concurrent sealing sector limit for deals 2020-08-18 21:48:18 +02:00
Łukasz Magiera
6a7d72c030 fsm: fail early on too-many-sealing-sectors in pledge 2020-08-18 19:26:17 +02:00
Łukasz Magiera
e7d65be90a gofmt 2020-08-18 18:27:28 +02:00
Łukasz Magiera
baf91f08a1 Unbreak tests 2020-08-18 18:27:18 +02:00
Łukasz Magiera
886d9cd5eb fsm: handle already-precommitted CommitFailed sectors correctly 2020-08-18 18:02:25 +02:00
Łukasz Magiera
6a49bd6d8e fsm: Config for limiting max sealing sectors 2020-08-18 16:54:05 +02:00
Łukasz Magiera
65ffde9e4b fsm: Config for max WaitDeals sectors 2020-08-18 16:20:31 +02:00
Aayush Rajasekaran
37ff876bc6 restart WaitDeals timers if miner restarts 2020-08-18 05:07:14 -04:00
Łukasz Magiera
01df17f1e7
Merge pull request #3103 from filecoin-project/fix/fsm-recover-bork-snark 
fsm: Recover from errors from VerifySeal in checkCommit
 2020-08-17 19:00:16 +02:00
Łukasz Magiera
bb79af7721 fsm: Recover from errors from VerifySeal in checkCommit 2020-08-17 18:53:09 +02:00
Łukasz Magiera
a66e202f02 fsm: Fix panic on missing precommit info 2020-08-17 18:45:38 +02:00
Łukasz Magiera
6ef7a30b19
Merge pull request #3089 from filecoin-project/integrate/storage-fsm 
integrate extern/{storage-fsm,sector-storage} into lotus source tree
 2020-08-17 18:37:54 +02:00
Raúl Kripalani
1f016262cd readd int64 cast + nolint directive. 2020-08-17 17:26:07 +01:00
Raúl Kripalani
862bafc63a fix lint errors. 2020-08-17 14:39:33 +01:00
Raúl Kripalani
efdc428d5d keep storage-fsm (renamed to storage-sealing) and sector-storage in extern. 2020-08-17 14:26:18 +01:00
yaohcn
39bcfab37c make addpiece configurable 2020-08-17 17:39:50 +08:00
Raúl Kripalani
483e82e14b point test-vectors to master. 2020-08-16 22:05:43 +01:00
Raúl Kripalani
3c17cd655e integrate extern/sector-storage into lotus proper. 2020-08-16 11:09:58 +01:00
Raúl Kripalani
fb0ccc9260 integrate extern/storage-fsm into lotus proper. 2020-08-16 10:42:13 +01:00
Raúl Kripalani
322b33197c introduce interoperable vector-based conformance testing. 
This commit introduces a new package `conformance` containing:

 1. the test driver to exercise Lotus against interoperable
    test vectors, and
 2. the test runner, which integrates go test with the test vector
    corpus hosted at https://github.com/filecoin-project/conformance-vectors.

The corpus is mounted via a git submodule.

Right now, only message-class test vectors are supported. In the
next week, this support will be extended to tipset-class, chain-class,
and block sequence-class vectors.
 2020-08-16 00:15:52 +01:00
Łukasz Magiera
9328dc27f3 Update filecoin-ffi to fix Intel build 2020-08-15 13:19:10 +02:00
Łukasz Magiera
0c75dd3865 Support AddPiece on workers 2020-08-14 16:06:53 +02:00
Łukasz Magiera
632fd36205 sealing sched: Fix deadlock in worker watcher 2020-08-13 12:17:24 +02:00
yaohcn
1555984785 change to RLock 2020-08-13 17:31:18 +08:00
Steven Allen
3ef3f570fb Fix lint errors an broken tests 2020-08-12 23:16:44 +02:00
Łukasz Magiera
e1a1b325bc Merge remote-tracking branch 'origin/next' into feat/max-msg-fee-config 2020-08-12 21:55:03 +02:00
Łukasz Magiera
6f890a3edd Miner fee config 2020-08-12 19:47:09 +02:00
Steven Allen
41f1c74ae2 Set a minimum sector lifetime 2020-08-12 10:33:18 -07:00
Steven Allen
e18904bff5 [WIP] fix post submission 2020-08-12 10:33:18 -07:00
Steven Allen
9248e5a572 Update specs-actors, cbor-gen, and go-address 2020-08-12 10:32:39 -07:00
Steven Allen
9135a5d048 Pass bitfields by-value 
This ensures we can't end up decoding nil bitfields from clients when not
expecting them.

Part of https://github.com/filecoin-project/specs-actors/issues/895. Please see
this issue for details and leave any comments there.
 2020-08-12 10:32:39 -07:00
Łukasz Magiera
f537c48f93 v28 Proofs 2020-08-12 00:33:30 +02:00
Raúl Kripalani
d53c6f2599 storage-fsm: emit sealing state transition notifications. 2020-08-11 13:23:40 +01:00
yaohcn
6b0f607f4b add space check in StorageFindSector 2020-08-11 15:27:03 +08:00
Łukasz Magiera
624731cb80 More gomod fixing 2020-08-10 18:03:54 +02:00
Łukasz Magiera
641eb3e2cf Merge storage-fsm subtree 2020-08-10 17:40:27 +02:00
Łukasz Magiera
85d8133f4a Fix gomods 2020-08-10 17:31:14 +02:00
Łukasz Magiera
0eaf44eb31 Merge sector-storage subtree 2020-08-10 17:25:46 +02:00
Jakub Sztandera
f55ed9ea09
Update serialization vectors 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-08-07 01:21:01 +02:00
Peter Rabbitson
e266f3b955 Bump fil-commcid and filecoin-ffi deps 
Propagates correct on-chain commX CIDs
 2020-07-17 00:38:42 +02:00
Peter Rabbitson
d244749f1a Bump fil-commcid and filecoin-ffi deps 
Propagates correct on-chain commX CIDs
 2020-07-16 23:00:22 +02:00
Łukasz Magiera
17039a5672 Update FFI 2020-07-03 02:23:45 +02:00
Łukasz Magiera
c1ac986f20 Update FFI 2020-06-30 19:05:47 +02:00
Łukasz Magiera
77b3bf8bc2 Update FFI to 0.30.1 2020-06-29 20:24:27 +02:00
Łukasz Magiera
18dd1c277b Update ffi 2020-06-16 12:28:28 +02:00
Łukasz Magiera
907364ce67 Update deps, fix more tests 2020-06-15 18:30:49 +02:00
Łukasz Magiera
bd2ff4e909 specs-actors v0.6 2020-06-15 18:26:01 +02:00
Łukasz Magiera
3d1225bf34 gofmt 2020-06-15 16:28:57 +02:00
Łukasz Magiera
464f6a6b08 Update specs-actors to v0.6 2020-06-15 14:49:18 +02:00
Łukasz Magiera
f67bbbc457 specs-actors v0.6 2020-06-15 14:32:17 +02:00
Łukasz Magiera
a00df0da90 FFI v27 2020-06-10 01:44:14 +02:00
Łukasz Magiera
796af1351c v27 parameters 2020-06-09 01:02:44 +02:00
Jakub Sztandera
d6615b6286
Cleanup many lint warnings 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-05-27 22:53:20 +02:00
Jeromy
646800b8a8 update to latest ffi 2020-05-22 09:26:14 -07:00
Jeromy
a59ca7536a update to latest filecoin-ffi 2020-05-21 18:19:46 -07:00
Jeromy
fad9412c04 update to latest filecoin-ffi 2020-05-21 18:03:34 -07:00
Jeromy
e6f3b79b23 update serialization vectors 2020-05-18 11:02:34 -07:00
Łukasz Magiera
0ae0e89ddd Update FFI 2020-05-15 19:16:06 +02:00
Łukasz Magiera
f7314646ec Update FFI 2020-05-12 20:18:58 +02:00
Łukasz Magiera
6002e359ae Updates for 64G sectors 2020-05-11 22:24:42 +02:00
laser
32d092b293 v26 groth parameters 2020-05-08 14:13:37 -07:00
laser
b24920c606 update to v26 proofs 2020-05-08 13:08:02 -07:00
Łukasz Magiera
00c107548e ffi: use v26 master 2020-05-08 20:36:32 +02:00
Łukasz Magiera
75642f393d v26 2020-05-07 01:22:59 +02:00
Jeromy
6a27c65201 updating to specs actors v0.2.0 2020-04-28 13:52:07 -07:00
Frrist
0f0589bcf5 Update validation driver to match latest in chain-validation (#1532) 
* update driver to match new chain-validation interfaces

* update chain-validation

* update filecoin-ffi

* gofmt

* update chain-validation again
 2020-04-24 15:08:16 -07:00
Łukasz Magiera
ff5494af4e Cleanup gohacks, use ffi master 2020-04-13 22:21:13 +02:00
Łukasz Magiera
26b8ff722d Update Deps 2020-04-13 22:00:04 +02:00
Łukasz Magiera
9d548f7432 Use FFI master 2020-04-11 01:28:57 +02:00
Łukasz Magiera
92e77fbba5 Update FFI 2020-04-10 23:12:11 +02:00
Łukasz Magiera
e854090bdd v25 2020-04-10 20:46:53 +02:00
Łukasz Magiera
37e7c512e6 Update ffi (v25 proofs) 2020-04-09 23:17:23 +02:00
laser
8f682303ca configure CI, move types around, prepare for consumption by lotus 2020-04-06 17:29:52 -07:00
Łukasz Magiera
23d6dc67cf Update FFI 2020-04-03 07:04:40 +02:00
Łukasz Magiera
afebab334e Update imports; Add build scripts 2020-03-28 00:21:36 +01:00
Jakub Sztandera
437a418afe update filecoin-ffi 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-03-26 17:20:57 +01:00
Jakub Sztandera
7b19e26692 Update filecoin-ffi 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-03-26 14:41:02 +01:00
Łukasz Magiera
cfc65f525a sectorstorage: wire up closing logic 2020-03-25 00:52:55 +01:00
Łukasz Magiera
62cf9a5dd7 Update FFI 2020-03-24 19:41:25 +01:00
whyrusleeping
905fc968bf Integrate updated serialization vectors as tests 2020-03-18 22:53:15 -07:00
Łukasz Magiera
1bc55714ed Update to v24 params 2020-03-14 03:45:44 +01:00
Łukasz Magiera
ec00636b52 Update FFI 2020-03-06 05:54:43 +01:00
whyrusleeping
767392332e WIP: update sectorbuilder 2020-02-26 14:54:34 -08:00
Łukasz Magiera
a593a4f6f4 update ffi 2020-02-11 01:44:39 +01:00
Jakub Sztandera
a404d535ee
Make it buld without cgo 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-01-22 12:03:12 -08:00
steven004
fdbbf65fea comment print 2019-12-24 13:42:30 +08:00
steven004
d313d97947 Add a little more check 2019-12-24 08:51:10 +08:00
Łukasz Magiera
ada11d8734 Update ffi to f261762 2019-12-13 14:46:08 +01:00
Łukasz Magiera
ffc77c35c7 Use filecoin-ffi master 2019-12-11 17:45:54 +01:00
Łukasz Magiera
d576e13bec Update filecoin-ffi 2019-12-10 22:04:26 +01:00
Łukasz Magiera
098f0346fd Update FFI 2019-12-10 12:12:42 +01:00
Łukasz Magiera
cd45e3faf3 update ffi 2019-12-08 22:27:59 +01:00
Jakub Sztandera
ac8d8fb671
Update to correct version 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-12-07 19:08:43 +01:00
Łukasz Magiera
83924e6b97
sectorbuilder: Allow to restrict task types 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-12-07 19:05:15 +01:00
whyrusleeping
bc343dbb67 flag blocks that are received too late 2019-12-07 11:49:05 +01:00
Łukasz Magiera
7c0f62acc2 Update filecoin-ffi 2019-12-06 21:09:38 +01:00
Łukasz Magiera
9adb1c004b Update filecoin-ffi 2019-12-05 10:59:02 +01:00
Łukasz Magiera
869a1be200 Update filecoin-ffi 2019-12-04 14:04:37 +01:00
Łukasz Magiera
f5a35c32a3 Update filecoin-ffi 2019-12-02 22:25:43 +01:00
Łukasz Magiera
66a0aaf253 Update filecoin-ffi 2019-12-02 15:29:21 +01:00
Łukasz Magiera
99b9dfe18d filecoin-ffi master 2019-11-27 23:37:02 +01:00
Łukasz Magiera
ce27cf9656 v19 parameters 2019-11-27 21:08:52 +01:00
Łukasz Magiera
1ccfe7d8f7 update filecoin-ffi to v18 params 2019-11-27 16:00:04 +01:00
laser
3623925f66 replace go-bls-sigs and go-sectorbuilder with filecoin-ffi 
- remove old submodules and add new submodule
- update build tooling to consume new unified static library
- update consumers of old libs to use new package
 2019-11-26 18:16:37 -08:00
whyrusleeping
a0588d513d Add lotus-gen, rewire genesis mining 2019-11-24 22:45:13 -06:00
whyrusleeping
96482f456a WIP: election post restructuring 2019-11-21 16:21:45 -06:00
Łukasz Magiera
b435d7d2db wip 2019-11-14 18:21:44 +01:00
Łukasz Magiera
e48f016b29 Update sectorbuilder 2019-11-11 12:11:45 +01:00
Łukasz Magiera
4e6e83149a Update sectorbuilder with a fix 2019-11-09 12:26:47 +01:00
Łukasz Magiera
44a512aa20 Update go-sectorbuilder with gpu fixes 2019-11-08 21:46:47 +01:00
Łukasz Magiera
e5f90371c7 update go-sectorbuilder 2019-11-07 16:19:07 +01:00
Łukasz Magiera
82be4cd77e Update go-sectorbuilder again 2019-11-05 14:15:21 +01:00
Łukasz Magiera
2a695611d5 Update sectorbuilder 2019-11-03 21:44:22 +01:00
whyrusleeping
fc9091cc89 Get interactive porep sector sealing mostly working 2019-10-31 20:57:10 -07:00
Łukasz Magiera
dd9d6c4ef0 Update sectorbuilder, v15 params 2019-10-30 18:40:48 +01:00
whyrusleeping
874ab1456c WIP: updating to new proofs code 2019-10-25 18:07:34 +02:00
Jakub Sztandera
1bf713cb0a
Cleanup imports after rename 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-10-18 13:47:41 +09:00
Jakub Sztandera
b8c3eeccfa
Update build scripts 
Remove outdated

License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2019-10-17 16:52:29 +09:00
whyrusleeping
7eefa4e577 use faster bls code 2019-10-11 12:26:54 +09:00
Łukasz Magiera
04c17cb214 update go-sectorbuilder 2019-09-23 12:08:57 +02:00
Jakub Sztandera
fa61da254a Update sectorbuilder 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
 2019-09-16 14:25:59 +02:00
Jakub Sztandera
4107d701c1 Add rleplus 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
 2019-09-16 14:10:51 +02:00
Jakub Sztandera
830295a6a4 Merge commit 'c57c47ffb5695f7536306c4f3ab05c9a98adb1c6' as 'extern/rleplus' 2019-09-16 14:07:48 +02:00
Łukasz Magiera
8c3d0e1a4a Simpler paramfetch 2019-09-04 12:10:07 +02:00
Łukasz Magiera
c87d9dc4b4 Extract go-fil-proofs 2019-08-29 17:51:06 +02:00
Łukasz Magiera
cd6aa9ad77 Import proofs for paramfetch 2019-08-29 17:51:06 +02:00
Łukasz Magiera
1c4296f7ac update sectorbuilder 2019-08-29 17:51:06 +02:00
Łukasz Magiera
329e36f77c Update go-sectorbuilder 2019-08-02 16:29:23 +02:00
whyrusleeping
4058885df9 switch over to new sector builder library 2019-07-26 15:29:18 -07:00
Jakub Sztandera
d745fa1af1 Switch to go-bls-sigs 
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
 2019-07-19 13:56:58 +02:00