cerc-io/lotus
16
0
Fork 0
Code Issues Pull Requests Packages Projects Releases 27 Wiki Activity
13,243 Commits 24 Branches 342 Tags 314 MiB
bfd69f5381
Commit Graph

363 Commits

Author SHA1 Message Date
Raúl Kripalani
3795cc2bd2 segregate chain and state blockstores. 
This paves the way for better object lifetime management.

Concretely, it makes it possible to:
- have different stores backing chain and state data.
- having the same datastore library, but using different parameters.
- attach different caching layers/policies to each class of data, e.g.
  sizing caches differently.
- specifying different retention policies for chain and state data.

This separation is important because:
- access patterns/frequency of chain and state data are different.
- state is derivable from chain, so one could never expunge the chain
  store, and only retain state objects reachable from the last finality
  in the state store.
 2021-02-28 22:49:44 +00:00
Raúl Kripalani
7f0f7d0b36 Merge branch 'master' into refactor/lib/blockstore 2021-02-28 19:55:23 +00:00
Łukasz Magiera
0c6aef221d Fix error logging format strings 2021-02-11 12:00:26 +01:00
Łukasz Magiera
ebfde330dd shed: Support miner nodes in rpc util 2021-02-04 20:06:05 +01:00
Łukasz Magiera
fed3e82ff8
Merge pull request #5047 from zgfzgf/feat-shed-bitfield 
shed bitfield: Cleanup, add merge command
 2021-01-30 12:54:39 +01:00
Raúl Kripalani
af429dba0f Merge branch 'master' into chore/snake_context_through_blockstore_init 2021-01-29 21:21:46 +00:00
Raúl Kripalani
b0cbc932bd consolidate all blockstores in blockstore package. 2021-01-29 20:01:00 +00:00
Raúl Kripalani
a1da1dab85 add context to LockedRepo#Datastore(). 2021-01-26 11:01:43 +00:00
Steven Allen
126a5c1cf8 chore: fix nolint comment 2021-01-21 15:21:19 -08:00
Peter Rabbitson
9334e73396 Snake a context through the Chain-blockstore creation 2021-01-04 15:27:52 +01:00
vyzo
210216a94f lotus-shed blockmsgid command 2020-12-15 20:20:16 +02:00
Łukasz Magiera
a999e41677
Merge pull request #5072 from zgfzgf/feat-shed-cid 
Feat shed cid
 2020-12-08 10:23:04 +01:00
Łukasz Magiera
b7975dcd9a
Merge pull request #5114 from filecoin-project/chore/update_sr2_stat_aggregation 
Chore/update sr2 stat aggregation
 2020-12-07 13:09:23 +01:00
Peter Rabbitson
d9e3cc0374 Add an extra filplus counter 2020-12-04 19:00:13 +01:00
Peter Rabbitson
2514c96cff Count deals from sealed sectors only 2020-12-04 15:45:25 +01:00
Peter Rabbitson
88bd757024 Only count the first 10 copies of the same piece per project 2020-12-04 15:45:25 +01:00
Peter Rabbitson
1e6aa4b129 Only count phase2 deals ( start epoch 166560 ) 2020-12-04 15:45:25 +01:00
Łukasz Magiera
9707c82285 shed: ledger show command 2020-12-02 10:37:17 +01:00
zgfzgf
7c8ab6977a add estimate command 2020-12-02 12:57:57 +08:00
zgfzgf
7d3e4c5d01 feat election error miner-power to network-power 2020-12-02 12:36:05 +08:00
zgfzgf
97dd082585 change flag codec value raw to id and default value is id 2020-12-02 08:41:58 +08:00
zgfzgf
715c32ff77 add flag codec 2020-12-01 22:53:24 +08:00
Łukasz Magiera
4b1d6bfcca
Merge pull request #5079 from zgfzgf/feat-shed-commp 
add commp-to-cid base64 decode
 2020-12-01 15:11:23 +01:00
zgfzgf
ec08e27af2 add base64 decode 2020-12-01 19:36:01 +08:00
zgfzgf
a8cdb8adc7 add abi Cid 2020-12-01 17:16:41 +08:00
zgfzgf
0439e95aa3 add encoding flag 2020-12-01 16:50:53 +08:00
ZenGround0
2e5843a0ee Filecoin signature serialization 2020-11-30 23:14:21 -05:00
ZenGround0
751568a4dd Print hex 2020-11-30 22:50:41 -05:00
Łukasz Magiera
d15ef9ac9b
Merge pull request #5036 from filecoin-project/feat/shed-rpc-args 
shed rpc: Allow calling with args
 2020-11-30 14:33:52 +01:00
Łukasz Magiera
70732ac423 Fix lint 2020-11-30 14:26:42 +01:00
zgfzgf
253e22d6ea add bitfield merge func 2020-11-28 21:54:30 +08:00
zgfzgf
a7ed639c21 optimize bitfield use func 2020-11-28 21:44:12 +08:00
zgfzgf
f4adf03ce5 optimize bitfield intersect 2020-11-28 21:07:14 +08:00
zgfzgf
c016e34dbc bitfield add encode 2020-11-28 20:56:16 +08:00
zgfzgf
21835c785b optimize bitfield runs 2020-11-28 20:17:56 +08:00
zgfzgf
8007c1f9ae feat bitfield stat 2020-11-28 20:03:26 +08:00
zgfzgf
055795c4cc optimize bitfield decode 2020-11-28 19:14:48 +08:00
zgfzgf
b03c4bc26b add bitfield hex encode 2020-11-28 17:29:15 +08:00
Łukasz Magiera
0c1592f2d3
Merge pull request #5025 from filecoin-project/feat/accounting-tool 
add a tooling to make filecoin accounting a little easier
 2020-11-27 16:11:25 +01:00
Łukasz Magiera
61485beb22 fix lint 2020-11-27 16:02:01 +01:00
Łukasz Magiera
01ad4c0514 shed rpc: Allow calling with args 2020-11-27 15:57:00 +01:00
whyrusleeping
4f675b76ad add a tooling to make filecoin accounting a little easier 2020-11-26 13:46:19 -08:00
Łukasz Magiera
9cef300535
Merge pull request #4971 from filecoin-project/chore/new_sr2_deal_rollup_cmd 
New SR-specific lotus-shed cmd
 2020-11-24 17:50:10 +01:00
Peter Rabbitson
a145819004 More linter... 2020-11-23 18:46:59 +01:00
Peter Rabbitson
e7f3554c62 The linter is *so* dumb: 
- There is no way for me to check the error on defer ...Close(), why even ask?
- A sort function does not suffer arbitrary aliasing

Everything is terrible...
 2020-11-23 06:51:52 +01:00
Peter Rabbitson
2609342356 New SR-specific lotus-shed cmd 2020-11-23 05:41:14 +00:00
Łukasz Magiera
b10b6fdd11
Merge pull request #4355 from filecoin-project/shed/post-find 
Shed/post find
 2020-11-20 14:52:42 +01:00
Raúl Kripalani
0c6072a1a0 chainstore lifecycle: close via Close() instead of context. 2020-11-16 22:28:59 +00:00
Raúl Kripalani
d7b4f92f1f add context to ChainStore. 2020-11-16 15:52:19 +00:00
Raúl Kripalani
3577300aee Merge branch 'master' into badger-viewable 2020-11-06 19:34:25 +00:00
Łukasz Magiera
426c2e8c2b
Merge pull request #4717 from filecoin-project/feat/optional-chain-bitswap 
Optional chain Bitswap
 2020-11-06 16:49:39 +01:00
Łukasz Magiera
3c9e438a68
Merge pull request #4617 from filecoin-project/termination-penalty 
Add `termination-estimate` to get an estimation for how much a termination penalty will be
 2020-11-06 16:44:44 +01:00
Łukasz Magiera
ee9df63221 shed: Util for creating ID CIDs 2020-11-06 15:42:09 +01:00
Łukasz Magiera
a1e1b03ca4 Optionally allow bitswap for chainstore 2020-11-03 23:44:44 +01:00
Raúl Kripalani
809111336a Merge branch 'master' into badger-viewable 2020-11-03 18:29:10 +00:00
Łukasz Magiera
a4cf6fa715 sched: Interactive RPC Shell 2020-11-02 20:38:15 +01:00
Raúl Kripalani
d1ebf3c769 introduce non-pooled StorageKey method. 2020-11-02 13:32:07 +00:00
Raúl Kripalani
d8d85373f5 fix lotus-shed datastore commands. 2020-11-01 13:50:41 +00:00
Raúl Kripalani
a16d7f221e Merge branch 'master' into badger-viewable 2020-11-01 13:10:56 +00:00
Raúl Kripalani
099c4b5e1d migrate repo.Datastore(/chain) to repo.Blockstore(). 2020-11-01 13:03:21 +00:00
Łukasz Magiera
978192233d
Merge pull request #4498 from filecoin-project/feat/try-election 
Add election run-dummy command
 2020-10-31 01:02:25 +01:00
jennijuju
2f4582147a Add termination-estimate to get an estimation for how much a termination penalty will be: 
- Usage example: `./lotus-shed sectors termation-estimate 5 8 10`.
 2020-10-30 13:34:03 -04:00
Jakub Sztandera
ae905bd056
Fix closing 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-10-29 01:05:31 +01:00
Jakub Sztandera
a2c66dd102
make linter happy 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-10-28 23:30:28 +01:00
Jakub Sztandera
0297be4b9a
Add lotus-shed datastore rewrite command 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-10-28 23:24:45 +01:00
Jakub Sztandera
cced3bf9ee
Randomize seed 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-10-26 17:44:55 +01:00
Jakub Sztandera
ea6afe84db
Add election run-dummy command 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-10-26 17:44:51 +01:00
Łukasz Magiera
067de4508b shed: Commad to decode messages 2020-10-23 22:17:46 +02:00
Łukasz Magiera
f9723ca3c1
Merge pull request #4521 from filecoin-project/feat/fix-shed-ledger-list 
Fix lotus-shed ledger list
 2020-10-22 19:59:18 +02:00
Łukasz Magiera
041762a34f
Merge pull request #4383 from filecoin-project/steb/actor-v2-imports 
Remove most v0 actor imports
 2020-10-22 17:17:56 +02:00
Łukasz Magiera
9a58763a4e shed: Rename the command to frozen-miners 2020-10-22 16:07:42 +02:00
ZenGround0
f9707ba344 add borked inspection command 
hook up new command

Fix head call

Debug internal error

Debug moa

Debug 0

Fix 0

Fix 1

Better print

Don't ignore error
 2020-10-22 16:03:11 +02:00
Łukasz Magiera
b85bf82d00
Merge pull request #4318 from filecoin-project/asr/shed-won-power 
Add a shed util to determine % of power that has won a block
 2020-10-22 15:40:55 +02:00
Steven Allen
bcabe7b3b5 migrate methods to abstracted methods 
Method numbers never change anyways. At worst, we'll deprecate old methods and
have to explicitly import them from the correct actors version to use them.
 2020-10-21 12:18:37 -07:00
Steven Allen
4e730b5ec8 port to v2 imports 2020-10-21 12:16:23 -07:00
Jakub Sztandera
f0d966a595
Fix lotus-shed ledger list 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-10-21 19:40:51 +02:00
Aayush Rajasekaran
75eb644108
Merge pull request #4507 from filecoin-project/lotus-shed-terminate-1475 
Add a terminate sectors command to lotus-shed
 2020-10-20 18:28:09 -04:00
jennijuju
ee5dcbc1d8 Add wait message 2020-10-20 18:26:17 -04:00
Steven Allen
ed1645109a Add lotus storage miner API support to lotus-shed 2020-10-20 17:38:15 -04:00
jennijuju
277d3e9ab4 Add terminate sectors based on 1475's #4433 implementation in lotus-shed: 
-  Moving the cmd to lotus-shed so that miners can use this right away without waiting for fsm changes.- Note: this should only be used when the miner is 100% sure that they want to terminate the sector on chain and they will be lose the power and pay a big one-time termination penalty for the sectors.
- Only live sectors can be terminated.
- To use, run `./lotus-shed sectors terminate --really-do-it=true sectorNum1 sectorNum2`.
- A message will be sent and after the message is landed on chain, miner can run `lotus-miner sectors status --on-chain-info <terminated sector number>`, and check Expiration Info at the bottom. Both `OnTime` and `Early` are 0 indicates the sector is terminated.
 2020-10-20 17:38:09 -04:00
Aayush Rajasekaran
8c7d2efe72 Make audit balances capable of printing robust addresses 2020-10-15 12:17:54 -04:00
Aayush Rajasekaran
2613e837a9 Bugfix: Eligible miners should be computed based on start tipset, not end tipset 2020-10-14 03:01:41 -04:00
Travis Person
20c57fcd0e lotus-shed: post-find use lookback 2020-10-13 19:00:37 +00:00
ZenGround0
619ee1e6f9 add comma 2020-10-13 00:49:32 -04:00
ZenGround0
0e88f32d66 Fix bug and add flag 2020-10-13 00:47:43 -04:00
ZenGround0
546614455f Fix print 2020-10-13 00:38:15 -04:00
ZenGround0
0b9499a00f withpower flag 2020-10-13 00:29:43 -04:00
ZenGround0
448ca6e43c less verbose 2020-10-13 00:17:09 -04:00
ZenGround0
c9955c0635 verbose flag 2020-10-12 23:59:30 -04:00
ZenGround0
768d2db114 Tipset traversal for speed 2020-10-12 23:53:14 -04:00
ZenGround0
79d94c4771 Hook up cmd 2020-10-12 23:09:40 -04:00
ZenGround0
a3e26233b2 Add postfind 2020-10-12 23:00:29 -04:00
Aayush Rajasekaran
96e1dfd8d7 Add an endpoint for precise circulating supply 2020-10-12 16:38:29 -04:00
Aayush Rajasekaran
bae3b7d594 add a shed util to determine % of power that has won a block 2020-10-11 19:05:54 -04:00
Jakub Sztandera
2b21fdef33
Refactor from crypto.SigType to types.KeyType 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-10-12 00:07:53 +02:00
Jakub Sztandera
7ee6bafd23
Fix lint warn 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-10-12 00:07:41 +02:00
Jakub Sztandera
753d7b71a9
Fix hardened path printing, show 20 addresses after empty 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-10-12 00:07:40 +02:00
Łukasz Magiera
8ae66d6c6a
Fix lint warnings 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-10-12 00:07:40 +02:00
Łukasz Magiera
2c92157233
shed ledger: Some UX improvements 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-10-12 00:07:40 +02:00
whyrusleeping
b35f9b56b4
WIP: adding in ledger support 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-10-12 00:07:40 +02:00
Łukasz Magiera
a6d9b302fa
Merge pull request #3583 from filecoin-project/feat/signing-backends 
Remote wallet backends
 2020-10-10 02:58:02 +02:00
Steven Allen
748d2e82a7 unshare the journal 
Motivation:

* Run lotus with the race detector enabled (primary motivation).
* Allow multiple lotus nodes in a process (not a high priority).

Previously, the journal was shared between all lotus instances, but it was
initialized for every new node. This caused safety problems in tests (at a
minimum).

This patch explicitly passes the journal to all services that need it.
 2020-10-09 13:23:07 -07:00
Łukasz Magiera
6cc7559b04 Fix APIInfo import cycle in tests 2020-10-09 02:58:12 +02:00
Łukasz Magiera
7d2f06cfbd Fix WalletSign in tests 2020-10-09 01:34:48 +02:00
Łukasz Magiera
8783c7434e Merge remote-tracking branch 'origin/master' into feat/signing-backends 2020-10-09 00:50:41 +02:00
Łukasz Magiera
d26ece10b8
Merge pull request #4241 from filecoin-project/fix/daemon-flag-clash 
fix: clash between daemon --api flag and cli tests
 2020-10-08 18:30:47 +02:00
Dirk McCormick
cb7d99fcc7 fix: clash between daemon --api flag and cli tests 2020-10-08 14:24:50 +02:00
Łukasz Magiera
7332a39f00 Merge remote-tracking branch 'origin/master' into fix/balances-audit-no-suffix 2020-10-08 13:58:40 +02:00
whyrusleeping
cd9af278b4 more info in audit outputs 2020-10-07 17:01:01 -07:00
whyrusleeping
8f4911ac0d dont print fil suffix in lotus shed audit balances 2020-10-07 16:00:52 -07:00
Steven Allen
df4b068d0e Merge branch 'master' into next 2020-10-07 11:55:00 -07:00
Aayush Rajasekaran
0ec2a10ebc Merge branch 'master' into next 2020-10-06 21:09:20 -04:00
whyrusleeping
be92dd9e63 allow manual setting of noncefix fee cap 2020-10-06 18:07:34 -07:00
whyrusleeping
74016ab1cc fix noncefix 2020-10-06 16:46:47 -07:00
Łukasz Magiera
2f70a91665 Merge remote-tracking branch 'origin/master' into next 2020-10-06 23:54:59 +02:00
Łukasz Magiera
0e2f697217
Merge pull request #4133 from filecoin-project/feat/backup 
Miner backup/restore commands
 2020-10-06 02:05:03 +02:00
Łukasz Magiera
70d88f226e Add usage to repo-type in shed datastore 2020-10-06 01:33:51 +02:00
Steven Allen
8292d60196 Merge branch 'master' into asr/spec-v1 2020-10-02 18:03:03 -07:00
Łukasz Magiera
bd964b4c3e
Merge pull request #4124 from filecoin-project/asr/verifreg 
Some helpers for verifreg work
 2020-10-03 00:20:45 +02:00
Łukasz Magiera
6f33706025 Merge remote-tracking branch 'origin/master' into feat/backup 2020-10-03 00:08:23 +02:00
Łukasz Magiera
1319d7072e shed: Fix lint 2020-10-02 23:54:03 +02:00
Łukasz Magiera
f147072284 Merge remote-tracking branch 'origin/master' into feat/pruning-command 2020-10-02 23:37:25 +02:00
Łukasz Magiera
deac7166b5 Support offline backups 2020-10-01 17:55:47 +02:00
Łukasz Magiera
c8a3269c4b shed: utils to read datastore backups 2020-10-01 17:55:47 +02:00
Łukasz Magiera
d20ebe93b9 shed: gofmt 2020-10-01 17:55:47 +02:00
Łukasz Magiera
6875527224 shed: Datastore utils 2020-10-01 17:55:46 +02:00
Aayush Rajasekaran
93e4eae94c Some helpers for verifreg work 2020-10-01 04:49:38 -04:00
Steven Allen
4989b1cc90 Merge branch 'master' into asr/spec-v1 2020-09-30 09:19:12 -07:00
Aayush Rajasekaran
a4e7117429 Add lotus shed util to validate a tipset 2020-09-30 01:29:04 -04:00
Łukasz Magiera
91d04ede0f
Merge pull request #4051 from filecoin-project/chore/final-dealstat-version 
Chore/final dealstat version
 2020-09-29 19:39:16 +02:00
Łukasz Magiera
867ca2f25d
Merge pull request #3434 from filecoin-project/feat/shed-import-object-cmd 
add a command to import an ipld object into the chainstore
 2020-09-29 15:02:31 +02:00
Aayush Rajasekaran
be9d23b329 Centralize some params in builtin 2020-09-29 02:25:43 -04:00
Peter Rabbitson
be5dc2c57f Walk back 10 epochs for stat generation 2020-09-27 20:45:45 +02:00
Peter Rabbitson
e4c1f090af Disable exclusion of miner-associated addresses 2020-09-27 20:44:50 +02:00
Peter Rabbitson
fb3bcc4ce5 Add startup warning 2020-09-26 21:49:05 +02:00
Peter Rabbitson
1483f1e59a Add filtering of addresses associated with miners 2020-09-26 21:45:34 +02:00
Peter Rabbitson
10cdbadd82 Arrange json as the frontend expects it 2020-09-26 21:44:40 +02:00
Peter Rabbitson
8955b8d8a7 Centralize filtering, output wallet addresses 2020-09-26 21:44:36 +02:00
Łukasz Magiera
ef28ebb14a Ignition upgrades, much excite. 2020-09-25 23:55:37 -07:00
whyrusleeping
4eaa05db52 add some more big pictures stats to stateroot stat 2020-09-24 09:40:49 -07:00
Łukasz Magiera
f4f5ef6f83
Merge pull request #3963 from filecoin-project/feat/dealstats 
Add basic deal stats api server for spacerace slingshot
 2020-09-23 22:17:03 +02:00
Łukasz Magiera
a1281273bc shed dealtracker: fix lint, env var filter 2020-09-23 22:10:02 +02:00
Aayush Rajasekaran
476e7992e8 Add an error return to all actor state interface methods 2020-09-23 01:51:38 -04:00
whyrusleeping
88ada66280 finish up the total bytes endpoint 2020-09-22 13:31:01 -05:00
whyrusleeping
3cf2fd595f fix appending to array 2020-09-22 13:27:58 -05:00
whyrusleeping
3153ab9ae3 allow graceful shutdown 2020-09-22 13:24:49 -05:00
Steven Allen
c91774be3b remove old comment 2020-09-22 11:19:28 -07:00
whyrusleeping
f96698b54d finish up other endpoints 2020-09-22 12:54:39 -05:00
whyrusleeping
9b91628d85 begin adding simple api server for deal stats 2020-09-22 11:05:12 -05:00
Steven Allen
3f0106cfe5 migrate lotus-shed/genesis-verify to actor abstraction 2020-09-21 15:18:30 -07:00