cerc-io/lotus
16
0
Fork 0
Code Issues Pull Requests Packages Projects Releases 27 Wiki Activity
16,057 Commits 24 Branches 342 Tags 314 MiB
bec1dc47ce
Commit Graph

236 Commits

Author SHA1 Message Date
Raúl Kripalani
0c6072a1a0 chainstore lifecycle: close via Close() instead of context. 2020-11-16 22:28:59 +00:00
Raúl Kripalani
bac51dd4e3 daemon --import-snapshot: force head silently, without triggering reorg. 2020-11-16 16:03:47 +00:00
Raúl Kripalani
d7b4f92f1f add context to ChainStore. 2020-11-16 15:52:19 +00:00
Raúl Kripalani
87d6daf745 fix blockstore double open issue on --import-snapshot. 
Fixes https://github.com/filecoin-project/lotus/issues/4850.
 2020-11-16 15:21:47 +00:00
Raúl Kripalani
3577300aee Merge branch 'master' into badger-viewable 2020-11-06 19:34:25 +00:00
Łukasz Magiera
a1e1b03ca4 Optionally allow bitswap for chainstore 2020-11-03 23:44:44 +01:00
Raúl Kripalani
809111336a Merge branch 'master' into badger-viewable 2020-11-03 18:29:10 +00:00
Raúl Kripalani
656ece06e5 fix metrics wiring. 
Some components like go-ds-measure, go-ipfs-blockstore and go-bitswap
expose metrics via ipfs/go-metrics-interface, but Lotus never injects
the Prometheus exporter (ipfs/go-metrics-prometheus). Therefore, those
metrics never surface in instrumentation.

Instead, Lotus uses OpenCensus directly.

This commit injects the Prometheus exporter for go-metrics-interface, and
instructs the OpenCensus Prometheus exporter to use the DefaultRegistry.

This has the effect of exposing blending the metrics of both metrics
libraries.

With this patch, the datastore, cache utilisation, and bitswap metrics
are now exported via the /debug/metrics endpoint.

This commit also fixes an issue where the metrics scope was empty, making
go-metrics-interface default to "<no-scope>". Angle brackets are inadmissible
characters for Prometheus, so it was refusing to export the affected metrics.
(These were the ARC cache metrics.)
 2020-11-02 17:56:49 +00:00
Raúl Kripalani
099c4b5e1d migrate repo.Datastore(/chain) to repo.Blockstore(). 2020-11-01 13:03:21 +00:00
lanzafame
7a33d5bb34 register all apis with metric wrapper 2020-10-21 18:37:50 +10:00
lanzafame
3e767ca5c8 wrap api in metrics proxy 2020-10-21 18:27:13 +10:00
Peter Rabbitson
6610a247cf Dump the block validation cache whenever we perform an import 
This solves a problem with folks resurrecting long-out-of-sync nodes via
snapshot imports.

The interface switch to Batching is necessary: startup is too long otherwise
( 8 minutes just to clear everything on a relatively old node )
 2020-10-10 03:41:04 +02:00
Steven Allen
748d2e82a7 unshare the journal 
Motivation:

* Run lotus with the race detector enabled (primary motivation).
* Allow multiple lotus nodes in a process (not a high priority).

Previously, the journal was shared between all lotus instances, but it was
initialized for every new node. This caused safety problems in tests (at a
minimum).

This patch explicitly passes the journal to all services that need it.
 2020-10-09 13:23:07 -07:00
Łukasz Magiera
ab8286fa38 Fix docsgen, lotus-soup build 2020-10-09 18:43:22 +02:00
Dirk McCormick
7f7c9e978f feat: hide lite mode flag 2020-10-09 11:56:25 +02:00
Dirk McCormick
d69e4c7cf2 refactor: lite-mode - simplify organization of dep injection 2020-10-09 11:54:42 +02:00
Dirk McCormick
ef73b964fb feat: add end-to-end test for lite mode 2020-10-09 11:48:35 +02:00
Dirk McCormick
b32d25c562 feat: add RPC for GasEstimateMessageGas 2020-10-09 11:45:16 +02:00
Dirk McCormick
767611247c feat: add RPC for StateWaitMsg 2020-10-09 11:45:16 +02:00
Dirk McCormick
be09a8a00a feat: lite-mode - check that gateway API implements required chain, mpool, state methods 2020-10-09 11:43:03 +02:00
Dirk McCormick
2719adc1b1 feat: lite-mode - thin client for chan & state 2020-10-09 11:43:03 +02:00
Dirk McCormick
8fa4c0a970 feat: gateway - MpoolPush 2020-10-09 11:43:03 +02:00
Dirk McCormick
eec13ff8dc refactor: daemon - simplify gateway cleanup 2020-10-09 11:43:03 +02:00
Dirk McCormick
e19cd9ed01 feat: lotus-lite - replace wallet StateManager with thin client to gateway 2020-10-09 11:43:03 +02:00
Jakub Sztandera
6b5f8a6b1d
Add options to set BlockProfileRate and MutexProfileFraction 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-10-02 19:06:41 +02:00
Łukasz Magiera
e444977891 Full node metadata backup 2020-10-01 17:55:48 +02:00
Aayush Rajasekaran
6abccc4d5e Add an option to set config 2020-09-30 03:19:04 -04:00
Łukasz Magiera
f809529699 daemon cmd: Support imports straight from http 2020-09-28 12:30:12 +02:00
Łukasz Magiera
a3145bae07 daemon cmd: Add progress bar to chain import 2020-09-28 12:17:54 +02:00
Travis Person
eadc61c37a log shutdown method for lotus daemon and miner 2020-09-18 18:07:58 +00:00
Steven Allen
7a46c5ff31 [WIP] Fix ticket randomness 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-09-10 17:41:55 -04:00
Łukasz Magiera
38863d3025 build: Separate API versions per node type 2020-09-08 21:14:53 +02:00
Aayush Rajasekaran
39755a294a Update to specs v0.9.6 2020-09-07 15:48:41 -04:00
Jakub Sztandera
59f765f7be Rename to import-snapshot, require more than finality for state export 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-09-02 17:15:36 +02:00
Łukasz Magiera
528e39fcb3 docsgen, fix snapshot flag name 2020-09-02 17:15:10 +02:00
whyrusleeping
2b16e69e90 allow snapshot importing 2020-09-02 17:15:10 +02:00
Aayush Rajasekaran
8417f516e5 Check error in advance-block 2020-09-02 02:41:12 -04:00
Aayush Rajasekaran
5095e6f07b Fix chain import 2020-08-28 22:15:43 -04:00
Aayush Rajasekaran
bed7158212 Use beacon entries in advance-block 2020-08-27 21:38:51 -04:00
Steven Allen
7fb4851eb9 update deps for bug fixes 
* updates bitswap to include _many_ perf enhancements and bug fixes.
* updates go-fs-lock because the version here is pretty old.
* updates go-libp2p
* updates bbloom _just_ in case, because the version we were depending on had bugs (looks like we're not actually using it).
 2020-08-25 17:06:07 -07:00
Raúl Kripalani
efdc428d5d keep storage-fsm (renamed to storage-sealing) and sector-storage in extern. 2020-08-17 14:26:18 +01:00
Raúl Kripalani
3c17cd655e integrate extern/sector-storage into lotus proper. 2020-08-16 11:09:58 +01:00
Steven Allen
e18904bff5 [WIP] fix post submission 2020-08-12 10:33:18 -07:00
Jakub Sztandera
b309e80e41
Wire in Ticket Quality to MpoolSelect 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-08-11 16:14:27 +02:00
vyzo
6f660f7915 repair references to defunct miner.SelectMessages 2020-08-06 10:46:48 +03:00
Steven Allen
b7a4dbb07f Support inline CIDs 
And use the new CidBuilder from the spec actors.

This patch does not switch over to inline CIDs by default, but paves the way.
 2020-07-23 23:12:32 -07:00
Łukasz Magiera
69cb7f6b03
Merge pull request #2555 from filecoin-project/feat/helptext-helpers 
sprinkle some nice helptext returns around
 2020-07-23 21:42:26 +02:00
whyrusleeping
fcef3696bc sprinkle some nice helptext returns around 2020-07-23 12:31:28 -07:00
Frank
c38b8b1265 close file 2020-07-23 18:21:13 +08:00
Łukasz Magiera
2c00b92325 Merge remote-tracking branch 'origin/master' into next 2020-07-08 21:47:05 +02:00
Jakub Sztandera
68081a7a1f
Ignore log.Sync() error 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-08 21:13:22 +02:00
Jakub Sztandera
ebecca64a1
Fix daemon shutdown 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-08 21:08:24 +02:00
Jakub Sztandera
9936439608
Merge remote-tracking branch 'origin/master' into next 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-07-03 14:56:06 +02:00
whyrusleeping
a5935486ef have lotus attempt to raise its own file descriptor limit 2020-07-01 17:09:21 -07:00
Łukasz Magiera
cfdbc2312d Merge branch 'master' into next 2020-07-01 11:22:57 +02:00
Raúl Kripalani
4f9c907248 rename build.{BlockDelay=>BlockDelaySecs}. 
Since this global is not typed as a time.Duration,
rather as an int, it makes sense to clarify the unit.
 2020-06-30 14:26:49 +01:00
Jakub Sztandera
1f967c6f63
Fix debug_advance 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-06-23 20:37:35 +02:00
Łukasz Magiera
ab4c11c096 Merge remote-tracking branch 'origin/master' into next 2020-06-16 12:04:29 +02:00
Aayush Rajasekaran
a9abf3ceb2 extract the fake Wpost used for testing 2020-06-15 21:02:53 -04:00
Mike Greenberg
2cd6347a13 Express block validation, cpu/mem usage via OpenCensus 2020-06-11 12:31:04 +02:00
Mike Greenberg
ae83ca6893 Express block validation, cpu/mem usage via OpenCensus 2020-06-08 14:15:01 -04:00
Łukasz Magiera
3b13397165 gofmt 2020-06-06 00:59:01 +02:00
Łukasz Magiera
163c2b2544 Merge remote-tracking branch 'origin/master' into next 2020-06-06 00:58:24 +02:00
laser
4855045ea2 pass context to paramfetch.GetParams 
Fixes #1209
 2020-06-05 10:28:00 -07:00
Jakub Sztandera
7bee5b3abc
Merge remote-tracking branch 'origin/master' into next 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-06-05 00:33:43 +02:00
Jakub Sztandera
29dbc26dbd
Update cli 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-06-04 01:01:41 +02:00
Jakub Sztandera
4a983995a8
Merge pull request #1901 from acruikshank/bugs/1893-chain-import-home-directory 
Expand tilde before passing file name into chain import
 2020-06-02 23:53:04 +02:00
acruikshank
d7a2556292 expand tilda before passing file name into chain import 2020-06-02 16:43:39 -04:00
laser
bea9cd2fe2 rename to better convey intent + document 2020-06-02 12:35:11 -07:00
laser
1e8a875edb shutdownChan instead of shutdownCh, for consistency 2020-06-02 12:31:01 -07:00
laser
38d714a28a first take at "daemon stop" command 
Fixes #1827

TODO: plumb the daemon-stopping into lotus-storage-miner, too
 2020-06-02 12:29:58 -07:00
laser
5e727819ad stub the "daemon stop" command 2020-06-02 08:09:18 -07:00
Łukasz Magiera
64f4e80446 Include build type in version 2020-06-01 20:49:39 +02:00
Łukasz Magiera
c73326e96d fsrepo: Use LevelDB for metadata datastore 2020-06-01 20:13:07 +02:00
Jakub Sztandera
d6615b6286
Cleanup many lint warnings 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-05-27 22:53:20 +02:00
Łukasz Magiera
f7325a69c1 Extract auth utils to go-jsonrpc 2020-05-20 20:37:45 +02:00
Łukasz Magiera
eeca031525 extract lib/jsonrpc to go-jsonrpc 2020-05-20 19:49:09 +02:00
Łukasz Magiera
0ae0e89ddd Update FFI 2020-05-15 19:16:06 +02:00
Jeromy
d3eb808ff4 add profile for bootstrappers 2020-05-14 09:27:07 -07:00
Jeromy
17e969bc4a disable gpu usage for lotus daemon 2020-05-13 14:22:05 -07:00
Łukasz Magiera
24c764c91e Don't print QAPower as bytes 2020-04-21 21:46:50 +02:00
Łukasz Magiera
cdbf79fff5 non-debug 2k sector build mode 2020-04-17 17:58:20 +02:00
Łukasz Magiera
70d654e4a6 Merge pull request #1527 from filecoin-project/feat/drand 
Initial randomness beacon implementation
 2020-04-09 19:48:09 +02:00
Jeromy
83416e2758 remove deadcode 2020-04-09 10:34:54 -07:00
Jakub Sztandera
d909119bb6 Make debug_advance build, still doesn't work 
Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-04-08 21:19:17 +02:00
Jakub Sztandera
2d2b89fcd8 make debug_advance build 
Still doesn't work

Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
 2020-04-08 18:46:57 +02:00
Łukasz Magiera
2bdedefa05 Shell completions 2020-04-03 04:03:53 +02:00
Łukasz Magiera
95ee1c1cde Extract sector-storage 2020-03-28 01:32:39 +01:00
Łukasz Magiera
e050e0307e Cleanup after dropping sectorbuilder 2020-03-26 20:35:16 +01:00
Łukasz Magiera
4be54a976c Merge sectorbuilder into sectorstorage 2020-03-26 03:51:06 +01:00
Łukasz Magiera
1647798396 build: Remove unused vars, fix debug build 2020-03-09 07:54:29 +01:00
whyrusleeping
24bf720a9a Merge branch 'master' into testnet/3 2020-03-07 16:46:12 -08:00
Aayush Rajasekaran
55f155a72c fix make debug 2020-03-06 14:31:16 -08:00
whyrusleeping
5076b2b950 fix reward actor and block reward application 2020-03-04 13:21:24 -08:00
Whyrusleeping
41bf668189
Merge pull request #1294 from natewalck/more-opencensus-metrics 
More opencensus metrics
 2020-03-03 12:02:13 -08:00
whyrusleeping
60b19c51ef more misc fixes 2020-03-01 17:09:38 -08:00
Aayush Rajasekaran
fe8db295e7 Re: #1290: Add a lotus wallet verify API and CLI command 
- The command takes an address, message, and signature, and returns true if the sig is valid
 2020-02-28 15:56:15 -08:00
Nate Walck
353c5d8b12 Relocation opencensus metrics to its own package and add more node stats 2020-02-27 21:49:18 -05:00
Nate Walck
a3504dd51e Change lotusInfo opencensus key back to info 2020-02-25 20:11:55 -05:00
Nate Walck
0ce86e999a Add commit tag so we have that info as well 2020-02-25 19:59:51 -05:00