vyzo
da0feb3fa4
dont mark references inline; instad rely on the main compaction thread to do concurrent marking
...
The problem is that it is possible that an inline marking might take minutes for some objects
(infrequent, but still possible for state roots and prohibitive if that's a block validation).
So we simply track references continuously and rely on the main compaction thread to trigger
concurrent marking for all references at opportune moments.
Assumption: we can mark references faster than they are created during purge or else we'll
never purge anything.
2021-07-09 15:10:02 +03:00
vyzo
acc4c374ef
properly handle protecting long-running views
2021-07-09 13:20:18 +03:00
vyzo
565faff754
fix test
2021-07-09 11:38:09 +03:00
vyzo
4f89d260b0
kill isOldBlockHeader; it's dangerous.
2021-07-09 11:35:10 +03:00
vyzo
de5e21bf1a
correctly handle identity cids
2021-07-09 11:31:04 +03:00
vyzo
909f7039d4
make badger Close-safe
2021-07-09 09:54:12 +03:00
vyzo
abdf4a161a
explicitly switch marksets for concurrent marking
...
this has very noticeable impact in initial marking time; it also allows us
to get rid of the confusing ts monikers.
2021-07-09 04:26:36 +03:00
Łukasz Magiera
77a1a8a23f
Merge pull request #6709 from filecoin-project/arajasek-patch-1
...
Release Template: remove binary validation step
2021-07-08 20:45:49 +02:00
Aayush Rajasekaran
dbc721af3a
Release Template: remove binary validation step
2021-07-08 14:45:24 -04:00
vyzo
b6611125b6
add environment variables to turn on the debug log without recompiling
2021-07-08 21:30:39 +03:00
vyzo
60dd97c7fc
fix potential deadlock in View
...
As pointed out by magik, it is possible to deadlock if the view callback performs
a blockstore operation while a Lock is pending.
This fixes the issue by optimistically tracking the reference before actually calling
the underlying View and limiting the scope of the lock.
2021-07-08 21:18:59 +03:00
Łukasz Magiera
44e81424f2
Print completed deal stats in miner info
2021-07-08 19:40:05 +02:00
Łukasz Magiera
ed0cc0b56d
Handle bad peerIDs in MarketListRetrievalDeals
2021-07-08 19:27:03 +02:00
Łukasz Magiera
10825e3a95
Add more info about deals to miner info
2021-07-08 19:02:18 +02:00
Łukasz Magiera
8f7bf1df86
Merge pull request #6697 from filecoin-project/feat/dealpublish-ctl-config
...
Config for deal publishing control addresses
2021-07-08 19:00:29 +02:00
Łukasz Magiera
79b0bfb272
policy: Add a docstring to SetProviderCollateralSupplyTarget
2021-07-08 18:56:03 +02:00
vyzo
c0537848b3
fix typo
...
Co-authored-by: Łukasz Magiera <magik6k@users.noreply.github.com>
2021-07-08 17:54:16 +03:00
vyzo
fa30ac8c5d
fix typo
...
Co-authored-by: Łukasz Magiera <magik6k@users.noreply.github.com>
2021-07-08 17:53:59 +03:00
Łukasz Magiera
616fcb974c
Merge pull request #6689 from filecoin-project/reset/interopnet
...
Reset of the interop network
2021-07-08 15:53:24 +02:00
vyzo
00d7772f57
move check for closure in walkChain
...
so that we don't do it too often and also cover warmup.
2021-07-08 13:12:19 +03:00
Łukasz Magiera
e258e7c353
Merge pull request #6696 from filecoin-project/chore/even-less-color-on-cli
...
Enable color by default only if os.Stdout is a TTY
2021-07-08 12:05:10 +02:00
vyzo
5cf1e09e81
README: add instructions for how to enable
2021-07-08 13:00:31 +03:00
vyzo
9aa4f3b3b2
add README for documentation
2021-07-08 12:32:41 +03:00
Peter Rabbitson
4dd59b566c
Respect GOLOG_LOG_FMT=color
2021-07-08 10:44:37 +02:00
Peter Rabbitson
140a2e0200
Stabilize default text and make gen docsgen-cli
2021-07-08 10:44:13 +02:00
vyzo
e6eacbdd56
use RW mutexes in marksets
2021-07-08 10:20:29 +03:00
vyzo
48f13a43b7
intelligently close marksets and signal errors in concurrent operations
2021-07-08 10:18:43 +03:00
vyzo
f5c45bd517
check the closing state variable often
...
so that we have a reasonably quick graceful shutdown
2021-07-08 10:13:44 +03:00
Łukasz Magiera
9bdea91a70
itests: Some kit cleanup
2021-07-07 21:40:44 +02:00
vyzo
4f808367f8
fix lint
2021-07-07 21:32:58 +03:00
vyzo
fee50b13a2
check the closing state on each batch during the purge.
2021-07-07 21:32:05 +03:00
vyzo
c6421f8a75
don't nil the mark sets on close, it's dangerous.
...
a concurrent marking can panic.
2021-07-07 21:27:36 +03:00
Łukasz Magiera
d0e87a7487
dealpublisher: Fix provider address checks
2021-07-07 20:06:49 +02:00
Łukasz Magiera
2dc27d6ab4
itests: Fix deal provider collateral flakiness
2021-07-07 19:41:46 +02:00
Łukasz Magiera
ee97aa0a8a
dealpublisher: Use address selector
2021-07-07 19:12:03 +02:00
Peter Rabbitson
c7bb326c78
Enable color by default only if os.Stdout is a TTY
2021-07-07 18:12:24 +02:00
Łukasz Magiera
8f5c0c60f5
Config for deal publishing control addresses
2021-07-07 18:00:54 +02:00
Anton Evangelatov
82efe01c70
fixup
2021-07-07 18:00:28 +02:00
Anton Evangelatov
bb466ede66
fix cast on role_miner in testground lotus-soup plan
2021-07-07 16:04:01 +02:00
vyzo
aec2ba2c82
nil map/bf on markset close
2021-07-07 16:46:14 +03:00
vyzo
ec586a852a
remove bbolt dependency from go.mod
2021-07-07 16:41:11 +03:00
vyzo
451ddf50ab
RIP bbolt-backed markset
2021-07-07 16:39:37 +03:00
vyzo
9dbb2e0abd
don't leak tracking errors through the API
2021-07-07 16:34:02 +03:00
Łukasz Magiera
49896afe9f
Merge pull request #6694 from filecoin-project/chore/no-unexpected-color
...
Stop outputing ANSI color on non-TTY
2021-07-07 15:04:44 +02:00
Anton Evangelatov
1fe08f5973
refactor testkit in lotus-soup to include Subsystems when instantiating miner
2021-07-07 14:21:28 +02:00
Anton Evangelatov
6b014f57e5
pass Subsystems to StorageMiner option; add enableLibp2p bool in Settings
2021-07-07 13:56:37 +02:00
Anton Evangelatov
caa366bc6a
variadic WithSubsystems
2021-07-07 13:35:40 +02:00
Anton Evangelatov
42ae876711
remove ApplyIfEnableLibP2P
2021-07-07 13:31:56 +02:00
Peter Rabbitson
dcfbb1998f
Stop outputing ANSI color on non-TTY
...
No more stuff like: https://circleci.com/gh/filecoin-project/lotus/189136
2021-07-07 11:06:20 +02:00
vyzo
83c30dc4c0
protect assignment of warmup epoch with the mutex
2021-07-07 11:31:27 +03:00
