Commit Graph

14396 Commits

Author SHA1 Message Date
vyzo
1b77361301 add option for hotstore message retention 2021-07-17 08:35:35 +03:00
hannahhoward
3b4df5e10d fix(itests): fix simultaneous transfer logic
limit parallelism on client side and also fix the issue with how ongoing transfers are detected
2021-07-16 11:46:03 -07:00
Raúl Kripalani
089bcceb33 remove test concurrency guardrails. 2021-07-16 19:09:56 +01:00
Raúl Kripalani
9042429abd Merge branch 'master' into raulk/merge-gs-fix 2021-07-16 18:19:50 +01:00
Raúl Kripalani
aeb8e57eef use https://github.com/ipfs/go-graphsync/pull/176. 2021-07-16 18:17:34 +01:00
Raúl Kripalani
b2feb7e960 upgrade go-fil-markets, go-data-transfer; add logging. 2021-07-16 17:30:45 +01:00
Łukasz Magiera
d5c9cccf21 address net interface split review 2021-07-15 15:51:47 +02:00
Łukasz Magiera
b20581bac2 api: check that only the top-level internal struct gets picked up 2021-07-15 15:45:41 +02:00
Łukasz Magiera
fd9f5dc83c
Merge pull request #6764 from filecoin-project/deps/update-pubsub
update go-libp2p-pubsub to v0.5.0
2021-07-15 14:58:52 +02:00
vyzo
1d9dcef878 update go-libp2p-pubsub to v0.5.0 2021-07-15 15:07:14 +03:00
Łukasz Magiera
25cd577d06
Merge pull request #6762 from filecoin-project/feat/splitstore-exposed
Implement exposed splitstore
2021-07-15 13:11:45 +02:00
vyzo
e003203bea implement exposed splitstore 2021-07-15 13:12:10 +03:00
Łukasz Magiera
812dc266cf builder: Don't require specific NetAPI impl in StorageMinerAPI 2021-07-15 12:01:13 +02:00
Łukasz Magiera
49e26cce7d api: Separate the Net interface from Common 2021-07-15 11:41:30 +02:00
Łukasz Magiera
f07a370711
Merge pull request #6642 from hunjixin/feat/add_getmessagesints_api
Add ChainGetMessagesInTipset API
2021-07-15 11:12:51 +02:00
Łukasz Magiera
a03c5ac3d2
Merge pull request #6758 from filecoin-project/test/deflake-fork-refuse-call
test: handle null blocks in TestForkRefuseCall
2021-07-15 11:01:15 +02:00
Łukasz Magiera
ab2f159d54
Merge pull request #6757 from filecoin-project/jennijuju-patch-1
Master disclaimer
2021-07-15 10:37:55 +02:00
hunjixin
d023026cb0 fix confilct 2021-07-15 14:55:03 +08:00
hunjixin
b2f8b4011a fix imports 2021-07-15 14:52:12 +08:00
hunjixin
3e9ec01d04 rm fmt 2021-07-15 14:52:12 +08:00
hunjixin
a48a6a168a add test for new api 2021-07-15 14:52:12 +08:00
hunjixin
ac03c01e4a test for messages in tipset 2021-07-15 14:52:12 +08:00
hunjixin
bdaa73a413 add ChainGetMessagesInTipset api 2021-07-15 14:52:09 +08:00
Steven Allen
cf81c897df test: handle null blocks in TestForkRefuseCall
Otherwise, this fails on rare occasions.
2021-07-14 17:41:24 -07:00
Steven Allen
81d614a607
Merge pull request #6756 from filecoin-project/feat/splitstore-reorg
Splitstore code reorg
2021-07-14 16:57:11 -07:00
Jennifer
5e5b4b7191
Update README.md 2021-07-14 19:07:02 -04:00
Jennifer
dd0f4dea81
Update README.md 2021-07-14 18:32:17 -04:00
Steven Allen
c738d1f7ef
Merge pull request #6747 from filecoin-project/action/stale
Create stale.yml
2021-07-14 13:50:38 -07:00
vyzo
5a23f64b3b code reorg: break splitstore.go into smaller logical units 2021-07-14 13:11:15 -07:00
Steven Allen
44d01712c8
Merge pull request #6754 from filecoin-project/feat/splitstore-refactor
Splitstore: Some small fixes
2021-07-14 13:09:59 -07:00
vyzo
3f3a12b75c remove BlockstoreMover interface
we decided it's premature
2021-07-14 22:59:53 +03:00
vyzo
023146803d use Broadcast for view barrier 2021-07-14 22:59:53 +03:00
vyzo
3d77ae1f4d make trackTxnRefMany consistent with trackTxnRef 2021-07-14 22:59:53 +03:00
vyzo
6f126c80bf remove redundant log, more descriptive error message for closing condition 2021-07-14 22:59:53 +03:00
vyzo
ff093fae00 use a missing compactionIndex as an indicator for warmup
so that splitstore v0 nodes upgrading will get a fresh warmup.
2021-07-14 22:59:53 +03:00
vyzo
669b47cfc9 do moving gc for hotstore every 20 compactions
that's about once a week
2021-07-14 22:59:53 +03:00
vyzo
818b8de182 keep track of the compaction serial (index)
it is useful so that:
- we only do slow (but very effective) moving gc every 10 compactions
- we can detect a splitstore v0 upgrade and re-warm up
2021-07-14 22:59:53 +03:00
vyzo
c93328b036 use the new traits for hotstore gc 2021-07-14 22:59:52 +03:00
vyzo
35180b4761 merge Compact and CollectGarbage in badger 2021-07-14 22:59:52 +03:00
vyzo
dc81c0e6a2 add blockstore traits related to gc 2021-07-14 22:59:52 +03:00
Łukasz Magiera
f0c9e4e8f2
Merge pull request #6746 from filecoin-project/chore/add_power_to_shed_storage-stats 2021-07-14 11:54:43 +02:00
Jennifer
71ddbdaf10
Update stale.yml 2021-07-14 02:52:39 -04:00
Jennifer
856cbb2ca0
Create stale.yml
Mark any issue thats labeled with `hint/needs-author-input` and has no activity more than 5 days as stale and give a 24 hours notice before closing.
2021-07-14 02:50:18 -04:00
Peter Rabbitson
a37ababc20 Minor rearrange 2021-07-14 08:32:07 +02:00
Peter Rabbitson
677c193e6c Add current power to the stats 2021-07-14 08:11:23 +02:00
Łukasz Magiera
dd09666399
Merge pull request #6743 from filecoin-project/chore/centralize_all_cli_color_handling
Handle the --color flag via proper global state
2021-07-13 17:34:25 +02:00
Łukasz Magiera
583a8a13d9
Merge pull request #6629 from filecoin-project/feat/pledge-from-miner-balance
Config for collateral from miner available balance
2021-07-13 17:22:00 +02:00
Łukasz Magiera
837322ea59
Merge pull request #6356 from filecoin-project/nonsense/split-market-miner-processes
Support standalone miner-market process
2021-07-13 17:16:07 +02:00
Łukasz Magiera
0678b3fa05 sealing: Cleanup DisableCollateralFallback handling 2021-07-13 17:06:41 +02:00
Łukasz Magiera
7526a074d9 sealing: collateral buffer / falback config 2021-07-13 17:04:58 +02:00