Commit Graph

192 Commits

Author SHA1 Message Date
Raúl Kripalani
7f3716504b
refactor lotus recipes to make them more manageable. (#86)
- Each role now has its own file (role_*.go).
- Options have their own file (lotus_opts.go).
- Sync service constructions have their own file (sync.go).
- Utilities are functionally grouped in files ({deals,retrieval}.go).
2020-06-30 23:02:01 +01:00
Anton Evangelatov
af582aff02
register and export lotus metrics (#84) 2020-06-30 18:02:02 +02:00
Anton Evangelatov
46beab3cf1 fixup 2020-06-30 17:59:42 +02:00
Anton Evangelatov
0a9af6ad5c extract startServer 2020-06-30 17:53:27 +02:00
Anton Evangelatov
e3d2d2e7c1 extract withApiEndpoint 2020-06-30 17:50:21 +02:00
vyzo
903b1ea914 more logging for serial execution 2020-06-30 16:05:23 +03:00
Anton Evangelatov
b62878c260 upgrade go-sdk 2020-06-30 14:47:09 +02:00
Anton Evangelatov
63bce1a426 extract starting of rpc servers 2020-06-30 13:56:24 +02:00
Anton Evangelatov
954ad1f396 fixup 2020-06-30 13:31:50 +02:00
Anton Evangelatov
33e60df301 resolved merge conflicts 2020-06-30 13:23:02 +02:00
Anton Evangelatov
204714a01f wip 2020-06-30 13:20:10 +02:00
Anton Evangelatov
eec5c23671 working client rpc 2020-06-30 13:18:02 +02:00
vyzo
4595ded0d3 manifest and composition for deal stress test 2020-06-30 14:07:00 +03:00
vyzo
36f82ab9fe deal stress test 2020-06-30 13:57:54 +03:00
vyzo
62f63a29b5 remove useless error argument from retrieveData 2020-06-30 13:56:37 +03:00
vyzo
6b44e6d0d8 update composition-natural.toml 2020-06-29 20:06:38 +03:00
vyzo
79246e6ee9 record shutting down message in a more pertinent place 2020-06-29 20:05:44 +03:00
vyzo
cced69e496 add composition for natural time test 2020-06-29 20:05:44 +03:00
vyzo
da85855a6b option to turn on natural time mining 2020-06-29 20:05:43 +03:00
Anton Evangelatov
6c8abeb067
Merge pull request #78 from filecoin-project/fix-compositions
fix compositions
2020-06-29 19:04:08 +02:00
Anton Evangelatov
05e5c42f33 fix compositions 2020-06-29 19:00:18 +02:00
Anton Evangelatov
b47641f1c2 introduce 2 groups of miners 2020-06-29 18:48:10 +02:00
Anton Evangelatov
50b9a7f212 get seq num based on role, not based on group 2020-06-29 18:38:28 +02:00
Anton Evangelatov
0ec247de8c fix broken counter 2020-06-29 17:21:50 +02:00
Anton Evangelatov
c4347c0485 wip 2020-06-29 17:10:31 +02:00
Anton Evangelatov
909c12c6b4 sync miners 2020-06-29 17:06:04 +02:00
Anton Evangelatov
222d718ccd wip 2020-06-29 14:57:55 +02:00
Anton Evangelatov
38132cdb94 go-sdk from master 2020-06-26 23:44:04 +02:00
Anton Evangelatov
0d908c18b4 who mined block 2020-06-26 22:07:49 +02:00
Anton Evangelatov
0487d60d0e better metrics 2020-06-26 18:56:09 +02:00
Anton Evangelatov
e388d96073 metric for offer 2020-06-26 18:19:40 +02:00
Anton Evangelatov
5fa2c1c410 more compositions 2020-06-26 18:18:44 +02:00
Anton Evangelatov
f91364fb3e extract common vars 2020-06-26 17:00:13 +02:00
Anton Evangelatov
d7631fb997 basic timers and counters 2020-06-26 17:00:13 +02:00
vyzo
b7403fd93c fix mining termination race condition 2020-06-26 17:44:40 +03:00
vyzo
3d5f58c8b8 sort preseals by miner GroupSeq 2020-06-26 17:30:44 +03:00
vyzo
f7af27f1d2 fix miner synchronization 2020-06-26 17:27:10 +03:00
vyzo
2a8333e0e4 gomod: update go-libp2p-pubsub-tracer@master 2020-06-26 17:16:50 +03:00
vyzo
95c3229f89 Merge branch 'pubsub-tracer' of github.com:filecoin-project/oni into pubsub-tracer 2020-06-26 14:12:58 +03:00
vyzo
909e0e401f define enable_pubsub_tracer in manifest.toml 2020-06-26 14:12:22 +03:00
vyzo
b1159b657d log close errors with RecordMessage 2020-06-26 14:10:39 +03:00
vyzo
30a6361a8f
fix typo
Co-authored-by: Anton Evangelatov <anton.evangelatov@gmail.com>
2020-06-26 14:06:45 +03:00
vyzo
eb65f1e441 output the tracer logs under TestOutputPath 2020-06-26 13:14:28 +03:00
vyzo
a612b77cee simplify code by removing extraneous conversion to multiaddr
just Cast to verify correctness and panic if something is wrong
2020-06-26 12:16:36 +03:00
vyzo
16149b9198 add composition with pubsub tracing 2020-06-26 12:05:08 +03:00
vyzo
00f137ba3e add pubsub-tracer role to baseline 2020-06-26 12:04:20 +03:00
vyzo
71503cce8b add pubsub tracer config to scaffolding 2020-06-26 11:58:56 +03:00
vyzo
1c2af85b20 pubsub tracer role 2020-06-26 11:49:24 +03:00
vyzo
3ff9045178 gomod: import go-libp2p-pubsub-tracer@feat/traced-lib and go-libp2p 2020-06-26 11:49:14 +03:00
Yusef Napora
c66dfe1c03
Merge pull request #53 from filecoin-project/feat/drand-setup
initial drand setup
2020-06-25 13:07:26 -04:00
Yusef Napora
19f0aa75eb rm resources block from drand composition 2020-06-25 13:01:46 -04:00
Yusef Napora
8b0f6c355c read from sub.Done() 2020-06-25 13:00:55 -04:00
Yusef Napora
3cbf5efddd use temp dir for drand state 2020-06-25 12:38:40 -04:00
Yusef Napora
fda66f5bd9 move drand to common_roles & fix mock randomness override 2020-06-25 12:18:08 -04:00
Yusef Napora
3f15146c19 add composition with mock randomness 2020-06-25 12:18:08 -04:00
Anton Evangelatov
f11d726ddc
Merge pull request #65 from filecoin-project/move-rolling-build-config-to-composition
move rolling build config to composition file, not manifest
2020-06-25 17:48:18 +02:00
Yusef Napora
75ff8d0689 add random_beacon_type param, default to mock randomness 2020-06-25 11:35:55 -04:00
Yusef Napora
e225a644f4 run drand gossip relays alongside each drand node 2020-06-25 11:35:55 -04:00
Yusef Napora
4a337785b5 rebase drand setup onto master 2020-06-25 11:35:55 -04:00
vyzo
b0c3963506 extract common roles for bootstrapper and miner 2020-06-25 18:29:01 +03:00
Anton Evangelatov
8588cce4d5 move rolling build config to composition file, not manifest 2020-06-25 15:24:53 +02:00
Anton Evangelatov
7898451236 min 100ms between blocks 2020-06-25 14:37:59 +02:00
Anton Evangelatov
67b1bb6178 better default for k8s composition 2020-06-25 14:30:02 +02:00
vyzo
0c00b8b2ab use temporary file instead of hardcoding /tmp/data for deal data 2020-06-25 15:27:11 +03:00
vyzo
889b440bb1 use the full node api instead of breaking abstraction barriers 2020-06-25 15:14:27 +03:00
vyzo
1eeeff82d1 use a single context for miner 2020-06-25 14:26:43 +03:00
vyzo
b476bc86ce synchronize all miners to mine next block 2020-06-25 14:16:04 +03:00
vyzo
58923fe2ff some baseline cleanup
1. Miners wait for all client's signal to stop mining
2. Miners don't care about client addresses
3. Moved collect methods to node.go
2020-06-25 14:10:00 +03:00
vyzo
5cccc81abf keep log level at WARN so that we see what's happening in the system 2020-06-25 13:52:02 +03:00
Anton Evangelatov
831cd2e71d move init to node.go 2020-06-25 12:33:52 +02:00
Anton Evangelatov
9f9c30d406 speed up block mining 2020-06-25 12:21:14 +02:00
Anton Evangelatov
ae3fcca543 barrier for stop mining, instead of sleep 2020-06-25 12:00:56 +02:00
Anton Evangelatov
801a4f79b9 completed deal 2020-06-24 18:15:52 +02:00
Anton Evangelatov
98bc576888 insecure post validation 2020-06-24 17:39:37 +02:00
Anton Evangelatov
bb758854fb move init to main, add more logging 2020-06-24 16:46:12 +02:00
Anton Evangelatov
f460d24f65 fixup 2020-06-24 16:12:10 +02:00
Anton Evangelatov
b026160c5c mine longer 2020-06-24 15:48:15 +02:00
Anton Evangelatov
fe842823a9 mine more blocks 2020-06-24 15:45:32 +02:00
Anton Evangelatov
65dff05008 bump up balances 2020-06-24 15:42:34 +02:00
Anton Evangelatov
d4f883c1b0 connect miner node to its full node??? 2020-06-24 15:40:30 +02:00
Anton Evangelatov
e8f037cac8 broken mining and deal sealing 2020-06-24 15:29:27 +02:00
Anton Evangelatov
cca568112d start deal, need to add mining 2020-06-24 15:16:10 +02:00
Anton Evangelatov
db19764130 generate random data, start deal 2020-06-24 15:10:05 +02:00
Anton Evangelatov
2379ff1740 composition for k8s, better error logging on collect addrs 2020-06-24 14:50:06 +02:00
Anton Evangelatov
f6da7679b8 connect client to miner; fix topic bug 2020-06-24 14:40:29 +02:00
Anton Evangelatov
b0d0a7a04a improvements 2020-06-24 14:34:19 +02:00
Anton Evangelatov
f1181ce9c2 broadcast addrs, and connect miner and client 2020-06-24 14:34:19 +02:00
Anton Evangelatov
e9402da131
fix ignored barrier (#58) 2020-06-24 14:33:31 +02:00
vyzo
04a945531c
Merge pull request #56 from filecoin-project/extract-subscriptions-and-check-for-errors
extract subscriptions for balances, genesis and preseals
2020-06-24 15:07:12 +03:00
Anton Evangelatov
ebd0e85d65 extract subscriptions 2020-06-24 13:10:35 +02:00
vyzo
0e924edf0e use the role map, luke! 2020-06-24 14:02:20 +03:00
vyzo
448bbf3710
generic test plan scaffolding, with baseline plan (#39)
* test plan scaffolding

* generify the testplan role dispatch

* manifest.toml

* initial go.mod and go.sum

* correct name

* gomod: update from build

* node construction in scaffolding

* fix test runner return type

* remove offending comments

* add initial composition, and fix context bug

* debug lines

* check errors from node construction

* specify Repo after Online option

* add power/proof type initialization code

* fix baseline composition

* use new docker-images (build/run) introduced in the #48 PR

* upgrade go-sdk to master (#51)

* fix types for run.InvokeMap

* fix miner actor sequence address

* explictly specify listen address for nodes on the data network

* make a separate full node for the miner

* initialize the wallet for the full node before creating the storage node

* go mod tidy

* also set the listen address for the miner node

* circleci to build the soup testplan

* extract topics

* test runner: pass the role map to doRun for generic runner

* use a wrapper TestEnvironment to encapsulate the runenv and initCtx

* embed RunEnv and InitContext into TestEnvironment for better ergonomics

* remove empty import

* extract stateReady

Co-authored-by: Anton Evangelatov <anton.evangelatov@gmail.com>
2020-06-24 12:52:23 +02:00