140 Commits

Author	SHA1	Message	Date
Prathamesh Musale	17e860d6e4	Update subgraph watcher versions and instructions to use deployments (#775) ... Part of https://www.notion.so/Setup-watchers-on-sandman-34b5514a10634c6fbf3ec338967c871c Reviewed-on: #775 Co-authored-by: Prathamesh Musale <prathamesh.musale0@gmail.com> Co-committed-by: Prathamesh Musale <prathamesh.musale0@gmail.com>	2024-03-12 05:32:55 +00:00
jonathan@vulcanize.io	b4eda902ea	fixed optimum deployment	2024-03-08 19:27:36 +00:00
jonathan@vulcanize.io	b4df8104c8	tweaking yml	2024-03-08 17:20:44 +00:00
jonathan@vulcanize.io	07282cdd6e	minimal build	2024-03-08 02:56:23 +00:00
jonathan@vulcanize.io	e7c935fb78	integration testing, I think	2024-03-07 22:24:46 +00:00
jonathan@vulcanize.io	1a636799a6	filepath	2024-03-06 19:34:25 +00:00
jonathan@vulcanize.io	0aa4b350bd	keycloak implementation	2024-03-06 19:21:29 +00:00
Thomas E Lackey	62f7ce649d	Exit non-0 if docker build fails. (#778) ... Make sure to check the exit code of the docker build and bubble it back up to laconic-so. Reviewed-on: #778 Co-authored-by: Thomas E Lackey <telackey@bozemanpass.com> Co-committed-by: Thomas E Lackey <telackey@bozemanpass.com>	2024-03-06 18:38:30 +00:00
jonathan@vulcanize.io	2252252072	comment format	2024-03-05 20:42:53 +00:00
jonathan@vulcanize.io	c92f15f47c	comment format	2024-03-05 20:38:09 +00:00
jonathan@vulcanize.io	fee32ec703	copying genesis.json to /data/blast-data for blast	2024-03-05 20:32:56 +00:00
David Boreham	fb55c1425e	Beginnings of blast stack	2024-03-04 15:05:31 -07:00
Thomas E Lackey	cc541ac20f	Use -slim variant for Dockerfile (#773) ... This saves about 1GB of space in the image. Reviewed-on: #773 Co-authored-by: Thomas E Lackey <telackey@bozemanpass.com> Co-committed-by: Thomas E Lackey <telackey@bozemanpass.com>	2024-02-28 04:37:57 +00:00
Thomas E Lackey	10e2311a8b	Add timed logging for the webapp build (#771) ... Add lots of log and timer output to webapp builds. Reviewed-on: #771	2024-02-28 00:38:11 +00:00
Thomas E Lackey	21eb9f036f	Add support for pnpm as a webapp build tool. (#767) ... This adds support for auto-detecting pnpm as a build tool for webapps. Reviewed-on: #767 Reviewed-by: David Boreham <dboreham@noreply.git.vdb.to> Co-authored-by: Thomas E Lackey <telackey@bozemanpass.com> Co-committed-by: Thomas E Lackey <telackey@bozemanpass.com>	2024-02-26 23:31:52 +00:00
zramsay	a16fc657bf	clarify uniswap urbit readme (#766) ... Co-authored-by: zramsay <zach@bluecollarcoding.ca> Reviewed-on: #766	2024-02-24 00:15:53 +00:00
Thomas E Lackey	704c42c404	Use a catchall for single page apps. (#763) ... This creates a new environment variable, CERC_SINGLE_PAGE_APP, which controls whether a catchall redirection back to / is applied. If the value is not explicitly set, we try to detect if the page looks like a single-page app. Reviewed-on: #763 Co-authored-by: Thomas E Lackey <telackey@bozemanpass.com> Co-committed-by: Thomas E Lackey <telackey@bozemanpass.com>	2024-02-23 20:32:24 +00:00
Thomas E Lackey	2af6ffce77	Tweaks for running the container registry in k8s (#760) ... Minor tweaks for running the container-registry in k8s. The big change is not requiring --image-registry. Reviewed-on: #760 Reviewed-by: David Boreham <dboreham@noreply.git.vdb.to>	2024-02-22 21:11:06 +00:00
David Boreham	642c0ead0d	Add test for two config parameters (#758) ... Reviewed-on: #758 Co-authored-by: David Boreham <david@bozemanpass.com> Co-committed-by: David Boreham <david@bozemanpass.com>	2024-02-22 19:35:55 +00:00
Thomas E Lackey	db4986dcc6	snowballtool-base backend stack (#751) ... This adds a stack for the backend from snowball/snowballtools-base. Reviewed-on: #751 Co-authored-by: Thomas E Lackey <telackey@bozemanpass.com> Co-committed-by: Thomas E Lackey <telackey@bozemanpass.com>	2024-02-21 04:45:46 +00:00
Thomas E Lackey	65f05ea80c	Run a manual build script, if present. (#750) ... If the tree has a 'build-webapp.sh' script, use that. Reviewed-on: #750 Co-authored-by: Thomas E Lackey <telackey@bozemanpass.com> Co-committed-by: Thomas E Lackey <telackey@bozemanpass.com>	2024-02-21 00:20:50 +00:00
zramsay	01f9fe67ed	add Mars v2 interface (#744) ... Tested on DO with real funds on mainnet Co-authored-by: zramsay <zach@bluecollarcoding.ca> Reviewed-on: #744	2024-02-19 19:11:59 +00:00
David Boreham	39f4fa4487	Container Registry Stack (#747) ... Co-authored-by: David Boreham <david@bozemanpas.com> Reviewed-on: #747 Co-authored-by: David Boreham <david@bozemanpass.com> Co-committed-by: David Boreham <david@bozemanpass.com>	2024-02-18 18:55:55 +00:00
David Boreham	37b9500483	Support non-tls ingress for kind (#748) ... Reviewed-on: #748 Co-authored-by: David Boreham <david@bozemanpass.com> Co-committed-by: David Boreham <david@bozemanpass.com>	2024-02-17 01:54:30 +00:00
Thomas E Lackey	3c3e582939	Minor envsubst improvements. (#746) ... Minor fixes to envsubst for webapps. Somewhat specially treated is `LACONIC_HOSTED_CONFIG_homepage` which can be used to replace the homepage in package.json. With react, this gets an extra `/` though, which we need to remove. Reviewed-on: #746 Co-authored-by: Thomas E Lackey <telackey@bozemanpass.com> Co-committed-by: Thomas E Lackey <telackey@bozemanpass.com>	2024-02-16 04:11:09 +00:00
David Boreham	d9bb6b3588	Test Database Stack (#737) ... Reviewed-on: #737	2024-02-15 05:26:29 +00:00
Thomas E Lackey	b22c72e715	For k8s, use provisioner-managed volumes when an absolute host path is not specified. (#741) ... In kind, when we bind-mount a host directory it is first mounted into the kind container at /mnt, then into the pod at the desired location. We accidentally picked this up for full-blown k8s, and were creating volumes at /mnt. This changes the behavior for both kind and regular k8s so that bind mounts are only allowed if a fully-qualified path is specified. If no path is specified at all, a default storageClass is assumed to be present, and the volume managed by a provisioner. Eg, for kind, the default provisioner is: https://github.com/rancher/local-path-provisioner ``` stack: test deploy-to: k8s-kind config: test-variable-1: test-value-1 network: ports: test: - '80' volumes: # this will be bind-mounted to a host-path test-data-bind: /srv/data # this will be managed by the k8s node test-data-auto: configmaps: test-config: ./configmap/test-config ``` Reviewed-on: #741 Co-authored-by: Thomas E Lackey <telackey@bozemanpass.com> Co-committed-by: Thomas E Lackey <telackey@bozemanpass.com>	2024-02-14 21:45:01 +00:00
Thomas E Lackey	c9444591f5	Fix default webapp port number. (#740) ... Reviewed-on: #740 Co-authored-by: Thomas E Lackey <telackey@bozemanpass.com> Co-committed-by: Thomas E Lackey <telackey@bozemanpass.com>	2024-02-09 01:20:41 +00:00
David Boreham	2104eb5f30	Merge pull request 'Add Mars stack' (#725) from zach/mars into main ... Reviewed-on: #725 Reviewed-by: David Boreham <dboreham@noreply.git.vdb.to>	2024-02-08 20:30:47 +00:00
zramsay	afd6be3b13	Ping pub (#663) ... for #170, revives #190 uses https://github.com/LaconicNetwork/explorer/pull/1 Co-authored-by: zramsay <zach@bluecollarcoding.ca> Co-authored-by: David Boreham <david@bozemanpass.com> Reviewed-on: #663 Co-authored-by: zramsay <zramsay@noreply.git.vdb.to> Co-committed-by: zramsay <zramsay@noreply.git.vdb.to>	2024-02-08 20:13:12 +00:00
David Boreham	f914baa913	Merge branch 'main' into zach/mars	2024-02-08 19:52:49 +00:00
David Boreham	8be1e684e8	Process environment variables defined in compose files (#736) ... Reviewed-on: #736 Co-authored-by: David Boreham <david@bozemanpass.com> Co-committed-by: David Boreham <david@bozemanpass.com>	2024-02-08 19:41:57 +00:00
Thomas E Lackey	4a981d8d2e	Fix repo URL (#733) ... Needs a '/' (http) not ':' (ssh). Reviewed-on: #733 Co-authored-by: Thomas E Lackey <telackey@bozemanpass.com> Co-committed-by: Thomas E Lackey <telackey@bozemanpass.com>	2024-02-07 18:52:07 +00:00
Thomas E Lackey	937b983ec9	Update links from github.com to git.vdb.to (#732) ... Update links and references to github.com to git.vdb.to. Also enable the flake8 lint action in gitea. Reviewed-on: #732 Co-authored-by: Thomas E Lackey <telackey@bozemanpass.com> Co-committed-by: Thomas E Lackey <telackey@bozemanpass.com>	2024-02-06 22:42:44 +00:00
Thomas E Lackey	36bb068983	Add ConfigMap test. (#726) ... * Add ConfigMap test. * eof * Minor tweak * Trigger test --------- Co-authored-by: David Boreham <david@bozemanpass.com>	2024-02-05 14:15:11 -06:00
David Boreham	25a2b70f2c	Fix command in mainnet-eth docs	2024-02-03 18:25:02 -07:00
Thomas E Lackey	2fcd416e29	Basic webapp deployer stack. (#722)	2024-02-02 19:05:15 -07:00
Thomas E Lackey	6629017d6a	Support other webapp types (react, static). (#721) ... * Support other webapp types (react, static).	2024-02-02 18:04:06 -06:00
Thomas E Lackey	62af03077f	Add deployed/error status output to the state file. (#719) ... * More status info * Up default resource limits. * Need ps	2024-01-30 22:13:45 -06:00
Zach	098567625a	Create README.md	2024-01-30 17:47:56 -05:00
zramsay	23ee3e19b7	mars: add env vars to docker-compose	2024-01-29 22:44:55 +00:00
zramsay	2d764fc7d0	basic mars stack	2024-01-29 16:00:58 +00:00
Thomas E Lackey	554f05de87	Fix pip3 error (#709)	2024-01-22 21:06:15 -06:00
prathamesh0	282e175566	Remove unnecessary hyperlinks and pin image versions (#706) ... * Remove invalid dashboard and panel ids from alert rules * Pin grafana and prometheus versions * Configure custom grafana server URL	2024-01-17 14:02:10 +05:30
Thomas E Lackey	0587813dd0	Create next.config.js if it is missing. (#701) ... * Create next.config.js if it is missing. * Add comment.	2024-01-15 12:12:59 -06:00
Thomas E Lackey	4b3ea7c30f	Update independent act-runner stack to use custom act as well. (#702) ... * Update independent act-runner stack to use custom act as well. * Remove branches which are not needed or already merged.	2024-01-15 12:10:48 -06:00
Nabarun Gogoi	db8aec52aa	Pin commit hash of asset list repo in osmosis frontend app (#703)	2024-01-15 16:56:06 +05:30
Thomas E Lackey	b83030f63b	Use custom act with gitea. (#700) ... * Use custom act with gitea. * Make sure wget is available * Fix repo url	2024-01-09 22:53:43 -06:00
prathamesh0	a3eb3c0bb0	Setup basic alerting for watchers in monitoring stack (#698) ... * Provision Grafana alert contactpoints and policies for Slack * Add watcher alert rules * Update watcher monitoring instructions * Add listening port flag to node exporter command * Add reference links	2024-01-08 17:25:30 +05:30
Nabarun Gogoi	eae2af7ccc	Upgrade watcher versions (#699)	2024-01-08 11:51:54 +05:30
prathamesh0	a57b0cdd26	Add a stack for prom node exporter and its dashboard in monitoring stack (#696) ... * Add a stack for Prometheus node exporter * Add node exporter dashboard to monitoring stack	2023-12-21 15:15:03 +05:30
prathamesh0	38622fb33c	[WIP] Use templating for watcher dashboard and add Postgres exporter (#695) ... * Add Postgres exporter and it's dashboard * Use templating for watcher dashboard * Add subgraph related panels to watcher dashboard * Remove individual watcher dashboards and update instructions	2023-12-21 13:41:36 +05:30
prathamesh0	4a1a46facc	Update monitoring stack with additional dashboards and watcher metrics (#693) ... * Include retry jobs and update default refresh intervals * Add prometheus blackbox exporter and it's dashboard * Add NodeJS application dashboard * Allow UI updates * Update watcher dashboards for upstream and external chain heads * Update watcher dashboards with watcher config metrics * Upgrade sushiswap and azimuth watchers * Removed fixed title size values * Update instructions * Update instructions for env config * Update instructions with setup	2023-12-21 09:26:37 +05:30
Zach	42b92f7e23	use square logo for an urbit tile (#689) ... * use square logo for an urbit tile * bump version, improve info text	2023-12-19 09:50:14 -05:00
Nabarun Gogoi	def192edab	Update new environment values for Osmosis frontend app (#694) ... * Update new env values for Osmosis frontend app * Use .env.production instead of local	2023-12-18 17:49:45 +05:30
Thomas E Lackey	997496b8a5	Update script for new nextjs build output. (#691)	2023-12-14 19:47:30 -06:00
Thomas E Lackey	61f2884505	Reduce base image size (first round of improvements) (#690)	2023-12-14 17:46:03 -06:00
prathamesh0	b9b758bfdd	Add a stack for running Osmosis frontend app on Urbit (#683) ... * Deploy osmosis on Urbit fake ship * Remove Urbit configuration from existing osmosis stack * Add a separate stack for Osmosis front end on Urbit * Run script for renaming build files with bash * Add environment variables required in urbit osmosis build * Fix BASEPATH in compose file * Remove ipfs-glob-host from network config in osmosis readme * Use laconic branch for osmosis frontend --------- Co-authored-by: Nabarun <nabarun@deepstacksoft.com>	2023-12-14 17:28:10 +05:30
prathamesh0	9ba410b095	Add a stack for monitoring watchers with prometheus and grafana (#687) ... * Setup Prometheus and Grafana for monitoring stack * Add dashboard for azimuth watchers * Add a dashboard for sushiswap watcher * Persist prometheus server data * Additional metrics in watcher dashboards * Update dashboards and add for merkl sushiswap watcher * Add dashboards for remaining azimuth watchers * Separate out preconfigured watcher dashboards and add instructions * Keep the empty dashboards dir	2023-12-14 16:59:00 +05:30
Thomas E Lackey	88f66a3626	Add deployment update and deploy-webapp-from-registry commands. (#676)	2023-12-13 21:02:34 -06:00
prathamesh0	1ef0b316c6	Expose metrics endpoints for sushiswap and merkl sushiswap watchers (#685)	2023-12-13 14:58:26 +05:30
prathamesh0	232d5618cb	Update instructions in osmosis stack (#684)	2023-12-12 13:54:00 +05:30
Nabarun Gogoi	fa6b570f4a	Add stack for running osmosis frontend app (#673) ... * osmosis FE stack * chmod * dont use 3000 * fix for neww stack format * updates * update osmosis readme * Update stack.yml * Update osmosis frontend stack to serve app * Host osmosis app static build using python server * Fix mapped ports in deployment for containers * Update instructions * Use nginx server to host files and handle page reloads * Fix typo --------- Co-authored-by: zramsay <zach@bluecollarcoding.ca> Co-authored-by: Prathamesh Musale <prathamesh.musale0@gmail.com>	2023-12-11 14:10:54 +05:30
prathamesh0	f9eb5a4ba8	Refactor to make Urbit setup generic (#682) ... * Refactor to make Urbit app deployment script generic * Rename urbit pod and update instructions * Add a flag to allow skipping app installation on Urbit * Make remote Urbit app deployment scripts generic * Move remote deployment scripts to urbit fixturenet * Update and use existing kubo pod for Urbit glob hosting	2023-12-08 09:35:00 +05:30
prathamesh0	6bef0c5b2f	Separate out GQL proxy server from uniswap-urbit stack (#681) ... * Separate out uniswap gql proxy in a stack * Use proxy server from watcher-ts * Add a flag to enable/disable the proxy server * Update env configuratoin for uniswap urbit app stack * Update stack file for uniswap urbit app stack * Fix env variables in instructions	2023-12-06 10:41:10 +05:30
prathamesh0	f27da19808	Use IPFS for hosting glob files for Urbit (#677) ... * Use IPFS for hosting glob files for Urbit * Add env configuration for IPFS endpoints to instructions * Make ship pier dir configurable in remote deployment script * Update remote deployment script to accept glob hash arg	2023-12-05 15:00:03 +05:30
Nabarun Gogoi	c319e90ddd	Add a stack for running uniswap frontend on urbit (#670) ... * Create uniswap-frontend stack * Add stack for building uniswap frontend app * Add a container for Urbit fake ship * Update with deployment command * Add a service for uniswap app deployment to urbit * Use a script to start urbit ship to handle restarts * Rename stack name to uniswap-urbit-app * Rename build.sh to build-app.sh and check if build already exists * Rename stack directory name * Update uniswap build restart on failure * Perform uniswap app deployment in the urbit container * Add steps to create glob for the app * Tail /dev/null after deployment * Add steps to install the app to desk * Host glob files for uniswap * Update repo branch * Update readme with command to get urbit password * Update readme * Update readme to open urbit web UI * Expose the port on glob hosting container * Avoid exposing urbit http port * Add scripts for installing uniswap on remote urbit instance * Configure GQL proxy for uniswap app * Use laconic branch for app repo * Rename urbit pod for uniswap app deployment --------- Co-authored-by: Prathamesh Musale <prathamesh.musale0@gmail.com>	2023-12-04 18:39:19 +05:30
Thomas E Lackey	2173e7ce6a	If the next version is unsupported, print a big warning and try higher version. (#674)	2023-11-30 12:33:06 -06:00
David Boreham	a68cd5d65c	Webapp deploy (#662)	2023-11-27 22:02:16 -07:00
Nabarun Gogoi	1b94db27c1	Upgrade azimuth watcher release version to 0.1.2 (#666) ... * Upgrade azimuth watcher release version * Fix version for azimuth watcher repo	2023-11-24 14:05:37 +05:30
prathamesh0	9499941891	Increase max connections for Azimuth watcher dbs (#665)	2023-11-23 19:11:02 +05:30
Nabarun Gogoi	3fefc67e77	Run azimuth contract watcher in active mode (#661) ... * Update stack to run azimuth job runner * Run azimuth watcher in active mode * Update stack to run job-runners for all watchers * Update ports in job-runner health checks * Map metrics ports to host * Configure historical block processing batch size for Azimuth watcher * Use deployment command for azimuth stack --------- Co-authored-by: neeraj <neeraj.rtly@gmail.com> Co-authored-by: Prathamesh Musale <prathamesh.musale0@gmail.com>	2023-11-23 15:00:18 +05:30
Thomas E Lackey	1a37255c18	Tweak laconicd config to allow setting endpoint port and to make the fixturenet restartable. (#660) ... * Endpoint includes port * Make it restartable * Don't try to remove the mounted directory * Make copy of init.sh	2023-11-22 11:31:30 -06:00
Nabarun Gogoi	0b87c12c13	Upgrade merkl and sushiswap watcher to v0.1.4 (#657) ... * Upgrade merkl and sushi watcher versions * Set gqlPath to base URL and remove filling start block * Upgrade watcher versions to 0.1.4	2023-11-21 19:07:09 +05:30
Ian	80c4b9214b	Merge pull request #643 from cerc-io/iskay/update-optimism ... Iskay/update optimism	2023-11-16 12:31:57 -05:00
Nabarun Gogoi	70529c43e7	Upgrade merkl and sushiswap watcher versions (#654)	2023-11-16 16:27:41 +05:30
Thomas E Lackey	2059d67dca	Add run-webapp command. (#651)	2023-11-15 10:54:27 -07:00
Thomas E Lackey	4ae4d3b61d	Print docker container logs in webapp test. (#649)	2023-11-14 17:30:01 -06:00
Thomas E Lackey	9687d84468	646: Add error message for webapp startup hang (#647) ... This fixes three issues: 1. #644 (build output) 2. #646 (error on startup) 3. automatic env quote handling (related to 2) For the build output we now have: ``` ################################################################# Built host container for /home/telackey/tmp/iglootools-home with tag: cerc/iglootools-home:local To test locally run: docker run -p 3000:3000 cerc/iglootools-home:local ``` For the startup error, it was hung waiting for the "success" message from the next generate output (itself a workaround for a nextjs bug fixed by this PR we submitted: https://github.com/vercel/next.js/pull/58276). I added a timeout which will cause it to wait up to a maximum _n_ seconds before issuing: ``` ERROR: 'npm run cerc_generate' exceeded CERC_MAX_GENERATE_TIME. ``` On the quoting itself, I plan on adding a new run-webapp command, but I realized I had a decent spot to do effect the quote replacement on-the-fly after all when I am already escaping the values for insertion/replacement into JS. The "dequoting" can be disabled with `CERC_RETAIN_ENV_QUOTES=true`.	2023-11-14 16:07:26 -06:00
iskay	f088cbb3b0	fix linter errors	2023-11-14 14:38:49 +00:00
Thomas E Lackey	f1f618c57a	Don't change the next.js version by default. (#640)	2023-11-13 11:56:04 -06:00
Nabarun Gogoi	0aca087558	Upgrade release versions for merkl and sushiswap watchers (#642) ... * Upgrade merkl-sushiswap-v3-watcher-ts release * Increase blockDelayInMilliSecs for merkl-sushiswap-v3 watcher * Upgrade sushiswap-v3-watcher-ts release * Add sushiswap-v3 watcher to stack list * Avoid mapping ports that are not required to be exposed	2023-11-13 17:36:37 +05:30
Nabarun Gogoi	a04730e7ac	Add a merkl-sushiswap-v3 watcher stack (#641) ... * Add a merkl-sushiswap-v3 watcher stack * Remove unrequired image from list	2023-11-13 11:13:55 +05:30
prathamesh0	95e881ba19	Add a sushiswap-v3 watcher stack (#638) ... * Add a sushiswap-v3 watcher stack * Add services for watcher db and server * Add service for watcher job-runner * Use 0.0.0.0 for watcher server config --------- Co-authored-by: Nabarun <nabarun@deepstacksoft.com>	2023-11-13 10:58:55 +05:30
Thomas E Lackey	414b887036	Allow setting build tool (npm/yarn) and next.js version. (#639) ... * Allow setting build tool (npm/yarn) and next.js version.	2023-11-10 17:44:25 -06:00
iskay	3db443b2bb	fix commands import	2023-11-10 20:42:02 +00:00
iskay	1072fc98c3	update fixturenet-optimism	2023-11-10 20:05:22 +00:00
Thomas E Lackey	042b413598	Support the case where webpack config is already present next.config.js (#631) ... * Support the case where webpack config is already present next.config.js * Update scripts for experimental-compile/experimental-generate	2023-11-08 23:44:48 -06:00
Thomas E Lackey	660326f713	Add new build-webapp command and related scripts and containers. (#626) ... * Add new build-webapp command and related scripts and containers.	2023-11-07 18:15:04 -06:00
David Boreham	4456e70c93	Rename app -> stack_orchestrator (#625)	2023-11-07 00:06:55 -07:00