165 Commits

Author	SHA1	Message	Date
Thomas E Lackey	704c42c404	Use a catchall for single page apps. (#763) ... This creates a new environment variable, CERC_SINGLE_PAGE_APP, which controls whether a catchall redirection back to / is applied. If the value is not explicitly set, we try to detect if the page looks like a single-page app. Reviewed-on: #763 Co-authored-by: Thomas E Lackey <telackey@bozemanpass.com> Co-committed-by: Thomas E Lackey <telackey@bozemanpass.com>	2024-02-23 20:32:24 +00:00
David Boreham	202f187172	Fix copy/paste error	2024-02-23 13:15:37 -07:00
David Boreham	aaed356d32	Simple container image publication (#762) ... Reviewed-on: #762 Co-authored-by: David Boreham <david@bozemanpass.com> Co-committed-by: David Boreham <david@bozemanpass.com>	2024-02-23 19:57:47 +00:00
Thomas E Lackey	2af6ffce77	Tweaks for running the container registry in k8s (#760) ... Minor tweaks for running the container-registry in k8s. The big change is not requiring --image-registry. Reviewed-on: #760 Reviewed-by: David Boreham <dboreham@noreply.git.vdb.to>	2024-02-22 21:11:06 +00:00
David Boreham	642c0ead0d	Add test for two config parameters (#758) ... Reviewed-on: #758 Co-authored-by: David Boreham <david@bozemanpass.com> Co-committed-by: David Boreham <david@bozemanpass.com>	2024-02-22 19:35:55 +00:00
Thomas E Lackey	6bd77c893a	Even more logging fixes (#757) ... Hopefully the last one for a bit. This only output the cmdline if log_file is present (ie, not to stdout). It also fixes a bug where the log_file was not passed in one line. Reviewed-on: #757 Co-authored-by: Thomas E Lackey <telackey@bozemanpass.com> Co-committed-by: Thomas E Lackey <telackey@bozemanpass.com>	2024-02-22 01:24:44 +00:00
Thomas E Lackey	4a4d48ddb9	Fix error when logging exception. (#756) ... Reviewed-on: #756 Co-authored-by: Thomas E Lackey <telackey@bozemanpass.com> Co-committed-by: Thomas E Lackey <telackey@bozemanpass.com>	2024-02-22 00:11:06 +00:00
Thomas E Lackey	08438b1cd5	More logging for webapp deployments (#755) ... Reviewed-on: #755 Co-authored-by: Thomas E Lackey <telackey@bozemanpass.com> Co-committed-by: Thomas E Lackey <telackey@bozemanpass.com>	2024-02-21 23:48:52 +00:00
Thomas E Lackey	9f1dd284a5	Better error logging for registry deployments. (#754) ... We were missing errors related to registration, this should fix that. Reviewed-on: #754 Co-authored-by: Thomas E Lackey <telackey@bozemanpass.com> Co-committed-by: Thomas E Lackey <telackey@bozemanpass.com>	2024-02-21 20:12:52 +00:00
Thomas E Lackey	db4986dcc6	snowballtool-base backend stack (#751) ... This adds a stack for the backend from snowball/snowballtools-base. Reviewed-on: #751 Co-authored-by: Thomas E Lackey <telackey@bozemanpass.com> Co-committed-by: Thomas E Lackey <telackey@bozemanpass.com>	2024-02-21 04:45:46 +00:00
Thomas E Lackey	65f05ea80c	Run a manual build script, if present. (#750) ... If the tree has a 'build-webapp.sh' script, use that. Reviewed-on: #750 Co-authored-by: Thomas E Lackey <telackey@bozemanpass.com> Co-committed-by: Thomas E Lackey <telackey@bozemanpass.com>	2024-02-21 00:20:50 +00:00
zramsay	01f9fe67ed	add Mars v2 interface (#744) ... Tested on DO with real funds on mainnet Co-authored-by: zramsay <zach@bluecollarcoding.ca> Reviewed-on: #744	2024-02-19 19:11:59 +00:00
David Boreham	39f4fa4487	Container Registry Stack (#747) ... Co-authored-by: David Boreham <david@bozemanpas.com> Reviewed-on: #747 Co-authored-by: David Boreham <david@bozemanpass.com> Co-committed-by: David Boreham <david@bozemanpass.com>	2024-02-18 18:55:55 +00:00
David Boreham	37b9500483	Support non-tls ingress for kind (#748) ... Reviewed-on: #748 Co-authored-by: David Boreham <david@bozemanpass.com> Co-committed-by: David Boreham <david@bozemanpass.com>	2024-02-17 01:54:30 +00:00
Thomas E Lackey	3c3e582939	Minor envsubst improvements. (#746) ... Minor fixes to envsubst for webapps. Somewhat specially treated is `LACONIC_HOSTED_CONFIG_homepage` which can be used to replace the homepage in package.json. With react, this gets an extra `/` though, which we need to remove. Reviewed-on: #746 Co-authored-by: Thomas E Lackey <telackey@bozemanpass.com> Co-committed-by: Thomas E Lackey <telackey@bozemanpass.com>	2024-02-16 04:11:09 +00:00
David Boreham	d9bb6b3588	Test Database Stack (#737) ... Reviewed-on: #737	2024-02-15 05:26:29 +00:00
Thomas E Lackey	b22c72e715	For k8s, use provisioner-managed volumes when an absolute host path is not specified. (#741) ... In kind, when we bind-mount a host directory it is first mounted into the kind container at /mnt, then into the pod at the desired location. We accidentally picked this up for full-blown k8s, and were creating volumes at /mnt. This changes the behavior for both kind and regular k8s so that bind mounts are only allowed if a fully-qualified path is specified. If no path is specified at all, a default storageClass is assumed to be present, and the volume managed by a provisioner. Eg, for kind, the default provisioner is: https://github.com/rancher/local-path-provisioner ``` stack: test deploy-to: k8s-kind config: test-variable-1: test-value-1 network: ports: test: - '80' volumes: # this will be bind-mounted to a host-path test-data-bind: /srv/data # this will be managed by the k8s node test-data-auto: configmaps: test-config: ./configmap/test-config ``` Reviewed-on: #741 Co-authored-by: Thomas E Lackey <telackey@bozemanpass.com> Co-committed-by: Thomas E Lackey <telackey@bozemanpass.com>	2024-02-14 21:45:01 +00:00
Thomas E Lackey	c9444591f5	Fix default webapp port number. (#740) ... Reviewed-on: #740 Co-authored-by: Thomas E Lackey <telackey@bozemanpass.com> Co-committed-by: Thomas E Lackey <telackey@bozemanpass.com>	2024-02-09 01:20:41 +00:00
Thomas E Lackey	903f3b10e2	Add support for annotations and labels in spec. (#739) ... ``` stack: webapp-deployer-backend deploy-to: k8s annotations: foo.bar.annot/{name}: baz labels: a.b.c/{name}.blah: "value" ``` Reviewed-on: #739 Co-authored-by: Thomas E Lackey <telackey@bozemanpass.com> Co-committed-by: Thomas E Lackey <telackey@bozemanpass.com>	2024-02-09 00:11:07 +00:00
Thomas E Lackey	72ed2eb91a	Fix bad test in tag check. (#738) ... Reviewed-on: #738 Co-authored-by: Thomas E Lackey <telackey@bozemanpass.com> Co-committed-by: Thomas E Lackey <telackey@bozemanpass.com>	2024-02-08 20:38:41 +00:00
David Boreham	2104eb5f30	Merge pull request 'Add Mars stack' (#725) from zach/mars into main ... Reviewed-on: #725 Reviewed-by: David Boreham <dboreham@noreply.git.vdb.to>	2024-02-08 20:30:47 +00:00
zramsay	afd6be3b13	Ping pub (#663) ... for #170, revives #190 uses https://github.com/LaconicNetwork/explorer/pull/1 Co-authored-by: zramsay <zach@bluecollarcoding.ca> Co-authored-by: David Boreham <david@bozemanpass.com> Reviewed-on: #663 Co-authored-by: zramsay <zramsay@noreply.git.vdb.to> Co-committed-by: zramsay <zramsay@noreply.git.vdb.to>	2024-02-08 20:13:12 +00:00
David Boreham	f914baa913	Merge branch 'main' into zach/mars	2024-02-08 19:52:49 +00:00
David Boreham	8be1e684e8	Process environment variables defined in compose files (#736) ... Reviewed-on: #736 Co-authored-by: David Boreham <david@bozemanpass.com> Co-committed-by: David Boreham <david@bozemanpass.com>	2024-02-08 19:41:57 +00:00
Thomas E Lackey	3309782439	Refactor	2024-02-08 00:47:46 -06:00
Thomas E Lackey	4b3b3478e7	Switch to Docker-style limits	2024-02-08 00:43:41 -06:00
Thomas E Lackey	2a9955055c	debug	2024-02-07 16:56:35 -06:00
Thomas E Lackey	8964e1c0fe	Add resource limit options to spec.	2024-02-07 16:48:02 -06:00
Thomas E Lackey	d2ebb81d77	Tags for undeploy (#734) ... ``` --include-tags TEXT Only include requests with matching tags (comma-separated). --exclude-tags TEXT Exclude requests with matching tags (comma- separated). ``` Reviewed-on: #734 Co-authored-by: Thomas E Lackey <telackey@bozemanpass.com> Co-committed-by: Thomas E Lackey <telackey@bozemanpass.com>	2024-02-07 21:45:16 +00:00
Thomas E Lackey	4a981d8d2e	Fix repo URL (#733) ... Needs a '/' (http) not ':' (ssh). Reviewed-on: #733 Co-authored-by: Thomas E Lackey <telackey@bozemanpass.com> Co-committed-by: Thomas E Lackey <telackey@bozemanpass.com>	2024-02-07 18:52:07 +00:00
Thomas E Lackey	88a0236ca9	Add the ability to filter deployment requests by tag. (#730) ... Reviewed-on: #730	2024-02-07 03:12:40 +00:00
Thomas E Lackey	937b983ec9	Update links from github.com to git.vdb.to (#732) ... Update links and references to github.com to git.vdb.to. Also enable the flake8 lint action in gitea. Reviewed-on: #732 Co-authored-by: Thomas E Lackey <telackey@bozemanpass.com> Co-committed-by: Thomas E Lackey <telackey@bozemanpass.com>	2024-02-06 22:42:44 +00:00
David Boreham	bfbcfb7904	Volume processing fixes (#729)	2024-02-06 12:32:10 -07:00
David Boreham	3d5ececba5	Remove duplicate plugin paths and resulting extraneous error message (#728)	2024-02-06 11:59:37 -07:00
David Boreham	6848fc33cf	Implement dry run support for k8s deploy (#727)	2024-02-06 07:07:56 -07:00
Thomas E Lackey	36bb068983	Add ConfigMap test. (#726) ... * Add ConfigMap test. * eof * Minor tweak * Trigger test --------- Co-authored-by: David Boreham <david@bozemanpass.com>	2024-02-05 14:15:11 -06:00
David Boreham	25a2b70f2c	Fix command in mainnet-eth docs	2024-02-03 18:25:02 -07:00
Thomas E Lackey	2fcd416e29	Basic webapp deployer stack. (#722)	2024-02-02 19:05:15 -07:00
Thomas E Lackey	6629017d6a	Support other webapp types (react, static). (#721) ... * Support other webapp types (react, static).	2024-02-02 18:04:06 -06:00
Thomas E Lackey	b398050787	Don't include volumes in spec if we don't have any. (#720)	2024-01-31 15:11:32 -06:00
Thomas E Lackey	12ec1bec43	Add ConfigMap support for k8s. (#714) ... * Minor fixes for deploying with k8s and podman. * ConfigMap support	2024-01-30 23:09:48 -06:00
Thomas E Lackey	62af03077f	Add deployed/error status output to the state file. (#719) ... * More status info * Up default resource limits. * Need ps	2024-01-30 22:13:45 -06:00
Zach	098567625a	Create README.md	2024-01-30 17:47:56 -05:00
Thomas E Lackey	428b05158e	Fix DnsRecord ownership check. (#718) ... * Fix DnsRecord ownership check. * Var names	2024-01-30 13:31:59 -06:00
zramsay	23ee3e19b7	mars: add env vars to docker-compose	2024-01-29 22:44:55 +00:00
zramsay	2d764fc7d0	basic mars stack	2024-01-29 16:00:58 +00:00
Thomas E Lackey	554f05de87	Fix pip3 error (#709)	2024-01-22 21:06:15 -06:00
prathamesh0	282e175566	Remove unnecessary hyperlinks and pin image versions (#706) ... * Remove invalid dashboard and panel ids from alert rules * Pin grafana and prometheus versions * Configure custom grafana server URL	2024-01-17 14:02:10 +05:30
David Boreham	1f9653e6f7	Fix kind mode and add k8s deployment test (#704) ... * Fix kind mode and add k8s deployment test * Fix lint errors	2024-01-16 15:55:58 -07:00
Thomas E Lackey	0587813dd0	Create next.config.js if it is missing. (#701) ... * Create next.config.js if it is missing. * Add comment.	2024-01-15 12:12:59 -06:00
Thomas E Lackey	4b3ea7c30f	Update independent act-runner stack to use custom act as well. (#702) ... * Update independent act-runner stack to use custom act as well. * Remove branches which are not needed or already merged.	2024-01-15 12:10:48 -06:00
Nabarun Gogoi	db8aec52aa	Pin commit hash of asset list repo in osmosis frontend app (#703)	2024-01-15 16:56:06 +05:30
Thomas E Lackey	b83030f63b	Use custom act with gitea. (#700) ... * Use custom act with gitea. * Make sure wget is available * Fix repo url	2024-01-09 22:53:43 -06:00
prathamesh0	a3eb3c0bb0	Setup basic alerting for watchers in monitoring stack (#698) ... * Provision Grafana alert contactpoints and policies for Slack * Add watcher alert rules * Update watcher monitoring instructions * Add listening port flag to node exporter command * Add reference links	2024-01-08 17:25:30 +05:30
Nabarun Gogoi	eae2af7ccc	Upgrade watcher versions (#699)	2024-01-08 11:51:54 +05:30
Thomas E Lackey	837e443800	Support application removal requests. (#697) ... * Support application removal request. * Git should never prompt when deploying a webapp	2023-12-21 18:05:40 -06:00
prathamesh0	a57b0cdd26	Add a stack for prom node exporter and its dashboard in monitoring stack (#696) ... * Add a stack for Prometheus node exporter * Add node exporter dashboard to monitoring stack	2023-12-21 15:15:03 +05:30
prathamesh0	38622fb33c	[WIP] Use templating for watcher dashboard and add Postgres exporter (#695) ... * Add Postgres exporter and it's dashboard * Use templating for watcher dashboard * Add subgraph related panels to watcher dashboard * Remove individual watcher dashboards and update instructions	2023-12-21 13:41:36 +05:30
prathamesh0	4a1a46facc	Update monitoring stack with additional dashboards and watcher metrics (#693) ... * Include retry jobs and update default refresh intervals * Add prometheus blackbox exporter and it's dashboard * Add NodeJS application dashboard * Allow UI updates * Update watcher dashboards for upstream and external chain heads * Update watcher dashboards with watcher config metrics * Upgrade sushiswap and azimuth watchers * Removed fixed title size values * Update instructions * Update instructions for env config * Update instructions with setup	2023-12-21 09:26:37 +05:30
Zach	42b92f7e23	use square logo for an urbit tile (#689) ... * use square logo for an urbit tile * bump version, improve info text	2023-12-19 09:50:14 -05:00
Nabarun Gogoi	def192edab	Update new environment values for Osmosis frontend app (#694) ... * Update new env values for Osmosis frontend app * Use .env.production instead of local	2023-12-18 17:49:45 +05:30
David Boreham	d8357df345	Add image pull secret to pods (#692)	2023-12-15 14:27:45 -07:00
Thomas E Lackey	997496b8a5	Update script for new nextjs build output. (#691)	2023-12-14 19:47:30 -06:00
Thomas E Lackey	61f2884505	Reduce base image size (first round of improvements) (#690)	2023-12-14 17:46:03 -06:00
Thomas E Lackey	27a14737f8	Make the container tag based on the deployment path. (#688)	2023-12-14 09:49:21 -06:00
prathamesh0	b9b758bfdd	Add a stack for running Osmosis frontend app on Urbit (#683) ... * Deploy osmosis on Urbit fake ship * Remove Urbit configuration from existing osmosis stack * Add a separate stack for Osmosis front end on Urbit * Run script for renaming build files with bash * Add environment variables required in urbit osmosis build * Fix BASEPATH in compose file * Remove ipfs-glob-host from network config in osmosis readme * Use laconic branch for osmosis frontend --------- Co-authored-by: Nabarun <nabarun@deepstacksoft.com>	2023-12-14 17:28:10 +05:30
prathamesh0	9ba410b095	Add a stack for monitoring watchers with prometheus and grafana (#687) ... * Setup Prometheus and Grafana for monitoring stack * Add dashboard for azimuth watchers * Add a dashboard for sushiswap watcher * Persist prometheus server data * Additional metrics in watcher dashboards * Update dashboards and add for merkl sushiswap watcher * Add dashboards for remaining azimuth watchers * Separate out preconfigured watcher dashboards and add instructions * Keep the empty dashboards dir	2023-12-14 16:59:00 +05:30
Thomas E Lackey	1f4eb57069	Add --dry-run option (#686)	2023-12-13 22:56:40 -06:00
Thomas E Lackey	88f66a3626	Add deployment update and deploy-webapp-from-registry commands. (#676)	2023-12-13 21:02:34 -06:00
prathamesh0	1ef0b316c6	Expose metrics endpoints for sushiswap and merkl sushiswap watchers (#685)	2023-12-13 14:58:26 +05:30
prathamesh0	232d5618cb	Update instructions in osmosis stack (#684)	2023-12-12 13:54:00 +05:30
Nabarun Gogoi	fa6b570f4a	Add stack for running osmosis frontend app (#673) ... * osmosis FE stack * chmod * dont use 3000 * fix for neww stack format * updates * update osmosis readme * Update stack.yml * Update osmosis frontend stack to serve app * Host osmosis app static build using python server * Fix mapped ports in deployment for containers * Update instructions * Use nginx server to host files and handle page reloads * Fix typo --------- Co-authored-by: zramsay <zach@bluecollarcoding.ca> Co-authored-by: Prathamesh Musale <prathamesh.musale0@gmail.com>	2023-12-11 14:10:54 +05:30
prathamesh0	f9eb5a4ba8	Refactor to make Urbit setup generic (#682) ... * Refactor to make Urbit app deployment script generic * Rename urbit pod and update instructions * Add a flag to allow skipping app installation on Urbit * Make remote Urbit app deployment scripts generic * Move remote deployment scripts to urbit fixturenet * Update and use existing kubo pod for Urbit glob hosting	2023-12-08 09:35:00 +05:30
Thomas E Lackey	077ea80c70	Add deployment status command and fix k8s output for deployment ps (#679)	2023-12-06 09:27:47 -07:00
David Boreham	15faed00de	Generate a unique deployment id for each deployment (#680) ... * Move cluster name generation into a function * Generate a unique deployment id for each deployment	2023-12-05 22:56:58 -07:00
prathamesh0	6bef0c5b2f	Separate out GQL proxy server from uniswap-urbit stack (#681) ... * Separate out uniswap gql proxy in a stack * Use proxy server from watcher-ts * Add a flag to enable/disable the proxy server * Update env configuratoin for uniswap urbit app stack * Update stack file for uniswap urbit app stack * Fix env variables in instructions	2023-12-06 10:41:10 +05:30
prathamesh0	f27da19808	Use IPFS for hosting glob files for Urbit (#677) ... * Use IPFS for hosting glob files for Urbit * Add env configuration for IPFS endpoints to instructions * Make ship pier dir configurable in remote deployment script * Update remote deployment script to accept glob hash arg	2023-12-05 15:00:03 +05:30
Thomas E Lackey	2dd54892a1	Allow specifying the webapp tag explicitly (#675)	2023-12-04 21:39:16 -06:00
Thomas E Lackey	ab0e70ed83	Change path portion of unique cluster name to point to compose file, not argv[0]. (#678)	2023-12-04 13:39:14 -06:00
Nabarun Gogoi	c319e90ddd	Add a stack for running uniswap frontend on urbit (#670) ... * Create uniswap-frontend stack * Add stack for building uniswap frontend app * Add a container for Urbit fake ship * Update with deployment command * Add a service for uniswap app deployment to urbit * Use a script to start urbit ship to handle restarts * Rename stack name to uniswap-urbit-app * Rename build.sh to build-app.sh and check if build already exists * Rename stack directory name * Update uniswap build restart on failure * Perform uniswap app deployment in the urbit container * Add steps to create glob for the app * Tail /dev/null after deployment * Add steps to install the app to desk * Host glob files for uniswap * Update repo branch * Update readme with command to get urbit password * Update readme * Update readme to open urbit web UI * Expose the port on glob hosting container * Avoid exposing urbit http port * Add scripts for installing uniswap on remote urbit instance * Configure GQL proxy for uniswap app * Use laconic branch for app repo * Rename urbit pod for uniswap app deployment --------- Co-authored-by: Prathamesh Musale <prathamesh.musale0@gmail.com>	2023-12-04 18:39:19 +05:30
Thomas E Lackey	2173e7ce6a	If the next version is unsupported, print a big warning and try higher version. (#674)	2023-11-30 12:33:06 -06:00
David Boreham	d7093277b4	Use constants (#671)	2023-11-29 20:50:53 -07:00
Thomas E Lackey	03a3645b3c	Add --port option to run-webapp. (#667) ... * Add --port option to run-webapp * Fixed merge * lint	2023-11-29 11:32:28 -06:00
David Boreham	113c0bfbf1	Propagate env file for webapp deployment (#669)	2023-11-28 21:14:02 -07:00
David Boreham	1a069a6816	Use a temp file for the spec file name (#668)	2023-11-28 19:56:12 -07:00
David Boreham	a68cd5d65c	Webapp deploy (#662)	2023-11-27 22:02:16 -07:00
Nabarun Gogoi	1b94db27c1	Upgrade azimuth watcher release version to 0.1.2 (#666) ... * Upgrade azimuth watcher release version * Fix version for azimuth watcher repo	2023-11-24 14:05:37 +05:30
prathamesh0	9499941891	Increase max connections for Azimuth watcher dbs (#665)	2023-11-23 19:11:02 +05:30
Nabarun Gogoi	3fefc67e77	Run azimuth contract watcher in active mode (#661) ... * Update stack to run azimuth job runner * Run azimuth watcher in active mode * Update stack to run job-runners for all watchers * Update ports in job-runner health checks * Map metrics ports to host * Configure historical block processing batch size for Azimuth watcher * Use deployment command for azimuth stack --------- Co-authored-by: neeraj <neeraj.rtly@gmail.com> Co-authored-by: Prathamesh Musale <prathamesh.musale0@gmail.com>	2023-11-23 15:00:18 +05:30
Thomas E Lackey	1a37255c18	Tweak laconicd config to allow setting endpoint port and to make the fixturenet restartable. (#660) ... * Endpoint includes port * Make it restartable * Don't try to remove the mounted directory * Make copy of init.sh	2023-11-22 11:31:30 -06:00
David Boreham	87bedde5cb	Support for k8s ingress and tls (#659)	2023-11-21 16:04:36 -07:00
David Boreham	01029cf7aa	Fix for code path that doesn't create a DeploymentContext (#658)	2023-11-21 08:35:31 -07:00
Nabarun Gogoi	0b87c12c13	Upgrade merkl and sushiswap watcher to v0.1.4 (#657) ... * Upgrade merkl and sushi watcher versions * Set gqlPath to base URL and remove filling start block * Upgrade watcher versions to 0.1.4	2023-11-21 19:07:09 +05:30
David Boreham	f6624cb33a	Add image push command (#656)	2023-11-20 20:23:55 -07:00
David Boreham	c9c6a0eee3	Changes for remote k8s (#655)	2023-11-20 09:12:57 -07:00
Thomas E Lackey	5c80887215	Fix missing tty parameter. (#653)	2023-11-16 12:58:03 -06:00
Ian	80c4b9214b	Merge pull request #643 from cerc-io/iskay/update-optimism ... Iskay/update optimism	2023-11-16 12:31:57 -05:00
Nabarun Gogoi	70529c43e7	Upgrade merkl and sushiswap watcher versions (#654)	2023-11-16 16:27:41 +05:30
Thomas E Lackey	2059d67dca	Add run-webapp command. (#651)	2023-11-15 10:54:27 -07:00
David Boreham	638fa01649	Support external stack file (#650)	2023-11-14 20:59:48 -07:00