Science Platform operations

The Rubin Science Platform is described in LDM-542. This document contains operational notes of interest to administrators of the Science Platform and maintainers of applications deployed via the Science Platform, but not of interest to users.

For user documentation of the Notebook Aspect of the Rubin Science Platform, see nb.lsst.io.

The Science Platform uses Argo CD to manage its Kubernetes resources. The Argo CD configuration and this documentation are maintained on GitHub.

A phalanx is a SQuaRE deployment (Science Quality and Reliability Engineering, the team responsible for the Rubin Science Platform). Phalanx is how we ensure that all of our services work together as a unit.

Overview

Intended audience: Anyone who is administering an installation of the Rubin Science Platform or maintaining an application deployed on it.

• Introduction to Kubernetes and Argo CD
• Repository structure
  • Layout
  • Charts
  • Chart versioning
• Secrets
  • Vault
  • 1Password

Application maintenance guide

Intended audience: Maintainers of applications deployed on the Rubin Science Platform.

• Syncing Argo CD
• Upgrading an application
• Add new application
• Add a secret with 1Password and VaultSecret
  • Part 1. Open the 1Password vault
  • Part 2. Create a Secret Note
  • Part 3. Sync 1Password items into Vault
  • Next steps: connecting Vault to Kubernetes with VaultSecret

Operations guide

Intended audience: Administrators of an installation of the Rubin Science Platform.

Applications

• Argo CD
  • Upgrading Argo CD
  • Argo CD authentication
• cachemachine
  • Image pruning
  • Updating “recommended”
• cert-issuer
  • Setting up Route 53 for cert-issuer
  • Bootstrapping cert-issuer
• cert-manager
• gafaelfawr
  • Debugging authentication issues
  • Configuring storage
• ingress-nginx
  • TLS certificates
• logging
• nublado2
  • Database surgery
• postgres
  • Recreating postgres PV/PVC
• rancher-external-ip-webhook
• squash-api
• vault-secrets-operator

Bootstrapping

• Bootstrapping a new deployment
  • Checklist
  • Hostnames and TLS
  • Application notes

Troubleshooting

• Troubleshooting the Rubin Science Platform
  • Overview