Volcano Scheduler charm
Volcano is a batch system built on Kubernetes.
It provides a suite of mechanisms that are commonly required by many classes of batch & elastic workload including: machine learning/deep learning, bioinformatics/genomics and other “big data” applications. These types of applications typically run on generalized domain frameworks like TensorFlow, Spark, Ray, PyTorch, MPI, etc, which Volcano integrates with.
This work is based on the upstream project volcano.sh.
Deploying the volcano charms
Prerequisites
The Volcano charms must be deployed in a Kubernetes model on your cluster, not
a machine model (i.e., it runs on Kubernetes). These instructions assume you
have read and followed the instructions for
adding your Charmed Kubernetes cluster to your Juju controller.
These instructions assume you have a cluster registered with Juju and named ck8s. Please
adjust the commands given appropriately if you have used a different name.
Assuming you have a Charmed Kubernetes deployment running and have copied the kube config file from your control-plane:
If necessary, add a new model to deploy the Volcano charm into. Adding a model creates a Kubernetes namespace behind the scenes:
juju add-model volcano-system ck8s
Next, deploy the Volcano charms. Note that it must be deployed using --trust:
juju deploy volcano --trust
The --trust switch means that the Volcano charms will have access to the Juju credentials required to add/remove CRD and webhook.
Integrations
Certificates
The volcano-admission service is exposed as a service on port 443 for internal communication and comes
by default with self-signed certificates for this service. Its possible to relate to a certificate
provider and have its certs generated by a trusted third-party like Vault or EasyRSA.
CERT_MODEL=<name of certificate model>
juju switch $CERT_MODEL
juju offer <certificate-application>:client certificates
juju switch volcano-system
juju consume admin/${CERT_MODEL}.certificates
juju relate volcano-admission:certificates certificates