You are currently reviewing an older revision of this page.

Running Language Weaver Edge on Kubernetes

Language Weaver Edge could easily be deployed in Kubernetes & the deployment architecture is similar to an on-prem Windows/Linux deployment. Helm charts and sample “values.yaml” files are provided by RWS for easy deployment. Kubernetes GPU nodes are preferred for Training Engines.

Minimum requirement

  1. Kubernetes cluster with node CPU/RAM totalling up to the minimum requirement.
    e.g. AKS, EKS, GKE
  2. Autoscaling is enabled in Kubernetes cluster. (optional)
  3. Ingress controller to access Kubernetes services.
    e.g. NGINX
  4. Storage classes in Kubernetes that support both RWO & RWX volume types.

Architecture

  1. Edge Controller host is deployed as a pod in Kubernetes and Edge UI & API are published as a service.
  2. Job Engines, Translation Engines & Training Engines are deployed as Stateful Sets and could be configured to auto scale based on the pod CPU usage or predefine the number of replica pods.
  3. Language Pairs and the Edge configuration is saved in persistent volumes.
  4. All pods use the same docker base image.

Deployment

  1. Helm charts & example “values.yaml” files are provided by RWS for easy deployment.
  2. Upgrades & rescaling of Edge configuration is possible with helm upgrades.
  3. Training Engines require GPU nodes in the Kubernetes cluster for better performance.
  4. LW Edge license & default admin accounts are saved as Kubernetes secrets.
  5. Persistent volume of the Controller pod could be a standard RWO storage class.
  6. Persistent volume of Language Pairs requires a high performance, case sensitive RWX storage class.
  7. Language Pairs are deployed to the persistent volume using Kubernetes Jobs.

Depending on the size of the Language Pair and I/O bandwidth, each Language Pair installation job will generally run for about 2-10 minutes.

Whilst it is possible to deploy the Edge software during Language Pair installation process, Translation Engines will not start or be usable until all the above Kubernetes jobs are completed.

Most likely used parameters are described in the sample “google.yaml” & “azure.yaml” files provided. Consult “values.yaml” inside the chart “sdl-mtedge-8.6.2.tgz” for a complete list of parameters.