Running Language Weaver Edge on Kubernetes

Brian John — Fri, 13 Oct 2023 10:40:39 GMT

Current Revision posted to Wiki by Brian John on 10/13/2023 10:40:39 AM

Language Weaver Edge could easily be deployed in Kubernetes & the deployment architecture is similar to an on-prem Windows/Linux deployment. Helm charts and sample “values.yaml” files are provided by RWS for easy deployment. Kubernetes GPU nodes are preferred for Training Engines.

Minimum requirement

Kubernetes cluster with node CPU/RAM totalling up to the minimum requirement.
e.g. AKS, EKS, GKE
Autoscaling is enabled in Kubernetes cluster. (optional)
Ingress controller to access Kubernetes services.
e.g. NGINX
Storage classes in Kubernetes that support both RWO & RWX volume types.

Architecture

Edge Controller host is deployed as a pod in Kubernetes and Edge UI & API are published as a service.
Job Engines, Translation Engines & Training Engines are deployed as Stateful Sets and could be configured to auto scale based on the pod CPU usage or predefine the number of replica pods.
Language Pairs and the Edge configuration is saved in persistent volumes.
All pods use the same docker base image.

Deployment

Helm charts & example “values.yaml” files are provided by RWS for easy deployment.
Upgrades & rescaling of Edge configuration is possible with helm upgrades.
Training Engines require GPU nodes in the Kubernetes cluster for better performance.
LW Edge license & default admin accounts are saved as Kubernetes secrets.
Persistent volume of the Controller pod could be a standard RWO storage class.
Persistent volume of Language Pairs requires a high performance, case sensitive RWX storage class.
Language Pairs are deployed to the persistent volume using Kubernetes Jobs.

Depending on the size of the Language Pair and I/O bandwidth, each Language Pair installation job will generally run for about 2-10 minutes.

Whilst it is possible to deploy the Edge software during Language Pair installation process, Translation Engines will not start or be usable until all the above Kubernetes jobs are completed.

Most likely used parameters are described in the sample “google.yaml” & “azure.yaml” files provided. Consult “values.yaml” inside the chart “sdl-mtedge-8.6.2.tgz” for a complete list of parameters.

Reconfigure

Language Weaver Edge instance in a Kubernetes cluster could be reconfigured/resized while the Language Weaver Edge service is running. Reconfiguration can be performed using a helm upgrade or directly modifying relevant Kubernetes objects. The simplest way is to modify the “values.yaml” and run a helm upgrade.

Typical values that could be changed while the system is running are:

Bootstrap Language Weaver Edge admin user.
Install new Language Pairs.
Increase/Decrease the size of the pool of Job Engines, Training Engines or add/modify the pool of Translation Engines for a given Language Pair.
Auto scale the number of Translation Engines, depending on the system load.

Environment Variables

Custom environment variables could be set independently for:

Controller pod.
Job Engine pods - all pods share the same environment variables.
Translation Engine pods - each Language Pair has its own environment variables.
Training Engine pods - all pods share the same environment variables.

Edge API

The API key is automatically prefixed with “u_” + username + ”_” when created.

For an example, to make a REST API call for user admin@example.com with API key myapikey1234

$ curl -u u_admin@example.com_myapikey1234: https://myhost.example.com/api/v2/

Running Language Weaver Edge on Kubernetes

Brian John — Fri, 06 Oct 2023 10:52:55 GMT

Revision 26 posted to Wiki by Brian John on 10/6/2023 10:52:55 AM

Minimum requirement

Kubernetes cluster with node CPU/RAM totalling up to the minimum requirement.
e.g. AKS, EKS, GKE
Autoscaling is enabled in Kubernetes cluster. (optional)
Ingress controller to access Kubernetes services.
e.g. NGINX
Storage classes in Kubernetes that support both RWO & RWX volume types.

Architecture

Edge Controller host is deployed as a pod in Kubernetes and Edge UI & API are published as a service.
Job Engines, Translation Engines & Training Engines are deployed as Stateful Sets and could be configured to auto scale based on the pod CPU usage or predefine the number of replica pods.
Language Pairs and the Edge configuration is saved in persistent volumes.
All pods use the same docker base image.

Deployment

Helm charts & example “values.yaml” files are provided by RWS for easy deployment.
Upgrades & rescaling of Edge configuration is possible with helm upgrades.
Training Engines require GPU nodes in the Kubernetes cluster for better performance.
LW Edge license & default admin accounts are saved as Kubernetes secrets.
Persistent volume of the Controller pod could be a standard RWO storage class.
Persistent volume of Language Pairs requires a high performance, case sensitive RWX storage class.
Language Pairs are deployed to the persistent volume using Kubernetes Jobs.

Depending on the size of the Language Pair and I/O bandwidth, each Language Pair installation job will generally run for about 2-10 minutes.

Whilst it is possible to deploy the Edge software during Language Pair installation process, Translation Engines will not start or be usable until all the above Kubernetes jobs are completed.

Reconfigure

Typical values that could be changed while the system is running are:

Bootstrap Language Weaver Edge admin user.
Install new Language Pairs.
Increase/Decrease the size of the pool of Job Engines, Training Engines or add/modify the pool of Translation Engines for a given Language Pair.
Auto scale the number of Translation Engines, depending on the system load.

Environment Variables

Custom environment variables could be set independently for:

Controller pod.
Job Engine pods - all pods share the same environment variables.
Translation Engine pods - each Language Pair has its own environment variables.
Training Engine pods - all pods share the same environment variables.

Edge API

The API key is automatically prefixed with “u_” + username + ”_” when created.

For an example, to make a REST API call for user admin@example.com with API key myapikey1234

$ curl -u u_admin@example.com_myapikey1234 https://myhost.example.com/api/v2/

Running Language Weaver Edge on Kubernetes

Brian John — Fri, 06 Oct 2023 10:42:21 GMT

Revision 25 posted to Wiki by Brian John on 10/6/2023 10:42:21 AM

Minimum requirement

Kubernetes cluster with node CPU/RAM totalling up to the minimum requirement.
e.g. AKS, EKS, GKE
Autoscaling is enabled in Kubernetes cluster. (optional)
Ingress controller to access Kubernetes services.
e.g. NGINX
Storage classes in Kubernetes that support both RWO & RWX volume types.

Architecture

Edge Controller host is deployed as a pod in Kubernetes and Edge UI & API are published as a service.
Job Engines, Translation Engines & Training Engines are deployed as Stateful Sets and could be configured to auto scale based on the pod CPU usage or predefine the number of replica pods.
Language Pairs and the Edge configuration is saved in persistent volumes.
All pods use the same docker base image.

Deployment

Helm charts & example “values.yaml” files are provided by RWS for easy deployment.
Upgrades & rescaling of Edge configuration is possible with helm upgrades.
Training Engines require GPU nodes in the Kubernetes cluster for better performance.
LW Edge license & default admin accounts are saved as Kubernetes secrets.
Persistent volume of the Controller pod could be a standard RWO storage class.
Persistent volume of Language Pairs requires a high performance, case sensitive RWX storage class.
Language Pairs are deployed to the persistent volume using Kubernetes Jobs.

Depending on the size of the Language Pair and I/O bandwidth, each Language Pair installation job will generally run for about 2-10 minutes.

Whilst it is possible to deploy the Edge software during Language Pair installation process, Translation Engines will not start or be usable until all the above Kubernetes jobs are completed.

Reconfigure

Typical values that could be changed while the system is running are:

Bootstrap Language Weaver Edge admin user.
Install new Language Pairs.
Increase/Decrease the size of the pool of Job Engines, Training Engines or add/modify the pool of Translation Engines for a given Language Pair.
Auto scale the number of Translation Engines, depending on the system load.

Environment Variables

Custom environment variables could be set independently for:

Controller pod.
Job Engine pods - all pods share the same environment variables.
Translation Engine pods - each Language Pair has its own environment variables.
Training Engine pods - all pods share the same environment variables.

Edge API

The API key is automatically prefixed with “u_” + username + ”_” when created.

For an example, to make a REST API call for user admin@example.com with API key myapikey1234

$ curl -u u_admin@example.com_myapikey1234 https://myhost.example.com/api/v2/

Running Language Weaver Edge on Kubernetes

Brian John — Fri, 06 Oct 2023 10:41:59 GMT

Revision 24 posted to Wiki by Brian John on 10/6/2023 10:41:59 AM

Minimum requirement

Kubernetes cluster with node CPU/RAM totalling up to the minimum requirement.
e.g. AKS, EKS, GKE
Autoscaling is enabled in Kubernetes cluster. (optional)
Ingress controller to access Kubernetes services.
e.g. NGINX
Storage classes in Kubernetes that support both RWO & RWX volume types.

Architecture

Edge Controller host is deployed as a pod in Kubernetes and Edge UI & API are published as a service.
Job Engines, Translation Engines & Training Engines are deployed as Stateful Sets and could be configured to auto scale based on the pod CPU usage or predefine the number of replica pods.
Language Pairs and the Edge configuration is saved in persistent volumes.
All pods use the same docker base image.

Deployment

Helm charts & example “values.yaml” files are provided by RWS for easy deployment.
Upgrades & rescaling of Edge configuration is possible with helm upgrades.
Training Engines require GPU nodes in the Kubernetes cluster for better performance.
LW Edge license & default admin accounts are saved as Kubernetes secrets.
Persistent volume of the Controller pod could be a standard RWO storage class.
Persistent volume of Language Pairs requires a high performance, case sensitive RWX storage class.
Language Pairs are deployed to the persistent volume using Kubernetes Jobs.

Depending on the size of the Language Pair and I/O bandwidth, each Language Pair installation job will generally run for about 2-10 minutes.

Whilst it is possible to deploy the Edge software during Language Pair installation process, Translation Engines will not start or be usable until all the above Kubernetes jobs are completed.

Reconfigure

Typical values that could be changed while the system is running are:

Bootstrap Language Weaver Edge admin user.
Install new Language Pairs.
Increase/Decrease the size of the pool of Job Engines, Training Engines or add/modify the pool of Translation Engines for a given Language Pair.
Auto scale the number of Translation Engines, depending on the system load.

Environment Variables

Custom environment variables could be set independently for:

Controller pod.
Job Engine pods - all pods share the same environment variables.
Translation Engine pods - each Language Pair has its own environment variables.
Training Engine pods - all pods share the same environment variables.

Edge API

The API key is automatically prefixed with “u_” + username + ”_” when created.

For an example, to make a REST API call for user admin@example.com with API key myapikey1234

$ curl -u u_admin@example.com_myapikey1234 https://myhost.example.com/api/v2/

Running Language Weaver Edge on Kubernetes

Brian John — Fri, 06 Oct 2023 10:41:20 GMT

Revision 23 posted to Wiki by Brian John on 10/6/2023 10:41:20 AM

Minimum requirement

Kubernetes cluster with node CPU/RAM totalling up to the minimum requirement.
e.g. AKS, EKS, GKE
Autoscaling is enabled in Kubernetes cluster. (optional)
Ingress controller to access Kubernetes services.
e.g. NGINX
Storage classes in Kubernetes that support both RWO & RWX volume types.

Architecture

Edge Controller host is deployed as a pod in Kubernetes and Edge UI & API are published as a service.
Job Engines, Translation Engines & Training Engines are deployed as Stateful Sets and could be configured to auto scale based on the pod CPU usage or predefine the number of replica pods.
Language Pairs and the Edge configuration is saved in persistent volumes.
All pods use the same docker base image.

Deployment

Helm charts & example “values.yaml” files are provided by RWS for easy deployment.
Upgrades & rescaling of Edge configuration is possible with helm upgrades.
Training Engines require GPU nodes in the Kubernetes cluster for better performance.
LW Edge license & default admin accounts are saved as Kubernetes secrets.
Persistent volume of the Controller pod could be a standard RWO storage class.
Persistent volume of Language Pairs requires a high performance, case sensitive RWX storage class.
Language Pairs are deployed to the persistent volume using Kubernetes Jobs.

Depending on the size of the Language Pair and I/O bandwidth, each Language Pair installation job will generally run for about 2-10 minutes.

Whilst it is possible to deploy the Edge software during Language Pair installation process, Translation Engines will not start or be usable until all the above Kubernetes jobs are completed.

Reconfigure

Typical values that could be changed while the system is running are:

Bootstrap Language Weaver Edge admin user.
Install new Language Pairs.
Increase/Decrease the size of the pool of Job Engines, Training Engines or add/modify the pool of Translation Engines for a given Language Pair.
Auto scale the number of Translation Engines, depending on the system load.

Edge API

The API key is automatically prefixed with “u_” + username + ”_” when created.

For an example, to make a REST API call for user admin@example.com with API key myapikey1234

$ curl -u u_admin@example.com_myapikey1234 https://myhost.example.com/api/v2/

Environment Variables

Custom environment variables could be set independently for:

Controller pod.
Job Engine pods - all pods share the same environment variables.
Translation Engine pods - each Language Pair has its own environment variables.
Training Engine pods - all pods share the same environment variables.

Running Language Weaver Edge on Kubernetes

Brian John — Fri, 06 Oct 2023 10:39:59 GMT

Revision 22 posted to Wiki by Brian John on 10/6/2023 10:39:59 AM

Minimum requirement

Kubernetes cluster with node CPU/RAM totalling up to the minimum requirement.
e.g. AKS, EKS, GKE
Autoscaling is enabled in Kubernetes cluster. (optional)
Ingress controller to access Kubernetes services.
e.g. NGINX
Storage classes in Kubernetes that support both RWO & RWX volume types.

Architecture

Edge Controller host is deployed as a pod in Kubernetes and Edge UI & API are published as a service.
Job Engines, Translation Engines & Training Engines are deployed as Stateful Sets and could be configured to auto scale based on the pod CPU usage or predefine the number of replica pods.
Language Pairs and the Edge configuration is saved in persistent volumes.
All pods use the same docker base image.

Deployment

Helm charts & example “values.yaml” files are provided by RWS for easy deployment.
Upgrades & rescaling of Edge configuration is possible with helm upgrades.
Training Engines require GPU nodes in the Kubernetes cluster for better performance.
LW Edge license & default admin accounts are saved as Kubernetes secrets.
Persistent volume of the Controller pod could be a standard RWO storage class.
Persistent volume of Language Pairs requires a high performance, case sensitive RWX storage class.
Language Pairs are deployed to the persistent volume using Kubernetes Jobs.

Depending on the size of the Language Pair and I/O bandwidth, each Language Pair installation job will generally run for about 2-10 minutes.

Whilst it is possible to deploy the Edge software during Language Pair installation process, Translation Engines will not start or be usable until all the above Kubernetes jobs are completed.

Reconfigure

Typical values that could be changed while the system is running are:

Bootstrap Language Weaver Edge admin user.
Install new Language Pairs.
Increase/Decrease the size of the pool of Job Engines, Training Engines or add/modify the pool of Translation Engines for a given Language Pair.
Auto scale the number of Translation Engines, depending on the system load.

Edge API

The API key is automatically prefixed with “u_” + username + ”_” when created.

For an example, to make a REST API call for user admin@example.com with API key myapikey1234

$ curl -u u_admin@example.com_myapikey1234 https://myhost.example.com/api/v2/

Environment Variables

Custom environment variables could be set independently for:

Controller pod.
Job Engine pods - all pods share the same environment variables.
Translation Engine pods - each Language Pair has its own environment variables.
Training Engine pods - all pods share the same environment variables.

Running Language Weaver Edge on Kubernetes

Brian John — Fri, 06 Oct 2023 10:39:23 GMT

Revision 21 posted to Wiki by Brian John on 10/6/2023 10:39:23 AM

Minimum requirement

Kubernetes cluster with node CPU/RAM totalling up to the minimum requirement.
e.g. AKS, EKS, GKE
Autoscaling is enabled in Kubernetes cluster. (optional)
Ingress controller to access Kubernetes services.
e.g. NGINX
Storage classes in Kubernetes that support both RWO & RWX volume types.

Architecture

Edge Controller host is deployed as a pod in Kubernetes and Edge UI & API are published as a service.
Job Engines, Translation Engines & Training Engines are deployed as Stateful Sets and could be configured to auto scale based on the pod CPU usage or predefine the number of replica pods.
Language Pairs and the Edge configuration is saved in persistent volumes.
All pods use the same docker base image.

Deployment

Helm charts & example “values.yaml” files are provided by RWS for easy deployment.
Upgrades & rescaling of Edge configuration is possible with helm upgrades.
Training Engines require GPU nodes in the Kubernetes cluster for better performance.
LW Edge license & default admin accounts are saved as Kubernetes secrets.
Persistent volume of the Controller pod could be a standard RWO storage class.
Persistent volume of Language Pairs requires a high performance, case sensitive RWX storage class.
Language Pairs are deployed to the persistent volume using Kubernetes Jobs.

Depending on the size of the Language Pair and I/O bandwidth, each Language Pair installation job will generally run for about 2-10 minutes.

Whilst it is possible to deploy the Edge software during Language Pair installation process, Translation Engines will not start or be usable until all the above Kubernetes jobs are completed.

Reconfigure

Typical values that could be changed while the system is running are:

Bootstrap Language Weaver Edge admin user.
Install new Language Pairs.
Increase/Decrease the size of the pool of Job Engines, Training Engines or add/modify the pool of Translation Engines for a given Language Pair.
Auto scale the number of Translation Engines, depending on the system load.

Edge API

The API key is automatically prefixed with “u_” + username + ”_” when created.

For an example, to make a REST API call for user admin@example.com with API key myapikey1234

$ curl -u u_admin@example.com_myapikey1234 https://myhost.example.com/api/v2/

Environment Variables

Custom environment variables could be set independently for:

Controller pod.
Job Engine pods - all pods share the same environment variables.
Translation Engine pods - each Language Pair has its own environment variables.
Training Engine pods - all pods share the same environment variables.

Running Language Weaver Edge on Kubernetes

Brian John — Fri, 06 Oct 2023 10:39:01 GMT

Revision 20 posted to Wiki by Brian John on 10/6/2023 10:39:01 AM

Minimum requirement

Kubernetes cluster with node CPU/RAM totalling up to the minimum requirement.
e.g. AKS, EKS, GKE
Autoscaling is enabled in Kubernetes cluster. (optional)
Ingress controller to access Kubernetes services.
e.g. NGINX
Storage classes in Kubernetes that support both RWO & RWX volume types.

Architecture

Edge Controller host is deployed as a pod in Kubernetes and Edge UI & API are published as a service.
Job Engines, Translation Engines & Training Engines are deployed as Stateful Sets and could be configured to auto scale based on the pod CPU usage or predefine the number of replica pods.
Language Pairs and the Edge configuration is saved in persistent volumes.
All pods use the same docker base image.

Deployment

Helm charts & example “values.yaml” files are provided by RWS for easy deployment.
Upgrades & rescaling of Edge configuration is possible with helm upgrades.
Training Engines require GPU nodes in the Kubernetes cluster for better performance.
LW Edge license & default admin accounts are saved as Kubernetes secrets.
Persistent volume of the Controller pod could be a standard RWO storage class.
Persistent volume of Language Pairs requires a high performance, case sensitive RWX storage class.
Language Pairs are deployed to the persistent volume using Kubernetes Jobs.

Depending on the size of the Language Pair and I/O bandwidth, each Language Pair installation job will generally run for about 2-10 minutes.

Whilst it is possible to deploy the Edge software during Language Pair installation process, Translation Engines will not start or be usable until all the above Kubernetes jobs are completed.

Reconfigure

Typical values that could be changed while the system is running are:

Bootstrap Language Weaver Edge admin user.
Install new Language Pairs.
Increase/Decrease the size of the pool of Job Engines, Training Engines or add/modify the pool of Translation Engines for a given Language Pair.
Auto scale the number of Translation Engines, depending on the system load.

Edge API

The API key is automatically prefixed with “u_” + username + ”_” when created.

For an example, to make a REST API call for user admin@example.com with API key myapikey1234

$ curl -u u_admin@example.com_myapikey1234 https://myhost.example.com/api/v2/

Environment Variables

Custom environment variables could be set independently for:

Controller pod.
Job Engine pods - all pods share the same environment variables.
Translation Engine pods - each Language Pair has its own environment variables.
Training Engine pods - all pods share the same environment variables.

Running Language Weaver Edge on Kubernetes

Brian John — Fri, 06 Oct 2023 10:38:46 GMT

Revision 19 posted to Wiki by Brian John on 10/6/2023 10:38:46 AM

Minimum requirement

Kubernetes cluster with node CPU/RAM totalling up to the minimum requirement.
e.g. AKS, EKS, GKE
Autoscaling is enabled in Kubernetes cluster. (optional)
Ingress controller to access Kubernetes services.
e.g. NGINX
Storage classes in Kubernetes that support both RWO & RWX volume types.

Architecture

Edge Controller host is deployed as a pod in Kubernetes and Edge UI & API are published as a service.
Job Engines, Translation Engines & Training Engines are deployed as Stateful Sets and could be configured to auto scale based on the pod CPU usage or predefine the number of replica pods.
Language Pairs and the Edge configuration is saved in persistent volumes.
All pods use the same docker base image.

Deployment

Helm charts & example “values.yaml” files are provided by RWS for easy deployment.
Upgrades & rescaling of Edge configuration is possible with helm upgrades.
Training Engines require GPU nodes in the Kubernetes cluster for better performance.
LW Edge license & default admin accounts are saved as Kubernetes secrets.
Persistent volume of the Controller pod could be a standard RWO storage class.
Persistent volume of Language Pairs requires a high performance, case sensitive RWX storage class.
Language Pairs are deployed to the persistent volume using Kubernetes Jobs.

Depending on the size of the Language Pair and I/O bandwidth, each Language Pair installation job will generally run for about 2-10 minutes.

Whilst it is possible to deploy the Edge software during Language Pair installation process, Translation Engines will not start or be usable until all the above Kubernetes jobs are completed.

Reconfigure

Typical values that could be changed while the system is running are:

Bootstrap Language Weaver Edge admin user.
Install new Language Pairs.
Increase/Decrease the size of the pool of Job Engines, Training Engines or add/modify the pool of Translation Engines for a given Language Pair.
Auto scale the number of Translation Engines, depending on the system load.

Edge API

The API key is automatically prefixed with “u_” + username + ”_” when created.

For an example, to make a REST API call for user admin@example.com with API key myapikey1234

$ curl -u u_admin@example.com_myapikey1234 https://myhost.example.com/api/v2/

Environment Variables

Custom environment variables could be set independently for:

Controller pod.
Job Engine pods - all pods share the same environment variables.
Translation Engine pods - each Language Pair has its own environment variables.
Training Engine pods - all pods share the same environment variables.

Running Language Weaver Edge on Kubernetes

Brian John — Fri, 06 Oct 2023 10:37:29 GMT

Revision 18 posted to Wiki by Brian John on 10/6/2023 10:37:29 AM

Minimum requirement

Kubernetes cluster with node CPU/RAM totalling up to the minimum requirement.
e.g. AKS, EKS, GKE
Autoscaling is enabled in Kubernetes cluster. (optional)
Ingress controller to access Kubernetes services.
e.g. NGINX
Storage classes in Kubernetes that support both RWO & RWX volume types.

Architecture

Edge Controller host is deployed as a pod in Kubernetes and Edge UI & API are published as a service.
Job Engines, Translation Engines & Training Engines are deployed as Stateful Sets and could be configured to auto scale based on the pod CPU usage or predefine the number of replica pods.
Language Pairs and the Edge configuration is saved in persistent volumes.
All pods use the same docker base image.

Deployment

Helm charts & example “values.yaml” files are provided by RWS for easy deployment.
Upgrades & rescaling of Edge configuration is possible with helm upgrades.
Training Engines require GPU nodes in the Kubernetes cluster for better performance.
LW Edge license & default admin accounts are saved as Kubernetes secrets.
Persistent volume of the Controller pod could be a standard RWO storage class.
Persistent volume of Language Pairs requires a high performance, case sensitive RWX storage class.
Language Pairs are deployed to the persistent volume using Kubernetes Jobs.

Depending on the size of the Language Pair and I/O bandwidth, each Language Pair installation job will generally run for about 2-10 minutes.

Whilst it is possible to deploy the Edge software during Language Pair installation process, Translation Engines will not start or be usable until all the above Kubernetes jobs are completed.

Reconfigure

Typical values that could be changed while the system is running are:

Bootstrap Language Weaver Edge admin user.
Install new Language Pairs.
Increase/Decrease the size of the pool of Job Engines, Training Engines or add/modify the pool of Translation Engines for a given Language Pair.
Auto scale the number of Translation Engines, depending on the system load.

Edge API

The API key is automatically prefixed with “u_” + username + ”_” when created.

For an example, to make a REST API call for user admin@example.com with API key myapikey1234

curl -u u_admin@example.com_myapikey1234 https://myhost.example.com/api/v2/

Environment Variables

Custom environment variables could be set independently for:

Controller pod.
Job Engine pods - all pods share the same environment variables.
Translation Engine pods - each Language Pair has its own environment variables.
Training Engine pods - all pods share the same environment variables.

Running Language Weaver Edge on Kubernetes

Brian John — Fri, 06 Oct 2023 10:37:11 GMT

Revision 17 posted to Wiki by Brian John on 10/6/2023 10:37:11 AM

Minimum requirement

Kubernetes cluster with node CPU/RAM totalling up to the minimum requirement.
e.g. AKS, EKS, GKE
Autoscaling is enabled in Kubernetes cluster. (optional)
Ingress controller to access Kubernetes services.
e.g. NGINX
Storage classes in Kubernetes that support both RWO & RWX volume types.

Architecture

Edge Controller host is deployed as a pod in Kubernetes and Edge UI & API are published as a service.
Job Engines, Translation Engines & Training Engines are deployed as Stateful Sets and could be configured to auto scale based on the pod CPU usage or predefine the number of replica pods.
Language Pairs and the Edge configuration is saved in persistent volumes.
All pods use the same docker base image.

Deployment

Helm charts & example “values.yaml” files are provided by RWS for easy deployment.
Upgrades & rescaling of Edge configuration is possible with helm upgrades.
Training Engines require GPU nodes in the Kubernetes cluster for better performance.
LW Edge license & default admin accounts are saved as Kubernetes secrets.
Persistent volume of the Controller pod could be a standard RWO storage class.
Persistent volume of Language Pairs requires a high performance, case sensitive RWX storage class.
Language Pairs are deployed to the persistent volume using Kubernetes Jobs.

Depending on the size of the Language Pair and I/O bandwidth, each Language Pair installation job will generally run for about 2-10 minutes.

Whilst it is possible to deploy the Edge software during Language Pair installation process, Translation Engines will not start or be usable until all the above Kubernetes jobs are completed.

Reconfigure

Typical values that could be changed while the system is running are:

Bootstrap Language Weaver Edge admin user.
Install new Language Pairs.
Increase/Decrease the size of the pool of Job Engines, Training Engines or add/modify the pool of Translation Engines for a given Language Pair.
Auto scale the number of Translation Engines, depending on the system load.

Edge API

The API key is automatically prefixed with “u_” + username + ”_” when created.

For an example, to make a REST API call for user admin@example.com with API key myapikey1234

curl -u u_admin@example.com_myapikey1234 https://myhost.example.com/api/v2/

Environment Variables

Custom environment variables could be set independently for:

Controller pod.
Job Engine pods - all pods share the same environment variables.
Translation Engine pods - each Language Pair has its own environment variables.
Training Engine pods - all pods share the same environment variables.

Running Language Weaver Edge on Kubernetes

Brian John — Fri, 06 Oct 2023 10:36:01 GMT

Revision 16 posted to Wiki by Brian John on 10/6/2023 10:36:01 AM

Minimum requirement

Kubernetes cluster with node CPU/RAM totalling up to the minimum requirement.
e.g. AKS, EKS, GKE
Autoscaling is enabled in Kubernetes cluster. (optional)
Ingress controller to access Kubernetes services.
e.g. NGINX
Storage classes in Kubernetes that support both RWO & RWX volume types.

Architecture

Edge Controller host is deployed as a pod in Kubernetes and Edge UI & API are published as a service.
Job Engines, Translation Engines & Training Engines are deployed as Stateful Sets and could be configured to auto scale based on the pod CPU usage or predefine the number of replica pods.
Language Pairs and the Edge configuration is saved in persistent volumes.
All pods use the same docker base image.

Deployment

Helm charts & example “values.yaml” files are provided by RWS for easy deployment.
Upgrades & rescaling of Edge configuration is possible with helm upgrades.
Training Engines require GPU nodes in the Kubernetes cluster for better performance.
LW Edge license & default admin accounts are saved as Kubernetes secrets.
Persistent volume of the Controller pod could be a standard RWO storage class.
Persistent volume of Language Pairs requires a high performance, case sensitive RWX storage class.
Language Pairs are deployed to the persistent volume using Kubernetes Jobs.

Depending on the size of the Language Pair and I/O bandwidth, each Language Pair installation job will generally run for about 2-10 minutes.

Whilst it is possible to deploy the Edge software during Language Pair installation process, Translation Engines will not start or be usable until all the above Kubernetes jobs are completed.

Reconfigure

Typical values that could be changed while the system is running are:

Bootstrap Language Weaver Edge admin user.
Install new Language Pairs.
Increase/Decrease the size of the pool of Job Engines, Training Engines or add/modify the pool of Translation Engines for a given Language Pair.
Auto scale the number of Translation Engines, depending on the system load.

Edge API

The API key is automatically prefixed with “u_” + username + ”_” when created.

For an example, to make a REST API call for user admin@example.com with API key myapikey1234

curl -u u_admin@example.com_myapikey1234 https://myhost.example.com/api/v2/

Running Language Weaver Edge on Kubernetes

Brian John — Fri, 06 Oct 2023 10:35:19 GMT

Revision 15 posted to Wiki by Brian John on 10/6/2023 10:35:19 AM

Minimum requirement

Kubernetes cluster with node CPU/RAM totalling up to the minimum requirement.
e.g. AKS, EKS, GKE
Autoscaling is enabled in Kubernetes cluster. (optional)
Ingress controller to access Kubernetes services.
e.g. NGINX
Storage classes in Kubernetes that support both RWO & RWX volume types.

Architecture

Edge Controller host is deployed as a pod in Kubernetes and Edge UI & API are published as a service.
Job Engines, Translation Engines & Training Engines are deployed as Stateful Sets and could be configured to auto scale based on the pod CPU usage or predefine the number of replica pods.
Language Pairs and the Edge configuration is saved in persistent volumes.
All pods use the same docker base image.

Deployment

Helm charts & example “values.yaml” files are provided by RWS for easy deployment.
Upgrades & rescaling of Edge configuration is possible with helm upgrades.
Training Engines require GPU nodes in the Kubernetes cluster for better performance.
LW Edge license & default admin accounts are saved as Kubernetes secrets.
Persistent volume of the Controller pod could be a standard RWO storage class.
Persistent volume of Language Pairs requires a high performance, case sensitive RWX storage class.
Language Pairs are deployed to the persistent volume using Kubernetes Jobs.

Depending on the size of the Language Pair and I/O bandwidth, each Language Pair installation job will generally run for about 2-10 minutes.

Whilst it is possible to deploy the Edge software during Language Pair installation process, Translation Engines will not start or be usable until all the above Kubernetes jobs are completed.

Reconfigure

Typical values that could be changed while the system is running are:

Bootstrap Language Weaver Edge admin user.
Install new Language Pairs.
Increase/Decrease the size of the pool of Job Engines, Training Engines or add/modify the pool of Translation Engines for a given Language Pair.
Auto scale the number of Translation Engines, depending on the system load.

Edge API

The API key is automatically prefixed with “u_” + username + ”_” when created.

For an example, to make a REST API call for user admin@example.com with API key myapikey1234

curl -u u_admin@example.com_myapikey1234 https://myhost.example.com/api/v2/

Running Language Weaver Edge on Kubernetes

Brian John — Fri, 06 Oct 2023 10:34:58 GMT

Revision 14 posted to Wiki by Brian John on 10/6/2023 10:34:58 AM

Minimum requirement

Kubernetes cluster with node CPU/RAM totalling up to the minimum requirement.
e.g. AKS, EKS, GKE
Autoscaling is enabled in Kubernetes cluster. (optional)
Ingress controller to access Kubernetes services.
e.g. NGINX
Storage classes in Kubernetes that support both RWO & RWX volume types.

Architecture

Edge Controller host is deployed as a pod in Kubernetes and Edge UI & API are published as a service.
Job Engines, Translation Engines & Training Engines are deployed as Stateful Sets and could be configured to auto scale based on the pod CPU usage or predefine the number of replica pods.
Language Pairs and the Edge configuration is saved in persistent volumes.
All pods use the same docker base image.

Deployment

Helm charts & example “values.yaml” files are provided by RWS for easy deployment.
Upgrades & rescaling of Edge configuration is possible with helm upgrades.
Training Engines require GPU nodes in the Kubernetes cluster for better performance.
LW Edge license & default admin accounts are saved as Kubernetes secrets.
Persistent volume of the Controller pod could be a standard RWO storage class.
Persistent volume of Language Pairs requires a high performance, case sensitive RWX storage class.
Language Pairs are deployed to the persistent volume using Kubernetes Jobs.

Depending on the size of the Language Pair and I/O bandwidth, each Language Pair installation job will generally run for about 2-10 minutes.

Whilst it is possible to deploy the Edge software during Language Pair installation process, Translation Engines will not start or be usable until all the above Kubernetes jobs are completed.

Reconfigure

Typical values that could be changed while the system is running are:

Bootstrap Language Weaver Edge admin user.
Install new Language Pairs.
Increase/Decrease the size of the pool of Job Engines, Training Engines or add/modify the pool of Translation Engines for a given Language Pair.
Auto scale the number of Translation Engines, depending on the system load.

Edge API

The API key is automatically prefixed with “u_” + username + ”_” when created.

For an example, to make a REST API call for user admin@example.com with API key myapikey1234

curl -u u_admin@example.com_myapikey1234 https://myhost.example.com/api/v2/

Running Language Weaver Edge on Kubernetes

Brian John — Fri, 06 Oct 2023 10:33:19 GMT

Revision 13 posted to Wiki by Brian John on 10/6/2023 10:33:19 AM

Minimum requirement

Kubernetes cluster with node CPU/RAM totalling up to the minimum requirement.
e.g. AKS, EKS, GKE
Autoscaling is enabled in Kubernetes cluster. (optional)
Ingress controller to access Kubernetes services.
e.g. NGINX
Storage classes in Kubernetes that support both RWO & RWX volume types.

Architecture

Edge Controller host is deployed as a pod in Kubernetes and Edge UI & API are published as a service.
Job Engines, Translation Engines & Training Engines are deployed as Stateful Sets and could be configured to auto scale based on the pod CPU usage or predefine the number of replica pods.
Language Pairs and the Edge configuration is saved in persistent volumes.
All pods use the same docker base image.

Deployment

Helm charts & example “values.yaml” files are provided by RWS for easy deployment.
Upgrades & rescaling of Edge configuration is possible with helm upgrades.
Training Engines require GPU nodes in the Kubernetes cluster for better performance.
LW Edge license & default admin accounts are saved as Kubernetes secrets.
Persistent volume of the Controller pod could be a standard RWO storage class.
Persistent volume of Language Pairs requires a high performance, case sensitive RWX storage class.
Language Pairs are deployed to the persistent volume using Kubernetes Jobs.

Depending on the size of the Language Pair and I/O bandwidth, each Language Pair installation job will generally run for about 2-10 minutes.

Whilst it is possible to deploy the Edge software during Language Pair installation process, Translation Engines will not start or be usable until all the above Kubernetes jobs are completed.

Reconfigure

Typical values that could be changed while the system is running are:

Bootstrap Language Weaver Edge admin user.
Install new Language Pairs.
Increase/Decrease the size of the pool of Job Engines, Training Engines or add/modify the pool of Translation Engines for a given Language Pair.
Auto scale the number of Translation Engines, depending on the system load.

Running Language Weaver Edge on Kubernetes

Brian John — Fri, 06 Oct 2023 10:32:53 GMT

Revision 12 posted to Wiki by Brian John on 10/6/2023 10:32:53 AM

Minimum requirement

Kubernetes cluster with node CPU/RAM totalling up to the minimum requirement.
e.g. AKS, EKS, GKE
Autoscaling is enabled in Kubernetes cluster. (optional)
Ingress controller to access Kubernetes services.
e.g. NGINX
Storage classes in Kubernetes that support both RWO & RWX volume types.

Architecture

Edge Controller host is deployed as a pod in Kubernetes and Edge UI & API are published as a service.
Job Engines, Translation Engines & Training Engines are deployed as Stateful Sets and could be configured to auto scale based on the pod CPU usage or predefine the number of replica pods.
Language Pairs and the Edge configuration is saved in persistent volumes.
All pods use the same docker base image.

Deployment

Helm charts & example “values.yaml” files are provided by RWS for easy deployment.
Upgrades & rescaling of Edge configuration is possible with helm upgrades.
Training Engines require GPU nodes in the Kubernetes cluster for better performance.
LW Edge license & default admin accounts are saved as Kubernetes secrets.
Persistent volume of the Controller pod could be a standard RWO storage class.
Persistent volume of Language Pairs requires a high performance, case sensitive RWX storage class.
Language Pairs are deployed to the persistent volume using Kubernetes Jobs.

Depending on the size of the Language Pair and I/O bandwidth, each Language Pair installation job will generally run for about 2-10 minutes.

Whilst it is possible to deploy the Edge software during Language Pair installation process, Translation Engines will not start or be usable until all the above Kubernetes jobs are completed.

Reconfigure

Typical values that could be changed while the system is running are:

Bootstrap Language Weaver Edge admin user.
Install new Language Pairs.
Increase/Decrease the size of the pool of Job Engines, Training Engines or add/modify the pool of Translation Engines for a given Language Pair.
Auto scale the number of Translation Engines, depending on the system load.

Running Language Weaver Edge on Kubernetes

Brian John — Fri, 06 Oct 2023 10:32:32 GMT

Revision 11 posted to Wiki by Brian John on 10/6/2023 10:32:32 AM

Minimum requirement

Kubernetes cluster with node CPU/RAM totalling up to the minimum requirement.
e.g. AKS, EKS, GKE
Autoscaling is enabled in Kubernetes cluster. (optional)
Ingress controller to access Kubernetes services.
e.g. NGINX
Storage classes in Kubernetes that support both RWO & RWX volume types.

Architecture

Edge Controller host is deployed as a pod in Kubernetes and Edge UI & API are published as a service.
Job Engines, Translation Engines & Training Engines are deployed as Stateful Sets and could be configured to auto scale based on the pod CPU usage or predefine the number of replica pods.
Language Pairs and the Edge configuration is saved in persistent volumes.
All pods use the same docker base image.

Deployment

Helm charts & example “values.yaml” files are provided by RWS for easy deployment.
Upgrades & rescaling of Edge configuration is possible with helm upgrades.
Training Engines require GPU nodes in the Kubernetes cluster for better performance.
LW Edge license & default admin accounts are saved as Kubernetes secrets.
Persistent volume of the Controller pod could be a standard RWO storage class.
Persistent volume of Language Pairs requires a high performance, case sensitive RWX storage class.
Language Pairs are deployed to the persistent volume using Kubernetes Jobs.

Depending on the size of the Language Pair and I/O bandwidth, each Language Pair installation job will generally run for about 2-10 minutes.

Whilst it is possible to deploy the Edge software during Language Pair installation process, Translation Engines will not start or be usable until all the above Kubernetes jobs are completed.

Reconfigure

Typical values that could be changed while the system is running are:

Bootstrap Language Weaver Edge admin user.
Install new Language Pairs.
Increase/Decrease the size of the pool of Job Engines, Training Engines or add/modify the pool of Translation Engines for a given Language Pair.
Auto scale the number of Translation Engines, depending on the system load.

Running Language Weaver Edge on Kubernetes

Brian John — Fri, 06 Oct 2023 10:32:17 GMT

Revision 10 posted to Wiki by Brian John on 10/6/2023 10:32:17 AM

Minimum requirement

Kubernetes cluster with node CPU/RAM totalling up to the minimum requirement.
e.g. AKS, EKS, GKE
Autoscaling is enabled in Kubernetes cluster. (optional)
Ingress controller to access Kubernetes services.
e.g. NGINX
Storage classes in Kubernetes that support both RWO & RWX volume types.

Architecture

Edge Controller host is deployed as a pod in Kubernetes and Edge UI & API are published as a service.
Job Engines, Translation Engines & Training Engines are deployed as Stateful Sets and could be configured to auto scale based on the pod CPU usage or predefine the number of replica pods.
Language Pairs and the Edge configuration is saved in persistent volumes.
All pods use the same docker base image.

Deployment

Helm charts & example “values.yaml” files are provided by RWS for easy deployment.
Upgrades & rescaling of Edge configuration is possible with helm upgrades.
Training Engines require GPU nodes in the Kubernetes cluster for better performance.
LW Edge license & default admin accounts are saved as Kubernetes secrets.
Persistent volume of the Controller pod could be a standard RWO storage class.
Persistent volume of Language Pairs requires a high performance, case sensitive RWX storage class.
Language Pairs are deployed to the persistent volume using Kubernetes Jobs.

Depending on the size of the Language Pair and I/O bandwidth, each Language Pair installation job will generally run for about 2-10 minutes.

Whilst it is possible to deploy the Edge software during Language Pair installation process, Translation Engines will not start or be usable until all the above Kubernetes jobs are completed.

Reconfigure

Typical values that could be changed while the system is running are:

Bootstrap Language Weaver Edge admin user.
Install new Language Pairs.
Increase/Decrease the size of the pool of Job Engines, Training Engines or add/modify the pool of Translation Engines for a given Language Pair.
Auto scale the number of Translation Engines, depending on the system load.

Running Language Weaver Edge on Kubernetes

Brian John — Fri, 06 Oct 2023 10:31:07 GMT

Revision 9 posted to Wiki by Brian John on 10/6/2023 10:31:07 AM

Minimum requirement

Kubernetes cluster with node CPU/RAM totalling up to the minimum requirement.
e.g. AKS, EKS, GKE
Autoscaling is enabled in Kubernetes cluster. (optional)
Ingress controller to access Kubernetes services.
e.g. NGINX
Storage classes in Kubernetes that support both RWO & RWX volume types.

Architecture

Edge Controller host is deployed as a pod in Kubernetes and Edge UI & API are published as a service.
Job Engines, Translation Engines & Training Engines are deployed as Stateful Sets and could be configured to auto scale based on the pod CPU usage or predefine the number of replica pods.
Language Pairs and the Edge configuration is saved in persistent volumes.
All pods use the same docker base image.

Deployment

Helm charts & example “values.yaml” files are provided by RWS for easy deployment.
Upgrades & rescaling of Edge configuration is possible with helm upgrades.
Training Engines require GPU nodes in the Kubernetes cluster for better performance.
LW Edge license & default admin accounts are saved as Kubernetes secrets.
Persistent volume of the Controller pod could be a standard RWO storage class.
Persistent volume of Language Pairs requires a high performance, case sensitive RWX storage class.
Language Pairs are deployed to the persistent volume using Kubernetes Jobs.

Running Language Weaver Edge on Kubernetes

Brian John — Fri, 06 Oct 2023 10:29:35 GMT

Revision 8 posted to Wiki by Brian John on 10/6/2023 10:29:35 AM

Minimum requirement

Kubernetes cluster with node CPU/RAM totalling up to the minimum requirement.
e.g. AKS, EKS, GKE
Autoscaling is enabled in Kubernetes cluster. (optional)
Ingress controller to access Kubernetes services.
e.g. NGINX
Storage classes in Kubernetes that support both RWO & RWX volume types.

Running Language Weaver Edge on Kubernetes

Brian John — Fri, 06 Oct 2023 10:29:06 GMT

Revision 7 posted to Wiki by Brian John on 10/6/2023 10:29:06 AM

Minimum requirement

Kubernetes cluster with node CPU/RAM totalling up to the minimum requirement.
e.g. AKS, EKS, GKE
Autoscaling is enabled in Kubernetes cluster. (optional)
Ingress controller to access Kubernetes services.
e.g. NGINX
Storage classes in Kubernetes that support both RWO & RWX volume types.