Hi all,

I'm happy to announce that Language Weaver Edge 8.7.0.0 has been released and is now available from our download servers.

Release overview

Language Weaver Edge 8.7.0.0 is a major update release which introduces Generative Language Pairs. Generative LPs use Large Language Models (LLM) and Quality Estimation Models (MTQE) to automatically post-edit low quality segments and improve their quality. Once enabled, the Generative LPs will be available in the Portal and will also be available to use from the API. 

What's New?

• Generative LPs (Linux only)

  • Generative LPs can be managed from the Deployment page. Each Generative LP is automatically created if there is a running LLM engine, a matching QE engine, and a matching Translation engine.

    • MTQE Engines:

      • Require at least 2 CPU cores and 4GB RAM, similar to a regular Translation Engine, to run.

      • Require one Processing Unit (PU) per engine.

      • Are applied per language pair (i.e., English → French, French → English, English → German, etc).

    • LLM Engines:

      • Require at least 1 GPU and 24GB GPU RAM to run (we recommend at least an NVIDIA A10 GPU).

      • Require one Processing Unit (PU) per engine.

      • Can be applied across multiple language pairs for Automatic Post-Editing (however an MTQE engine must be in place for that Language Pair).

    • Speed / Throughput Considerations:

      • Translation Engines running with one PU can run at approximately 2,000 words per minute (WPM), additional PUs can be added to increase the throughput WPM at a rate of 2,000 WPM per PU.

      • LLM Engines running with one PU can run at approximately 500 WPM for Automatic Post-Editing on an NVIDIA A10 GPU.

        • To handle increased throughput for Automatic Post-Editing, for example if there are multiple Generative LPs running multiple jobs at one time, additional LLM Engines could be added to handle the additional jobs - each at 500 WPM.

• Multilingual Document Translation

  • Documents that contain multiple languages can now be translated into your chosen target language. A Multilingual Document Translation option has been added on the Translate page to selectively enable this feature. Admins can also control if this feature is available to all users in the Settings > Translations page.

    • In the Translation Settings page, there are 4 options regarding this feature:

      • Disabled: All segments will be translated using the single detected document-wide language.

      • Skip Unavailable Language Pairs (Default): Translation will only occur for language pairs that are running. Segments with unavailable language pairs will be left untranslated.

      • Fall Back on Document Source Languages: If a segment's detected language does not match any running language pair, it will be translated using the detected document-wide language instead.

      • Translate Only Document Source Language: Only segments that match the detected document-wide language will be translated. All other segments will be skipped.

• Live Streaming for Audio Transcription

  • The REST API for transcription has been updated to support HTTP chunked requests for continuous audio streams. This requires an ASR engine that’s been configured to run with the streaming mode capability.

  • A microphone button has been added to the Translate page to allow voice transcription directly from the browser.

    • To begin live audio streaming from the Translate page, a user can click on the microphone button to begin audio recording. When they are finished, they click Stop (in the same place as the microphone button), and this will conclude the recording. Language Weaver will then transcribe and translate the audio.

  • The requirements for Live Audio Transcription are the same as Language Weaver Edge’s ASR requirements.

Enhancements

• Added support for PDF output for the legacy Microsoft Word binary format.

• Added default recommended custom HTTP headers in the HTTP Settings admin page and a configurable toggle. Disabled by default.

• Added support to select all substate on the Translation Queue page filter by selecting the parent state.

• Improved formatting and tag alignments for post-edited segments.

• Reduced Job Engine memory usage by 1 GB.

• Moved the Brands page from the Admin Settings page to the user accessible Manage menu so that non-Admin users with permission to manage brands have access to it.

• Improved inflections and rules for flexible terminology.

Fixes

• Fixed jobs getting stuck in the dispatching state when a worker node running the Job Engine gets disconnected and the TCP connection is not properly closed - TCP Keepalives enabled.

• Fixed adaptation hanging during cleaning phase on Windows hosts that have more than 64 cores.

• Fixed failed import of feedback entries that have invalid timestamps; the invalid timestamps are replaced with the current timestamp.

• Fixed invalid web server port shown in Edge post-installation summary.

• Fixed validation to prevent an Edge worker host that is currently added to one cluster, from joining another cluster.

• Fixed security vulnerability for the Moment.js JavaScript library: CVE-2022-24785

Are new licenses required for this version upgrade?

Yes, Language Weaver Edge requires version specific licenses for major and minor updates.  Version numbers are denoted by [major].[minor].[patch].[subpatch].  

For Language Weaver Edge 8.7, a new license is then required. It is only required for the Controller host and the new license can be installed from the Web UI, in the Manage / Deployment / Entitlements section.

Is there updated documentation for Language Weaver Edge 8.7?

Yes, the Language Weaver Edge documentation has been fully updated for 8.7