Hi Tom Imhof , I have reviewed this issue today, but unable to reproduce the issue that you are reporting.

Prerequisites

• Trados Studio 2022 SR1 - 17.1.6.16252
• GS: 15.1.9.12529 - GS 2020 SR1 CU09

Steps

1. Create a server based tm from GroupShare
2. Open the server based TM in Stduio & add some custom fields
3. Add a few TU entries & assign a custom field value to one or two of the TU's
4. Commit changes so that they are updated on the server.
5. Create a standalone app to connect and export the server based TM to tmx
   1. Documentation: How to export serverbased TM to TMX

Actual result

The custom field values are exported correctly, visible from the TU's in the TMX that was exported from the serverbased TM

Follow up

Tom Imhof  Can you pls provide the GroupShare version + Trados Studio version you are using?

Dear Patrick, 

many thanks for your answer. My issue is about the *context matching information* - not about custom fields. Custom fields - I agree - do survive the export. The context matching information in the TM is stored in these fields:

<prop-type="x-IncludesContextContent">True</prop>

This turns the feature on, I guess.

Then on segment pair level, you will find:

<prop type="x-Context"> etc. as highlighted in the screenshot:

These elements - when you export via the API from a server TM - are *not* exported. I am quite sure you can repro it. I tested against an older GS 2020 SR 1 CU7 (gsdemo.gs.sdl.com) as well as my own VM running GS 2020 SR1 8.1. I will test against CU9 as well, but I am quite sure it is not a Groupshare issue - it is a Studio API issue. 

Hi Patrick,

ok, I will test with CU9 then and report back - it would be wonderful if it was fixed already in CU9  

Hi Patrick,

my test with CU9 was negative - with CU9, this code causes an internal server error (500) - it is still working fine against CU7 and CU8.1 of Groupshare (running Trados Studio 2022 SR1):

>>>>>>>>>>

Public Function GetServerTMs()

Dim ServerUri As New System.Uri(ServerURL & ":" & Portnumber)

Dim TMServer As New TranslationProviderServer(ServerUri, False, Username, Password)

For Each ServerBasedTranslationMemory In TMServer.GetTranslationMemories().   <---- Internal server Error (500) happens here 

Dim ServerTM As String = ServerBasedTranslationMemory.Name

Msgbox(ServerTM)

Next

Return 0

End Function

>>>>>>>>>>>

However, I will create a separate request for this issue, as this has (I think) nothing to do with my original ticket here.

But fact is - with CU9, I cannot retrieve any TMs any longer using the code above. This code as worked for years without any issues.

Hi Tom Imhof  - there is indeed a known issue in the API when retrieving the list of GroupShare TMs, however you can work around it in your code by making certain small changes. I would ask Andrei Caia  to explain the workaround here when he has time. Also tagging Paul Petrehus . Thanks, Daniel

Hi Tom Imhof , I have just received information from Paul Petrehus that you should use  "GetTranslationMemoriesByQuery(TranslationMemoryEntityQuery query)" to get the TMs + avoid this exception. 

Can you try this an let me know how it goes?

Hi Patrick,

I tried, but the result is exactly the same as with the GetTranslationMemories function.

The error in the GS TMService.log is also identical:

2023-08-25 08:24:50.2662|WIN-DGSP368NVJB|Error|THREAD_ID:78|TR_ID:|EX:Object reference not set to an instance of an object.|DefaultExceptionHandler System.NullReferenceException: Object reference not set to an instance of an object.
at Sdl.Services.Common.ResourceQuery.WebApi.Parsing.ParsingHelper.GetPropertyName(CollectionNavigationNode property)
at Sdl.Services.Common.ResourceQuery.WebApi.Parsing.AnyNodeParser.ParseInternal(AnyNode expression, String resourceIdFieldName)
at Sdl.Services.Common.ResourceQuery.WebApi.Parsing.AbstractSingleValueNodeParser`1.Parse(SingleValueNode node, String resourceIdFieldName)
at Sdl.Services.Common.ResourceQuery.WebApi.Parsing.ODataQueryOptionsParser.Parse(SingleValueNode node, String resourceIdFieldName)
at Sdl.Services.Common.ResourceQuery.WebApi.Parsing.ODataQueryOptionsParser.Parse[T](SingleValueNode node, String resourceIdFieldName)
at Sdl.Services.Common.ResourceQuery.WebApi.Parsing.UnaryOperatorNodeParser.ParseInternal(UnaryOperatorNode expression, String resourceIdFieldName)
at Sdl.Services.Common.ResourceQuery.WebApi.Parsing.AbstractSingleValueNodeParser`1.Parse(SingleValueNode node, String resourceIdFieldName)
at Sdl.Services.Common.ResourceQuery.WebApi.Parsing.ODataQueryOptionsParser.Parse(SingleValueNode node, String resourceIdFieldName)
at Sdl.Services.Common.ResourceQuery.WebApi.Parsing.BinaryOperatorNodeParser.ParseInternal(BinaryOperatorNode expression, String resourceIdFieldName)
at Sdl.Services.Common.ResourceQuery.WebApi.Parsing.AbstractSingleValueNodeParser`1.Parse(SingleValueNode node, String resourceIdFieldName)
at Sdl.Services.Common.ResourceQuery.WebApi.Parsing.ODataQueryOptionsParser.Parse(SingleValueNode node, String resourceIdFieldName)
at Sdl.Services.Common.ResourceQuery.WebApi.Parsing.BinaryOperatorNodeParser.ParseInternal(BinaryOperatorNode expression, String resourceIdFieldName)
at Sdl.Services.Common.ResourceQuery.WebApi.Parsing.AbstractSingleValueNodeParser`1.Parse(SingleValueNode node, String resourceIdFieldName)
at Sdl.Services.Common.ResourceQuery.WebApi.Parsing.ODataQueryOptionsParser.Parse(SingleValueNode node, String resourceIdFieldName)
at Sdl.Services.Common.AspNetCore.RestApi.OData.ODataQueryOptionsExtensions.ToResourceFilterExpression(SingleValueNode odataFilterExpression, String resourceIdFieldName)
at Sdl.Services.Common.AspNetCore.RestApi.OData.ODataQueryOptionsExtensions.ToResourceListOptions[T](ODataQueryOptions`1 options, Int32 maxNodeCount)
at Sdl.TMService.RestApi.Controllers.TranslationMemoriesController.Get(ODataResourceQueryOptions`1 options) in D:\a\1\s\TMService\RestApi\Controllers\TranslationMemoriesController.cs:line 1224
at Microsoft.AspNetCore.Mvc.Infrastructure.ActionMethodExecutor.TaskOfIActionResultExecutor.Execute(IActionResultTypeMapper mapper, ObjectMethodExecutor executor, Object controller, Object[] arguments)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.<InvokeActionMethodAsync>g__Awaited|12_0(ControllerActionInvoker invoker, ValueTask`1 actionResultValueTask)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.<InvokeNextActionFilterAsync>g__Awaited|10_0(ControllerActionInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Rethrow(ActionExecutedContextSealed context)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Next(State& next, Scope& scope, Object& state, Boolean& isCompleted)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.InvokeInnerFilterAsync()
--- End of stack trace from previous location ---
at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.<InvokeFilterPipelineAsync>g__Awaited|20_0(ResourceInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted)
at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.<InvokeAsync>g__Awaited|17_0(ResourceInvoker invoker, Task task, IDisposable scope)
at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.<InvokeAsync>g__Awaited|17_0(ResourceInvoker invoker, Task task, IDisposable scope)
at Microsoft.AspNetCore.Routing.EndpointMiddleware.<Invoke>g__AwaitRequestTask|6_0(Endpoint endpoint, Task requestTask, ILogger logger)
at Sdl.TMService.Common.Runtime.EntitlementVerificationMiddleware.InvokeAsync(HttpContext context) in D:\a\1\s\TMService\Sdl.TMService.Common.Runtime\EntitlementVerificationMiddleware.cs:line 46
at Microsoft.AspNetCore.Authorization.AuthorizationMiddleware.Invoke(HttpContext context)
at Microsoft.AspNetCore.Authentication.AuthenticationMiddleware.Invoke(HttpContext context)
at Sdl.Services.Common.AspNetCore.RestApi.Middleware.ExecutionContextMiddleware.InvokeAsync(HttpContext context)
at Sdl.Services.Common.AspNetCore.RestApi.Authentication.AuthenticationRequestMiddleware.InvokeAsync(HttpContext context)
at Sdl.TMService.Common.Runtime.ExceptionHandling.ExceptionHandlingMiddleware.Invoke(HttpContext context) in D:\a\1\s\TMService\Sdl.TMService.Common.Runtime\ExceptionHandling\ExceptionHandlingMiddleware.cs:line 30

Hello Tom Imhof 

Can you please please tell us, please, what parameters you send in the TranslationMemoryQuery.

Also, here is an example of parameters that works: 

var input = new TranslationMemoryEntityQuery()
{
Size = 10,
Index = 1,
IsProject = true,
OwnerId = GuidOwnerId,
IncludeChildResourceGroups = true,
ResourceGroupPath = "Location"
};

Also send paratmeter IsProject as true, so you'll get all TMs.

Can you, please, try this an let us know how it goes?

Hello Tom Imhof 

How TranslationMemoryQuery looks?

Here you have an working example: 

var query = new Sdl.LanguagePlatform.TranslationMemoryApi.TranslationMemoryQuery() {
ResourceGroupPath = UserSettings.Organization,
IsProject = true,
IsMain = true,
IncludeChildResourceGroups = false
};

Also, set IsProject as true.

Can you, please, try this an let us know how it goes?

Thanks!

Hello Paul,

many thanks, I will try this and get back to you on the results. 

Kind regards

Tom

Hi Patrick,

In the meantime I have tested the following two use cases using an older GS-Server

Running export using (classic) TranslationMemoryExporter:

--> Original problem (context information missing in the TMX) can be reproduced.

versus:

Running export with the new method ScheduledServerTranslationMemoryExport:

--> Original problem cannot be reproduced.

So, for the original problem, I have a solution at least and can carry on with my work :-) Many thanks for the decisive tipp about using the scheduled export! However, the issue should also not occur using the TranslationMemoryExporter method, even if it is not recommended as it is slower than the scheduled one.

Many thanks,

Tom

Hi Tom Imhof , thank you for confirming this (y). I confirm that I can also reproduce the original issue you reported against GS server CU9 using TranslationMemoryExporter.  I overlooked this as I've always used ScheduledServerTranslationMemoryExport  for server based memories as it is the more optimal approach, especially over slower network.

You're absolutely correct, the content of the exported TMX should be the same irrespective of the users choice in using the scheduled export or not.  Daniel Brockmann ,  I'll escalate this issue to the dev team.

Hi Tom Imhof , thank you for confirming this (y). I confirm that I can also reproduce the original issue you reported against GS server CU9 using TranslationMemoryExporter.  I overlooked this as I've always used ScheduledServerTranslationMemoryExport  for server based memories as it is the more optimal approach, especially over slower network.

You're absolutely correct, the content of the exported TMX should be the same irrespective of the users choice in using the scheduled export or not.  Daniel Brockmann ,  I'll escalate this issue to the dev team.

Dear Patrick,

many thanks for escalating the issue. 

Could you let me know how to unzip the archive that is downloaded using the ScheduledServerTranslationMemoryExport method programmatically?

I tried various unzip methods incl. sharpziplib and .net system.io.compression.unziptodirectory as well as gzipstream and others, but they all fail on this type of archive. Which format is it in the first place? 

Many thanks for any tip!

Hi Tom Imhof , name the download file with the extension .tmx.gz; I'm using https://7-zip.org/. It supports GZip compressed files, such as: export.tmx.gz

Dear Patrick,

yes I do know 7-zip, but I would like to unzip the gz archive *programmatically* and without installing an additional desktop app. Is there any sample code available to do this in c#/.net?

Please try the following and let me know how it goes.

string sourceFilePath = "compressed.gz"; // Replace with your source GZip file path
string extractedFilePath = "extracted.txt"; // Replace with the desired output file path

try
{
    using (FileStream sourceFileStream = File.OpenRead(sourceFilePath))
    using (FileStream extractedFileStream = File.Create(extractedFilePath))
    using (GZipStream gzipStream = new GZipStream(sourceFileStream, CompressionMode.Decompress))
    {
        byte[] buffer = new byte[4096];
        int bytesRead;

        while ((bytesRead = gzipStream.Read(buffer, 0, buffer.Length)) > 0)
        {
            extractedFileStream.Write(buffer, 0, bytesRead);
        }

        Console.WriteLine("File extraction complete.");
    }
}
catch (Exception ex)
{
    //TODO
}

Hi Patrick,

the GZipStream method indeed did the trick! Many thanks for your help!

Cheers

Tom