Translation memory management: duplicate TUs or overwritten TUs

Hello,

I manage the TMs and translation resources for my company. When I import a TU with a custom set of fields (filename, category, subcategory, translator, date entry, native check) and then import the exact same TU from a different project with a different set of fields, the original TU is overwritten. Instead of having 2 TU's I just have 1. This is problematic. If one TU is used for one manual, then overwritten with info from another manual, the reliability of the TU is put into question even though it could have been used serval times.

Is there any way to stop this from happening? I would like two TU and not like old TUs to be overwritten. 

As of now, the only way I know how to NOT override an old TU is to import the new TU into another TM. I split our master TM into 3 TMs for our main divisions and this sorta helped. Another workaround is to customize the field settings of the TU to allow for multiple values. That way I could keep track of where the TU was used (useful for manuals or say makings sure that speech from the president of company stays associated with the president). But this would lead to really huge "filename" fields for me and would potentially take an incredibly long time to initiate because this setting can only be done from a fresh new TM... right? How would I do this for a TM with a few hundred projects and several 10s of thousands of TUs?

So anyway, if anyone has a good translation memory management method or tips, especially for in-house translators, I'd love to hear yr thoughts.

Best regards,

Keenan

  • Paul,

    I have robust fields (category, subcategory, file name, translator, native check, date added) and this only helps when the target is different. If the target is the same, the field values get overwritten by those of the most recent import. As I said in my first post, if I changed the TM settings to "allow multiple values" then, as indicated by the hazard icon, it would delete all the fields there to begin with which would be a disaster. (My UI settings are in Japanese but you get the idea)

    "If the only reason you want a 100% duplicate where source and target are exactly the same is for counting TUs then you need to force the software to not make the default choice."

    As I explained several times, that is not the reason I want this option. Specifically, see the very non-hypothetical scenario I explained in my last post. Also, from an earlier post, seeing multiple duplicates with different fields does make sense and does affect the translator and translation. Seeing 10 occurrences of the same source-target verses 1 instance but with a different target, helps the translator choose the right one.
    Also, I don't know what you mean by "forcing the software to not make the default choice."

  • Unknown said:
    Also, from an earlier post, seeing multiple duplicates with different fields does make sense and does affect the translator and translation. Seeing 10 occurrences of the same source-target verses 1 instance but with a different target, helps the translator choose the right one.

    Hi  

    ok... can you elaborate on this for me please as I'm clearly missing something here.  If the source and target results are all the same then why does it matter which one the translator picks?

    Paul Filkin | RWS Group

    ________________________
    Design your own training!

    You've done the courses and still need to go a little further, or still not clear? 
    Tell us what you need in our Community Solutions Hub

  • Here's another example, similar to my earlier flier/pamphlet example.

    TU#1 Source: パワーコンディショナー Target: PV inverter    Filename: P11 manual
    TU#2 Source: パワーコンディショナー Target: PV inverter    Filename: T11 manual
    TU#3 Source: パワーコンディショナー Target: PV inverter    Filename: R11 manual
    TU#4 Source: パワーコンディショナー Target: PV inverter    Filename: S11 manual
    TU#5 Source: パワーコンディショナー Target: PV inverter    Filename: Q11 manual
    TU#6 Source: パワーコンディショナー Target: power conditioner    Filename: F11 manual

    So all six of those TUs are imported, in that order, meaning in that there are only two TUs in that TM:
    TU#1 Source: パワーコンディショナー Target: PV inverter    Filename: P11 manual
    TU#6 Source: パワーコンディショナー Target: power conditioner    Filename: F11 manual

    Now I am translating something and I want it to be similar to the R11 manual, like, an update of the R11 manual.

    When I, or the several non-native translators in my company, come across   パワーコンディショナー in the source, the translation memory results window shows results like this:
    1 Source: パワーコンディショナー Target: power conditioner    Filename: F11 manual 99% match (-1 penalty)
    2 Source: パワーコンディショナー Target: PV inverter    Filename: P11 manual 99% match (-1 penalty)

    So which one does the translator choose? It's pretty much a toss-up. The vital TU#3 was overwritten so the translator is lost. If the first 5 TUs were not overwritten, the translator could see that "power conditioner" is the preferred and most used option, plus, most importantly, knowing the origin of the TU, would help translation when the context is just as important as the target. 
    So if the translator chooses "power conditioner" it would be wrong. Obviously, a TB could supplement this by defining context, which we do have, but I'm just giving this short TU as an example. 
    I just explained this to a coworker and he also strongly agreed that knowing the context is important. My other Japanese coworkers would freak if I told them their data was being overwritten.

  • Hi  

    I spent a little time playing with this today after sending six packages out to different people so I could reproduce this as accurately as possible.  I do have different context in the TU because I was getting confused with all the duplicates but you can hopefully still see what is happening.  First, this is what I get if I update without any fields at all, as expected:

    The F11 and others are treated as variables so even though my source for the manual names are different I only get one TU.  Then as expected, and as you explained, I get two TUs for the two segments we are talking about.  Five of them translated the same way, one different.

    If I use fields, set up like this:

    I used a picklist to control what I was getting, but you could use any type of field you like.  The important part is that I'm allowing multiple values.  When I update the TM with the returned packages and apply the appropriate update value into the fields then I get this in my TM:

    So still four results but the fields values are all added.  The effect this has in the files themselves would be this:

    So I can see which one to choose based on the field name.  Doesn't this approach work for you?

    Paul Filkin | RWS Group

    ________________________
    Design your own training!

    You've done the courses and still need to go a little further, or still not clear? 
    Tell us what you need in our Community Solutions Hub

  • Hi  

    Thanks for your email, and your patience, explaining to me again what your problem is.  I'm going to summarise the situation so it's clear (for me at least):

    • you need to be able to differentiate between duplicate translations based on your field values
    • you have many field values in use, all of which are important, so using "allow multiple values" is not a solution for you because there would be too many in the TM results pane to make it possible to use them during translation
    • you could apply filters to the TMs based on a field value so you only get results from the field you want, but this is not a solution for you either
    • using multiple TMs is not a solution for you because the management of so many TMs is impractical
    • what you would like is the ability to update and create duplicates during import

    Currently, as you know, it is very difficult by design to create a true duplicate in a Studio TM.  Even if you go to TM Maintenance and manually create one by copy pasting over another you'll find Studio removes one automatically.  So making the change to allow this would be an enhancement, and probably not a simple one either.  It is also very likely to cause duplication where you don't want it because it would probably be an all or nothing approach and this would add unwanted maintenance to your TMs. Maybe an option to suggest is to add new translation units if the field values differ and perhaps that would give you the desired effect?

    TM updates is quite a complicated area and all changes need to be very carefully thought through, however, I think the best approach is for you to log this request in the ideas site and the product management team can pick it up and decide whether it's something they wish to introduce based on their views and the amount of support you get.

    I hope this reflects the situation.  Sorry it took so long to get there too!

    Paul Filkin | RWS Group

    ________________________
    Design your own training!

    You've done the courses and still need to go a little further, or still not clear? 
    Tell us what you need in our Community Solutions Hub

  • Unknown said:
    Maybe an option to suggest is to add new translation units if the field values differ

    How do I "add new translation unit" as an engineer when performing TM update after receiving translation packages from translators?
    AFAIK, adding new TU is possible only during translation (i.e. on the translator's side), but that action is completely disconnected from what happens in the main project after importing the return package...
    Or am I missing something? Is the "this segment is supposed to be added as new TU" information recorded somewhere in the SDLXLIFF (so that subsequent TM update can act accordingly)? I believe it's not.

  • Hi  ,

    You're not missing anything... there is no such option. I was suggesting Keenan might want to suggest this when/if he creates his idea.  But re-reading what I have written I can see it wasn't very clear!  Sorry about that.

    Paul Filkin | RWS Group

    ________________________
    Design your own training!

    You've done the courses and still need to go a little further, or still not clear? 
    Tell us what you need in our Community Solutions Hub

  • Hi Keenan,

    I guess you are trying to put the cart before the horse.

    You don't need multiple TU with same translation, which as Paul said is difficult to implement, but what about a workaround which might be way easier to implement?

    Your example:

    TU#1 Source: パワーコンディショナー Target: PV inverter    Filename: P11 manual
    TU#2 Source: パワーコンディショナー Target: PV inverter    Filename: T11 manual
    TU#3 Source: パワーコンディショナー Target: PV inverter    Filename: R11 manual
    TU#4 Source: パワーコンディショナー Target: PV inverter    Filename: S11 manual
    TU#5 Source: パワーコンディショナー Target: PV inverter    Filename: Q11 manual
    TU#6 Source: パワーコンディショナー Target: power conditioner    Filename: F11 manual

    So all six of those TUs are imported, in that order, meaning in that there are only two TUs in that TM:
    TU#1 Source: パワーコンディショナー Target: PV inverter    Filename: P11 manual
    TU#6 Source: パワーコンディショナー Target: power conditioner    Filename: F11 manual

    Now I am translating something and I want it to be similar to the R11 manual, like, an update of the R11 manual.

     

    You suggest you need several TU for the various Filename fields, so that translators know which one to use, but what if importing TU into your existing TM would have the following option (which checkbox to enable it):

    If same source and target then update the following fields. (the fields would need to be selected with checkboxes)

    in the background the process would use regex to check if field current string contains the string of the field from new TU and update it if necessary:

    old value for field Filename:

    P11 manual

    value for field Filename of new TU:

    R11 manual

    new value for that TU in TM:

    P11 manual; R11 manual

     

    During translation it would look like this:

    1 Source: パワーコンディショナー Target: power conditioner    Filename: F11 manual 99% match (-1 penalty)
    2 Source: パワーコンディショナー Target: PV inverter    Filename: P11 manual; R11 manual 99% match (-1 penalty)

     

    So the translators would see which TU to use for the manual they are translating whithout the TM result window being cluttered with too many strings.

     

    Alternatively Trados could have an additional filter for TM result window could be set in project options:

    Filter Fieldname: R11 manual

    TM result window would then show results with Fieldname containing "R11 manual" as first result (most relevant one), which would mean less scrolling for the translator.

     

    Regards,

    Pascal