Studio 2017 analysis - breakdown

Hi all,

Could anyone offer an explanation for the new analysis categories in Studio 2017? What do the following categories include exactly, please?:

New columns:

Fragment words (whole TU)
Fragment words (TU fragment)
AdaptiveMT Impact

New rows:

AdaptiveMT Baseline
AdaptiveMT with Learnings
New/AT (why are these together in the same category?)

Thanks very much in advance!

Parents
  • Hi  

    The documentation around this is missing indeed!  I'll risk a brief explanation for now:

    Unknown said:
    Fragment words (whole TU)

    These are the number of whole TU fragments found.  So where a complete TU is found within a longer segment which would make it a fuzzy match or lower in the analysis results.

    Unknown said:
    Fragment words (TU fragment)

    The number of Fragment words found.  The number of times relevant fragments appear in a segment.  I think these fragment figures will provide an indication of how useful a TM could be even if there are no relevant fuzzy or 100% matches purely because of the productivity gains with autosuggest.  So it's useful if you have multiple TMs as you may find one is more relevant for a particular domain than another; and it might help with estimating time for a job because poor leverage generally and no fragment matching means you really are on your own, whereas poor leverage generally and high fragment matching means you can still expect to get some help from your TM while you work.

    Unknown said:
    AdaptiveMT Impact

    This is related to the "AdaptiveMT with learnings".  The percentage is an estimate of the reduced post-editing required for the number of segments in that row.  So it takes the original baseline MT, looks at the changes due to the Adaptive engine and makes it's assessment.  This is intended to show you how much use your are getting from your Adaptive engine in a particular text.  Could be valuable if you have several Adaptive engines in use and want to see which one is potentially going to give you the best results for your project.

    Unknown said:
    AdaptiveMT Baseline

    This is just telling you how many words/segments etc. have been handled with machine translation based on the baseline engine.

    Unknown said:
    AdaptiveMT with Learnings

    I explained this above, but will reiterate that I see this as an indication of how much value you might get from your Adaptive engine.  With the right domain and the right amount of training the theory is that this percentage should increase.  The higher it is the more confidence you might be able to have in a reduced post-editing effort.  So it's designed to help you assess your effort which is part of what the analysis is all about.

    Unknown said:
    New/AT (why are these together in the same category?)

    I agree this could be a little confusing, but AT is really "Automated Translation" and in this context I believe it relates to anything that was automatically handled by the Studio TM, but not Machine Translation.  So number only segments for example could be draft with AT status and are in effect new translations for you as they were not confirmed through being in your TM.  I believe this is the idea anyway.

     might be able to clarify if I've gone wrong somewhere.

    Regards

    Paul

    Paul Filkin | RWS Group

    ________________________
    Design your own training!

    You've done the courses and still need to go a little further, or still not clear? 
    Tell us what you need in our Community Solutions Hub

  • Hi Paul and Elisa,

    Thanks Paul for the excellent information. All correct except for the final comment on New/AT. New/AT really means the following: if you don't use Automated (Machine) Translation - AT - then the word count in this category is "New" - i.e. all words in this category will be new. If you do use an Automated Translation engine, then the word count is completely "AT" - i.e. all words are no longer 'new', as they will be automatically translated by the MT engine.

    So far, the Studio analysis report did not indicate at all the potential use of an MT engine - and this is what we have started to address with this naming change, and also by including the new information around AdaptiveMT.

    I will take an action for us to document this in more detail in future help updates.

    Let me know if you have any questions on the above.

    Thanks, Daniel

    Daniel Brockmann
    Team Trados @ RWS

  • Thanks , that is helpful. One question though... what's the difference between AT and AdaptiveMT Baseline? They seem very similar... or does this only measure SDL LanguageCloud MT whilst the AT could be any MT engine at all?

    Will be good to see some documentation on this.

    Thanks

    Paul

    Paul Filkin | RWS Group

    ________________________
    Design your own training!

    You've done the courses and still need to go a little further, or still not clear? 
    Tell us what you need in our Community Solutions Hub

  • Hi - exactly - AdaptiveMT baseline/w learnings is only shown when using SDL AdaptiveMT. All other MT providers are not adaptive, so they appear as 'plain' AT. Thanks, Daniel

    Daniel Brockmann
    Team Trados @ RWS

  • If I could add something here, I think the use of the word Baseline both as the name of the generic, non-adaptive Language Cloud engine and in the Analysis report as "AdaptiveMT Baseline" is confusing, as this means that choosing the Baseline LC provider is not adaptive and therefore it will appear in the analysis as New/AT, and not as AdaptiveMT Baseline. I think it might be a good idea to rename Adaptive MT Baseline to something else, like Unedited, for example.
  • Well, the thing is that the term "baseline" is established terminus technicus in MT world, so using anything else would be actually much more confusing... And the term really means 'a starting level', not distinguishing between adaptive and non-adaptive engine.

Reply Children
No Data