OpenAI provider for Trados

I just read Paul's information here:
Unleash the Power of Translation with AI Professional

which is 6 months old.

He (and several others) talks about the "Trados Copilot AI Assistant" plugin. When I search the net, there are many hits, such as this one:

https://www.trados.com/product/studio/FAQ/what-is-Trados-Copilot-AI-Assistant-and-how-do-I-access-it-in-Trados-Studio/

However, no such plugin seems to exist. In fact, it seems to be the OpenAI provider for Trados plugin. 

I also found, in a query by Michael Beijer, the statement that "inside Trados Studio 2024, there is an app called 'Trados Copilot - AI assistant". This led me (don't ask how) to the documentation center 

Welcome to the Trados Studio cloud capabilities documentation

(sorry about the font; it is copied) which provided me with lots of useful information that I did not even know existed!

Among other things, I found out (by myself) that in order to see the AI Assistant in the View ribbon (in the Editing view), you also have to have the plugin installed! This is not mentioned in the instructions.

Anyway, my main point is that it is confusing to read about both "Trados Copilot AI Assistant" (mainly) and "OpenAI provider for Trados" yet nowhere see it stated that they are in fact the same except that the former (as far as I can see) requires the latter.

Since this feature is a quite important one (and since, furthermore, the possibility to use the plugin directly, without making changes to the Project Settings, is very useful), I really do think you should take care to avoid confusion.

(I may certainly have some misconceptions here, in which case I would be very glad for further clarifications.)

emoji
Parents
  •  

    Indeed, we have added a bit of confusion as we were very quick to provide a solution as a plugin (AI Professional) and then as we realised there was a better solution to ensuring we could make AI a longer term and well integrated solution it became two things:

    • Trados Copilot - AI Assistant
    • AI providers (similar to an MT provider) that would be able to work with the Trados Copilot - AI Assistant

    If you have Trados Studio 2024, which is the version you need to be able to take advantage of this, you should note that Trados Copilot AI Assistant and the first AI provider (OpenAI Provider for Trados) are actually pre-installed. 

    You are half right in that one requires the other, but you have it the wrong way around.  The idea is that Trados Copilot - AI Assistant will be part of the Trados Studio core product.  On its own it's useless as it will need an AI provider to be able to provide results.  So on the appstore you will be able to find AI providers of your choice (in time) that will deliver the AI to use within the AI Assistant and also as an alternative to an MT provider like Language Weaver or DeepL... or even alongside these MT providers so you can take advantage of your own terminology in MultiTerm for example.

    I thought I'd just ramble a little for 5 mins and it might be helpful for you:

    Let me know if you still have some questions after that?

    Paul Filkin | RWS Group

    ________________________
    Design your own training!

    You've done the courses and still need to go a little further, or still not clear? 
    Tell us what you need in our Community Solutions Hub

    emoji
  • Am I correct in understanding it thus: 

    - The AI Assistant is part of Studio.

    - For it to work, you need an LLM provider. So far only OpenAI Provider for Trados is available, providing OpenAI and Azure. In future, more will come.

    Because the Assistant is useless without an LLM provider, it is disabled if OpenAI Provider for Trados is not installed. 

    But why? Why not keep it, always, and provide it with a text saying it requires an LLM provider (and suggesting available plugin[s])?

    BTW, why not just call the plugins OpenAI/Azure LLM provider, X LLM provider, Y LLM provider, etc. The "for Trados" seems superfluous in the context.

    emoji
  •  

    - The AI Assistant is part of Studio.

    It will be.  Right now it's part of the plugin as I explained.

    - For it to work, you need an LLM provider. So far only OpenAI Provider for Trados is available, providing OpenAI and Azure. In future, more will come.

    Correct.

    Because the Assistant is useless without an LLM provider, it is disabled if OpenAI Provider for Trados is not installed. 

    It's not disabled... right now it'll be completely missing!  As I explained, right now it's part of the plugin.  We have separated it, but we need the Core Studio Team to adopt it into a future release.  Once that happens it will always be there, just not usable without an AI provider (a source for the LLM).

    But why? Why not keep it, always, and provide it with a text saying it requires an LLM provider (and suggesting available plugin[s])?

    Exactly.

    BTW, why not just call the plugins OpenAI/Azure LLM provider, X LLM provider, Y LLM provider, etc. The "for Trados" seems superfluous in the context.

    Many discussions about that one and this is the name that was agreed amongst a wide range of stakeholders.

    Paul Filkin | RWS Group

    ________________________
    Design your own training!

    You've done the courses and still need to go a little further, or still not clear? 
    Tell us what you need in our Community Solutions Hub

    emoji
  • Hi, 
    I upgraded to Studio 2024 for the AI integration, but I am unable to get it to work, even after reading this. Could you please simplify it? Here are my questions:

    Do I need to install the plugin? Or does it come pre-installed?

    I have a subscription to ChatGPT 40, and can get an API key, but when I try to enter the information, I get stuck testing the connection. See screenshot:
    Screenshot of RWS AppStore Applications settings showing a failed connection test with an error message 'Connection Failed - Code: model_not_found. Message: The model 'gpt-4o' does not exist or you do not have access to it.'

    I am not sure what I am doing wrong. The only reason I upgraded was for this functionality.

    emoji


    Generated Image Alt-Text
    [edited by: RWS Community AI at 5:51 PM (GMT 0) on 20 Nov 2024]
  •  

    Hi Tess, I think your problem is you don't have the right tier for billing.

    I have a subscription to ChatGPT 40

    This is irrelevant.  ChatGPT and the OpenAI platform you use for any CAT tool, or application working with the API, are different.

    and can get an API key

    Indeed... but it may not be an API key based on a Tier suitable for your requirements.  Check this link:

    https://platform.openai.com/docs/guides/rate-limits?context=tier-free

    Note that the Free Tier, which will get you an API key, doesn't support the use of the model you have tried to use.  You need at least Tier 1.  Perhaps this is the problem?

    Paul Filkin | RWS Group

    ________________________
    Design your own training!

    You've done the courses and still need to go a little further, or still not clear? 
    Tell us what you need in our Community Solutions Hub

    emoji
  • Thanks Paul! Yes I believe so. For Azure, is Tier 1 same as S1? I can find a price for that, but it is very confusing. Is it the Azure AI Translator subscription I need? Do you happen to have links to the services freelancers need in order to purchase the subscription? I.e. I would prefer to not have anything enterprise level, and not talk to a sales person.

    emoji
  •  

    Don't confuse Azure with different Tiers of OpenAI.  OpenAI and Azure OpenAI Service both provide access to advanced AI models, but they differ in ownership, access, integration, and target users.

    OpenAI is an independent research organisation focused on developing artificial intelligence technologies. It offers APIs that allow developers to integrate AI models like GPT-4, DALL-E, and Whisper into various applications. Access to these models is generally open to the public, with subscription plans varying by model and usage. OpenAI's services are accessible globally and are designed to cater to a broad audience, including individual developers and businesses.  The API key you probably need can be found in the OpenAI platform as well as the different Tiers.

    Azure OpenAI Service, on the other hand, is a collaboration between Microsoft and OpenAI. This service integrates OpenAI's models into Microsoft's Azure cloud platform, providing enterprise-grade security, compliance, and scalability. Azure OpenAI is available exclusively to Microsoft enterprise customers and requires an Azure subscription. It offers features such as private networking, regional availability, and responsible AI content filtering, making it suitable for organisations with specific security and compliance requirements.

    In a nutshell, while OpenAI provides direct access to its AI models for a wide range of users, Azure OpenAI Service offers a more controlled, secure, and integrated environment tailored for enterprise applications within the Azure ecosystem.

    Do you happen to have links to the services freelancers need in order to purchase the subscription?

    I already pointed you in that direction with the link to the documentation for the OpenAI platform.  But if you look at the plugin itself you'll see this:

    Screenshot of RWS AppStore application settings window with options for GPT-4 connection, prompts, search options, and a highlighted link to 'Sign up for an OpenAI account'.

    That's the one you need.

    It's also worth reviewing the documentation here in the appstore: https://appstore.rws.com/Plugin/249?tab=documentation

    I think generally we're going through a period of significant change and the sort of features out there today offer tremendous value, but do require an investment of time to understand how to work with them.  Very little is just plug and play!!  But once you get there you'll find there is a lot more you can do with this stuff and not just in Trados.

    Paul Filkin | RWS Group

    ________________________
    Design your own training!

    You've done the courses and still need to go a little further, or still not clear? 
    Tell us what you need in our Community Solutions Hub

    emoji


    Generated Image Alt-Text
    [edited by: RWS Community AI at 10:36 PM (GMT 0) on 22 Nov 2024]
  • Thank you Paul! When clicking on the "Sign up for an OpenAI account" I am taken to the login page. I already have an account. After I log in I get to this page:

    Screenshot of a webpage with a 'Developer quickstart' guide, code snippet in node.js, and sections titled 'Meet the models' showcasing 'GPT-4o', 'GPT-4o mini', and 'o1-preview & o1-mini' with descriptions and 'Explore all' link.

    I am subscribed to GPT-40 Mini, but if I understand it correctly, I need something on top of this.

    The only reason I upgraded to Studio 2024 was for the possibility to integrate AI. However, it seems like I would need to be an IT_engineer to understand how to integrate it, or it is more for Enterprise users. It was much easier to integrate MT before. Now I kind of regret upgrading. Finding the steps and the documentation, and knowing what to subscribe to, and how, is WAY confusing for a mere freelancer like me. I did review the documentation in the app store, but it doesn't make it any clearer what it is I need to subscribe to precisely.

    emoji


    Generated Image Alt-Text
    [edited by: RWS Community AI at 10:33 PM (GMT 0) on 3 Dec 2024]
  •  

    How do you know you are subscribed to GPT-4o Mini?

    If you go here what Tier does it tell you that you're running?

    https://platform.openai.com/settings/organization/limits

    For example, this is what I see in my account:

    Screenshot showing 'Increasing your limits' section on a website. It indicates the organization is currently in Usage tier 2 with criteria for moving to Usage tier 3, including spending $100 on the API and waiting 7 days after payment.

    So, I am on Tier 2.  Once you check your Tier (and a lower Tier may be enough for you) go here and generate a new API key:

    https://platform.openai.com/settings/organization/api-keys

    This is important because for all I know you may have generated your key before getting onto an appropriate Tier.  So I recommend you delete your existing keys and create a new one.

    Then try again.

    However, it seems like I would need to be an IT_engineer to understand how to integrate it, or it is more for Enterprise users.

    Not really.  The Azure OpenAI option is an Enterprise solution, but if you're just using OpenAI and the models they provide then this would be suitable for anyone.

    It was much easier to integrate MT before.

    Indeed!  And you can still use these more straightforward solutions.  But if you want to use AI then I'm afraid at this pioneering stage of its use you are going to have to invest your time to understand what you're using... at least to be able to get to grips with the way it's billed and how this relates to the API key you're using.

    Paul Filkin | RWS Group

    ________________________
    Design your own training!

    You've done the courses and still need to go a little further, or still not clear? 
    Tell us what you need in our Community Solutions Hub

    emoji


    Generated Image Alt-Text
    [edited by: RWS Community AI at 10:16 PM (GMT 0) on 4 Dec 2024]
  • Hi Paul, 

    OK, I think I got it now, by clicking on "Buy credits" I got it to connect. Thanks for bearing with me!

    emoji
Reply Children