SDL PowerShell Toolkit

SDL is pleased to announce the availability of a beta version of the SDL PowerShell Toolkit.

The SDL PowerShell Toolkit is a set of modules using Windows PowerShell scripting technology and the Project Automation and Translation Provider APIs from the SDL Trados Studio Professional SDK. In a nutshell, the modules provide functions and sample code that you can re-use in your PowerShell scripts to automate SDL Trados Studio. They feature an initial set of code for use in typical Studio automation tasks such as creating a project, a translation memory or a package derived from a project. You can use these as a starting point for your own PowerShell-based efforts. It is assumed that the reader is familiar with Windows PowerShell as well as an initial understanding of the SDL Trados Studio SDK, in particular the project automation API.

Over time, we would like to see the development community develop further modules and helpful functions that we can share with each other.

Best regards, Ian

Ian Davies | Senior Product Manager | SDL | Language Technologies Division | +44 7826843819

Paul Filkin | RWS Group

________________________
Design your own training!

You've done the courses and still need to go a little further, or still not clear? 
Tell us what you need in our Community Solutions Hub

PowerShellToolkit.zip
  • Hello?! Anyone in there?!
    Am I being deliberately ignored with my (presumably unpleasant) discoveries?
  • Hello Evzen,

    We have added an item of work to look at powershell and see what needs to be done to ensure it works correctly with the latest versions of the products. If I'm really honest this doesn't have a very high priority as there are many other things waiting at the top of the tree which affect more users and there are other ways to handle the problems most of the time. But we do appreciate that not everyone wants to use C# and some are more comfortable with a scripting tool.

    A good starting point would be for us to identify the things, in a single line or two, that need to be done so they don't get lost in long threads. This is something we'll come back to so we can agree with you, and if anyone else is having problems with them too, so we can prioritise in case the effort is substantial.

    So to answer your question we are listening, but are just not in a position to do anything about them in the very near future. I think I did ask you a while ago whether we might be able to help by resolving some of these things for you in a different way as this could be a good stop gap... but you didn't respond?

    Regards

    Paul

    Paul Filkin | RWS Group

    ________________________
    Design your own training!

    You've done the courses and still need to go a little further, or still not clear? 
    Tell us what you need in our Community Solutions Hub

  • Paul, it is obvious that most (if not all) of the issues recently reported by me have nothing to do with PowerShell itself. PowerShell is just the way to use the API. Moreover, I have commented in quite a few threads where the same issues were reported by people NOT using PowerShell.
    Show me working C# code which does NOT show the buggy behavior to prove that the problem is PowerShell...

    Regarding your previous offer - perhaps I did not post the answer after all, since it was quite pointless... because you obviously failed to get the point of the discussion :-\.
    So, in short - I need to be able to automate EVERY basic engineering operation (creating project, running tasks, creating packages, importing packages, creatingTMs, updating TMs, etc.) from commandline.

    And in fact I'm already very close to have it already done using the PowerShell Toolkit... but the terrible bugs in either API or Studio itself are preventing me from getting it finished - memory hogs causing OutOfMemory exceptions, options not working as documented, etc.

    So you should better invest the effort in fixing the bugs instead of developing some funny single-purpose application which would be full of new bugs anyway...

  • Hello Evzen,

    The reason I asked again is because fixing this is something that will require core development, so finding a workaround is going to be the best approach if we want something quickly.

    We do have a list of things we have already raised with the development team that need to be fixed, some which you have probably come across already and some which you won't. We, and by "we" I mean the team that supports developers, don't set the priorities for core development so we can escalate them (and we do) but they still have to fit within other priorities. So we find workarounds where we can.

    If I look at your default project template issue. Why can't you use a named project template for example? If you do that then the API performs correctly and using your example will honour the excel settings to ignore worksheet names. If you make that your default it still works. So is this a major problem for you to work around this problem in this way?

    Regards

    Paul

    Paul Filkin | RWS Group

    ________________________
    Design your own training!

    You've done the courses and still need to go a little further, or still not clear? 
    Tell us what you need in our Community Solutions Hub

  • Just to add to this. I discussed this again with Romulus just now and he is going to take a better look at this this week to identify where the problem is exactly. Then either find a workaround, if there is one, or just make sure we raise the awareness of this problem again with the development team to try and get it fixed.

    In the meantime it would be helpful to just understand why you need to use the default for command line scripts and can't use a specified template?

    Thank you

    Paul

    Paul Filkin | RWS Group

    ________________________
    Design your own training!

    You've done the courses and still need to go a little further, or still not clear? 
    Tell us what you need in our Community Solutions Hub

  • Unknown said:
    The reason I asked again is because fixing this is something that will require core development, so finding a workaround is going to be the best approach if we want something quickly.

    Well, but you have to fix it anyway as most (if not all) of my recent discoveries look like quite serious core BUGS...

    I have probably mentioned already somewhere that I have already implemented a workaround for the default project template:

    1. Get default project template GUID from the user settings (UserSettings.xml) file
    2. Get the location of local projects storage from ProjectApi configuration (SDL.ProjectApi.xml) file
    3. Get the default project template path from local project storage (projects.xml) file
    switch ($StudioVersion) {
        "Studio2" {$StudioVersionAppData = "10.0.0.0"}
        "Studio3" {$StudioVersionAppData = "11.0.0.0"}
        "Studio4" {$StudioVersionAppData = "12.0.0.0"}
    }
    $DefaultProjectTemplateGuid = Select-Xml -Path "${Env:AppData}\SDL\SDL Trados Studio\$StudioVersionAppData\UserSettings.xml" -XPath "//Setting[@Id='DefaultProjectTemplateGuid']" | ForEach {$_.node.InnerXml}
    $LocalDataFolder = Select-Xml -Path "${Env:AppData}\SDL\ProjectApi\$StudioVersionAppData\SDL.ProjectApi.xml" -XPath "//LocalProjectServerInfo/@LocalDataFolder" | ForEach {$_.node.Value}
    $DefaultProjectTemplate = Select-Xml -Path "$LocalDataFolder\projects.xml" -XPath "//ProjectTemplateListItem[@Guid='$DefaultProjectTemplateGuid']/@ProjectTemplateFilePath" | ForEach {$_.node.Value}

    At the moment I am not quite sure how realiable it will be in the real world - the users across the company have really VERY variable environments, so the result is unpredictable.

    Unknown said:
    If I look at your default project template issue. Why can't you use a named project template for example? If you do that then the API performs correctly and using your example will honour the excel settings to ignore worksheet names. If you make that your default it still works. So is this a major problem for you to work around this problem in this way?

    This is not acceptable. We are not talking about situation you seem to be typically used to - a SINGLE user (typically a freelancer translator). We are talking about solution for DOZENS of individual users across the company with various environments, various needs, various habits, etc., which MUST be respected. I am not in a position to push them to workarounds... especially if these weird workarounds would be connected with the automation... that would show the automation in VERY BAD light.
    So I really need a solution which "creates new project based on default template configured in Studio", just as the Studio does when the project is created from Studio GUI.

  • Unknown said:
    We are not talking about situation you seem to be typically used to - a SINGLE user (typically a freelancer translator). We are talking about solution for DOZENS of individual users across the company with various environments, various needs, various habits, etc., which MUST be respected.

    Evzen,

    I wish you would tone down your language when you respond to me.  I'm trying very hard to help you.  I do work for a company that has a fairly large LSP and I reckon I also deal with many more companies than you do who are trying to find solutions for these problems.  Truth is I have no idea who you are Evzen or what problems you are trying to solve from a business perspective.  You could just as easily be a hobby scriptor rather than someone providing solutions for a major enterprise supporting thousands of users.  You have an aversion to using the APIs without powershell (whether they work or not) so it's very hard to tell.

    For this reason I asked you this:

    Unknown said:
    So is this a major problem for you to work around this problem in this way?

    A simple explanation would be just fine without the barbed responses.

    Unknown said:
    So I really need a solution which "creates new project based on default template configured in Studio", just as the Studio does when the project is created from Studio GUI.

    ok.  So we will look at this to see whether there is a way to workaround the problem in the product for you and also see what we need to do in order to address the product.  I did have a quick play with InSource which offers a simple example of how to use the API for project automation and there we also do not use the default template.  So custom templates are always used.  Could be we did this because of the scenario you have described.  However, we will look at this and let you know the outcome one way or the other.

    Regards

    Paul

    Paul Filkin | RWS Group

    ________________________
    Design your own training!

    You've done the courses and still need to go a little further, or still not clear? 
    Tell us what you need in our Community Solutions Hub

  • Hi Paul,

    I'm just judging from your replies in other forums, where the solutions usually concern one particular person in one particular situation. That's all, nothing else.

    Regarding the default template problem - if someone can confirm that my current workaround could be the right direction (is this perhaps the same way Studio itself determines which is the default configured template?) or what should be better workaround, that will be enough for now for me.
    (Still, this bug should be fixed in the API rather earlier than later, IMO)

    What's much more serious are the other reported showstoppers:

    • "Invalid number of analysis bands" exception when Analysis task is called using overload with status event handler
    • (Presumably) memory leaks causing Out Of Memory exceptions (and/or other failures) when "Create New Project TM" option is used when creating packages
    • Similar (same?) memory issues during Analysis causing the analysis to fail
    • Json.NET component version issue which started happening after update to CU7 (and disappeared after downgrading back to CU6)

    The memory issues and the Json.NET problem concern rather Studio as such than only the API.

    Regarding the memory issues - it looks like it can be related to work with rather huge TMs. I can see it happening when project includes one or more TMs which are several hundreds of megabytes, up to even ~1GB *.sdltm file.
    On the other hand, from the memory consumption graphs I posted recently it doesn't seem that the TM size itself is the problem; it looks rather like some unfreed memory issue.

  • Oh, and there is also the problem with project TMs not being included in packages at all under certain cicumstances:
    community.sdl.com/.../34392

    Not a showstopper, there is a workaround... but still a quite long-standing BUG.
  • First of all you are right the default behavior in the API has nothing to do with Powershell Toolkit. Your implementation for discovering the current default template is really good and reliable since it's pretty much what Studio does at the "UI" level.

    Now to clarify a bit the default "mistery" in the Project Automation API. The documentation says the constructor will use the default template, the information that is unclear is that it will use the default template configured in the current configured user profile. Most of the times this is the Default user profile which is based on the default project template. It would make more sense to use the current default project template persisted in the user settings so I will raise this change with the development.

    Romulus Crisan | Translation Productivity Development Manager | SDL | (twitter) @cromica_82 | (blog) http://www.romuluscrisan.com/