Is there a way to split a sdltm?

Hello people,

We have got a several different machine translations memories(.sdltm) that's huge at least 180.000 different segments.

the problem is when people that work in our place  using our sdltms it take to long time to  Pre-translate the projects against our translation memories

I wonder if there is a way to split a sdltm/ is there another solution to handle a huge sdltm?

Thank you in advance.

Parents
  • Hi Daniel,

    180k TUs isn't huge... but perhaps you can use Project TMs when you create your projects? This way the TMs are smaller and more specific.

    One other question, are you sharing a filebased TM between many translators as opposed to using a server based TM?

    Regards

    Paul

    Paul Filkin | RWS Group

    ________________________
    Design your own training!

    You've done the courses and still need to go a little further, or still not clear? 
    Tell us what you need in our Community Solutions Hub

  • We are using Project Tm:s but when we create our projects we using our big customer memory, then when the translator recieve the project of course its just a newly created tm for the project (not the big once).
  • Unknown said:
    We are using Project Tm:s but when we create our projects we using our big customer memory, then when the translator recieve the project of course its just a newly created tm for the project (not the big once).

    Daniel
    If I understand you well, your translators don't work with the main TM. In this case, what do you mean exactly by "the problem is when people using our sdltms it take to long time to use...".
    Which people do you mean here? The project managers who prepare the projects? What is it that takes a long time: is it (1) the time to prepare the project (pretranslation and analysis) or is it (2) the delay in the Editor when translating.
    It would be good if you could be a bit more specific about where the problem exactly shows up, so we can give you appropriate recommendations.
    Let me also stress once more that a size of 180'000 segments is not considered to be a "huge TM" for Studio and should not create any problems. The only common bottleneck is when several users access a file-based TM simultaneously and this can be solved by using a server-based TM (using the SDL GroupShare server).
    Walter
  • Hi Walter,
    I mean when a project manager in our place creates a project turn on our customers (main) translation memory.
    Then (Prepare without project TM), that is what takes time.

  • Daniel

    The Prepare task may take some time, depending on the number and size of the files in the project. Consider however that this is a one-time task.
    And it depends on where your files, TMs and TBs are stored. You still didn't tell us where you store your TMs. Is this on a local drive or on a network drive?

    Walter
  • Oh sorry,
    In general are our Clients TM:s located on a network drive but I did a test to put the TM into a local drive it took the same amount of time.

  • Hi Daniel,

    I forgot to ask also where are the source files stored. However, here is how I see the big picture:

    Try first with all the source files, TMs, TBs, stored on the local disc. Make sure you re-index TMs, reorganize termbases and prep your files before use. Also, in the TM settings, under Performance and Tuning you have the Advanced Tuning section where you can choose Speed over Accuracy. That might help too (see below screenshot). Try on several computers to make sure it's not a computer-related issue. You can also consider doing a general PC clean-up. Uninstall any unnecessary applications, perform a system check (from a command prompt run sfc /scannow) and use a cleanup tool. I use CCleaner and it's very easy to use and works great. It cleans all unnecessary files and can also fix broken registry entries. A free version is available online.

    One good hardware upgrade that you can make is the hard disk. Solid State Drives will help a lot, as the access times are way shorter then traditional hard disks and SSDs are not that expensive nowadays. I have a Samsung one and when I did the upgrade I could not believe how fast everything worked! Of course this would help if you have your resources stored on that local SSD drive not on the network.

    If you need to have a centralized way to share TMs, Projects, Termbases, then you might want to take a look at our GroupShare offerings. There are basically 3 options:

    1. GroupShare On-premise - this means you buy the license and you install it in your own network and are responsible for managing it and of course for the infrastructure.

    2. GroupShare Hosted - this means we, SDL, are responsible for the infrastructure and the actual software is installed in our data centers. You will have a dedicated VM just for your server. You will be given a link and credentials to access it.

    3. GroupShare Cloud - this is similar to 2. but the VM and infrastructure are shared with other customers. You will not see any difference on your end, because we set it up in such a way that every customer has access only to their own data.

    The last two options would be helpful if you have people working from several offices or locations, but if everybody is in the same location, then option 1 is the best choice.

    Let us know how it goes and if we can help with anything else,

    Thank you,

    Adrian

  • Hi Adrian, thank you for the info I already changed Advanced tuning from accuracy to speed.
    there was no difference in time tho.
  • Hi Daniel and all contributors

    Following this thread from the beginning and seeing no resolution so far, let me ask one question: "How much time doe these project preparation processes really take?"

    What I want to point out is that no single timing figure has been mentioned so far. The only statement we have is Daniel's first statement:  "... the problem is when people using our sdltms it take to long time to use..."

    What is "too long time to use"? Could it be that the expectations are too high and that the time it actually takes to prepare projects is absolutely within the normal timings?

    It would be helpful if we could get some examples of preparation projects that take too long, so we can judge whether we really have a problem here.

    Walter

Reply
  • Hi Daniel and all contributors

    Following this thread from the beginning and seeing no resolution so far, let me ask one question: "How much time doe these project preparation processes really take?"

    What I want to point out is that no single timing figure has been mentioned so far. The only statement we have is Daniel's first statement:  "... the problem is when people using our sdltms it take to long time to use..."

    What is "too long time to use"? Could it be that the expectations are too high and that the time it actually takes to prepare projects is absolutely within the normal timings?

    It would be helpful if we could get some examples of preparation projects that take too long, so we can judge whether we really have a problem here.

    Walter

Children