Sabina Fata asked:
A student of mine, who wrote her final dissertation about gender bias in MT, tried the dictionary function in Language Weaver, but did not get good results (the sentences did not adapt to the terms in the dictionary) as compared to DeepL. What would you suggest to improve quality keeping the correct terminology? (She used the generic Language Weaver en-it model)
Is this related to this one?
Hi Paul,
yes, I meant the dictionaries that can be applied to the Language Weaver language models. But as I said, the results were not perfect, i. e. the sentences did not adapt to the injected terms.
Hi Paul,
yes, I meant the dictionaries that can be applied to the Language Weaver language models. But as I said, the results were not perfect, i. e. the sentences did not adapt to the injected terms.
Perhaps Heather Rossi has some suggestions?
In the meantime, can you provide some example text and terminology (we don't need a complete document just a few sentences and terms to reproduce the problem)? It should replace so if we can repro the issue it's a good start.
Dear Paul,
one example would be the following:
The two following term has been added to the dictionary:
Source English "trans"
Target Italian "persona trans"
Example sentence 1: In 2019, we surveyed nearly 3,000 trans and nonbinary people from across Canada."
Italian Jan/Feb 2023: Nel 2019, abbiamo condotto un sondaggio su circa 3.000 persone provenienti da persona trans e di genere non binario provenienti da tutto il Canada
Italian today: "Nel 2019, abbiamo intervistato circa 3.000 persona trans e persone non binarie provenienti da tutto il Canada."
Example sentence 2: The closure of the Connect-Clinic is likely to make accessing health care even harder for trans and non-binary people."
Italian Jan/Feb 23: "La chiusura della Connect-Clinic renderà molto più difficile l'accesso all'assistenza sanitaria per le persone persona trans e di genere non binario"
Italian today:" La chiusura della Connect-Clinic probabilmente renderà ancora più difficile l'accesso all'assistenza sanitaria per persona trans e persone non binarie"
So, there behaviour of the dictionary function in Language Weaver has changed a little bit since Jan/Feb, when Serena wrote her dissertation, but the plural forms are still not recognised.
She carried out the same tests using DeepL with dictionaries, and the results were slightly better.
You can find more examples in Serena's dissertation "Gender bias in machine translation: an investigation of the causes, characteristics, and effects of gender-biased MT output" starting from page 92 "De-biasing the system: DeepL glossaries and Language Weaver dictionaries".
I'm sorry, I used bold for the terms, but I see that the bold formatting has disappeared. :-(
Thank you... I think the bold looks ok for me? Unless you had more bold terminology in the post that's missing?
the plural forms are still not recognised.
I'm not sure how plural forms of terms are handled by LW. I'd be pleasantly surprised if LW was able to take the singular and derive the plural from it when needed. If that's what DeepL does then it's pretty clever.
I can't see the thesis... although I'd like to... as the guid like numbers in the underlying URL get stripped out by the forum:
https://thesis.unipd.it/retrieve/xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx/Rizzardi_Serena.pdf
If you use a URL shortner you can post links like this... I then found it via Google Scholar @-)
I'm glad you found it! And sorry for giving you a broken link.
(now I see the bold formattin, too)
Translate
