dreamsavior

The Better Batch Translation API

Added 2024-10-09 08:45:32 +0000 UTC

Hello fellow translators!

If you’ve been keeping up with the latest Translator++ updates, you may have noticed a big change in how batch translations are handled. I’ve rebuilt the batch translation system from the ground up. The original system was created way back in the earliest versions of Translator++, when translation engines were much simpler. But things have changed a lot in the last six years. Modern translation engines come with a variety of fine-tuning options, and each backend has its own unique way of handling translations. Plus, with the rise of AI tools like ChatGPT and Gemini—which are actually designed for general-purpose text generation, not just translation—it was clear that a major overhaul of Translator++'s API was needed to handle batch translations more effectively.

I won’t get into all the technical details here, but if you’re curious about the new BatchTranslate class, you can find more in the Translator++'s API reference.

Introducing the new ChatGPT translator

I’ve also started using ChatGPT as a prototype for this updated API. You may have already noticed two versions of ChatGPT in the settings: OpenAI ChatGPT and OpenAI ChatGPT V2. The V2 version is an experimental model that uses the new API. For now, you can switch between the old and new ChatGPT, but eventually, once the new API is fully stable, the older version will be replaced. This will simplify things and avoid any confusion by having just one ChatGPT translator moving forward.

Thanks to this new API, ChatGPT now has some exciting new features:

Actor Information
Adding actor information can make a big difference in translation quality, especially when it comes to pronouns. You can even fine-tune translations based on the personality of the characters involved. For example, a timid character’s lines will be translated differently than those of a bold or tsundere character.

Options to automatically add character name into the prompt.

Options to automatically add character information into the prompt.

Contextual Awareness
This is one of the main reasons for the batch translation overhaul—to ensure the translation engine supports context. Context is key, especially with AI. By feeding several lines of dialogue or text at once, the AI can better understand the flow and meaning of the conversation, resulting in more accurate translations.

Options to enable context.

Sample Dialogue
This option allows you to feed the AI with static “previous messages.” It’s especially useful for giving the AI context or enforcing specific rules. You can also use this field to provide examples of poor responses versus good ones, helping the AI learn the right way to handle similar situations.

Feeding AI with sample of bad response:

Batch Manager Support
The BatchTranslate API also integrates with the Batch Manager. In the Batch Manager window, you can view the entire translation process as it happens. This gives you all the information you need to fine-tune your prompts. As we enter the era of prompt engineering, this tool is essential for debugging and optimizing your prompts to get the best possible results.