To find good prompts, Tencent AI directly asked ChatGPT to give 10 prompts, with the following prompt: Here we want ChatGPT to translate a sentence in a source language, denoted “,” into a target language, denoted “.” We need to find an appropriate natural language formulation to query the model given our target task. When dealing with generative language models, one of the most important steps is prompt design. In this article, I will analyze and explain their main findings, especially to highlight what seems to work and what doesn’t when using ChatGPT as a machine translation system. They also evaluate translation into other languages that are much less represented in its training data, such as Japanese and Romanian, and thus more challenging. Moreover, 93% of GPT-3’s pre-training data is English ( Brown et al., 2020 ). InstructGPT is GPT-3 fine-tuned with prompts “mostly in English” ( Ouyang et al., 2022 ). Note: Indeed, ChatGPT is based on instructGPT, as mentioned in the blog post.

The main objective of this study is to evaluate ChatGPT for translating text into English since most of its training data is in English. Is ChatGPT A Good Translator? A Preliminary Study by Wenxiang Jiao, Wenxuan Wang, Jen-tse Huang, Xing Wang, and Zhaopeng Tu (Tencent AI) Towards that direction, Tencent AI published a preliminary study on ChatGPT’s ability to translate: However, since it is a very recent system, ChatGPT remains to be properly evaluated scientifically to compare its NLP performance with previous work. It seems to perform especially well at natural language processing (NLP) tasks such as summarization, question answering, language generation, and machine translation.

It is based on instructGPT: It has been trained to follow and answer instructions, or so-called “prompts,” written by users.ĬhatGPT demonstrates impressive abilities in providing coherent and relevant detailed answers to user prompts. ChatGPT is a chatbot developed by OpenAI.

Translate japanese to chinese photo