Currently, there is no UI to change the language in the frontend. You can manually set the language of any Unreal Engine program by modifying its *Engine.ini file. Add/find the Internationalization section, add/find the Culture key, set the value to the ISO 639 code of your desired language. You can find this file at /Engine/Programs/UnrealFrontend/Config/DefaultEngine.ini.
Examples
DefaultEngine.ini for English
[Internationalization]
Culture=en
DefaultEngine.ini for Japanese
[Internationalization]
Culture=ja