Packaged Game loses custom config after second start

I have a game with a custom config file. Everything works fine in the editor. After packaging, I can run the game with no problems a first time, everything works. But the second time and beyond, it returns an empty config class. It also created the .ini files after the first launch of the game. If I delete the created .ini file, it works again.
Whats the idea behind that?

// Edit: If I use one of the default config files like “Game” instead my own .ini file everything still works after restarting the game.

If I replace
UCLASS(config=MySettings, defaultconfig)
UCLASS(config=Game, defaultconfig)

But I need to use the MySettings.ini file and don’t want to have it in the game.ini file.
Any advice?