That’s exactly it.
So the option actually fixes the behavior the initial question was referring to, but it also makes the application actually shut down when you press the X button in the top-right.
It works well for me, since that’s the behaviour I want when I try to shut down the application, but I would rather the two features be independent.