Ah, as it turns out it was Gamelift’s SDK initializing at the same time as we were trying to create the server. We unhooked that and now it works. The SDK must be doing something with creating sessions or something like that that interfered with Create Session Advanced.
Weird!