Had to manually select all textures and bulk change the Filter setting to “nearest” using the property matrix.
(I guess you could somehow edit the Paper2D texture group to make this happen too but I have no clue how or where you can edit texture groups, so this will do for me for now.)