Why is it that there's no way to remove inputs/outputs from custom functions?

There is definitely a little “x” next to any input/output you create in a function. If you click on the input node or the output node the “details” panel should show up with your variables, just click the little “x” next to the variable you want to remove and poof! Haha