Hello littleclaude,
What you are can range between very simple and very complicated depending on how you want to implement it in your game. I will try to give you some pointers on where to start and hopefully you can pick up from there and expand it to better suit your needs.
As you have guessed (simplest method) way to go is to disable collision for tile you want player to be able to jump through. You create a bp that has that tile inside it and you add a box collision a little bigger than tile itself. then when player touches that collision box you disable bp’s collision and when he exits you re enable it.
Things to consider: make it only work when player is ascending (tip:get his velocity) to avoid funky situations.
Experiment with collision box size to make it feel more “natural”. And last but not least you need to create a safe zone so that bp will not re enable collisions as long as player is inside tile , otherwise he will get stuck.
I hope that above information can get you started. Good luck with your game!