That number is the ID of the task and will never change, is a way to identify them across the project. The number does not mean the order in the panel. If you click on a task and go to the details page, you’ll see that number is part of the url. Maybe the # is causing the confusion here.