Git source control causing major file issues

Hi guys, I just started using a local Git repository in UE5 and it seemed to work. But when I started organizing/editing, it just duplicated and did unnecessary things. When I go into Git GUI I see there are thousands of loose files! How should I handle this?