Yeah a public bug tracker would definitely be nice, but I guess Epic fears that people see the list of thousands bugs and think unreal engine is buggy before they even start using it.
If there would be a public bug tracker it would be really helpful, I would read through all the bugs to know at least where I can expect bugs.