You are absolutely right. When Chaos comes out of its experimental state it will be part of the launcher. Until then you will always have to compile the version to be able to use it.
I would definitely expect to need to compile it in 4.24 and 4.25, too.