To configure the Chaos Destruction Demo for Unreal Engine 4.26-Chaos Preview, download the demo project, ensure Chaos Physics is enabled in project settings, set up destructible objects as per demo instructions, adjust scene elements, and test for optimal performance and visual presentation.