How to replicate it:

Enable the 'Always On Top' feature, turn off the app, and open it back, then open the settings, and the settings window will always show behind the app window.