Adaptive lighting not automatically adapting

[dbdmdbdmdbdm]

I have the adaptive lighting integration working with 4x philip hue lights. These lights are a group created in Hue. For some reason, the lights are just not adapting over time. If i toggle the adaptive_lighting switch or run the adapt lighting apply service call the lights change, but they don't change manually. Other lights in my house seem to change automatically with the same config. Anything i am missing?