So just did a lot of experimenting and found
Works:
when: inventory_hostname in groups['group']
Fails:when: inventory_hostname in {{ groups['group'] }}
So it is the extra set of {{ }} that causes the problem. Although I don't know why it works for static but not for dynamic.