OIDC is working also now - i just want to link to this thread which may help someone to get the right direction where to look:
With this information i found additional proxy-headers to set, and that i should set xwiki.url.protocol=https which i hadn’t before (i thought the reverse proxy will take care of this).
Without this, the OIDC-redirect (in my case Azure) won’t work correctly.