Just had the worst experience so far making this work.
So i forgot to mention that i am doing this with a LUKS encrypted rootfs and obyusly i need to unlock it first before i had an ssh connection.
I tried doing this with TPM 2 and long story short: don't
So I'm just gonna use this [github.com] and be done with it.
Tomorrow i will finally be able to do the thing this whole vm was for in the first place: to test Fedora Server so i know if i want to migrate to it on my main server