I actually found a temporary fix, by deleting the local data folder each time I launch the game (C:\Users[Your Username]\AppData\Local\Packages\Microsoft.Limitless_8wekyb3d8bbwe\LocalCache in my case)
It’s a bit annoying because I have to reconfigure everything each time, but at least it work 
I will try to find which file is causing the crash, instead of deleting the complete folder