I’m not sure if you can do this, but if you can, cancel that joining (the pending one) in the Xbox Insider.