By this do you mean that it performs a POST which then fails and dumps you into the BIOS config?
This indicates that an issue was discovered or occured during Power on self ttest.
There could be a number of reasons for this but GPU drivers are pretty low on that list as this is in fact happening to your system before the OS (and therefore the drivers) have loaded.
The easiest and most definitive test with regards drivers is to start in safe mode. No drivers at all.
If your motherboard has a dual bios it’s also quite possible that the failed start is bios 1 which may have some config issues and which then switches to bios 2 with a more default “safe” setting which does work.
A cause for this could (for example) be an aggressive overclock or memory timings which simply cause a failed POST.