Fix "bitsandbytes CUDA Setup failed"
If bitsandbytes loads libbitsandbytes_cpu.so, no CUDA binary matched. Upgrade bitsandbytes first, confirm a CUDA PyTorch, then fix the library path.
3 articles
If bitsandbytes loads libbitsandbytes_cpu.so, no CUDA binary matched. Upgrade bitsandbytes first, confirm a CUDA PyTorch, then fix the library path.
The traceback lies because CUDA runs async. Get the real line with CUDA_LAUNCH_BLOCKING=1 or the CPU, then fix the out-of-range index behind it.
The fastest test is torch.version.cuda — if it's None you have a CPU-only wheel. PyTorch bundles its own CUDA runtime, so you only need the NVIDIA driver.