cuda

8 articles

• Fix RuntimeError: CUDA out of memory (PyTorch)

  Fix PyTorch CUDA out-of-memory errors with profiling, batch and sequence controls, AMP, checkpointing, allocator tuning, distributed fixes, and GPU diagnostics.

  July 31, 2026

• Fix "bitsandbytes CUDA Setup failed"

  If bitsandbytes loads libbitsandbytes_cpu.so, no CUDA binary matched. Upgrade bitsandbytes first, confirm a CUDA PyTorch, then fix the library path.

  July 24, 2026

• Resolve "CUDA error: device-side assert triggered"

  The traceback lies because CUDA runs async. Get the real line with CUDA_LAUNCH_BLOCKING=1 or the CPU, then fix the out-of-range index behind it.

  July 24, 2026

• Fix torch.cuda.is_available() Returns False

  The fastest test is torch.version.cuda — if it's None you have a CPU-only wheel. PyTorch bundles its own CUDA runtime, so you only need the NVIDIA driver.

  July 24, 2026

• Fix CUDA_ERROR_LAUNCH_FAILED & CUDNN_STATUS_INTERNAL_ERROR in TensorFlow

  These TensorFlow errors fire after the libraries load, so they're not path problems — usually GPU memory exhaustion (enable memory growth), a cuDNN/CUDA version mismatch, or the GPU being held by another process. How to diagnose and fix each.

  June 21, 2023

• Fix ImportError: libcublas.so.9.0 cannot open shared object file

  This means the dynamic loader can't find the exact CUDA library your framework was built against. The '.9.0' suffix must match exactly — here's how to check whether it's a path problem or a missing CUDA toolkit, and fix each.

  June 7, 2023

• Fix: Could not load dynamic library 'libcudart.so.11.0'

  This TensorFlow message means it needs the CUDA 11.x runtime and can't find it. The '11.0' is a major-version SONAME — any CUDA 11.x provides it, CUDA 12 does not. Here's the triage and fix.

  June 7, 2023

• TensorFlow Not Detecting GPU / CUDA Installed via Conda: The Version-Match Fix

  TensorFlow returns an empty GPU list even though CUDA is installed via conda — almost always a CUDA/cuDNN version mismatch or a conda-vs-system conflict. Diagnose it and fix it with tensorflow[and-cuda] or a matched conda environment.

  June 6, 2023

Other topics