TensorFlow & GPUs

TensorFlow, Keras, and CUDA/cuDNN setup, plus fixes for the runtime errors that block training.

21 articles

• Fix CUDA and cuDNN Library Load Errors in TensorFlow: A Diagnostic Guide

  Every TensorFlow CUDA library error — libcublas, libcudart, libnvinfer, cuDNN — traced to one of four root causes, with the order to diagnose them.

  July 21, 2026

• Fix Keras model.fit Failing Under MirroredStrategy (Multi-GPU)

  model.fit failing under tf.distribute.MirroredStrategy is almost always: the model/optimizer built outside strategy.scope(), a global batch size that isn't scaled, or a non-replica-aware custom step. The correct pattern, explained.

  June 23, 2023

• Fix: InvalidArgumentError — 'dtype' bfloat16 Not in List of Allowed Values

  This TensorFlow error doesn't mean bfloat16 is invalid — it means the specific op has no bfloat16 kernel. Cast to float32 for that op with tf.cast, or use mixed_bfloat16 precision so Keras places dtypes for you.

  June 23, 2023

• Fix TensorFlow 'Check failed: work_element_count > 0' (gpu_launch_config.h:129)

  This internal TensorFlow crash means a GPU kernel was launched with zero or a negative number of elements — almost always an empty batch, a layer whose shape math collapsed to 0, or an int32 overflow on a huge tensor. Here's how to find which.

  June 23, 2023

• TensorFlow 'InvalidArgumentError: Graph execution error' — Find the Real Cause

  'InvalidArgumentError: Graph execution error' is a generic wrapper — the real cause is in the nested traceback. The three most common ones (shape mismatch, label out of range, dtype mismatch) and how to fix each.

  June 22, 2023

• Fix CUDA_ERROR_LAUNCH_FAILED & CUDNN_STATUS_INTERNAL_ERROR in TensorFlow

  These TensorFlow errors fire after the libraries load, so they're not path problems — usually GPU memory exhaustion (enable memory growth), a cuDNN/CUDA version mismatch, or the GPU being held by another process. How to diagnose and fix each.

  June 21, 2023

• Could not load dynamic library 'libnvinfer_plugin.so.6' — Harmless TensorRT Warning

  This TensorFlow message about libnvinfer_plugin.so is almost always a harmless TensorRT warning, not an error — TF still runs on GPU. When it actually matters, and how to fix it if you need TensorRT.

  June 10, 2023

• Fix IDE Auto-Completion Failure for tensorflow.keras

  Autocomplete fails for tf.keras because it's a lazily-loaded alias that static analyzers can't follow. Your code still runs — import from keras directly to give the IDE a real module to introspect.

  June 8, 2023

• Relationship between TF.Slim, TF High-Level API, and Keras

  How TF-Slim, the TF high-level API, and Keras relate: three abstraction layers over TensorFlow. TF-Slim is deprecated; use Keras in TensorFlow 2.x today.

  June 8, 2023

• Fix ImportError: cannot import name 'abs'

  This ImportError comes from a shadowed or half-installed package (classically TensorFlow) or a circular import — not from the abs builtin. Here's how to find which one and fix it.

  June 8, 2023

• Build a CNN for Image Classification with Swift for TensorFlow

  Build a CNN for image classification with Swift for TensorFlow (S4TF). Note: S4TF was archived in 2021 — use Python TensorFlow/Keras or PyTorch instead.

  June 8, 2023

• Fix ImportError: libcublas.so.9.0 cannot open shared object file

  This means the dynamic loader can't find the exact CUDA library your framework was built against. The '.9.0' suffix must match exactly — here's how to check whether it's a path problem or a missing CUDA toolkit, and fix each.

  June 7, 2023

• Fix: Could not load dynamic library 'libcudart.so.11.0'

  This TensorFlow message means it needs the CUDA 11.x runtime and can't find it. The '11.0' is a major-version SONAME — any CUDA 11.x provides it, CUDA 12 does not. Here's the triage and fix.

  June 7, 2023

• How to Change default types globally in tensorflow?

  Set TensorFlow's default float type with tf.keras.backend.set_floatx, or use mixed_precision for float16/bfloat16. ConfigProto does not control dtypes.

  June 6, 2023

• TensorFlow Not Detecting GPU / CUDA Installed via Conda: The Version-Match Fix

  TensorFlow returns an empty GPU list even though CUDA is installed via conda — almost always a CUDA/cuDNN version mismatch or a conda-vs-system conflict. Diagnose it and fix it with tensorflow[and-cuda] or a matched conda environment.

  June 6, 2023

• What are the GPUOptions for Go binding in TensorFlow?

  Optimize GPU utilization with TensorFlow's Go binding using GPUOptions. Control memory allocation, growth, and device selection for efficient computations.

  June 6, 2023

• How to handle class weight for multiple outputs in keras?

  Weighting Classes in Multiple Output Models with tf.keras - Custom Loss and Sample Weights Solution

  June 6, 2023

• How to assign value to a EagerTensor slice?

  EagerTensors from tf.constant are immutable, so slice assignment raises AttributeError. Use tf.Variable, or tf.tensor_scatter_nd_update for a modified copy.

  June 6, 2023

• TensorFlow Lite vs TensorFlow Output: Differences Explained

  The advantages of TensorFlow Lite's optimized model size, execution efficiency, and supported operations for mobile and embedded deployments.

  June 6, 2023

• How to clear GPU memory in tensorflow 2?

  Clear GPU memory in TensorFlow 2 by enabling memory growth or setting memory limits. Optimize performance with these simple techniques.

  June 6, 2023

• Load a Keras Model from an HDF5 (.h5) File — and Why .keras Is Now Default

  Load a full Keras model from HDF5 with load_model('model.h5') — it restores architecture, weights, and optimizer. Plus weights-only loading, custom_objects for custom layers, and why Keras 3 defaults to the newer .keras format.

  December 21, 2022

Other topics