GPU Auto-Detection

Automatic GPU detection and fallback to CPU.

Overview

NeuronDB automatically detects available GPUs and falls back to CPU if GPU is unavailable.

Automatic Detection

Copy
-- Check GPU status
SELECT neurondb_gpu_info();

-- Enable auto-detection (default)
SET neurondb.compute_mode = true;
SET neurondb.gpu_auto_detect = true;

Fallback Behavior

When GPU is unavailable, operations automatically fall back to CPU:

Copy
-- Will use GPU if available, CPU otherwise
SELECT vector_l2_distance_gpu(embedding, query) AS distance
FROM documents;

Learn More

For detailed documentation on GPU auto-detection, fallback behavior, and manual configuration, visit:

GPU Auto-Detection Documentation

Related Topics

• CUDA Support - NVIDIA GPU
• ROCm Support - AMD GPU
• Metal Support - Apple Silicon