DocumentationNeuronDB Documentation
Documentation Branch: You are viewing documentation for the main branch (3.0.0-devel). Select a branch to view its documentation:

neuranllm - LLM Job Processor

Overview

neuranllm processes LLM-related jobs with automatic crash recovery.

Configuration

postgresql.conf

shared_preload_libraries = 'neurondb'
neurondb.neuranllm_enabled = true
neurondb_llm_provider = 'huggingface'
neurondb_llm_endpoint = 'https://api-inference.huggingface.co'
neurondb_llm_api_key = 'YOUR_KEY'

LLM Jobs

Check LLM job status

-- Check LLM job status
SELECT * FROM neurondb.llm_job_status;

-- View job queue
SELECT * FROM neurondb.llm_jobs WHERE status = 'pending';

Learn More

For detailed documentation on LLM job processing, crash recovery, and error handling, visit: neuranllm Documentation

Related Topics