llama-cpp-python
by abetlen★ 8,000
Cross-platformSkillinferencedeploymentservingmlops
Description
Python bindings for llama.cpp enabling local LLM inference
Type
Skill
Ecosystem
Cross-platform
Trust Score
80%
Related Skills
Stable Diffusion WebUI
Feature-rich web interface for Stable Diffusion image generation by AUTOMATIC1111.
Cross-platformai-tool
LangChain
Comprehensive framework for building LLM-powered applications with chains, agents, and retrieval.
Cross-platformframework
LobeChat
Modern, extensible AI chat framework with plugin ecosystem and multi-model support.
Cross-platformopen-source
Open WebUI
Self-hosted web UI for LLMs with multi-model support, RAG, and plugin system.
Cross-platformopen-source