ExLlamaV2
by turboderp★ 4,000
Cross-platformSkillframeworkai-toollibrary
Description
Inference library for running local LLMs on consumer-class GPUs
Type
Skill
Ecosystem
Cross-platform
Trust Score
85%
Related Skills
Stable Diffusion WebUI
Feature-rich web interface for Stable Diffusion image generation by AUTOMATIC1111.
Cross-platformai-tool
LangChain
Comprehensive framework for building LLM-powered applications with chains, agents, and retrieval.
Cross-platformframework
LobeChat
Modern, extensible AI chat framework with plugin ecosystem and multi-model support.
Cross-platformopen-source
Open WebUI
Self-hosted web UI for LLMs with multi-model support, RAG, and plugin system.
Cross-platformopen-source