torch-tensor-parallelism - Letta Skills
Description
This skill provides guidance for implementing tensor parallelism in PyTorch, specifically column-parallel and row-parallel linear layers. Use when implementing distributed neural network layers that split weights/activations across multiple ranks, working with torch.distributed for model parallelism, or implementing ColumnParallelLinear and RowParallelLinear classes.
Type
Skill
Ecosystem
Cross-platform
Trust Score
86%
Related Skills
Stable Diffusion WebUI
Feature-rich web interface for Stable Diffusion image generation by AUTOMATIC1111.
LangChain
Comprehensive framework for building LLM-powered applications with chains, agents, and retrieval.
LobeChat
Modern, extensible AI chat framework with plugin ecosystem and multi-model support.
Open WebUI
Self-hosted web UI for LLMs with multi-model support, RAG, and plugin system.