large-large-models 开源项目推荐（2 个）

相关标签

gpucudajitpytorchnvidiamoeattentionllm-inferencelarge-large-modelsdistributed-inference

flashinfer-ai / flashinfer

FlashInfer: Kernel Library for LLM Serving

gpu cuda jit pytorch nvidia moe attention llm-inference large-large-models distributed-inference

Updated Nov 1, 2026
Cuda

MBZUAI-Research-Office / research_muchi

research done at Prof Hung's Lab at MBZUAI

mac artificial-intelligence data-hub llama2 large-large-models data-observatory

Updated Jul 19, 2024
Python

在 GitHub 查看