• 2
• 0
• 1

tsymi / ring-flash-attention

ssssssssssss

• 1
• 0
• 0

tsymi / FlexGen-Gitee

• 1
• 0
• 0

tsymi / TensorRT-LLM-gitee

• 1
• 0
• 0

tsymi / DeepSpeed-gitee

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

• 1
• 0
• 0

tsymi / FlexFlow-gitee

FlexFlow Serve: Low-Latency, High-Performance LLM Serving

• 1
• 0
• 0

tsymi / vllm-gitee

A high-throughput and memory-efficient inference and serving engine for LLMs