AlexHe99
Follow
-
ROCm_AI_Examples Public
The LLM training examples over AMD ROCm
-
vllm Public
Forked from vllm-project/vllmA high-throughput and memory-efficient inference and serving engine for LLMs
Python Apache License 2.0 UpdatedDec 27, 2024 -
k8s-device-plugin Public
Forked from ROCm/k8s-device-pluginKubernetes (k8s) device plugin to enable registration of AMD GPU to a container cluster
Go Apache License 2.0 UpdatedDec 11, 2024 -
benchmark Public
Forked from fw-ai/benchmarkBenchmark suite for LLMs from Fireworks.ai
Python Apache License 2.0 UpdatedDec 3, 2024 -
auto_llm_bench Public
Forked from ZJLi2013/auto_llm_benchjust another bench scripts for llm inference bench among different frameworks & GPUs
Shell UpdatedSep 27, 2024 -
cpu-gpu-arch Public
Forked from azhirnov/cpu-gpu-archCollection of best practices, optimization guides, architecture overview, performance counters
UpdatedAug 11, 2024 -
-
personal_llm_assistant Public
Forked from amirarsalan90/personal_llm_assistantPython UpdatedApr 8, 2024 -
liva Public
Forked from LuciAkirami/livaLIVA - Local Intelligent Voice Assistant
Python MIT License UpdatedFeb 27, 2024