Skip to content

Issues: vllm-project/aibrix

v0.3.0 roadmap
#698 opened Feb 18, 2025 by Jeffwan
Open 9
Research & Industry Collaboration Invitation
#699 opened Feb 18, 2025 by Jeffwan
Open 3
Beta
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

142 Open 324 Closed
142 Open 324 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

The best practices for multi-node multi-GPU deployment of DeepSeek-R1-671B kind/support Categorizes issue as a support question. triage/accepted Indicates an issue or PR is ready to be actively worked on.
#977 opened Apr 15, 2025 by ZTurboX
@Jeffwan
1
failed to build code follow readme kind/support Categorizes issue as a support question. triage/needs-information Indicates an issue needs more information in order to work on it.
#974 opened Apr 13, 2025 by gaowayne
@Jeffwan
1
The pod metrics may be not up-to-date
#970 opened Apr 11, 2025 by spacewander
2
Is Prefill-Decode disaggregation supported in AIbrix
#958 opened Apr 9, 2025 by William12github
Integration test CI runner looses active pods area/cicd kind/bug Something isn't working
#951 opened Apr 8, 2025 by Jeffwan
1
@varungup90
3
[RFC]: Embedding API for inference job
#950 opened Apr 8, 2025 by varungup90
[RFC]: Support InfinityStore in AIBrix as the new KVCache backend area/kv-cache kind/feature Categorizes issue or PR as related to a new feature. priority/critical-urgent Highest priority. Must be actively worked on as someone's top priority right now.
#948 opened Apr 7, 2025 by Jeffwan v0.3.0
@Jeffwan
Kickstarting Community Building: Contributors, Maintainers, and Governance Guidelines area/community kind/misc
#945 opened Apr 7, 2025 by Jeffwan
1
Sync KV cache from inference engine to gateway area/gateway
#942 opened Apr 4, 2025 by varungup90
Orchestrate KV Cache for decentralized distributed hashing offerings area/kv-cache kind/feature Categorizes issue or PR as related to a new feature. priority/important-soon Must be staffed and worked on either currently, or very soon, ideally in time for the next release.
#928 opened Apr 1, 2025 by Jeffwan v0.3.0
1
Multi-Node Inference ' Waiting for creating a placement group of specs for 310 seconds'
#927 opened Apr 1, 2025 by ying2025
3
Failed to run RayFleet when using hostNetwork area/distributed priority/important-soon Must be staffed and worked on either currently, or very soon, ideally in time for the next release.
#915 opened Mar 28, 2025 by vaaandark
@Jeffwan
7
kv cache deploy the model across different GPUs, it create two etcd pod!
#910 opened Mar 27, 2025 by ying2025
Move the benchmark codes to aibrix python package area/benchmark area/performance kind/feature Categorizes issue or PR as related to a new feature.
#903 opened Mar 25, 2025 by Jeffwan
1
@happyandslow
1
What is the minimum k8s version requirement?
#902 opened Mar 25, 2025 by zhaotyer
2
[KVCache (Vineyard)] Do we need PodAffinity for model name in kvcache crd needs proper reconciliation? area/distributed area/kv-cache
#876 opened Mar 17, 2025 by gangmuk
@Jeffwan @DwyaneShi
2
[Vineyard] vllm engine crashes, failing to connect to vineyard when starting the pod. area/distributed area/kv-cache
#874 opened Mar 17, 2025 by gangmuk
@Jeffwan @DwyaneShi
5
Separate CRDs from manifest installation area/autoscaling area/installation priority/important-soon Must be staffed and worked on either currently, or very soon, ideally in time for the next release.
#873 opened Mar 17, 2025 by Jeffwan
1
[Dist KV] vllm pods which do not have kvcache pods running in the same node crashes. area/installation area/kv-cache kind/bug Something isn't working kind/enhancement New feature or request priority/critical-urgent Highest priority. Must be actively worked on as someone's top priority right now.
#863 opened Mar 14, 2025 by gangmuk
@DwyaneShi
1
Pluggable Gateway
#861 opened Mar 14, 2025 by danehans
4
Documentation is not clearly defined on how to set the RateLimiting and how to measure the token consumption and how to enable the authentication for different users area/gateway kind/support Categorizes issue as a support question.
#859 opened Mar 13, 2025 by vivekrsintc
@varungup90
5
Error: Invalid character 'u' looking for beginning of value area/gateway kind/support Categorizes issue as a support question. triage/needs-information Indicates an issue needs more information in order to work on it.
#858 opened Mar 13, 2025 by vivekrsintc
8
Automate local disk management and ai runtime model management area/runtime kind/feature Categorizes issue or PR as related to a new feature. priority/important-soon Must be staffed and worked on either currently, or very soon, ideally in time for the next release.
#854 opened Mar 12, 2025 by Jeffwan
Pod scale success,aibrix-controller-manager failed to parse metrics area/autoscaling kind/support Categorizes issue as a support question. triage/needs-information Indicates an issue needs more information in order to work on it.
#852 opened Mar 12, 2025 by ying2025
4
[RFC]: Make API Gateway interface OpenAI compatible area/gateway kind/enhancement New feature or request priority/critical-urgent Highest priority. Must be actively worked on as someone's top priority right now.
#846 opened Mar 11, 2025 by Jeffwan
ProTip! Updated in the last three days: updated:>2025-04-16.