You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I have read the above rules and searched the existing issues.
Description
Thanks for your awesome work! To leverage the power of open-sourcing, would you kindly consider creating a documentation/workflow to guide others in integrating more VLMs/LLMs into the supported model?
Pull Request
No response
The text was updated successfully, but these errors were encountered:
Put a pin here, haha, please kick me if there is a solution. And I also had some problem, I uploaded my model to huggingface, but I found that when I pull it for use, my processor won't work, which is the tokenizer's problem, I'm still trying to find a solution.
And as you mentioned you want a vLLM tutorial, I have a demo code for load directly from huggingface, if you need it, I can share it here. I just use fastapi to build a API for inference. Of course vLLM is the best solution...
Reminder
Description
Thanks for your awesome work! To leverage the power of open-sourcing, would you kindly consider creating a documentation/workflow to guide others in integrating more VLMs/LLMs into the supported model?
Pull Request
No response
The text was updated successfully, but these errors were encountered: