Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Model Integration Pipeline #7607

Open
1 task done
WeizhenWang-1210 opened this issue Apr 4, 2025 · 2 comments
Open
1 task done

Model Integration Pipeline #7607

WeizhenWang-1210 opened this issue Apr 4, 2025 · 2 comments
Labels
solved This problem has been already solved

Comments

@WeizhenWang-1210
Copy link

Reminder

  • I have read the above rules and searched the existing issues.

Description

Thanks for your awesome work! To leverage the power of open-sourcing, would you kindly consider creating a documentation/workflow to guide others in integrating more VLMs/LLMs into the supported model?

Pull Request

No response

@WeizhenWang-1210 WeizhenWang-1210 added enhancement New feature or request pending This problem is yet to be addressed labels Apr 4, 2025
@miko8422
Copy link

miko8422 commented Apr 5, 2025

Put a pin here, haha, please kick me if there is a solution. And I also had some problem, I uploaded my model to huggingface, but I found that when I pull it for use, my processor won't work, which is the tokenizer's problem, I'm still trying to find a solution.
And as you mentioned you want a vLLM tutorial, I have a demo code for load directly from huggingface, if you need it, I can share it here. I just use fastapi to build a API for inference. Of course vLLM is the best solution...

@hiyouga
Copy link
Owner

hiyouga commented Apr 7, 2025

Here are two best practice to integrate new model to llama factory

#7537
#7611

@hiyouga hiyouga added solved This problem has been already solved and removed enhancement New feature or request pending This problem is yet to be addressed labels Apr 7, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
solved This problem has been already solved
Projects
None yet
Development

No branches or pull requests

3 participants