Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bug: "GPU Acceleration" section removed in v0.5.15 but the documentation is not updated #4799

Open
1 of 3 tasks
mon-jai opened this issue Mar 11, 2025 · 6 comments · May be fixed by #4826
Open
1 of 3 tasks

bug: "GPU Acceleration" section removed in v0.5.15 but the documentation is not updated #4799

mon-jai opened this issue Mar 11, 2025 · 6 comments · May be fixed by #4826
Labels
/desktop type: bug Something isn't working

Comments

@mon-jai
Copy link

mon-jai commented Mar 11, 2025

Jan version

0.5.15

Describe the Bug

The documentation (the "AMD GPU" part) indicates that enabling Experimental Mode should reveal a "GPU Acceleration" section, allowing users to enable Vulkan support:

  • Enable Experimental Mode
  • Under GPU Acceleration, enable Vulkan Support

However, there is no "GPU Acceleration" section even after enabling Experimental Mode on v0.5.15.

I have a AMD Radeon RX 5700 GPU which should in theory support Vulkan API.

Steps to Reproduce

  1. Enable Experimental Mode
  2. Look for the "GPU Acceleration" section.

Screenshots / Logs

Image

Image

What is your OS?

  • MacOS
  • Windows
  • Linux
@mon-jai mon-jai added the type: bug Something isn't working label Mar 11, 2025
@github-project-automation github-project-automation bot moved this to Investigating in Menlo Mar 11, 2025
@stevenlafl
Copy link

Having this issue as well.

@emeric-martineau
Copy link

emeric-martineau commented Mar 20, 2025

Hello,

same issue. Vulkan driver is installed (2.0.279) for Radeon RX550 on Windows 11

@emeric-martineau
Copy link

Ok, since 0.5.15, you don't need enable vulkan. It's automatic see log:

2025-03-20T17:09:14.120Z [APP]::{"errno":-4075,"code":"EEXIST","syscall":"symlink","path":"C:\\Users\\xxxx\\AppData\\Local\\Programs\\jan\\resources\\app.asar.unpacked\\shared\\engines\\cortex.llamacpp\\windows-amd64-vulkan\\v0.1.49","dest":"C:\\Users\\xxxx\\AppData\\Roaming\\Jan\\data\\engines\\cortex.llamacpp\\windows-amd64-vulkan\\v0.1.49"}

@mon-jai
Copy link
Author

mon-jai commented Mar 20, 2025

@emeric-martineau Nope. Tried running models like olm2 on Jan AI and it used my CPU instead of GPU. I will try to upload my log in the next few days.

@emeric-martineau
Copy link

In my case, when I go to Local engine configuration, I see llama-cpp Backen use windows-amd64-vulkan.
Image

If I run a model, I see GPU is used:
Image

The documentation was not just updated for version 0.5.15.

@mon-jai I think you should open another issue for your GPU not working, and change title of this issue to something like Documentation not updated.

@stevenlafl
Copy link

For me, on Linux it fails to load properly sometimes. I have to killall cortex-server and killall jan and then restart and retry til it does work. But it eventually does.

emeric-martineau added a commit to emeric-martineau/jan that referenced this issue Mar 21, 2025
emeric-martineau added a commit to emeric-martineau/jan that referenced this issue Mar 21, 2025
emeric-martineau added a commit to emeric-martineau/jan that referenced this issue Mar 21, 2025
@mon-jai mon-jai changed the title bug: "GPU Acceleration" section missing after enabling Experimental Mode bug: "GPU Acceleration" section removed in v0.5.15 but the documentation is not updated Mar 21, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
/desktop type: bug Something isn't working
Projects
Status: No status
Status: Investigating
4 participants