Skip to content

Commit fe9347f

Browse files
[DOCS] Update OpenVINO Test Drive article (#29213)
### Details: - *item1* - *...* ### Tickets: - *ticket-id* Signed-off-by: sgolebiewski-intel <sebastianx.golebiewski@intel.com>
1 parent 0259dc5 commit fe9347f

9 files changed

+114
-4
lines changed

docs/articles_en/about-openvino/openvino-ecosystem/openvino-project/openvino-test-drive.rst

+90-4
Original file line numberDiff line numberDiff line change
@@ -20,15 +20,20 @@ Use OpenVINO™ Test Drive to:
2020

2121
* **Chat with LLMs** and evaluate model performance on your computer or edge device;
2222
* **Experiment with different text prompts** to generate images, using Stable
23-
Diffusion and Stable DiffusionXL models (coming soon);
23+
Diffusion and Stable DiffusionXL models;
2424
* **Transcribe speech from video**, using Whisper models, including generation
25-
of timestamps (coming soon);
25+
of timestamps;
2626
* **Run inference of models** trained by Intel® Geti™ and **visualize the results**.
2727

2828

2929
Installation (Windows)
3030
###############################################################################################
3131

32+
.. important::
33+
34+
For Intel® NPU, use the latest available version of
35+
`Intel® NPU Driver <https://www.intel.com/content/www/us/en/download/794734/intel-npu-driver-windows.html>`__.
36+
3237
1. Download the latest archive from the
3338
`release repository <https://storage.openvinotoolkit.org/repositories/openvino_testdrive/packages>`__.
3439
To verify the integrity of the downloaded package, use the SHA-256 file attached.
@@ -45,7 +50,7 @@ Quick start
4550
When starting the application, you can import an LLM model from Hugging Face Hub
4651
or upload an Intel® Geti™ model from a local drive.
4752

48-
Inference of models from Hugging Face
53+
Text generation and LLM performance evaluation
4954
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
5055

5156
1. Find a model on `Hugging Face <https://huggingface.co/>`__ and import it.
@@ -54,7 +59,8 @@ Inference of models from Hugging Face
5459
:align: center
5560
:alt: how to import a model to test drive
5661

57-
2. Chat with LLMs via the `Playground` tab.
62+
2. Chat with LLMs via the `Playground` tab. You can export an LLM by clicking
63+
the `Export model` button.
5864

5965
.. image:: ../../../assets/images/TestDrive_llm_model_chat.gif
6066
:align: center
@@ -67,6 +73,86 @@ Inference of models from Hugging Face
6773
:align: center
6874
:alt: verifying llm performance in test drive
6975

76+
77+
Retrieval-Augmented Generation with LLMs
78+
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
79+
80+
1. Upload files and create knowledge base for RAG (Retrieval-Augmented Generation),
81+
using `Knowledge base` tab.
82+
83+
.. image:: ../../../assets/images/TestDrive_rag_base.gif
84+
:align: center
85+
:alt: creating a knowledge base for RAG in test drive
86+
87+
The knowledge base can be used for text generation with LLM models.
88+
89+
.. image:: ../../../assets/images/TestDrive_rag_1.gif
90+
:align: center
91+
:alt: using a knowledge base for text generation with LLMs
92+
93+
2. You can also upload a document directly, using the `Playground`` tab.
94+
95+
.. image:: ../../../assets/images/TestDrive_rag_2.gif
96+
:align: center
97+
:alt: uploading a document to the knowledge base
98+
99+
100+
Image analysis with Visual Language Models (VLMs)
101+
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
102+
103+
1. Import a VLM for image analysis.
104+
105+
.. image:: ../../../assets/images/TestDrive_vlm_1.gif
106+
:align: center
107+
:alt: importing a visual language model for image analysis
108+
109+
2. Select the VLM from the `My models` section, upload an image and analyze it.
110+
111+
.. image:: ../../../assets/images/TestDrive_vlm_2.gif
112+
:align: center
113+
:alt: importing a visual language model for image analysis
114+
115+
116+
Video transcription with Whisper models
117+
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
118+
119+
1. Import a Whisper model for video transcription.
120+
121+
.. image:: ../../../assets/images/TestDrive_st_import.gif
122+
:align: center
123+
:alt: importing a Whisper model for video transcription
124+
125+
2. Select the speech-to-text LLM from the `My models` section, and upload a video for transcription.
126+
127+
.. image:: ../../../assets/images/TestDrive_ts_video.gif
128+
:align: center
129+
:alt: importing a visual language model for image analysis
130+
131+
You can search for words in the transcript or download it.
132+
133+
3. Use the `Performance metrics` tab to get performance metrics of the LLM on your computer
134+
or an edge device.
135+
136+
137+
Image generation with LLMs
138+
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
139+
140+
1. Import an image generation LLM from a predefined set of popular models or from
141+
`Hugging Face <https://huggingface.co/>`__, using `Import model` -> `Hugging Face`.
142+
143+
2. Select the LLM from the `My models` section and start the chat to generate an image.
144+
You can export the model by clicking the `Export model` button.
145+
146+
.. image:: ../../../assets/images/TestDrive_image_generation.gif
147+
:align: center
148+
:alt: image generation with a chosen LLM
149+
150+
You can download the generated image.
151+
152+
3. Use the `Performance metrics` tab to get performance metrics of the LLM on your computer
153+
or an edge device.
154+
155+
70156
Inference of models trained with Intel® Geti™
71157
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
72158

Loading
Loading
Loading
Loading
Loading
Loading
Loading
Loading

0 commit comments

Comments
 (0)