Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fixed WWB im2im tests #1482

Merged
merged 8 commits into from
Jan 6, 2025
Merged

Fixed WWB im2im tests #1482

Show file tree
Hide file tree
Changes from 4 commits
Commits
Show all changes
8 commits
Select commit Hold shift + click to select a range
92c1a74
Fixed WWB im2imt tests
AlexKoff88 Jan 6, 2025
bcab4bf
Merge branch 'master' into ak/wwb_tests_fix
AlexKoff88 Jan 6, 2025
28bd0a8
Updated datasets verrsion
AlexKoff88 Jan 6, 2025
2334526
Merge branch 'ak/wwb_tests_fix' of https://github.com/AlexKoff88/open…
AlexKoff88 Jan 6, 2025
e195a15
Update .github/workflows/llm_bench-python.yml
AlexKoff88 Jan 6, 2025
24f4d41
Update .github/workflows/llm_bench-python.yml
AlexKoff88 Jan 6, 2025
5d753fa
Merge branch 'master' into ak/wwb_tests_fix
AlexKoff88 Jan 6, 2025
bc1f499
Merged with master
AlexKoff88 Jan 6, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions .github/workflows/llm_bench-python.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -152,6 +152,7 @@ jobs:
- name: WWB Tests
run: |
pip install git+https://github.com/huggingface/optimum-intel.git
pip insatll -U --force-reinstall datasets==3.1.0
AlexKoff88 marked this conversation as resolved.
Show resolved Hide resolved
GIT_CLONE_PROTECTION_ACTIVE=false PIP_PRE=1 PIP_EXTRA_INDEX_URL=https://storage.openvinotoolkit.org/simple/wheels/nightly pip install ${{ env.WWB_PATH }}
python -m pytest -v ${{ env.WWB_PATH }}/tests
stateful:
Expand Down Expand Up @@ -191,6 +192,7 @@ jobs:
run: |
pip install pytest
pip install git+https://github.com/huggingface/optimum-intel.git
pip insatll -U --force-reinstall datasets==3.1.0
AlexKoff88 marked this conversation as resolved.
Show resolved Hide resolved
GIT_CLONE_PROTECTION_ACTIVE=false PIP_PRE=1 PIP_EXTRA_INDEX_URL=https://storage.openvinotoolkit.org/simple/wheels/nightly pip install ${{ env.WWB_PATH }}
python -m pytest -v ${{ env.WWB_PATH }}/tests

Expand Down
1 change: 1 addition & 0 deletions tools/who_what_benchmark/requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,3 +9,4 @@ pandas>=2.0.3
numpy>=1.23.5
tqdm>=4.66.1
diffusers
datasets<3.2.0
ilya-lavrenov marked this conversation as resolved.
Show resolved Hide resolved
6 changes: 3 additions & 3 deletions tools/who_what_benchmark/tests/test_cli_image.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -42,8 +42,8 @@ def teardown_module():
("hf-internal-testing/tiny-stable-diffusion-torch", "text-to-image", "hf"),
("hf-internal-testing/tiny-stable-diffusion-torch", "text-to-image", "openvino"),
("hf-internal-testing/tiny-stable-diffusion-xl-pipe", "text-to-image", "hf"),
# ("hf-internal-testing/tiny-stable-diffusion-torch", "image-inpainting", "hf"),
# ("hf-internal-testing/tiny-stable-diffusion-xl-pipe", "image-inpainting", "hf"),
("hf-internal-testing/tiny-stable-diffusion-torch", "image-inpainting", "hf"),
("hf-internal-testing/tiny-stable-diffusion-xl-pipe", "image-inpainting", "hf"),
],
)
def test_image_model_types(model_id, model_type, backend):
Expand Down Expand Up @@ -90,7 +90,7 @@ def test_image_model_types(model_id, model_type, backend):
list(itertools.product(OV_IMAGE_MODELS,
["image-to-image",
"text-to-image",
# "image-inpainting"
"image-inpainting"
])),
)
def test_image_model_genai(model_id, model_type):
Expand Down
Loading