[CI] [GHA] Introduce additional Ubuntu versions via separate workflows #25234
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -31,7 +31,7 @@ runs: | |
| id: copy_artifacts | ||
| shell: ${{ runner.os == 'Windows' && 'pwsh' || 'bash' }} | ||
| run: >- | ||
| python3 ${{ env.ACTION_PATH }}/store_artifacts.py | ||
|
There was a problem hiding this comment. The same as in #25234 (comment). |
||
| --storage_dir "${{ inputs.storage_dir }}" --storage_root "${{ inputs.storage_root }}" | ||
| -a "${{ inputs.artifacts }}" | ||
| env: | ||
|
|
||
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1 +1 @@ | ||
| pr-25234 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,72 @@ | ||
| FROM openvinogithubactions.azurecr.io/dockerhub/nvidia/cuda:11.8.0-runtime-ubuntu22.04 | ||
|
|
||
| USER root | ||
|
|
||
| # APT configuration | ||
| RUN echo 'Acquire::Retries "10";' > /etc/apt/apt.conf && \ | ||
| echo 'APT::Get::Assume-Yes "true";' >> /etc/apt/apt.conf && \ | ||
| echo 'APT::Get::Fix-Broken "true";' >> /etc/apt/apt.conf && \ | ||
| echo 'APT::Get::no-install-recommends "true";' >> /etc/apt/apt.conf | ||
|
|
||
| ENV DEBIAN_FRONTEND="noninteractive" \ | ||
| TZ="Europe/London" | ||
|
|
||
| RUN apt-get update && \ | ||
| apt-get install software-properties-common && \ | ||
| add-apt-repository --yes --no-update ppa:git-core/ppa && \ | ||
| add-apt-repository --yes --no-update ppa:deadsnakes/ppa && \ | ||
| apt-get update && \ | ||
| apt-get install \ | ||
| curl \ | ||
| wget \ | ||
| git \ | ||
| gpg-agent \ | ||
| tzdata \ | ||
| # Python | ||
| python3.11-dev \ | ||
mryzhov marked this conversation as resolved.
Show resolved
Hide resolved
|
||
| python3.11-venv \ | ||
| python3.11-distutils \ | ||
| # For Java API | ||
| default-jdk \ | ||
| && \ | ||
| rm -rf /var/lib/apt/lists/* | ||
|
|
||
| # Install build dependencies | ||
| ADD install_build_dependencies.sh /install_build_dependencies.sh | ||
| RUN chmod +x /install_build_dependencies.sh && \ | ||
| /install_build_dependencies.sh && \ | ||
| rm -rf /var/lib/apt/lists/* | ||
|
|
||
| # Install sscache | ||
| ARG SCCACHE_VERSION="v0.7.5" | ||
| ENV SCCACHE_HOME="/opt/sccache" \ | ||
| SCCACHE_PATH="/opt/sccache/sccache" | ||
|
|
||
| RUN mkdir ${SCCACHE_HOME} && cd ${SCCACHE_HOME} && \ | ||
| SCCACHE_ARCHIVE="sccache-${SCCACHE_VERSION}-x86_64-unknown-linux-musl.tar.gz" && \ | ||
| curl -SLO https://github.com/mozilla/sccache/releases/download/${SCCACHE_VERSION}/${SCCACHE_ARCHIVE} && \ | ||
| tar -xzf ${SCCACHE_ARCHIVE} --strip-components=1 && rm ${SCCACHE_ARCHIVE} | ||
|
|
||
| # Install CUDA | ||
| RUN wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2204/x86_64/cuda-keyring_1.1-1_all.deb && \ | ||
| dpkg -i cuda-keyring_1.1-1_all.deb | ||
| RUN apt-get update && apt-get install -y cuda-runtime-11-8 cuda-11-8 && apt-get install -y \ | ||
| libcudnn8=8.9.4.*-1+cuda11.8 \ | ||
| libcudnn8-dev=8.9.4.*-1+cuda11.8 \ | ||
| libcudnn8-samples=8.9.4.*-1+cuda11.8 \ | ||
| libcutensor1=1.7.0.1-1 \ | ||
| libcutensor-dev=1.7.0.1-1 \ | ||
| cuda-drivers | ||
|
|
||
| # Setup pip | ||
| ENV PIP_VERSION="24.0" | ||
| RUN curl https://bootstrap.pypa.io/get-pip.py -o get-pip.py && \ | ||
| python3.11 get-pip.py --no-cache-dir pip==${PIP_VERSION} && \ | ||
| rm -f get-pip.py | ||
|
|
||
| # Use Python 3.11 as default | ||
| # Using venv here 'cause other methods to switch the default Python on Ubuntu 22 break both system and wheels build | ||
| RUN python3.11 -m venv venv | ||
| ENV PATH="/venv/bin:$SCCACHE_HOME:$PATH" | ||
|
|
||
| ENV PIP_CACHE_DIR=/mount/caches/pip/linux/${PIP_VERSION} | ||
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,68 @@ | ||
| FROM openvinogithubactions.azurecr.io/dockerhub/ubuntu:24.04 | ||
|
|
||
| USER root | ||
|
|
||
| # APT configuration | ||
| RUN echo 'Acquire::Retries "10";' > /etc/apt/apt.conf && \ | ||
| echo 'APT::Get::Assume-Yes "true";' >> /etc/apt/apt.conf && \ | ||
| echo 'APT::Get::Fix-Broken "true";' >> /etc/apt/apt.conf && \ | ||
| echo 'APT::Get::no-install-recommends "true";' >> /etc/apt/apt.conf | ||
|
|
||
| ENV DEBIAN_FRONTEND="noninteractive" \ | ||
| TZ="Europe/London" | ||
|
|
||
| RUN apt-get update && \ | ||
| apt-get install software-properties-common && \ | ||
| add-apt-repository --yes --no-update ppa:git-core/ppa && \ | ||
| add-apt-repository --yes --no-update ppa:deadsnakes/ppa && \ | ||
| apt-get update && \ | ||
| apt-get install \ | ||
| curl \ | ||
| git \ | ||
| gpg-agent \ | ||
| tzdata \ | ||
| # Python | ||
| python3-dev \ | ||
| python3-venv \ | ||
| python3-pip \ | ||
| python3-full \ | ||
| # For Java API | ||
| default-jdk \ | ||
| # Compiler. TODO: remove and use the system one; if the system one is used, onnx fails to build | ||
| gcc-10 \ | ||
| g++-10 \ | ||
ilya-lavrenov marked this conversation as resolved.
Show resolved
Hide resolved
|
||
| && \ | ||
| rm -rf /var/lib/apt/lists/* | ||
|
|
||
| # Install build dependencies | ||
| ADD install_build_dependencies.sh /install_build_dependencies.sh | ||
| RUN chmod +x /install_build_dependencies.sh && \ | ||
| /install_build_dependencies.sh && \ | ||
| rm -rf /var/lib/apt/lists/* | ||
|
|
||
| # Set gcc-10 as a default compiler | ||
| RUN update-alternatives --install /usr/bin/gcc gcc /usr/bin/gcc-10 30 && \ | ||
| update-alternatives --install /usr/bin/g++ g++ /usr/bin/g++-10 30 | ||
ilya-lavrenov marked this conversation as resolved.
Show resolved
Hide resolved
|
||
|
|
||
| # Install sccache | ||
| ARG SCCACHE_VERSION="v0.7.5" | ||
| ENV SCCACHE_HOME="/opt/sccache" \ | ||
| SCCACHE_PATH="/opt/sccache/sccache" | ||
|
|
||
| RUN mkdir ${SCCACHE_HOME} && cd ${SCCACHE_HOME} && \ | ||
| SCCACHE_ARCHIVE="sccache-${SCCACHE_VERSION}-x86_64-unknown-linux-musl.tar.gz" && \ | ||
| curl -SLO https://github.com/mozilla/sccache/releases/download/${SCCACHE_VERSION}/${SCCACHE_ARCHIVE} && \ | ||
| tar -xzf ${SCCACHE_ARCHIVE} --strip-components=1 && rm ${SCCACHE_ARCHIVE} | ||
|
|
||
| ENV PATH="$SCCACHE_HOME:$PATH" | ||
|
|
||
| # Create a virtual environment for the system Python as Python in Ubuntu 24 complains about installing | ||
| # packages into the system Python | ||
| RUN python3 -m venv venv | ||
| ENV PATH="/venv/bin:$PATH" | ||
|
|
||
| # Setup pip | ||
| ENV PIP_VERSION="24.0" | ||
| RUN /venv/bin/python3 -m pip install --upgrade pip==${PIP_VERSION} | ||
|
|
||
| ENV PIP_CACHE_DIR=/mount/caches/pip/linux/${PIP_VERSION} | ||
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,44 @@ | ||
| FROM openvinogithubactions.azurecr.io/dockerhub/ubuntu:24.04 | ||
|
|
||
| USER root | ||
|
|
||
| # APT configuration | ||
| RUN echo 'Acquire::Retries "10";' > /etc/apt/apt.conf && \ | ||
| echo 'APT::Get::Assume-Yes "true";' >> /etc/apt/apt.conf && \ | ||
| echo 'APT::Get::Fix-Broken "true";' >> /etc/apt/apt.conf && \ | ||
| echo 'APT::Get::no-install-recommends "true";' >> /etc/apt/apt.conf | ||
|
|
||
| ENV DEBIAN_FRONTEND="noninteractive" \ | ||
| TZ="Europe/London" | ||
|
|
||
| RUN apt-get update && \ | ||
| apt-get install software-properties-common && \ | ||
| apt-get update && \ | ||
| apt-get install \ | ||
| curl \ | ||
| git \ | ||
| gpg-agent \ | ||
| tzdata \ | ||
| # Python | ||
| python3-full \ | ||
| libhdf5-dev \ | ||
| && \ | ||
| rm -rf /var/lib/apt/lists/* | ||
|
|
||
| # Install openvino dependencies | ||
| ADD scripts/install_dependencies/install_openvino_dependencies.sh /install_openvino_dependencies.sh | ||
| RUN chmod +x /install_openvino_dependencies.sh && \ | ||
| /install_openvino_dependencies.sh && \ | ||
| rm -rf /var/lib/apt/lists/* | ||
|
|
||
| # Create a virtual environment for the system Python as Python in Ubuntu 24 complains about installing | ||
| # packages into the system Python | ||
| RUN python3 -m venv venv | ||
| ENV PATH="/venv/bin:$PATH" | ||
|
|
||
| # Setup pip | ||
| ENV PIP_VERSION="24.0" | ||
| RUN /venv/bin/python3 -m pip install --upgrade pip==${PIP_VERSION} | ||
|
|
||
| ENV PIP_CACHE_DIR=/mount/caches/pip/linux/${PIP_VERSION} | ||
| ENV PIP_INSTALL_PATH=/venv/lib/python3/site-packages |
Oops, something went wrong.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Ubuntu 20 failed with
python: command not foundas I've removed the virtual env from its Docker and used the system Python there. I guess we can explicitly usepython3as we already do in all steps across workflows.