Skip to content

Commit

Permalink
Use TinyLLama
Browse files Browse the repository at this point in the history
  • Loading branch information
as-suvorov committed Jul 1, 2024
1 parent b102492 commit bd0a6ee
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions .github/workflows/continuous_batching_cpp.yml
Original file line number Diff line number Diff line change
Expand Up @@ -35,13 +35,13 @@ jobs:
source ./ov/setupvars.sh
python -m pip install --upgrade-strategy eager -r ./samples/requirements.txt --pre --extra-index-url https://storage.openvinotoolkit.org/simple/wheels/nightly
python -m pip install ./thirdparty/openvino_tokenizers/[transformers] --pre --extra-index-url https://storage.openvinotoolkit.org/simple/wheels/nightly
optimum-cli export openvino --trust-remote-code --weight-format fp16 --model openlm-research/open_llama_3b_v2 open_llama_3b_v2
optimum-cli export openvino --trust-remote-code --weight-format fp16 --model TinyLlama/TinyLlama-1.1B-Chat-v1.0 TinyLlama
cmake -DCMAKE_BUILD_TYPE=Release -DENABLE_CONTINUOUS_BATCHING=ON -DENABLE_APPS=ON -S ./ -B ./build/
cmake --build ./build/ --config Release -j
- run: >
. ./ov/setupvars.sh
&& PYTHONPATH=./build/:$PYTHONPATH timeout 25s
./build/samples/cpp/accuracy_sample/accuracy_sample -m ./open_llama_3b_v2/ -n 4
./build/samples/cpp/accuracy_sample/accuracy_sample -m ./TinyLlama/ -n 4
# - run: >
# . ./ov/setupvars.sh
# && PYTHONPATH=./build/:$PYTHONPATH timeout 25s
Expand Down

0 comments on commit bd0a6ee

Please sign in to comment.