Prepare model

To fine-tune target model distilbert/distilbert-base-uncased

python model_preparation/main.py

The best checkpoint will be in data/checkpoints/best folder.

To run

Run the producer

source ./venv/bin/activate
export PATH=$PATH:~/.docker/bin
export PYTHONPATH=${PYTHONPATH}:.

docker compose up -d
python src/data_producer.py

Run the inference

source ./venv/bin/activate
export PATH=$PATH:~/.docker/bin
export PYTHONPATH=${PYTHONPATH}:.

docker compose up -d
python src/data_inference.py

Run the visualizer

source ./venv/bin/activate
export PATH=$PATH:~/.docker/bin
export PYTHONPATH=${PYTHONPATH}:.

docker compose up -d
streamlit run src/visualize.py