Skip to content

Latest commit

 

History

History
10 lines (5 loc) · 788 Bytes

README.md

File metadata and controls

10 lines (5 loc) · 788 Bytes

Natural Language Processing

This project explores developing a Word2Vec model for NLP using the Climate Fever dataset from the Hugging Face AI community. The Word2Vec model is trained to generate an embedding matrix, and its spatial relationships are investigated using cosine similarity. The quality of the embeddings are examined by exploring arithmetic relationships between similar and dissimilar words. The model is then compared with two pretrained models (1 Word2Vec using Google News 300 dataset, 1 GloVe trained using a combination of a Wikipedia dataset and the Gigaword dataset). All models are compared to evaluate the quality of embeddings within their respective matrices.

Arithmetic Relationship Example

Nasa + Scientist = Laboratory