Remove duplicate documents/videos/images via popular algorithms such as SimHash, SpotSig, Shingling, etc.
-
Updated
Aug 28, 2023 - Python
#
shingling
Here are 12 public repositories matching this topic...
Implementation of algorithms for big data using python, numpy, pandas.
python bloom-filter lsh streams frequent-itemset-mining pcy frequent-itemsets stream-mining shingling big-data-processing lsh-algorithm min-hasing similar-items a-priori multistage-pcy multihash-pcy
-
Updated
Apr 27, 2020 - Python
A Java program to check Plagiarisms between multiple documents using the method of Shingling, MinHashing and Locality Sensitive Hashing.
-
Updated
Jul 31, 2020 - Java
Code for Shingling
-
Updated
Jun 12, 2024 - Python
Data-based analysis of the structure and linguistic characteristics of the Bible and the Quran
data-science data-mining bible textrank lsh data-analysis quran tf-idf shingling min-hashing bible-vs-quran
-
Updated
Jan 6, 2025 - Jupyter Notebook
Finding Similar Items: Textually Similar Documents
-
Updated
Nov 14, 2018 - TypeScript
Implementing Locality Sensitive Hashing for DNA Sequences.
-
Updated
Nov 29, 2020 - Python
Duplicate Detection on Hoaxy Dataset
-
Updated
Dec 4, 2018 - Jupyter Notebook
Finding Similar Items: Textually Similar Documents
-
Updated
Sep 14, 2022 - Jupyter Notebook
information-retrieval similarity cosine-similarity bands shingles latent-semantic-analysis latent-semantic-indexing shingling
-
Updated
Dec 26, 2019 - Python
Data Mining Algorithms
-
Updated
Dec 5, 2018 - Roff
Improve this page
Add a description, image, and links to the shingling topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the shingling topic, visit your repo's landing page and select "manage topics."