D
deduplication

Any
Batchfile
C
C++
CMake
CSS
Dockerfile
Go
HCL
HTML
Java
JavaScript
Jinja
Jupyter Notebook
Makefile
Nix
PHP
Python
Ruby
Rust
SCSS
Shell
Swift
TSX
TypeScript
Vue

Projects with this topic

Sort by:

Sort by
Updated date
Name
Name, descending
Oldest updated
Oldest created
Last created
Most stars
Hide archived projects
Show archived projects
Show archived projects only

View RemoveDup project

mirrored_repos / LibreTranslate / RemoveDup

https://github.com/LibreTranslate/RemoveDup Remove duplicates from parallel corpora

clean duplicates deduplication Large Langua...

0

Updated Jun 15, 2026

0 0 0 0

Updated Jun 15, 2026
View Semhash project

mirrored_repos / MachineLearning / MinishLab / Semhash

🔧🔗https://github.com/MinishLab/semhash

Fast Semantic Text Deduplication

datasets preprocessing deduplication vicinity semantic-ded... model2vec

0

Updated May 24, 2026

0 0 0 0

Updated May 24, 2026

🐾❤️ Strive to be the person your dogs believe you are ❤️🐾