Fast, secure, efficient backup program
-
Updated
Aug 27, 2022 - Go
#
dedupe
Here are 69 public repositories matching this topic...
Deduplicating archiver with compression and authenticated encryption.
-
Updated
Aug 28, 2022 - Python
python
clustering
dedupe
record-linkage
python-library
entity-resolution
datamade
dedupe-library
de-duplicating
-
Updated
Aug 17, 2022 - Python
Deduplication tool for yarn.lock files
-
Updated
Aug 27, 2022 - TypeScript
A powerful duplicate file finder and an enhanced fork of 'fdupes'.
c
windows
macos
linux
fast
dedupe
duplicate-files
bsd
macosx
btrfs
mit-license
win32
symlinks
deduplication
fdupes
symlink-files
delete-files
hard-links
hardlinking
deduplication-command
-
Updated
Mar 18, 2022 - C
A powerful and modular toolkit for record linkage and duplicate detection in Python
python
machine-learning
privacy
dedupe
record-linkage
python-library
entity-resolution
similarity
string-distance
deduplication
data-matching
utrecht-university
-
Updated
Apr 19, 2022 - Python
Make CSS easier and more maintainable by using JavaScript
-
Updated
Nov 9, 2021 - TypeScript
Remove duplicates from MASSIVE wordlist, without sorting it (for dictionary-based password cracking)
c
dictionary
dedupe
password
wordlist
remove-duplicates
uniq
hashes
cracking
wordlist-generator
hashcat
unique
duplicate-detection
password-cracking
wordlists
-
Updated
Jun 25, 2022 - C
Scalable identity resolution, entity resolution, data mastering and deduplication using ML
identity
data-science
identity-resolution
spark
etl
analytics
dedupe
entity-resolution
data-transformation
ml
fuzzy-matching
deduplication
datalake
masterdata
dataengineering
fuzzymatch
dataquality
analytics-engineering
data-transformations
modern-data-stack
-
Updated
Aug 25, 2022 - Java
-
Updated
Mar 31, 2020 - Python
-
Updated
Jan 19, 2022 - Python
Finding and deleting near-duplicate images based on perceptual hash.
-
Updated
Jun 21, 2022 - Python
A fast file deduplicator
-
Updated
Jan 25, 2022 - Rust
Fast block-level out-of-band BTRFS deduplication tool.
-
Updated
Jun 5, 2021 - Python
A simple command line interface to the datamade/dedupe library.
-
Updated
Jun 21, 2022 - Jupyter Notebook
Self-contained C# library for data deduplication using Sqlite
compression
storage
nuget
dedupe
sqlite-database
data-deduplication
chunk
compress
deduplication
chunk-data
duplicate-data
chunk-key
-
Updated
Jan 7, 2022 - C#
Yet Another Dupes Finder
-
Updated
Jul 13, 2022 - Rust
Improve this page
Add a description, image, and links to the dedupe topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the dedupe topic, visit your repo's landing page and select "manage topics."