Fast, secure, efficient backup program
-
Updated
Dec 3, 2022 - Go
#
dedupe
Here are 69 public repositories matching this topic...
Deduplicating archiver with compression and authenticated encryption.
-
Updated
Dec 3, 2022 - Python
python
clustering
dedupe
record-linkage
python-library
entity-resolution
datamade
dedupe-library
de-duplicating
-
Updated
Nov 18, 2022 - Python
A powerful duplicate file finder and an enhanced fork of 'fdupes'.
c
windows
macos
linux
fast
dedupe
duplicate-files
bsd
macosx
btrfs
mit-license
win32
symlinks
deduplication
fdupes
symlink-files
delete-files
hard-links
hardlinking
deduplication-command
-
Updated
Dec 2, 2022 - C
Deduplication tool for yarn.lock files
-
Updated
Dec 2, 2022 - TypeScript
A powerful and modular toolkit for record linkage and duplicate detection in Python
python
machine-learning
privacy
dedupe
record-linkage
python-library
entity-resolution
similarity
string-distance
deduplication
data-matching
utrecht-university
-
Updated
Apr 19, 2022 - Python
Make CSS easier and more maintainable by using JavaScript
-
Updated
Nov 9, 2021 - TypeScript
Scalable identity resolution, entity resolution, data mastering and deduplication using ML
identity
data-science
identity-resolution
spark
etl
analytics
dedupe
entity-resolution
data-transformation
ml
fuzzy-matching
deduplication
datalake
masterdata
dataengineering
fuzzymatch
dataquality
analytics-engineering
data-transformations
modern-data-stack
-
Updated
Dec 2, 2022 - Java
Remove duplicates from MASSIVE wordlist, without sorting it (for dictionary-based password cracking)
c
dictionary
dedupe
password
wordlist
remove-duplicates
uniq
hashes
cracking
wordlist-generator
hashcat
unique
duplicate-detection
password-cracking
wordlists
-
Updated
Jun 25, 2022 - C
-
Updated
Mar 31, 2020 - Python
-
Updated
Jan 19, 2022 - Python
Finding and deleting near-duplicate images based on perceptual hash.
-
Updated
Nov 22, 2022 - Python
A fast file deduplicator
-
Updated
Oct 19, 2022 - Rust
Fast block-level out-of-band BTRFS deduplication tool.
-
Updated
Jun 5, 2021 - Python
A simple command line interface to the datamade/dedupe library.
-
Updated
Jun 21, 2022 - Jupyter Notebook
Yet Another Dupes Finder
-
Updated
Sep 29, 2022 - Rust
Self-contained C# library for data deduplication using Sqlite
compression
storage
nuget
dedupe
sqlite-database
data-deduplication
chunk
compress
deduplication
chunk-data
duplicate-data
chunk-key
-
Updated
Jan 7, 2022 - C#
Improve this page
Add a description, image, and links to the dedupe topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the dedupe topic, visit your repo's landing page and select "manage topics."