Fast, secure, efficient backup program
-
Updated
Dec 3, 2022 - Go
#
deduplication
Here are 293 public repositories matching this topic...
Deduplicating archiver with compression and authenticated encryption.
-
Updated
Dec 3, 2022 - Python
Prometheus Alertmanager
-
Updated
Dec 2, 2022 - Go
A C library for parsing/normalizing street addresses around the world. Powered by statistical NLP and open geo data.
c
nlp
machine-learning
natural-language-processing
record-linkage
address
address-parser
international
deduplication
deduping
-
Updated
Dec 1, 2022 - C
Cross-platform backup tool for Windows, macOS & Linux with fast, incremental backups, client-side end-to-end encryption, compression and data deduplication. CLI and GUI included.
-
Updated
Dec 3, 2022 - Go
Extremely fast tool to remove duplicates and other lint from your filesystem
-
Updated
Nov 5, 2022 - C
A powerful duplicate file finder and an enhanced fork of 'fdupes'.
c
windows
macos
linux
fast
dedupe
duplicate-files
bsd
macosx
btrfs
mit-license
win32
symlinks
deduplication
fdupes
symlink-files
delete-files
hard-links
hardlinking
deduplication-command
-
Updated
Dec 2, 2022 - C
Simple, configuration-driven backup software for servers and workstations
-
Updated
Dec 2, 2022 - Python
A fast high compression read-only file system
linux
performance
fuse
compression
cpp
filesystem
archiving
zstd
lzma
fuse-filesystem
zpaq
deduplication
squashfs
xz
wimlib
erofs
gpl-license
lrzip
rzip
dwarfs
-
Updated
Nov 20, 2022 - C++
Data deduplication engine, supporting optional compression and public key encryption.
-
Updated
Aug 25, 2022 - Rust
A powerful and modular toolkit for record linkage and duplicate detection in Python
python
machine-learning
privacy
dedupe
record-linkage
python-library
entity-resolution
similarity
string-distance
deduplication
data-matching
utrecht-university
-
Updated
Apr 19, 2022 - Python
Scalable identity resolution, entity resolution, data mastering and deduplication using ML
identity
data-science
identity-resolution
spark
etl
analytics
dedupe
entity-resolution
data-transformation
ml
fuzzy-matching
deduplication
datalake
masterdata
dataengineering
fuzzymatch
dataquality
analytics-engineering
data-transformations
modern-data-stack
-
Updated
Dec 2, 2022 - Java
Straightforward fuzzy matching, information retrieval and NLP building blocks for JavaScript.
machine-learning
natural-language-processing
information-retrieval
clustering
record-linkage
fuzzy-matching
deduplication
-
Updated
May 5, 2021 - JavaScript
Config driven, easy backup cli for restic.
-
Updated
Nov 14, 2022 - Go
Fast, accurate and scalable probabilistic data linkage using your choice of SQL backend
spark
record-linkage
entity-resolution
fuzzy-matching
deduplication
em-algorithm
data-matching
deduplicate-data
-
Updated
Dec 2, 2022 - Python
A list of free data matching and record linkage software.
open-source
machine-learning
awesome
record-linkage
entity-resolution
fuzzy-matching
software
awesome-list
deduplication
data-matching
-
Updated
Aug 29, 2022
rustic - fast, encrypted, deduplicated backups powered by pure Rust
-
Updated
Dec 2, 2022 - Rust
Locality Sensitive Hashing using MinHash in Python/Cython to detect near duplicate text documents
-
Updated
Jun 7, 2020 - Python
Коллекция готовых SQL запросов для PostgreSQL по часто возникающим задачам (получение и модификация данных, ускорение запросов, обслуживание БД)
syntax
recipes
postgres
csv
parse
validation
sql
detect
howto
email
phone
function
postgresql
update
batch
check
ddl
gender
deduplication
determine
-
Updated
Dec 2, 2022 - PLpgSQL
Improve this page
Add a description, image, and links to the deduplication topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the deduplication topic, visit your repo's landing page and select "manage topics."