deduplication

Fast, secure, efficient backup program

Deduplicating archiver with compression and authenticated encryption.

Prometheus Alertmanager

A C library for parsing/normalizing street addresses around the world. Powered by statistical NLP and open geo data.

Find duplicate files

Cross-platform backup tool for Windows, macOS & Linux with fast, incremental backups, client-side end-to-end encryption, compression and data deduplication. CLI and GUI included.

Extremely fast tool to remove duplicates and other lint from your filesystem

A powerful duplicate file finder and an enhanced fork of 'fdupes'.

Simple, configuration-driven backup software for servers and workstations

A fast high compression read-only file system

Data deduplication engine, supporting optional compression and public key encryption.

A powerful and modular toolkit for record linkage and duplicate detection in Python

rustic - fast, encrypted, deduplicated backups powered by Rust

Config driven, easy backup cli for restic.

Scalable identity resolution, entity resolution, data mastering and deduplication using ML

Straightforward fuzzy matching, information retrieval and NLP building blocks for JavaScript.

Fast, accurate and scalable probabilistic data linkage using your choice of SQL backend

A list of free data matching and record linkage software.

Коллекция готовых SQL запросов для PostgreSQL по часто возникающим задачам (получение и модификация данных, ускорение запросов, обслуживание БД)

Locality Sensitive Hashing using MinHash in Python/Cython to detect near duplicate text documents