SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.
ingestr is a CLI tool to copy data between any databases with a single command seamlessly.
Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
Concurrent and multi-stage data ingestion and data processing with Elixir
Pravega - Streaming as a new software defined storage primitive
Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.
Copy to/from Parquet in S3, Azure Blob Storage, Google Cloud Storage, http(s) stores, local files or standard inout stream from within PostgreSQL
The Supabase of AI era. A modular, open-source backend for building AI-native software — designed for knowledge, not static data.
Orbital automates integration between data sources (APIs, Databases, Queues and Functions). BFF's, API Composition and ETL pipelines that adapt as your specs change.
Use SQL to build ELT pipelines on a data lakehouse.
Apache Paimon Rust The rust implementation of Apache Paimon.
The Data Engineering Book - หนังสือวิศวกรรมข้อมูล ของคนไทย เพื่อคนไทย
Build complete API integrations with YAML and SQL. Rapid development without vendor lock-in and per-row costs.
Claude Skills for connecting Claude.ai to local Weaviate vector databases - manage collections, ingest data, and query with RAG
Enables custom tracing of Java applications in Dynatrace
Sample code for the AWS Big Data Blog Post Building a scalable streaming data processor with Amazon Kinesis Data Streams on AWS Fargate
OpenKit Java Reference Implementation
Download and warehouse historical trading data
Add a description, image, and links to the data-ingestion topic page so that developers can more easily learn about it.
To associate your repository with the data-ingestion topic, visit your repo's landing page and select "manage topics."
