Python based Open Source ETL tools for file crawling, document processing (text extraction, OCR), content analysis (Entity Extraction & Named Entity Recognition) & data enrichment (annotation) pipelines & ingestor to Solr or Elastic search index & linked data graph database

An application-agnostic, all-in-one New Relic integration integration

JavaFX and commandline application to import events from the Ethereum blockchain into ElasticSearch, MongoDB, Hazelcast, CQEngine and SQLite.

E-ARK Web is a software for the creation and management of archival information packages, and it supports full-text search for individual files contained in them.

Hive streaming ingest test application

API client for Aleph, supports bulk entity and document upload.

DataStax or Cassandra Ingest from Relational Databases with StreamSets

Apache NiFi 1.5 Custom Processor for WebCams

Populating Cloud Data Warehouses with Apache NiFi

Twitter Ingest to S3, ORC, Slack, Hive Streaming

Islandora Prepare Ingest is a module that helps you build workflows for preparing data for ingest into Islandora.

Notes, scripts, images, Apache NiFi templates, processors

Renames a folder full of TIFF/XML/MRC files and moves them into the correct folders to prepare for ingest using the Islandora Book Batch module

Newspaper batch ingest that uses the ordering of a ZIP to dictate sequence.

🏭 Kids First Data Ingest Library

Ingest pipelines to parse Artifactory logs sent to Elasticsearch using Filebeat

A pluggable batch ingester module for Islandora.

Conversion and ingestion of NOAA GHCN-D weather data into PostgreSQL database and querying. Python, R, SQL, Scala

Batch ingest for IArchive format, as provided from UoM.