Open source cloud-native security lake platform (SIEM alternative) for threat hunting, detection & response, and cybersecurity analytics at petabyte scale on AWS

OneTable is an omni-directional converter for table formats that facilitates interoperability across data processing systems and query engines.

Use SQL to build ELT pipelines on a data lakehouse.

Lakehouse storage system benchmark

Jupyter notebooks and AWS CloudFormation template to show how Hudi, Iceberg, and Delta Lake work

Sample Data Lakehouse deployed in Docker containers using Apache Iceberg, Minio, Trino and a Hive Metastore. Can be used for local testing.

Stream CDC into an Amazon S3 data lake in Apache Iceberg format with AWS Glue Streaming and DMS

Streaming ETL job cases in AWS Glue to integrate Iceberg and creating an in-place updatable data lake on Amazon S3

A sample implementation of stream writes to an Iceberg table on GCS using Flink and reading it using Trino

Hands-on workshop with Iceberg, Redpanda, Debezium and Kafka-Connect

This is a collecton of Amazon CDK projects to show how to directly ingest streaming data from Amazon Mananged Service for Apache Kafka (MSK) and MSK Serverless into Apache Iceberg table in S3 with AWS Glue Streaming.

Hands-on workshop with Apache Iceberg

iceberg-spark-tpcds-benchmark

React Components to visualize Apache Iceberg tables

Experiments with Apache Iceberg

Apache Icebery examples designed to be run on AWS Elastic Map Reduce (EMR) via. EMR Studio or EMR Notebooks

Stream CDC into an Amazon S3 data lake in Apache Iceberg format with AWS Glue Streaming and MSK Connect (Debezium)

"Apache Iceberg Connector for AWS Glue를 이용하여 데이터레이크 CRUD 하기" 포스팅 내용 실습 프로젝트

Resources from an virtual tech talk / workshop - Set Up and Use Apache Iceberg Tables on Your Data Lake