Data Engineering

Data Engineering | News, how-tos, features, reviews, and videos

What can you do with quantum computing today?

Now is the perfect time to develop skills, research new security protocols, and experiment with potential use cases.

By Isaac Sacolick

May 19, 20269 mins

Data EngineeringData and Information SecurityQuantum Computing

Snowflake extends Cortex Code CLI to dbt and Airflow to streamline data engineering workflows

By Anirban Ghoshal

Feb 24, 20263 mins

AnalyticsData EngineeringDeveloper

Microsoft acquires Osmos to ease data engineering bottlenecks in Fabric

By Anirban Ghoshal

Jan 7, 20264 mins

AnalyticsArtificial IntelligenceData Engineering

Four important lessons about context engineering

By Md Abdul Halim Rafi

Nov 27, 202510 mins

Artificial IntelligenceData EngineeringGenerative AI

Improving annotation quality with machine learning

By Nick Lotz

Nov 20, 20259 mins

Data EngineeringGenerative AIMachine Learning

3 data engineering trends riding Kafka, Flink, and Iceberg

By Adi Polak

Nov 25, 20245 mins

Data EngineeringData ManagementSoftware Development

Articles

Microsoft gives enterprises new reasons to adopt Fabric

At its European Fabric Community Conference last week, Microsoft released a volley of incremental updates to woo enterprises to its data platform.

By Anirban Ghoshal

Sep 30, 2024 7 mins

Business IntelligenceData EngineeringData Warehousing

Google adds Gemini to BigQuery, Looker to help with data engineering

Other updates include support for open source Apache Spark and Kafka integrations to BigQuery.

By Anirban Ghoshal

Aug 1, 2024 4 mins

Data EngineeringGenerative AI

What can you do with quantum computing today?

Mastering the dull reality of sexy AI

Migrating from Apache Airflow v2 to v3

Anthropic alleges large-scale distillation campaigns targeting Claude

Snowflake extends Cortex Code CLI to dbt and Airflow to streamline data engineering workflows

Microsoft acquires Osmos to ease data engineering bottlenecks in Fabric

Four important lessons about context engineering

Improving annotation quality with machine learning

3 data engineering trends riding Kafka, Flink, and Iceberg

Articles

Microsoft gives enterprises new reasons to adopt Fabric

Google adds Gemini to BigQuery, Looker to help with data engineering

Resources

Simplifying Hybrid Cloud Security

Stop Managing Clusters and Start Managing the Fleet: The Full Stack Kubernetes Advantage

How IoT Remote Monitoring Created a Scalable Service Model for Septic System Infrastructure