DEV Community

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Mastering SQL for Data Engineering: Advanced Queries, Optimization, and Data Modeling Best Practices
mosesmorris profile

Mastering SQL for Data Engineering: Advanced Queries, Optimization, and Data Modeling Best Practices

#eventdriven #sql #dataengineering #etl
1
Comments 2
10 min read
A Step-by-Step Guide to Streaming Live Weather Data Using Apache Kafka and Apache Cassandra
nelsongei profile

A Step-by-Step Guide to Streaming Live Weather Data Using Apache Kafka and Apache Cassandra

#dataengineering #ai #kafka
6
Comments 2
4 min read
"Data Warehouses: The Silent Powerhouse Your Boss Doesn’t Understand"
spkibe profile

"Data Warehouses: The Silent Powerhouse Your Boss Doesn’t Understand"

#datawarehouse #datamodelling #dataengineering #programming
Comments
2 min read
Create, Read, Update, Delete (CRUD) | MongoDB Tutorial 2025
roxana_haidiner profile

Create, Read, Update, Delete (CRUD) | MongoDB Tutorial 2025

#mongodb #nosql #database #dataengineering
10
Comments
7 min read
Learn Python Basics for Data Engineering (with Mini Project)
dkkinyua profile

Learn Python Basics for Data Engineering (with Mini Project)

#python #programming #dataengineering #datascience
Comments 2
6 min read
SQL for Beginners - A Complete Guide.
dkkinyua profile

SQL for Beginners - A Complete Guide.

#sql #database #dataengineering #datascience
1
Comments
4 min read
Data Analytics: The Backbone of Modern Decision-Making
agarwal_aditya_ profile

Data Analytics: The Backbone of Modern Decision-Making

#webdev #datascience #dataengineering #analyst
Comments
2 min read
Apache Airflow for Data Engineering: Best Practices and Real-World Examples
nelsongei profile

Apache Airflow for Data Engineering: Best Practices and Real-World Examples

#dataengineering #ai #airflow #machinelearning
1
Comments
4 min read
"Our GPUs Are Melting": Building a Real-Time Streaming System with Go and Redpanda Ghibli Style
snehasish_dutta_007 profile

"Our GPUs Are Melting": Building a Real-Time Streaming System with Go and Redpanda Ghibli Style

#go #kafka #eventdriven #dataengineering
Comments
10 min read
What is Exploratory Data Analysis?
e77 profile
Ank

What is Exploratory Data Analysis?

#beginners #analytics #data #dataengineering
Comments
1 min read
Working with Web3 Data: Challenges
nocibambi profile

Working with Web3 Data: Challenges

#web3data #web3 #dataengineering #data
Comments
4 min read
🕸️ Why Web Scraping in Python Is a Must-Have Skill in 2025 🐍
aleksei_aleinikov profile

🕸️ Why Web Scraping in Python Is a Must-Have Skill in 2025 🐍

#web #python #programming #dataengineering
Comments
1 min read
Streamline data transfer: The ultimate data integration guide SFTP to BigQuery
mage_ai profile

Streamline data transfer: The ultimate data integration guide SFTP to BigQuery

#dataengineering #dataintegration #bigquery #mageai
1
Comments
6 min read
We're back and better than ever!
mage_ai profile

We're back and better than ever!

#mageai #ai #datapipelines #dataengineering
1
Comments
1 min read
Databricks Platform: Unlocking Big Data Analytics and Machine Learning at Scale
anil_kumarmoka_f93e418d0 profile

Databricks Platform: Unlocking Big Data Analytics and Machine Learning at Scale

#databricks #machinelearning #datascience #dataengineering
1
Comments
4 min read
What is Data Scraping?
e77 profile
Ank

What is Data Scraping?

#beginners #data #dataengineering #datastructures
Comments
2 min read
Is Your Data a Mess? Transform It with Expert Data Lake Consulting Services!
drodriguez profile

Is Your Data a Mess? Transform It with Expert Data Lake Consulting Services!

#datalake #datalakeconsulting #dataengineering
Comments
3 min read
Diving into bigdata
grokker_f9bf83d79cb9beb6f profile
Dinesh

Diving into bigdata

#bigdata #dataengineering
Comments
1 min read
Bring Oracle Data to Elasticsearch for Real-Time Search
bladepipe profile

Bring Oracle Data to Elasticsearch for Real-Time Search

#oracle #elasticsearch #dataengineering #database
Comments
4 min read
Study Notes 5.5.1-2 Operations on Spark RDDs & Spark RDD mapPartition
pizofreude profile

Study Notes 5.5.1-2 Operations on Spark RDDs & Spark RDD mapPartition

#dataengineering #dezoomcamp #spark #rdd
Comments
9 min read
Study Notes 5.6.1-2 Spark on cloud & local
pizofreude profile

Study Notes 5.6.1-2 Spark on cloud & local

#dataengineering #dezoomcamp #spark #cloud
Comments
7 min read
Study Notes 5.4.1-3 Anatomy of a Spark Cluster GroupBy & Joins in Spark
pizofreude profile

Study Notes 5.4.1-3 Anatomy of a Spark Cluster GroupBy & Joins in Spark

#dataengineering #dezoomcamp #sql #spark
Comments
11 min read
Study Notes 5.6.3-4 Setting up a Dataproc Cluster & Connecting Spark to Big Query
pizofreude profile

Study Notes 5.6.3-4 Setting up a Dataproc Cluster & Connecting Spark to Big Query

#dataengineering #dezoomcamp #spark #bigquery
Comments
8 min read
Study Notes 5.3.1-2 First Look at Spark/PySpark & Spark Dataframes
pizofreude profile

Study Notes 5.3.1-2 First Look at Spark/PySpark & Spark Dataframes

#dataengineering #dezoomcamp #pyspark #sparkdataframe
Comments
9 min read
Building an Automated Weather Data Pipeline with Apache Kafka and Cassandra
katumo profile

Building an Automated Weather Data Pipeline with Apache Kafka and Cassandra

#dataengineering #data #apachekafka
9
Comments
10 min read
loading...