Forem

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Bypassing Scraper Latency: Building a Real-Time Economic Indicator (REI) Tracker with Python
Cover image for Bypassing Scraper Latency: Building a Real-Time Economic Indicator (REI) Tracker with Python
kazutaka_kobayashi_45117a profile

Bypassing Scraper Latency: Building a Real-Time Economic Indicator (REI) Tracker with Python

#python #webscraping #dataengineering #economics
Comments
4 min read
Why Real-Time Analytics Eventually Changes Your Database Architecture
Cover image for Why Real-Time Analytics Eventually Changes Your Database Architecture
mohhddhassan profile

Why Real-Time Analytics Eventually Changes Your Database Architecture

#clickhouse #postgres #dataengineering #architecture
2
Comments
4 min read
Can ClickHouse DELETE Data? A 2026 PR-by-PR Analysis
manveer_chawla_64a7283d5a profile

Can ClickHouse DELETE Data? A 2026 PR-by-PR Analysis

#database #sql #dataengineering #data
6
Comments
31 min read
I Built Airflow DAG Studio — A Visual Drag-and-Drop Builder for Apache Airflow DAGs
datainteg profile

I Built Airflow DAG Studio — A Visual Drag-and-Drop Builder for Apache Airflow DAGs

#airflow #dataengineering #opensource #ai
Comments
1 min read
What I Learned From Reading 50 Data Pipeline Postmortems
Cover image for What I Learned From Reading 50 Data Pipeline Postmortems
andrew_tan_layline profile

What I Learned From Reading 50 Data Pipeline Postmortems

#dataengineering #kafka #softwareengineering #data
Comments
7 min read
Before You Put a Fabric AI Agent in Production, Steal This Checklist
Cover image for Before You Put a Fabric AI Agent in Production, Steal This Checklist
shai_karmani_2521c2f8e837 profile

Before You Put a Fabric AI Agent in Production, Steal This Checklist

#microsoftfabric #ai #dataengineering #governance
Comments
4 min read
Your Microsoft Fabric Bill Has a OneLake Problem
Cover image for Your Microsoft Fabric Bill Has a OneLake Problem
shai_karmani_2521c2f8e837 profile

Your Microsoft Fabric Bill Has a OneLake Problem

#microsoftfabric #dataengineering #governance #finops
Comments
5 min read
A data platform tracking news and social media across 167 cities in Rio Grande do Norte for under R$5/month.
Cover image for A data platform tracking news and social media across 167 cities in Rio Grande do Norte for under R$5/month.
gscdataanalytic profile

A data platform tracking news and social media across 167 cities in Rio Grande do Norte for under R$5/month.

#dataengineering #googlecloud #python #serverless
Comments
2 min read
Tech Lost 150K Jobs in 2026. Data Engineering Gained 414%.
datadriven profile

Tech Lost 150K Jobs in 2026. Data Engineering Gained 414%.

#dataengineering #career #python #beginners
Comments
7 min read
From DeepSeek to Quack: When the Dream of Distributed DuckDB Started to Feel Real
Cover image for From DeepSeek to Quack: When the Dream of Distributed DuckDB Started to Feel Real
amirsefati profile
amir

From DeepSeek to Quack: When the Dream of Distributed DuckDB Started to Feel Real

#duckdb #dataengineering #ai #database
3
Comments
8 min read
Understanding Apache Kafka: A Beginner's Guide to Real-time Data Streaming
Cover image for Understanding Apache Kafka: A Beginner's Guide to Real-time Data Streaming
nganga_njongo profile

Understanding Apache Kafka: A Beginner's Guide to Real-time Data Streaming

#kafka #python #dataengineering #data
Comments
4 min read
What Is the Best Metaplane Alternative in 2026?
iblaine profile

What Is the Best Metaplane Alternative in 2026?

#dataengineering #dataquality
Comments
11 min read
Integrating OIC with Databricks using AWS S3 (External Tables Approach)
naveen6735 profile

Integrating OIC with Databricks using AWS S3 (External Tables Approach)

#architecture #aws #cloud #dataengineering
Comments
2 min read
BigQuery, Snowflake, Redshift, Databricks, Fabric: where each one silently inflates your bill
engineersguide profile

BigQuery, Snowflake, Redshift, Databricks, Fabric: where each one silently inflates your bill

#cloud #database #devops #dataengineering
Comments
11 min read
Load PostgreSQL into Apache Iceberg with Sling
flarco profile

Load PostgreSQL into Apache Iceberg with Sling

#postgres #iceberg #dataengineering #etl
Comments
8 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.
HTTPS · forem.com
← Home