This show goes behind the scenes for the tools, techniques, and difficulties associated with the discipline of data engineering. Databases, workflows, automation, and data manipulation are just some of the topics that you will find here.
https://www.dataengineeringpodcast.com
Gesamtlänge aller Episoden: 16 days 1 hour 36 minutes
Building A Real Time Event Data Warehouse For Sentry
An interview about how Sentry used Clickhouse to build an event data warehouse and pay down their architecture debt
Escaping Analysis Paralysis For Your Data Platform With Data Virtualization
An interview about data virtualization and data engineering automation with AtScale and the value of abstractions for your data platform architecture
Designing For Data Protection
An interview about data protection regulations and how they can influence the design of your data platform
Automating Your Production Dataflows On Spark
An interview about how the Ascend platform provides an autonomous data orchestration platform to simplify your production dataflows
Build Maintainable And Testable Data Applications With Dagster
An interview about the Dagster framework and how you can use it to build testable and maintainable data applications
Data Orchestration For Hybrid Cloud Analytics
An interview about the emerging category of data orchestration platforms and how they can be used to bridge the gap between modern and legacy analytics systems
Keeping Your Data Warehouse In Order With DataForm
An interview about Dataform and how it helps you to keep your data warehouse in good working order
Fast Analytics On Semi-Structured And Structured Data In The Cloud
An interview about the architecture of Rockset and how they built a serverless platform for fast and flexible analytics on your semi-structured data
Ship Faster With An Opinionated Data Pipeline Framework
An interview about how the open source Kedro framework makes it faster and easier to build your end-to-end data pipeline for machine learning projects
Open Source Object Storage For All Of Your Data
An interview on the open source MinIO platform for fast and flexible object storage for data intensive applications and analytics that runs everywhere