End-to-end automated ETL pipeline for processing NYC Taxi trip data using Jenkins orchestration, Azure Blob Storage, Databricks Spark processing, and Azure SQL Database analytics.
Choosing the right data platform is critical for the modern enterprise. These platforms not only store and protect enterprise data, but also serve as analytics engines that source insights for pivotal ...
Este projeto implementa um pipeline ETL que coleta dados meteorológicos de São Paulo a cada hora, processa as informações e armazena em um banco de dados PostgreSQL para análise posterior.