Spin up a REST API for any Major Database

My personal project for data engineering zoomcamp

This utilizes a static IP address in GCP to pull data from the Clash of Clans API, store it and serve it via data studio. There is also a API client with a sleep of functions you can use to pull, store, and view CoC facts and dimensions.

Automatically load data from Google Cloud Storage files into Big Query tables

In this project, I am trying to predict traffic congestion, based on an aggregate measure of stopping distance and waiting times, at intersections in 4 major US cities: Atlanta, Boston, Chicago & Philadelphia.

Easy-to-use Python library for managing files and data in different environments

Scripts used for analyzing GitHub commit locations to create a map visualization

Explore efficient big data matching techniques

🍉 Repo for analytics engineering with dbt, transforming raw data into actionable insights.

A platform for users to upload and share the responses from law enforcement agencies to their traffic violation reports in Taiwan. This system aims to increase transparency and public oversight of traffic law enforcement.

Master of Applied Data Science - Milestone I Project (San Francisco Bike Sharing)

Data ingestion from Google BigQuery to PostgreSQL

Segmentação de clientes baseada na avaliação de risco de inadimplência.

Market Data Ingestion and BigQuery Integration project

Media sentiment analysis following the Israel-Hamas escalation in 2023

Copy table from one dataset to another in google big query using bash script

Analysed SEVIR and Storm Datasets and visualized the data using Big Query on Data Studio. Datasets: Sevir Data: The Storm EVent ImagRy (SEVIR) dataset is a collection of temporally and spatially aligned images containing weather events captured by satellite and radar. Visualized using Big Query and Data Studio.

A repo containing auto-triggered Airflow ETL activities for datasets located on GCP storage that flattens and creates analytical views on Big Query

Repo for queries written to run on Big Query for a data analytics project.

Webscraping dos dados do site Mercado Livre. Esses dados são exportados para uma base de dados BigQuery e algumas informações relevantes são obtidas através de consultas SQL.