Aakash Madabhushi
Data Engineer I build the pipelines that get data to dashboards and models, and the checks that stop bad data before it reaches either.
5M+ rows a day delivered to every customer's analytics at Sapaad
43% faster loads on 75+ customer dashboards, 12.4 s to 7.1 s at p95
14 bad-data incidents stopped before they reached a production model
27.1M network-connection records refined into model features At Sapaad, a restaurant-management SaaS company, built the production pipelines behind every customer's analytics and recommendations: 5M+ rows a day, in Python and Spark on Databricks. Cut load time on 75+ customer dashboards by 43%, from 12.4 to 7.1 seconds, by profiling where the slow Spark queries spent their time, rewriting them, and caching repeated results. Stopped 14 bad-data incidents before they reached a production model, with automatic checks for broken schemas, stale feeds and failed loads in front of every pipeline. On my own projects: an Airflow, dbt and Snowflake pipeline that turns 27.1M raw network records into model features, and a taxi platform serving one source of truth to both daily dashboards and live monitoring. 8 projects in this area Every link goes to code or data you can inspect yourself.
Nov to Dec 2025 · Personal project
NYC Taxi Data Platform: Batch and Streaming Serves the same taxi data to yesterday's dashboards and to live monitoring, from one source, so the two never disagree.
Dec 2025 · Team coursework
U.S. Flight Delays: Batch Analytics to Real-Time Prediction Predicts whether your flight will be late, learned from 9.5 million past flights, and scores each new departure in seconds.
Nov 2025 · Personal project
Live Wikipedia Edit Sentiment Shows which Wikipedia pages are turning into an argument, right now, by reading the tone of every edit as it lands.
Oct to Nov 2025 · Personal project
Stock Market Analytics Pipeline Keeps every revision a price feed makes, so a restated number never silently replaces the one you reported last week.
Nov 2025 · Personal project
Semantic Article Search Pipeline Finds the article you meant rather than the words you typed, by indexing each one by meaning on a nightly schedule.
Spring 2026 · Coursework
Event-Driven Yelp Clone Lets one part of a review site fail without taking the rest down, because its services talk through events, not direct calls.
Spring 2026 · Coursework
LinkedIn Simulation with an AI Recruiting Assistant Takes a recruiter from a pile of résumés to a shortlist without slowing the page, and asks before contacting anyone.
Feb to May 2026 · Team coursework
Explainable Network Threat Detection Finds the suspicious pair of machines among 27.1M network connections, and tells the analyst in plain English why.
Select a project for its figures, stack and links.
× NYC Taxi Data Platform: Batch and Streaming Personal project · Nov to Dec 2025 · Data Engineering
Serves the same taxi data to yesterday's dashboards and to live monitoring, from one source, so the two never disagree.
Built with Airflow · PySpark · dbt · Snowflake · Kafka · Docker
× U.S. Flight Delays: Batch Analytics to Real-Time Prediction SJSU big data course, team project · Dec 2025 · Data Engineering, ML Engineering
Predicts whether your flight will be late, learned from 9.5 million past flights, and scores each new departure in seconds.
Results
0.711 F1 predicting delays, 79.1% accuracy
9.5M flight records processed, 15 monthly BTS files totalling 3.1 GB
0.3% train-minus-test accuracy gap, against 1.6% for a single decision tree
78% of random-forest importance mass held by the top five features Built with Python · PySpark · Spark MLlib · Spark SQL · Kafka · Structured Streaming · Streamlit · Docker
× Live Wikipedia Edit Sentiment Personal project · Nov 2025 · Data Engineering, ML Engineering
Shows which Wikipedia pages are turning into an argument, right now, by reading the tone of every edit as it lands.
Built with Python · Kafka · RoBERTa · Hugging Face
× Stock Market Analytics Pipeline Personal project · Oct to Nov 2025 · Data Engineering
Keeps every revision a price feed makes, so a restated number never silently replaces the one you reported last week.
Built with Airflow · dbt · Snowflake · Docker
× Semantic Article Search Pipeline Personal project · Nov 2025 · Data Engineering, AI Engineering
Finds the article you meant rather than the words you typed, by indexing each one by meaning on a nightly schedule.
Built with Airflow · Sentence Transformers · Pinecone · Docker
× Event-Driven Yelp Clone SJSU DATA 236, Distributed Systems · Spring 2026 · Software Engineering, Data Engineering
Lets one part of a review site fail without taking the rest down, because its services talk through events, not direct calls.
Built with JavaScript · Kafka · Docker
× LinkedIn Simulation with an AI Recruiting Assistant SJSU DATA 236, Distributed Systems · Spring 2026 · Software Engineering, AI Engineering, Data Engineering
Takes a recruiter from a pile of résumés to a shortlist without slowing the page, and asks before contacting anyone.
Results
6× faster repeat profile loads, under 100 concurrent users
17 containers across 5 service groups Built with FastAPI · Kafka · LangGraph · React · MySQL · MongoDB · Redis · Docker
× Explainable Network Threat Detection SJSU capstone, team project · Feb to May 2026 · ML Engineering, AI Engineering, Data Engineering
Finds the suspicious pair of machines among 27.1M network connections, and tells the analyst in plain English why.
Results
0.90 F1 flagging suspicious machine pairs (0.94 precision)
27.1M Zeek network flows aggregated into the graph
0.87 s median end-to-end latency per retrieval-grounded explanation Built with PyTorch Geometric · Airflow · dbt · Snowflake · Pinecone · Llama 3.3
Hiring for data engineering? I'm available from December 2026 and open to relocating. Email is the fastest way to reach me.
Hiring for something else?
