I’m a Senior Data Engineer with seven years of experience across insurance, gaming, financial services and healthcare. I have built batch and streaming pipelines, migrated large datasets, modeled analytics-ready data and automated cloud infrastructure across Azure, AWS and GCP.

I care most about what happens after a pipeline reaches production. Can it handle late data? Can it be rerun safely? Will a schema change be caught before it reaches a report? Can the team understand why it failed? Those questions shape how I design, test and operate data systems.

These projects show how I turn an idea into a working product and how I make engineering decisions around reliability, usability and delivery.

My flagship production project is a live platform built for the Kingdom 846 gaming community. I designed it to organize alliance information, guides and interactive voting in one responsive experience, then deployed and maintained it for real users.

In its first 19 days, the platform generated 3,298 pageviews from 596 visitors across 49 countries, averaging 4.4 pages per visit.

Production Website Responsive Design Interactive Voting Community Platform

I built an end-to-end streaming pipeline that receives weblog events through Kafka, processes them with Spark Structured Streaming and writes reliable results to Delta Lake. It handles late, duplicate and malformed events through watermarks, bounded-state deduplication, checkpoints and a separate dead-letter path.

Kafka PySpark Structured Streaming Delta Lake Docker

I used public NYC taxi data to build a bronze, silver and gold lakehouse pipeline in PySpark. The pipeline enforces schemas, quarantines invalid records instead of silently dropping them, supports safe reruns and uses a two-stage salted aggregation for high-volume zones.

PySpark Parquet Data Quality Lakehouse pytest

I built a retail analytics warehouse with dbt and DuckDB, taking raw records through staging models into tested facts and dimensions. Monetary values stay precise, late-arriving orders are recovered through an incremental lookback and customer history is preserved with a Type 2 snapshot.

dbt DuckDB SQL Dimensional Modeling SCD Type 2

I created reusable Terraform modules for a layered S3 data lake, an AWS Glue catalog and a least-privilege pipeline role. The permissions deliberately prevent transformation jobs from rewriting raw source data, and the infrastructure can be tested without a live AWS account.

Terraform AWS S3 AWS Glue IAM GitHub Actions

My work has included cloud migrations, batch and streaming pipelines, warehouse performance tuning, infrastructure automation and reusable patterns for ingestion, CDC, deduplication and recovery. I have worked across the full delivery cycle, including design, code review, deployment and production support.

Master of Science in Information Systems — Data Management
Dakota State University · GPA: 3.91/4.00

If your team is solving difficult data-platform problems, I’d be glad to hear what you’re building.

bhanuvejendla.com · LinkedIn · bhanumanideepvejendla@gmail.com