Moez Khan · Data Engineer

I turn raw data into structured pipelines.

I build ETL pipelines, automations and data workflows with Python, SQL and Airflow — and I ship my own products on top of them, like two SaaS tools for the strategy game WarEra.

01 / aboutAbout me

I'm a data engineer who enjoys the unglamorous middle of data work: automating processes, integrating APIs, and structuring messy data into usable systems. I've designed and managed data flows with Apache NiFi, orchestrated pipelines with Airflow, and built ingestion tooling that infers schemas and loads data in full or incremental modes.

I care about pipelines that keep working — so I spend a lot of my time on performance, reliability and scalability, and on making it obvious when something needs a human to look at it.

02 / toolkitWhat I work with

Languages & data

PythonSQLPandasNumPy

Orchestration & flow

Apache AirflowApache NiFiPlaywright

Storage & cloud

MySQLMongoDBGoogle CloudDatabricks

03 / productsThings I've built & run

Two SaaS tools for WarEra, a browser-based strategy and economy game. Both are data pipelines under the hood: live game data in, clear decisions out.

Unofficial fan-made tools. WarEra and its artwork belong to their owners.

04 / workSelected projects

Generic Data Ingestor Framework

framework

Analyses semi-structured JSON, CSV and Parquet files, infers their structure, generates a matching schema and loads them into a structured target model — in full or incremental (delta) mode.

Pythonschema inferenceCDC

Databricks Bootcamp Prep Platform ↗

learning tool

An interactive prep platform that teaches SQL, Python, HTTP/APIs, FastAPI and Lakebase from zero — with a real in-browser SQL console.

SQLFastAPILakebase

Automated Production Log Reporter ↗

automation

Turns production logs into regular, readable reports automatically, so no one has to dig through raw logs by hand.

Pythonautomation

Lead & Dialer Automation

automation

Pipelines that pull marketing leads and dialer data from third-party systems and land them in one place, ready for reporting.

PythonAPIsPlaywright

05 / contactLet's talk

Working on something data-heavy, or want to chat about pipelines? I'm moezkayy everywhere.