Quant Development · Market Data Engineering · AI Systems

Engineering the data behind systematic trading.

I’m Shashidhar Reddy, a senior data engineer with 10+ years of experience. I build real-time pipelines, research-ready market datasets, and Python trading workflows. My current focus is Quantala, my quantitative trading and research platform.

Visit Quantala & Explore Dashboards

Shashidhar Reddy

About

Production data experience. A focus on financial markets.

Based in Johannesburg, South Africa, I bring experience across financial services, market data, and cloud data platforms. My core stack is Python, SQL, Spark, AWS, and Airflow, with hands-on work in streaming ingestion and systematic trading research.

I’m targeting quant developer, market data engineer, and related data platform roles. At Enable Benefits, I build AI-ready data workflows and integrate LLMs for document analysis and information retrieval. Alongside that work, I’m building Quantala.

South Africa work authorization · Open to relocation across EMEA

10+ years Data Engineering
IIQF · 2023–2024 Algorithmic Trading
LLM Signal Scoring

Current Focus · Founder / Builder · In Progress

Quantala — Quantitative Trading & Research

I’m building an end-to-end platform connecting real-time market data, order-flow analytics, systematic strategy research, backtesting, and execution workflows. My focus is the engineering foundation: usable data, testable signals, and observable trading systems.

Visit Quantala & Explore Dashboards

01

WebSocket Layer

Broker APIs and order-flow data providers for ticks, futures, order flow, OI, IV, bid/ask, and footprint data.

02

Streaming Layer

Redpanda/Kafka-compatible ingestion with compact analytics payloads, compression, and source-specific topics.

03

Storage Layer

ClickHouse raw tables, materialized views, 30s/1m/5m rollups, footprint levels, retention, and replay queries.

04

Feature Layer

Deterministic features: cumulative delta, stacked imbalance, absorption, VWAP, SuperTrend, RSI, IV, and OI context.

Reusable Quant Architecture

Foundation layer for any strategy

The platform architecture connects each stage: capture market events, store replayable data, filter deterministic signals, evaluate quality with AI, and route approved setups through risk-aware execution.

WebSockets Ticks, order flow, options, F&O
live stream
Storage Layer Redpanda, ClickHouse, rollups, replay
raw candles
Analyze Layer Feature engineering, filters, signal rules
delta VWAP
AI Layer Evaluation, scoring, confidence, reasoning
LLM JSON
Execute Layer Risk checks, dry-run logs, broker routing
risk orders

Strategy Layer

Deterministic candidate generation from 5-minute footprint candles and 1-minute confirmation closes. Strategies stay explainable and testable.

  • Order-flow imbalance detection
  • Opening Range Breakout research
  • Volume shocker scans and stock F&O backtests

AI Evaluation Layer

The evaluation layer consumes engineered features and returns structured JSON for storage and analysis.

  • Claude-assisted signal evaluation
  • Ollama/open-source model benchmarks
  • Prompt compression, JSON validation, token and latency logging

Risk + Execution Layer

Execution workflows are separated from strategy logic, with risk checks, trade logging, and outcome tracking for research and evaluation.

  • Broker execution integration
  • Trade setup rows and outcome tracker
  • Replay-ready logs for win-rate, drawdown, and expectancy analysis
5m + 1m Footprint signal and confirmation workflow
Redpanda Kafka-compatible event streaming
ClickHouse Fast rollups, replay, and AI score storage
LLM JSON Explainable TAKE, SKIP, WAIT decisions

Professional Experience

From production data platforms to market data and AI.

Aug 2025 – Present

Enable Benefits

Senior Data Engineer (AI) · Contract

Building AI-ready platforms with Python, Spark, SQL, and AWS. Integrating Llama 3 for document analysis, extraction, summarization, and retrieval across PDFs, APIs, and OCR content.

Nov 2024 – May 2025

SVSS Trading

Market Data Engineer · Remote Contract / Freelance

Developed a market-data pipeline proof of concept for equities, futures, and derivatives. Normalized API and WebSocket data, built strategy and backtesting workflows with transaction costs and slippage, and produced P&L and risk analytics.

Mar 2023 – Oct 2024

Old Mutual SA

Data Engineer · Contract

Built production pipelines supporting the Two-Pot retirement system using Spark, Python, and SQL, with CI/CD, monitoring, and failure notifications.

Oct 2020 – Feb 2023

JUMO

Senior Data Engineer

Built and operated financial data pipelines with Spark, AWS, Delta Lake, and Airflow. Designed resilient ETL workflows and data models, with responsibility across deployment and operational support.

Mar 2019 – May 2020

SVSS Trading

Data Engineer

Automated Indian equity and derivatives market-data and option-chain collection. Built backtesting frameworks and research datasets with Python, Pandas, PostgreSQL, and AWS.

Jan 2015 – Jan 2019

Sonata Software

Big Data Engineer

Built Hadoop and Spark data platforms for airline and travel clients, including TUI and British Airways, using Scala, Hive, and Spark SQL.

Education

Post Graduate Program in Algorithmic Trading, IIQF · 2023–2024
B.Tech in Aeronautical Engineering, JNTU Hyderabad · 2007–2011

Skill Set

A stack spanning market data, research, and production.

Quant Finance

Equities, futures, derivatives, market microstructure, order-flow research, systematic strategies, backtesting, P&L and exposure analytics.

Data Engineering

Python, SQL, Pandas, NumPy, Polars, Spark Structured Streaming, WebSockets, ClickHouse, QuestDB, PostgreSQL, Kafka / streaming concepts.

AI + LLMs

Llama 3 integration, AI inference, document analysis and extraction, OCR ingestion, information retrieval, and structured LLM evaluation workflows.

Cloud + Reliability

AWS (S3, EC2, EMR, Redshift, Athena, Lambda, SNS/SQS), Airflow, Delta Lake, Terraform, Docker, CI/CD, Grafana, and Datadog.

Project Portfolio

Data platforms, fintech systems, and quant research.

Quantala
Quant Finance

Quantala

Streaming market data, order-flow strategies, ClickHouse features, and AI-assisted signal scoring.
Fintech Data Specialist

Enable Benefits

AI-ready data platforms, Llama 3 document analysis, multi-format ingestion, and research workflows for a Canadian benefits company.
TUI Group
Data Analytics

TUI Group UK

Big data engineering and analytics for one of the world's leading travel companies.
JUMO
Data Systems

JUMO

Senior data engineering for mobile financial services, lending, savings, and EDW workflows.
Old Mutual South Africa
AWS Data Engineering

Old Mutual SA

Cloud data pipelines, production data movement, and analytics engineering.

Get In Touch

Hiring for quant development, market data engineering, or AI-enabled data platforms? Let’s talk. Based in Johannesburg and open to relocation across EMEA.

GitHub
LinkedIn
Email