Amardeep Singh Sidhu — FireHacker

Amardeep Singh Sidhu

aka FireHacker · Founder of AIEdx

Hello!

I am Amardeep Singh Sidhu, aka FireHacker. Founder of AIEdx.

Journey so far

2025 – Now

AI Research

Focusing on first-principles AI research at AIEdx — pretraining open-weights small sparse language models from scratch (starting with BubblSpace MoE-0.9B-A0.2B), studying MoE routing and Muon + AdamW optimization, and sharing weights, code, live training logs, and research notes in the open.

2022 – 2025

BubblSpace AI Personas

Founded AIEdx in January 2022 and built BubblSpace — exploring customizable AI personas and collaborative multi-agent workflows where specialized AI agents could retain domain context, coordinate tasks, and work alongside teams.

Before 2022

Enterprise IT Leadership & Systems

Over a decade leading complex enterprise infrastructure and full-enterprise application deployments — including BU IT Head / CIO at Godrej Industries Limited (Chemicals Division), SAP Manager at Kokuyo Camlin (ECC 6.0 to S/4HANA migration and analytics PoCs), and engineering and consulting roles at Capgemini, Ness Technologies, and Accenture.

21 November 2026 · 8 min read

Phase 2 pre-flight: profiling showed data loading, not the document mask

Before launching Phase 2 of BubblSpace MoE-0.9B-A0.2B on a single H100, I profiled one training step: the new document mask costs ~3.7%, while a serial NFS-bound data loader idled the GPU for ~1.37 s every step. A background prefetch thread took throughput from ~69k to ~85.5k tok/s, cutting the projected run from ~48h to ~39h without changing what the model sees.