ronleung.comContact
Work

A managed ingestion platform for cloud data at scale

A multitenant platform that pulls customer cloud data into an analytics platform, grown to 5,500+ customers and more than 125 TB per day.

Role
Senior Engineering Manager
Years
2021 to 2025
Team
10 engineers
Scale
125+ TB per day

The problem

Placeholder for who was stuck and what it cost them. Large customers had to balance inputs across hardware by hand, and problems were slow to find because there was little to observe.

What we built

Placeholder paragraph describing the platform in plain words: connectors that pull from customer cloud sources, isolated workers per customer, and a shared control plane that spreads the work and recovers it after failures.

Customer cloud sources → Connectors → Per-customer workers → Analytics platform

What was hard

  • Isolation versus cost. Placeholder for why noisy neighbors and operating cost pulled in opposite directions.
  • Balance as it scaled. Placeholder for how work drifted out of balance as capacity scaled up and down.
  • Zero data loss. Placeholder for recovering every failure without losing or duplicating data.

What I did

  • Raised the production bar. Placeholder for treating a rare failure as a systemwide risk, and why.
  • Framed a hard tradeoff. Placeholder for helping the leads separate what the customer needed from what was nice to have.
  • Ran the hardest customer turnaround. Placeholder for the design partner plan, the beta rounds, and the staged migration.
  • Made a deal possible. Placeholder for the costed plan that let a large deal close before the capability existed.

How we worked

Placeholder paragraph on design partners, beta rounds, and testing at customer scale before any migration.

What happened

  • 5,500+ customers and more than 125 TB per day.
  • Placeholder for the turnaround outcome.
  • Placeholder for the deal outcome.
  • Five promotions on the team, two to Senior Staff.

What I'd do differently

Placeholder for one or two honest points about what I'd change if I started again.

Next: Embedded Analytics for OEM Partners