Description:
Our mission is to make all of our customers’ security-relevant data continuously available for automated detection and response, threat hunting, and other Falcon use cases. To enable this, the systems behind NG-SIEM are growing to accommodate >100 PB of event and action data ingested every day, up to 10 years of retention, and dozens of millions of queries per hour across large sections of the data stored.
Ideal candidate for this Senior Engineer II has deep expertise in large-scale distributed/control systems (intelligent placement, auto balancing, autoscaling) and the ability to go deep into the underlying data platform (LogScale) — ingestion, storage, and query internals — to connect scaling decisions to real system behavior in a large multi-tenant environment. We run a multi-tenant platform where many customers share a common pool of infr
astructure. The core challenge is a two-sided optimization: deliver the best performance for every customer while achieving the best overall resource utilization (minimal wasted capacity, maximum density).
This role is hybrid, on-site at one of the posted locations: Sunnyvale, CA; Redmond, WA; New York City; or Austin, TX with a strong preference to candidates in Austin, TX.
What You’ll Do:
- Intelligent Customer Placement — Decide which part of the fleet each customer lands on, bin packing tenants efficiently while reserving enough headroom so everyone gets the capacity they're entitled to.
- Auto balancing — Continuously rebalance customers across shared infrastructure as load shifts, protecting each customer's performance while keeping the fleet healthy.
- Autoscaling — Automatically add or remove capacity as demand changes, so the fleet grows and shrinks with real usage instead of being manually provisioned.
- Data-Driven Decisions — Use real-time per-tenant usage (e.g., memory, storage, throughput, query cost) to drive placement and balancing.
- End-to-End System Depth — Go deep into the underlying data platform (how data is ingested, stored, cached, and queried) to understand why a placement or scaling decision helps or hurts, and feed that back into the models.
- Operational Rigor — Operate what you build, and treat customer-impacting incidents with the same rigor as feature work; reliability and static stability are forcing functions for design, not a phase bolted on after launch.
- Feature Delivery — Deliver key parts of our systems as an individual contributor while leading the team to solve ambiguous problems, and move the scalability of our LogScale engine to the next level.
- Technical Strategy & Alignment — Engage with other technical leads and principal engineers to keep our technical strategy coherent across the LogScale platform and move our product mission forward.
- Communication — As a remote-first company, bring excellent verbal and written communication skills when working with teams across the globe.
What You’ll Need:
- Must be a U.S. Citizen or US Permanent Resident.
- 12+ years of experience designing, implementing, and maintaining multiple software products/systems/releases, preferably in a SaaS delivery model, across all phases of the development lifecycle, and across multiple software stacks;
- 4+ years of experience as an engineer in a force-multiplying position (delivery through others);
- Current hands-on experience as an engineer (3+ years) owning a distributed system that handled tens of billions of requests per day or more than 1 PB of data per day;
- History of significant and continued impact on customer experience and business results;
- Demonstrated track record of operational excellence when operating services that span many components across several geographical regions;
- Experience working with and growing strong engineers within remote teams across geographies and cultures;
- Ability to communicate and articulate crisply
- Proven experience utilizing AI technologies to enhance decision-making, streamline workflows and processes, improve efficiency and drive business outcomes