Staff Software Engineer

 

Description:

Apollo Solutions is hiring on behalf of a Seed Stage AI Start-up that is building cutting-edge infrastructure to ensure large language models (LLMs) produce structured, schema-compliant outputs such as JSON, forms, and API calls — reliably and accurately. This platform acts as a compiler and runtime layer for LLMs, merging systems engineering, validation tooling, and multi-language integration to make AI outputs fully production-ready.

As a Staff Software Engineer – Python, you will be responsible for developing and maintaining core infrastructure across benchmarking systems, data pipelines, and integration tooling. This is a remote, full-time opportunity tailored for an experienced and adaptable engineer who thrives in data-intensive and high-performance environments.

Key Responsibilities:

  • Take ownership of build and benchmarking systems to support compiler testing and machine learning inference across hardware architectures like x86 and ARM.

  • Collaborate with C++ interfaces and Python bindings to create seamless integrations in full-stack environments such as AWS inference containers.

  • Develop and support complex build automation systems (currently using GitHub Actions), prioritizing reliability and performance.

  • Build and maintain internal APIs and data pipelines to facilitate structured data generation, benchmarking, and regression testing.

  • Contribute to cross-platform development strategies involving Python, C++, and possibly Rust, supporting structured testing and deployment pipelines.

Required Qualifications:

  • Demonstrated experience in leading technical projects, even when the problem scope is not well-defined.

  • Strong programming skills in Python, especially in the context of backend, build systems, or data infrastructure.

  • Proficiency with build systems such as Make, CMake, Bazel, or Python-based tooling.

  • Background in data-intensive industries and experience managing evolving codebases.

  • Ability to handle structured regression testing and contribute to testing frameworks.

  • A generalist, adaptive mindset with strong learning capabilities and a passion for solving unknown or novel problems.

Preferred (Nice to Have):

  • Experience working with AWS and containerized inference systems such as Docker.

  • Familiarity with C++ and/or Rust in high-performance computing or compiler toolchains.

Why Join:
You will play a foundational role in enabling AI systems to function in real-world software environments. This role sits at the forefront of integrating machine learning with modern software infrastructure and offers a unique opportunity to work on technically challenging and meaningful problems in a fast-growing AI startup.

Organization Apollo Solutions
Industry IT / Telecom / Software Jobs
Occupational Category Staff Software Engineer
Job Location New York,USA
Shift Type Morning
Job Type Full Time
Gender No Preference
Career Level Intermediate
Experience 2 Years
Posted at 2025-05-26 2:57 pm
Expires on 2026-01-12