Description:
Apollo Solutions is hiring on behalf of a Seed Stage AI Start-up that is building cutting-edge infrastructure to ensure large language models (LLMs) produce structured, schema-compliant outputs such as JSON, forms, and API calls — reliably and accurately. This platform acts as a compiler and runtime layer for LLMs, merging systems engineering, validation tooling, and multi-language integration to make AI outputs fully production-ready.
As a Staff Software Engineer – Python, you will be responsible for developing and maintaining core infrastructure across benchmarking systems, data pipelines, and integration tooling. This is a remote, full-time opportunity tailored for an experienced and adaptable engineer who thrives in data-intensive and high-performance environments.
Key Responsibilities:
Take ownership of build and benchmarking systems to support compiler testing and machine learning inference across hardware architectures like x86 and ARM.
Collaborate with C++ interfaces and Python bindings to create seamless integrations in full-stack environments such as AWS inference containers.
Develop and support complex build automation systems (currently using GitHub Actions), prioritizing reliability and performance.
Build and maintain internal APIs and data pipelines to facilitate structured data generation, benchmarking, and regression testing.
Contribute to cross-platform development strategies involving Python, C++, and possibly Rust, supporting structured testing and deployment pipelines.
Required Qualifications:
Demonstrated experience in leading technical projects, even when the problem scope is not well-defined.
Strong programming skills in Python, especially in the context of backend, build systems, or data infrastructure.
Proficiency with build systems such as Make, CMake, Bazel, or Python-based tooling.
Background in data-intensive industries and experience managing evolving codebases.
Ability to handle structured regression testing and contribute to testing frameworks.
A generalist, adaptive mindset with strong learning capabilities and a passion for solving unknown or novel problems.
Preferred (Nice to Have):
Experience working with AWS and containerized inference systems such as Docker.
Familiarity with C++ and/or Rust in high-performance computing or compiler toolchains.
Why Join:
You will play a foundational role in enabling AI systems to function in real-world software environments. This role sits at the forefront of integrating machine learning with modern software infrastructure and offers a unique opportunity to work on technically challenging and meaningful problems in a fast-growing AI startup.
| Organization | Apollo Solutions |
| Industry | IT / Telecom / Software Jobs |
| Occupational Category | Staff Software Engineer |
| Job Location | New York,USA |
| Shift Type | Morning |
| Job Type | Full Time |
| Gender | No Preference |
| Career Level | Intermediate |
| Experience | 2 Years |
| Posted at | 2025-05-26 2:57 pm |
| Expires on | 2026-01-12 |