AYN

Staff Engineer, Agentic AI

Clera · San Francisco · onsite

ABOUT THE ROLE

Lead the development of agent intelligence that helps engineers complete complex workflows across desktop engineering software. You will be a hands-on technical lead for a small AI team, partnering with user research and domain experts to deliver reliable, cost-efficient capabilities grounded in real engineering workflows.

WHAT YOU'LL DO

- Own agent architecture for tool calling, state management, error recovery, model routing, and context management.

- Define and improve task success metrics, establishing baselines and tracking workflow completion, cost, and failure modes.

- Build rigorous, reproducible evaluation infrastructure that translates validated user stories into test cases.

- Work with researchers, domain experts, and engineers to map user workflows and prioritize valuable agent capabilities.

- Set per-task token budgets and measure cost per completed workflow.

- Lead a small team through technical direction, design reviews, code reviews, and hands-on implementation.

- Collaborate with product, integrations, and customers to align agent behavior with real-world use.

WHAT WE'RE LOOKING FOR

- At least 7 years of software engineering experience, including 2 or more years building LLM agents that take real-world actions.

- Deep knowledge of LLM application architecture, including model selection, context management, retrieval, tool calling, and orchestration.

- Experience creating agent evaluation and benchmarking frameworks for task completion, cost efficiency, and failure analysis.

- Strong Python skills and familiarity with function calling, tool APIs, observability or tracing, and evaluation tools.

- Hands-on technical leadership experience guiding a small engineering team while continuing to write production code.

- Experience shipping AI or LLM tools over proprietary engineering data or desktop engineering software.

- Experience with desktop automation or application APIs, such as COM, and familiarity with enterprise workstation constraints.

- Background in mechanical engineering software, CAD/CAE, PLM, or a related engineering domain.

COMPENSATION & BENEFITS

Base salary: $160,000 to $250,000 annually. Visa sponsorship is not available.

LOCATION

On-site in San Francisco, California, United States.

Apply on the employer’s site