Staff Engineer - Machine Learning
at Freshworks
San Mateo, CA, United States, hybrid, senior, full time, USD 2,11,000–2,61,000 / year, 6+ years
seen 33d ago
- Airflow
- Java
- OAuth2
- PostgreSQL
- LangChain
- Kafka
- OpenTelemetry
- Pinecone
- LangSmith
- SSO
- LangGraph
- Terraform
- Temporal
- RBAC
- FAISS
- AWS
- Weaviate
- Python
- Kubernetes
About the role
We are seeking a Machine Learning Staff Engineer to lead the development of core backend services powering our Agentic AI Platform. In this role, you will be the primary technical driver for building reasoning-driven agents, multi-agent orchestration, and outcome-based workflows.
You will collaborate with the Principal AI Architect to bridge the gap between high-level design and scalable implementation. You will own the development of high-performance APIs and orchestration runtimes, integrating frameworks like LangChain, LangGraph, and LangSmith. This role is highly hands-on and requires a technical leader who can navigate a fast-paced environment while maintaining high engineering standards.
What you would do
Platform Backend Development
* Lead Implementation: Act as the lead engineer for agent runtime orchestration services, focusing on reasoning, planning, and tool invocation * API & SDK Design: Own the development of robust APIs and SDKs that enable internal and external teams to build and deploy agent workflows * State & Memory Management: Build and optimize stateful dialog management and memory services for multi-turn, context-aware agents * Agent Communication: Implement multi-agent communication (A2A) protocols and shared context systems
System Architecture & Execution
* Microservices Leadership: Execute the transition to cloud-native, event-driven backend services using microservices or service mesh architectures * Workflow Design: Build and manage task scheduling and long-running operations using tools like Temporal or Airflow * Performance Optimization: Optimize LLM orchestration for performance and cost through caching, batching, and token monitoring
Integrations & Data Services
* Data Pipeline Ownership: Implement and maintain RAG pipelines and integrations with vector databases (e.g., Pinecone, Weaviate, FAISS) * Telemetry Integration: Ensure all backend services support LangSmith-based evaluation and comprehensive observability
Security & Reliability
* Tenant Isolation: Implement RBAC, API authentication, and multi-tenant isolation logic * Engineering Excellence: Set the standard for automated testing (unit, integration, load) and implement OpenTelemetry for full system visibility * Mentorship: Provide technical guidance and code reviews for more junior backend engineers on the team
Read from jobs.smartrecruiters.com, last seen 2d ago.