Senior AI Operations Engineer
at Linuxcareers
Bellevue, Washington, United States; Menlo Park, California, United States; New York City, New York, United States, senior, full time, USD 1,53,000–1,80,000 / year, 5+ years
seen 4d ago
- Anthropic Claude
- Chef
- Google Gemini
- LangChain
- Bash
- Ray
- Pinecone
- Slurm
- Linux
- Terraform
- Ansible
- RAG
- Milvus
- LlamaIndex
- Python
- Kubernetes
About the role
Robinhood's Corporate Engineering team is building enterprise AI infrastructure to make AI capabilities reliable, secure, and accessible across the company. As a Senior AI Operations Engineer, you will build, operate, and improve the infrastructure behind Robinhood's enterprise AI capabilities, working across AI platforms, LLM integrations, automation, and production infrastructure.
What you would do
* Build internal tooling, automation, and self-service solutions that streamline AI operations, reduce manual intervention, and improve developer experience * Own complex technical troubleshooting and escalations across AI platforms, working directly with developers and internal teams to resolve issues involving LLM integrations, model behavior, APIs, and system performance * Manage and optimize enterprise integrations with LLM providers including Anthropic Claude and Google Gemini, focusing on performance, token utilization, reliability, and cost efficiency * Develop and improve observability, monitoring, and deployment pipelines for AI workloads, tracking metrics such as inference latency, API costs, token usage, and error rates * Support and optimize agentic workflows, orchestration layers, vector databases, and retrieval-augmented generation (RAG) systems to improve reliability and scalability
What they are looking for
* 5+ years of experience in IT Operations, Site Reliability Engineering, or AI infrastructure and support with a track record of operating complex production systems * Hands-on experience with enterprise AI platforms and LLM integrations, particularly Anthropic Claude and Google Gemini, including API integrations, prompt operations, and token management * Strong Linux administration skills and proficiency in scripting and automation using Python, Bash, or similar languages * Experience with infrastructure provisioning, configuration management, and orchestration tools such as Terraform, Ansible, Chef, or Kubernetes * Ability to independently investigate ambiguous technical problems, identify root causes, and develop scalable solutions that prevent recurring issues
* Experience with GPU clusters, AI workload orchestration (Slurm, Ray), vector databases (Pinecone, Milvus), or AI frameworks (LangChain, LlamaIndex) * Experience with hybrid cloud and bare-metal infrastructure
Read from linuxcareers.com, last seen 4d ago.