Backend Engineer AI (Agent Systems)

AI Agent System Development Design and implement backend components for: Multi‑agent orchestration frameworks Tooling/function‑calling systems Task planning and execution engines Short‑term and long‑term memory systems Retrieval and RAG pipelines Build high‑performance APIs to support large‑scale agent interactions. System Architecture Contribute to the architecture of the AI agent platform, including service decomposition, data flow design, and event‑driven systems. Optimize system performance to ensure low‑latency, high‑throughput agent reasoning. Collaboration with AI/ML Teams Work closely with LLM and ML engineers to integrate model capabilities into agent workflows. Develop model routing, caching, fallback, and optimization strategies. Engineering Excellence Build and maintain CI/CD pipelines, observability systems, monitoring, and logging. Promote engineering best practices, including code quality, testing, and performance tuning.

3+ years of backend engineering experience. Proficiency in at least one of: Go, Python, Java, Rust. Strong understanding of distributed systems, microservices, caching, and message queues. Experience building scalable, high‑availability backend services. Familiarity with cloud‑native technologies (Kubernetes, Docker, service mesh). Hands‑on experience with LLMs or agent frameworks (e.g., LangChain, Semantic Kernel, AutoGen). Experience building AI agent systems, RAG systems, or tool‑calling frameworks. Knowledge of vector databases (Milvus, Pinecone, Weaviate, FAISS). Experience with model serving or inference optimization. Contributions to open‑source projects or technical communities. Startup or 0→1 system‑building experience.

职位描述

职位要求

Fiona Lu