Job ID: JOB_ID_2701
Role Overview
We are seeking a highly skilled Senior Backend Technical Lead to join an AI-first technology company at the forefront of enterprise intelligence. This is a high-impact, onsite role in Palo Alto, CA, designed for engineers who thrive in high-intensity environments and want to build the core infrastructure for next-generation LLM-powered systems. As a hands-on leader, you will be responsible for designing and scaling distributed architectures that support complex agent-based workflows and data-intensive services. This role is ideal for a technical visionary who remains deeply involved in the codebase while guiding the architectural direction of a rapidly evolving platform.
Key Responsibilities
- Lead the architectural design and evolution of backend services that power AI-driven workflows and large-scale distributed execution.
- Develop and maintain robust systems for data processing, coordination, and orchestration at production scale.
- Drive technical excellence by setting high standards for code quality, performance, and system reliability.
- Mentor mid-level and junior engineers, fostering a culture of continuous learning and technical growth.
- Collaborate with cross-functional teams to align technical strategy with business objectives.
- Optimize infrastructure efficiency, focusing on compute utilization, storage, and networking performance.
- Participate in rigorous design reviews and code quality practices to maintain high engineering standards.
- Analyze and improve system performance, stability, and scalability through continuous optimization.
Technical Requirements
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field.
- Minimum of 8 years of professional software engineering experience, with at least 5 years focused on backend infrastructure.
- Proven track record of deploying AI agents or agentic systems in B2B production environments over the last 2 years.
- Hands-on experience with RAG (Retrieval-Augmented Generation), LangChain, AutoGPT, or similar orchestration frameworks.
- Deep understanding of vector databases such as Pinecone, Weaviate, or Qdrant.
- Experience with observability tools for non-deterministic systems, including LangSmith or Arize.
- Strong backend engineering fundamentals and system-level design judgment.
- Familiarity with multi-agent workflows and prompt chaining logic.
Work Environment
This position requires a 5-day onsite presence in Palo Alto. Our engineering culture emphasizes ownership, rapid execution, and rigorous design reviews. We offer competitive compensation packages, including equity participation and comprehensive healthcare coverage. This is an opportunity to work on foundational AI systems that have a direct operational impact on global enterprises. The environment is high-commitment and execution-focused, tailored for engineers who want to work on difficult problems with real operational impact and meaningful upside.
Special Requirements
Visa: USC only. Work Mode: 5 Days Onsite in Palo Alto, CA.
Compensation & Location
Salary: $220,000 – $310,000 per year (Estimated)
Location: Palo Alto, CA
Recruiter / Company – Contact Information
Recruiter / Employer: SHEF SOLUTIONS INC.
Email: tarun@shefsolutionsinc.com
Recruiter Notice:
To remove this job posting, please send an email from
tarun@shefsolutionsinc.com with the subject:
DELETE_JOB_ID_2701