Job ID: JOB_ID_1916
Role Overview: Gen AI Platform Developer
Rwaltz is looking for a visionary Gen AI Platform Developer to spearhead the development and scaling of our Generative AI capabilities. As we move through 2026, the integration of Large Language Models (LLMs) into production-grade platforms has become a cornerstone of enterprise innovation. This role is designed for a seasoned software engineer who combines traditional backend excellence with cutting-edge expertise in agentic workflows and retrieval-augmented generation (RAG). You will be responsible for building the infrastructure that powers the next generation of AI-driven applications.
Key Responsibilities
- Design and implement scalable GenAI platform services and high-performance APIs.
- Develop backend systems using object-oriented languages such as Java, C++, or C#.
- Build and maintain Python-based services for model integration and complex AI workflows.
- Architect and deploy agent-based systems using frameworks like LangGraph, LangChain, AutoGen, or CrewAI.
- Integrate and optimize vector databases (Pinecone, Weaviate, Milvus) for efficient RAG pipelines.
- Manage cloud-native workloads, with a strong emphasis on Google Cloud Platform (GCP) and Vertex AI.
- Collaborate with Data Science and Product teams to transition experimental models into production environments.
- Ensure system reliability, observability, and security across all AI deployments.
- Implement CI/CD pipelines and containerization strategies using Docker and Kubernetes.
Required Skills & Experience
- At least 12 years of professional software engineering experience.
- 2-3+ years of recent, hands-on experience specifically in Generative AI systems.
- Expertise in Python and at least one other OO language (Java, C#, or C++).
- Deep understanding of LLM architectures, embedding models, and prompt engineering.
- Practical experience with vector stores and orchestration frameworks for agentic AI.
- Strong background in cloud engineering (GCP preferred, but AWS/Azure acceptable).
- Experience with distributed systems, microservices, and modern API design.
Preferred Qualifications
- Experience fine-tuning LLMs or working with model serving frameworks like Triton or Ray Serve.
- Familiarity with GCP services such as BigQuery, Cloud Run, and GKE.
- Knowledge of streaming data systems like Kafka or Pub/Sub.
- Understanding of MLOps tooling and AI governance/compliance standards.
This is a remote-first position requiring a self-motivated individual who stays at the forefront of the rapidly evolving AI landscape. You will be part of a team that values technical rigor, innovation, and the delivery of secure, compliant AI solutions.
Special Requirements
Visa: TN candidates accepted. Passport number required. Mode: Remote. Domain: GenAI/Platform Engineering.
Compensation & Location
Salary: $165,000 – $225,000 per year (Estimated)
Location: Remote
Recruiter / Company – Contact Information
Recruiter / Employer: Rwaltz Software Solutions
Email: rashika@rwaltz.com
Recruiter Notice:
To remove this job posting, please send an email from
rashika@rwaltz.com with the subject:
DELETE_JOB_ID_1916