Job ID: JOB_ID_7515
Role: Lead Software Engineer (AI/ – Langchain, Lang Graph, Python, Pyspark, GCP)
Does the thought of building a modern AI-enabled data platform from the ground up excite you?
We are currently seeking a Lead Cloud Data Platform Engineer to apply deep technical skills to create data products, develop AI-based automation tools, and build a world-class cloud analytics capability.
The successful candidate will continually innovate and pioneer the use of new technologies and drive adoption of these amongst a team of talented data engineers.
You will be an integral part of our migration from our on-premises systems to the Google Azure cloud.
You will be a vital member of an agile team helping to lead the design and hands-on implementation of modern data processing capabilities.
This is a visible role that allows you to share your knowledge and skills with other developers and product teams in a collaborative environment.
Responsibilities:
- Implement and operationalize modern AI-enabled data capabilities on Google Cloud to ingest, transform, and distribute data for a variety of big data apps.
- Leverage AI/Agentic frameworks to automate data management, governance, and data consumption capabilities (data pipelines, data quality, metadata, data compliance, etc.).
- Work within a matrix org. with principal engineers, product managers, and data engineers to roadmap, plan, and deliver key data capabilities based on priority.
Required Qualifications:
- Demonstrable skills recently using AI tools such as LangChain, LangGraph/ADK, agentic frameworks, RAG, GraphRAG, and using MCP to build agent-based data capabilities.
- 5 years of experience in data engineering, including hands-on experience working with cloud data solutions: creating/supporting Spark-based ingestion and processing.
- 3 years of experience with Data lakehouse architecture and design, including hands-on experience with Python, pyspark, Kafka, Airflow, Google Cloud Storage, BigQuery, Data Proc, Cloud Composer.
- Hands-on experience developing data flows using Kafka, Flink, and Spark streaming.
Desired Qualifications:
- Proven experience using AI to auto-generate data engineering related code, context engineering, and prompt engineering.
- Deep background on cloud-based data lakes and warehouses and automated data pipelines.
- Public cloud certifications such as GCP Professional Data Engineer, Azure Data Engineer, or AWS Specialty Data Analytics.
- Web-based UI development using React and Node.js is a plus.
Special Requirements
Locals only/DL
Compensation & Location
Salary: $100,000 – $150,000 per year (Estimated)
Location: Irving, TX
Recruiter / Company – Contact Information
Email: aanamika@rconsultinginc.com
Recruiter Notice:
To remove this job posting, please send an email from
aanamika@rconsultinginc.com with the subject:
DELETE_JOB_ID_7515