Job ID: JOB_ID_406
Position Summary
New York Technology Partners is seeking a Foundry Lead Data Engineer for a high-priority, 100% remote engagement supporting our clients, Cognizant and PG&E. This role is designed for a technical expert with 10-14 years of experience who can design and deploy high-scale data architectures within the Palantir Foundry ecosystem. You will be responsible for optimizing data processing workflows using PySpark and integrating complex data models to support utility-scale business intelligence. As a technical lead, you will drive innovation in grid and operational analytics while mentoring a team of engineers.
Core Responsibilities
- Design and implement end-to-end data solutions within Palantir Foundry, ensuring seamless integration with utility enterprise systems.
- Develop and maintain robust data models and ontologies to serve as the foundation for strategic decision-making.
- Oversee the deployment of Palantir Work Model solutions, maintaining high availability for mission-critical grid data.
- Architect scalable data processing pipelines using PySpark to handle massive datasets and minimize latency.
- Continuously monitor and optimize data pipelines to improve performance and efficiency.
- Implement rigorous data security protocols and industry compliance standards to safeguard sensitive utility information.
- Provide technical mentorship to junior team members through code reviews and architectural guidance.
- Collaborate with business stakeholders to define project requirements and align technology solutions with operational goals.
Technical Qualifications
- 10-14 years of professional experience in data architecture and solution design.
- Extensive hands-on experience with Palantir Foundry and Palantir platforms.
- Expert proficiency in PySpark for complex data transformation and analysis.
- Proven expertise in developing scalable enterprise-level data models.
- Strong understanding of utility-scale data challenges and operational analytics.
- Experience with emerging technologies within the Spark and Palantir ecosystems.
- Excellent communication skills for stakeholder management and technical leadership.
Why Join This Project?
This is a unique opportunity to work at the intersection of advanced data engineering and critical infrastructure. By leveraging the Palantir Foundry platform, you will help PG&E transform their grid operations and enhance their analytical capabilities. This role offers the flexibility of a 100% remote work environment while providing the challenge of leading a high-impact project for a major utility provider. You will be part of a forward-thinking team at NYTP, a company known for delivering robust and scalable technology solutions to Fortune 1000 clients.
Special Requirements
100% Remote; Client: Cognizant / PG&E; Request ID: 53157-1.
Compensation & Location
Salary: $185,000 – $245,000 per year (Estimated)
Location: Remote, USA
Recruiter / Company – Contact Information
Recruiter / Employer: New York Technology Partners
Email: aditya.jain@nytpcorp.com
Recruiter Notice:
To remove this job posting, please send an email from
aditya.jain@nytpcorp.com with the subject:
DELETE_JOB_ID_406