NEWPosted 3 hours ago
Job ID: JOB_ID_4070
Job Overview:
We are seeking a highly experienced Data Engineer with a strong background in Agentic AI to join our team. This role involves designing, developing, and maintaining scalable data pipelines and leveraging advanced AI techniques to extract insights from complex datasets. The ideal candidate will have extensive experience with Palantir Foundry, Snowflake, and building robust ETL/ELT processes.
Key Responsibilities:
- Design, develop, and implement scalable ETL/ELT data pipelines for both batch and near real-time data processing.
- Perform data ingestion, transformations, and ontology modeling within Palantir Foundry.
- Utilize advanced SQL, performance tuning, and analytical schema design in Snowflake.
- Work with relational and NoSQL databases to manage and process data.
- Develop and automate data processing workflows using Python.
- Implement data quality, governance, and lineage practices to ensure data integrity.
- Conduct unsupervised clustering and classification of structured and unstructured data.
- Create multi-stage analysis and transformation pipelines within Palantir Foundry (e.g., Contour).
- Leverage distributed data processing frameworks like Spark for efficient data handling.
- Query data using SparkSQL, GraphQL, and other relevant tools.
- Develop applications, reports, and dashboards within Palantir Foundry.
- Support ML feature engineering and analytics initiatives.
- Apply Agentic AI skills to enhance data processing and analysis capabilities.
Required Skills and Experience:
- 10+ years of experience as a Data Engineer.
- Proficiency in Palantir Foundry (data ingestion, transformations, ontology modeling, analytics workflows).
- Expertise in Snowflake (advanced SQL, performance tuning, analytical schema design).
- Proven experience building scalable ETL/ELT data pipelines (batch + near real-time).
- Strong understanding of data modeling for analytics and reporting layers.
- Experience working with relational and NoSQL databases.
- Proficiency in Python for data processing and automation.
- Knowledge of data quality, governance, and lineage practices.
- Experience with unsupervised clustering and classification of structured and unstructured data.
- Ability to create multi-stage analysis/transformation pipelines like Contour in Palantir Foundry.
- Familiarity with distributed data processing frameworks like Spark.
- Experience with querying using SparkSQL, GraphQL, etc.
- Experience creating apps, reports, and dashboards within Palantir Foundry.
Good to Have:
- Experience with dbt, Airflow, Spark, or similar orchestration/processing frameworks.
- Familiarity with BI & visualization tools (Tableau, Power BI, Looker, etc.).
- Experience with streaming data platforms (Kafka/Kinesis).
- Experience with cloud platforms (AWS/Azure/GCP).
- Experience in ML feature engineering or analytics support.
- Agentic AI skills.
Compensation & Location
Salary: $120,000 – $160,000 per year (Estimated)
Location: Dallas, TX
Recruiter / Company – Contact Information
Email: rakshith@covetitinc.com
Recruiter Notice:
To remove this job posting, please send an email from
rakshith@covetitinc.com with the subject:
DELETE_JOB_ID_4070