Job ID: JOB_ID_5626
Role Overview
We are seeking a highly skilled and experienced Lead Data Engineer with a strong background in Python and Project Management to join our dynamic team. This role bridges the gap between technical architecture and project delivery, requiring a deep understanding of data engineering principles and leadership capabilities. You will be responsible for designing and implementing scalable data solutions, managing technical debt, and coordinating cross-functional teams to ensure successful project completion from planning through to delivery.
Key Responsibilities
- Technical Leadership: Drive architectural decisions for data solutions, leveraging expertise in Python, Spark, and SQL to build robust and efficient systems.
- Project Management: Lead the scoping, task breakdown, and roadmap definition for data engineering projects, ensuring alignment with business objectives.
- Tooling Proficiency: Utilize and manage a suite of modern data tools, including cloud data warehouses (Azure, Fabric, Databricks, Snowflake), orchestration tools (Airflow), and cloud storage solutions (S3/GCS).
- Data Pipelines: Design, develop, and manage complex ETL/ELT processes, ensuring data quality, integrity, and efficient processing.
- Team Leadership: Mentor and guide junior engineers, manage team capacity effectively, and foster a collaborative, high-performance culture focused on innovation and continuous improvement.
- Scalability and Performance: Ensure data solutions are scalable, performant, and cost-effective, addressing technical debt proactively.
- Cross-functional Collaboration: Work closely with stakeholders across different departments to understand data needs and deliver solutions that drive business value.
Required Experience
- A minimum of 10 years of experience in data engineering and software development.
- Proven experience in a technical leadership or project management role.
- Extensive experience with Python, Spark, and SQL.
- Hands-on experience with cloud data warehouses such as Azure, Fabric, Databricks, or Snowflake.
- Proficiency in workflow orchestration tools like Airflow.
- Experience with cloud storage solutions like S3 or GCS.
- Strong understanding of ETL/ELT processes and data modeling.
- Excellent communication, leadership, and problem-solving skills.
About Us
We are a forward-thinking organization committed to leveraging data to drive innovation and business success. We foster a collaborative environment where talented professionals can grow their careers and make a significant impact. Join us and be part of a team that is shaping the future of data engineering.
Compensation & Location
Salary: $120,000 – $160,000 per year (Estimated)
Location: Newark, NJ
Recruiter / Company – Contact Information
Email: prashant.ku7055@gmail.com
Recruiter Notice:
To remove this job posting, please send an email from
prashant.ku7055@gmail.com with the subject:
DELETE_JOB_ID_5626