NEWPosted 4 hours ago
Job ID: JOB_ID_8772
Job Description: Senior Data Engineer
We have an excellent job opening for a Senior Data Engineer in Manhattan, NY. This is a long-term contract position with our client. The role involves designing, building, and maintaining scalable data ingestion frameworks, architecting and managing the enterprise data lake, and developing robust ETL/ELT pipelines.
Key Responsibilities:
- Design, build, and maintain scalable data ingestion frameworks using AWS native services (Glue, Lambda, S3, Step Functions) and SnapLogic.
- Architect and manage the enterprise data lake on S3 using Apache Iceberg, including partitioning strategies, schema evolution, metadata optimization, and lifecycle management.
- Develop robust ETL/ELT pipelines to standardize, cleanse, and enrich source system data for analytics and operational use cases.
- Build and maintain reporting-ready datasets and queries using Amazon Athena and AWS Glue metadata.
- Implement and monitor data quality frameworks, including validation rules, reconciliation checks, and anomaly detection.
- Collaborate with Finance, Technology, and Operations stakeholders to translate business requirements into scalable data solutions.
- Establish and enforce data governance best practices: documentation, lineage tracking, access controls, and change management.
- Monitor pipeline health and performance, troubleshoot data issues, and support recurring reporting cycles.
Ideal Candidate Profile:
- 14+ years of overall software development experience, with significant exposure to data-centric systems.
- 7+ years of hands-on experience in data engineering, analytics engineering, or related roles.
- Strong SQL skills with proven experience designing and building analytical datasets.
- Hands-on experience with AWS data platforms: S3, Glue, Athena, and AWS Unified Data Catalog.
- Experience integrating data from SaaS and enterprise systems using ETL/ELT tools such as SnapLogic.
- Experience supporting BI tools like Amazon QuickSight, Tableau, or Power BI.
- Ability to work independently and collaborate effectively with both technical and non-technical stakeholders.
Essential Functions & Responsibilities:
- Work with architects, development teams, information security, infrastructure, and operations to develop requirements and maintain detailed functional and technical specifications.
- Ensure common services operate as a product with regular updates and a focus on the customer.
- Support ongoing operation of components and services.
- Ensure adherence to change management and risk policies.
- Drive modern enterprise application development with a cloud-first approach.
Success Factors / Job Competencies:
- Detail-oriented while understanding the broader enterprise environment.
- Strong team player, effective across technical teams, business partners, and leadership.
- Ability to balance hands-on execution with collaboration and operational responsibility.
Education:
- Bachelors degree in Computer Science, Engineering, Information Systems, or equivalent experience.
Desired Qualifications:
- Experience with payment systems, financial networks, and protocols (ISO 20022, SWIFT, NACHA).
- Experience in regulated environments (banking, fintech, healthcare).
- Knowledge of advanced data security principles: encryption, tokenization, data masking, RBAC, and secure data governance.
- Exposure to dbt and Snowflake as part of modern data platform evolution.
Special Requirements
Hybrid
Compensation & Location
Salary: $120,000 – $160,000 per year (Estimated)
Location: Manhattan, NY
Recruiter / Company – Contact Information
Recruiter / Employer: Byteware Inc.
Email: rge.smith@bytewareinc.com
Recruiter Notice:
To remove this job posting, please send an email from
rge.smith@bytewareinc.com with the subject:
DELETE_JOB_ID_8772