Job ID: JOB_ID_1336
Role Overview: Senior Data Engineer
We are seeking a highly skilled and experienced Senior Data Engineer for a high-priority, 12-month hybrid contract position based in McLean, Virginia. This role is specifically tailored for candidates who have previously worked within the Capital One ecosystem, as ‘Ex-Capital One’ experience is a mandatory requirement for this engagement. As a Senior Data Engineer, you will be at the forefront of designing, developing, and maintaining robust data pipelines and architectures that support large-scale financial data processing.
Key Responsibilities and Technical Environment
- Design and implement scalable data pipelines using Python, Spark, and PySpark for both batch and real-time streaming data processing.
- Leverage AWS cloud-native services including AWS Lambdas, Step Functions, DynamoDB, EMR, and Glue to build serverless and managed data solutions.
- Utilize Databricks and Snowflake for advanced data warehousing and analytics, ensuring high performance and data integrity.
- Orchestrate complex workflows using Airflow to manage dependencies and ensure timely data delivery.
- Collaborate with cross-functional teams to translate business requirements into technical specifications and high-quality code.
- Optimize data storage and retrieval processes to support high-concurrency and low-latency applications.
Mandatory Qualifications and Experience
To be considered for this role, candidates must demonstrate a strong background in data engineering within a financial services context. The primary requirement is previous experience at Capital One, which ensures familiarity with the internal tools, security protocols, and architectural standards unique to the organization. Technically, you must be proficient in Python and have a working knowledge of Java or Scala. Your expertise should extend across the modern data stack, specifically focusing on Apache Spark for distributed computing and AWS for cloud infrastructure. Experience with modern data platforms like Snowflake and Databricks is essential for managing the volume and variety of data handled in this role.
Why Join This Project?
This is a unique opportunity to return to a premier financial institution and contribute to mission-critical data initiatives. The 12-month duration offers stability, while the hybrid work model in McLean, VA, provides a balance between collaborative in-office sessions and remote flexibility. You will work with a team of elite engineers pushing the boundaries of what is possible in cloud-based data engineering. If you are a Capital One alum with a passion for Python, Spark, and AWS, we encourage you to apply and leverage your institutional knowledge to drive immediate impact.
Special Requirements
Ex-Capital One Experience is Mandatory; Hybrid work mode in McLean, VA.
Compensation & Location
Salary: $165,000 – $215,000 per year (Estimated)
Location: McLean, VA
Recruiter / Company – Contact Information
Recruiter / Employer: New York Technology Partners
Email: aditya.jain@nytpcorp.com
Recruiter Notice:
To remove this job posting, please send an email from
aditya.jain@nytpcorp.com with the subject:
DELETE_JOB_ID_1336