Job ID: JOB_ID_1061
Position Summary
DVG Tech Solutions is looking for a seasoned AWS Data Engineering Lead to spearhead data architecture and pipeline development for a long-term project based in Fort Mill, SC. This is a high-level leadership role requiring at least 13 years of experience in the data engineering domain. The successful candidate will be responsible for driving the technical vision of the data platform, ensuring that all data infrastructures are scalable, secure, and highly efficient. This role is strictly for local candidates in the Fort Mill area, emphasizing the need for on-site collaboration and leadership within the regional team.
Core Responsibilities
- Architect and oversee the construction of enterprise-grade data pipelines using AWS native services.
- Lead the migration and transition of legacy data ingestion processes, specifically moving from Sqoop-based workflows to AWS Glue.
- Optimize Spark jobs to ensure high performance and cost-efficiency across large-scale datasets.
- Define and implement data governance standards, ensuring compliance with security and regulatory requirements.
- Collaborate with cross-functional teams, including Data Science and Business Intelligence, to provide clean and accessible data for downstream consumption.
- Mentor junior and mid-level data engineers, providing code reviews and architectural guidance.
- Manage the end-to-end lifecycle of data projects, from initial discovery to production deployment and monitoring.
Technical Stack & Expertise
- Expert-level proficiency in the AWS ecosystem, with specific focus on AWS Glue, AWS Lambda, and Amazon S3.
- Advanced programming skills in Python and Java for building robust data handling applications.
- Mastery of SQL for complex querying, data modeling, and performance tuning.
- Deep understanding of distributed computing principles and hands-on experience with Apache Spark optimization.
- Experience with data orchestration tools and CI/CD pipelines for data engineering.
- Familiarity with modern data warehousing concepts and lakehouse architectures.
Leadership & Strategy
As a Data Lead, you are expected to go beyond technical execution. You will be a strategic partner to the business, identifying opportunities to leverage data for competitive advantage. Your 13+ years of experience should reflect a history of successful project deliveries and the ability to navigate complex organizational structures. You must possess excellent communication skills, capable of explaining technical complexities to executive leadership while providing granular technical direction to your engineering team. The role demands a focus on quality, reliability, and the ability to thrive in a dynamic, high-stakes environment. This long-term engagement is a career-defining opportunity for a local expert to make a significant impact on a major data initiative.
Special Requirements
ONLY LOCALS. 13+ years experience required.
Compensation & Location
Salary: $165,000 – $210,000 per year (Estimated)
Location: Fort Mill, SC
Recruiter / Company – Contact Information
Recruiter / Employer: DVG Tech Solutions
Email: vikas@dvgts.com
Recruiter Notice:
To remove this job posting, please send an email from
vikas@dvgts.com with the subject:
DELETE_JOB_ID_1061