Job ID: JOB_ID_4050
Job Description: Lead AWS Data Engineer with DynamoDB Expertise
We are seeking a highly experienced and motivated Lead AWS Data Engineer with a proven track record in building robust production data pipelines and a deep understanding of the AWS ecosystem. The ideal candidate will possess expert-level proficiency in Python for data processing and ETL development, with a strong emphasis on PySpark. This role requires significant hands-on experience with AWS Glue, including job development, crawler configuration, trigger management, and workflow orchestration. A critical requirement for this position is strong expertise in DynamoDB, encompassing data modeling, capacity planning, stream processing, and performance optimization.
Key Responsibilities:
- Design, develop, and maintain scalable and reliable data pipelines using AWS services.
- Implement ETL processes and data transformations using Python, PySpark, and AWS Glue.
- Develop and manage data models for DynamoDB, ensuring optimal performance and scalability.
- Utilize AWS services such as S3, Lambda, Step Functions, CloudWatch, IAM, KMS, and Kinesis to build data solutions.
- Collaborate with cross-functional teams to understand data requirements and deliver effective solutions.
- Ensure data quality, integrity, and security across all data systems.
- Implement and manage CI/CD pipelines for data engineering projects.
- Utilize version control systems like Git for code management.
- Work with infrastructure as code tools such as CloudFormation or Terraform.
- Troubleshoot and resolve issues in production data pipelines and systems.
- Mentor junior engineers and contribute to the team’s technical growth.
Required Skills and Qualifications:
- 12+ years of hands-on data engineering experience.
- Proven track record of building production data pipelines.
- Expert-level proficiency in Python for data processing, ETL development, and automation (PySpark).
- Deep experience with AWS Glue (job development, crawlers, triggers, workflow orchestration).
- Strong expertise in DynamoDB data modeling, capacity planning, streams, and performance optimization.
- Solid understanding of the AWS ecosystem: S3, Lambda, Step Functions, CloudWatch, IAM, KMS, Kinesis.
- Proficiency with Postman for API development, testing, and collaboration.
- Strong SQL skills and understanding of data warehousing principles.
- Experience with version control (Git), CI/CD tools, and infrastructure as code (CloudFormation/Terraform).
About the Role:
This is an onsite position located in Juno Beach, FL. The Lead AWS Data Engineer will play a pivotal role in shaping our data infrastructure and driving data-driven decision-making. You will be responsible for the end-to-end development and management of our data pipelines, ensuring they are efficient, scalable, and meet the evolving needs of the business. This is an excellent opportunity to work with cutting-edge AWS technologies and contribute to impactful projects.
Special Requirements
Onsite
Compensation & Location
Salary: $120,000 – $160,000 per year (Estimated)
Location: Juno Beach, FL
Recruiter / Company – Contact Information
Email: club14@gmail.com
Recruiter Notice:
To remove this job posting, please send an email from
club14@gmail.com with the subject:
DELETE_JOB_ID_4050