NEWPosted 1 hour ago

Job ID: JOB_ID_4921

Job Description:

We are seeking a skilled Data Engineer with a strong background in Python, Apache Spark, and AWS services to join our team. This role involves designing, developing, and maintaining scalable data pipelines and solutions that support business intelligence and analytics. You will work with large-scale, distributed data systems and collaborate with cross-functional teams to ensure data quality and integrity.

Key Responsibilities:

  • Develop and maintain robust data pipelines using Python and Apache Spark (PySpark preferred).
  • Utilize AWS services such as S3, Glue, EMR, Redshift, and Athena for data processing and storage.
  • Work with SQL and various relational/non-relational databases.
  • Implement data modeling and ETL frameworks for efficient data management.
  • Ensure data quality, consistency, and availability for analytics and reporting.
  • Collaborate with stakeholders to understand data requirements and deliver effective solutions.
  • Familiarity with CI/CD pipelines and version control tools (Git).
  • Troubleshoot and resolve data pipeline performance issues.

Required Skills & Qualifications:

  • Strong proficiency in Python for data processing and pipeline development.
  • Hands-on experience with Apache Spark (PySpark preferred).
  • Solid experience with AWS services such as S3, Glue, EMR, Redshift, Athena, Lambda.
  • Experience with SQL and relational/non-relational databases.
  • Knowledge of data modeling, data warehousing concepts, and ETL frameworks.
  • Experience working with large-scale, distributed data systems.
  • Familiarity with CI/CD pipelines and version control tools (Git).
  • Strong problem-solving and communication skills.

Preferred / Nice to Have:

  • Experience with Airflow or other workflow orchestration tools.
  • Knowledge of Kafka, Kinesis, or streaming data platforms.
  • Experience with Docker/Kubernetes.
  • Exposure to Delta Lake, Iceberg, or HuD.

Compensation & Location

Salary: $100,000 – $150,000 per year (Estimated)

Location: Columbus, OH

Recruiter / Company – Contact Information

Email: dy@convergenttechsolutions.com

Interested in this position?
Apply via Email

Recruiter Notice:
To remove this job posting, please send an email from
dy@convergenttechsolutions.com with the subject:

DELETE_JOB_ID_4921

to delete@join-this.com.