Job ID: JOB_ID_3187052
Job Summary
We are seeking a highly skilled and experienced Sr Data Engineer to join our dynamic team in Phoenix, AZ. This is an onsite position requiring a 5-day-per-week commitment. The ideal candidate will possess a strong background in Big Data technologies, Python, Spark, ETL, SQL, GCP, and DevOps, with a proven track record of designing, developing, and maintaining scalable data pipelines and solutions. You will play a crucial role in architecting and implementing data infrastructure that supports analytics, reporting, and business intelligence initiatives.
Key Responsibilities
- Design, develop, and maintain scalable Big Data pipelines using Spark (PySpark/Spark SQL) for both batch and real-time data processing.
- Build and optimize robust ETL/ELT workflows to efficiently ingest, transform, and load data from a variety of structured and unstructured sources.
- Develop high-performance SQL queries and implement efficient data models to support advanced analytics and comprehensive reporting needs.
- Architect and implement comprehensive data solutions on Google Cloud Platform (GCP), leveraging services such as BigQuery, Dataproc, Dataflow, Cloud Storage, Pub/Sub, and Composer.
- Monitor, troubleshoot, and resolve production issues within distributed and cloud-based environments, ensuring data integrity and system availability.
- Automate operational processes, enforce coding standards, implement version control best practices, and maintain thorough documentation for all data engineering workflows.
- Collaborate effectively with cross-functional teams, including business stakeholders, data scientists, data analysts, and product teams, to understand data requirements and deliver impactful solutions.
- Drive analytics initiatives by providing reliable and accessible data, enabling the generation of actionable insights for the business.
- Actively participate in Agile ceremonies, including sprint planning, design reviews, and retrospectives, contributing to a collaborative and iterative development process.
- Continuously improve reporting frameworks and data processes in alignment with Agile delivery practices, ensuring efficiency and scalability.
- Ensure data governance and compliance standards are met throughout the data lifecycle.
- Mentor junior data engineers and share best practices within the team.
Required Skills and Qualifications
- Proven experience as a Sr Data Engineer or in a similar role.
- Strong hands-on experience in Big Data technologies and distributed data processing frameworks.
- Expertise in Python for data engineering, scripting, and performance optimization.
- Extensive experience with Apache Spark (PySpark/Spark SQL) for large-scale data transformation and processing.
- Solid experience in designing and developing ETL/ELT pipelines for both batch and real-time data processing.
- Significant experience working with Google Cloud Platform (GCP) services, including BigQuery, Cloud Storage, Dataflow, Dataproc, Composer, and Pub/Sub.
- Strong understanding of data warehousing concepts, dimensional modeling, and data lake architectures.
- Experience with CI/CD pipelines and DevOps practices for data engineering workflows.
- Proficiency in version control systems (Git) and build/release management.
- Experience with workflow orchestration tools such as Apache Airflow or Cloud Composer.
- Experience working in Agile/Scrum environments with cross-functional teams.
- Strong analytical and problem-solving skills.
- Excellent collaboration and stakeholder communication skills.
Desirable Skills
- Experience with other cloud platforms (AWS, Azure).
- Knowledge of data visualization tools.
- Familiarity with containerization technologies (Docker, Kubernetes).
About the Company
Nvoids is committed to fostering a diverse, equitable, and inclusive work environment. We believe in the power of collaboration and strive to be as diverse as the clients and employees we partner with. We embrace individuals of all backgrounds and are dedicated to creating a workplace where everyone feels valued and respected. This role offers a competitive salary and benefits package, along with opportunities for professional growth and development within a forward-thinking organization.
Special Requirements
F2F interview required
Compensation & Location
Salary: $50 – $53 per year
Location: Phoenix, AZ
Recruiter / Company – Contact Information
Recruiter / Employer: Nvoids
Email: singh.pankajk221@gmail.com
Recruiter Notice:
To remove this job posting, please send an email from
singh.pankajk221@gmail.com with the subject:
DELETE_JOB_ID_3187052