Job ID: JOB_ID_2382
Role Overview
We are seeking a highly experienced Senior Data Engineer for a long-term contract engagement located onsite in Scottsdale, Arizona. This role is designed for a technical powerhouse with over a decade of experience in the big data ecosystem, specifically focusing on distributed systems and high-scale data processing. As a key member of the engineering team, you will be responsible for architecting, developing, and maintaining robust data pipelines that support critical business intelligence and analytical functions.
Technical Environment and Core Responsibilities
- Design and implement scalable data processing engines using Scala and Spark to handle massive datasets.
- Optimize Hive and SQL queries to ensure maximum performance across Hadoop clusters.
- Develop real-time streaming solutions utilizing Kafka and Spark Streaming for immediate data availability.
- Manage and integrate NoSQL solutions, specifically Aerospike, to support low-latency data requirements.
- Work within the Cloudera (Hadoop) distribution to manage large-scale ETL and Data Warehousing projects.
- Orchestrate complex batch jobs and ensure data quality through rigorous reconciliation processes.
- Implement Data Governance frameworks to maintain data integrity and compliance across the enterprise.
Detailed Requirements
The ideal candidate will possess 10-12 years of professional experience in software engineering with a heavy emphasis on Big Data technologies. You must demonstrate a deep understanding of distributed systems architecture and the ability to troubleshoot complex problems in a production environment. Proficiency in Scala is mandatory, as is a strong background in Java-based Spark applications. You should have a proven track record of working on large-scale ETL pipelines where data quality and orchestration are paramount. Beyond technical skills, we require a professional with strong analytical capabilities who can work independently to solve architectural bottlenecks. Communication is vital, as you will be collaborating with various stakeholders to translate business requirements into technical specifications. This position requires a local presence in Scottsdale, AZ, and is specifically open to H1B visa holders who meet the high-seniority threshold required for this project. You will be expected to lead by example, ensuring that all pipelines are built with scalability, security, and maintainability in mind. Experience with Aerospike is a significant advantage, as it plays a crucial role in our current real-time data strategy. If you are a seasoned engineer looking to tackle complex data challenges in a long-term capacity, we encourage you to apply.
Special Requirements
Local of AZ only; H1B Only; Onsite requirement.
Compensation & Location
Salary: $145,000 – $195,000 per year (Estimated)
Location: Scottsdale, AZ
Recruiter / Company – Contact Information
Recruiter / Employer: Nvoids
Email: pragatigg7171@gmail.com
Recruiter Notice:
To remove this job posting, please send an email from
pragatigg7171@gmail.com with the subject:
DELETE_JOB_ID_2382