Job ID: JOB_ID_988
Role Overview
We are looking for a seasoned Snowflake Architect to lead a high-priority cloud migration project. This is a 6-month onsite engagement with the flexibility to be based in either Minneapolis, MN or Dallas, TX. The primary focus of this role is to guide our engineering teams through the transition from an on-premise Cloudera environment to a robust, scalable Azure cloud infrastructure. The successful candidate will be the technical authority on Snowflake and Databricks architecture within the organization.
Key Responsibilities
- Design and implement scalable data lake solutions using Snowflake and Databricks to support enterprise-level data requirements.
- Develop and optimize complex data pipelines for efficient ingestion, transformation, and storage of large datasets.
- Lead the migration of Hadoop, Hive, and Spark data and applications to Azure cloud services, including Azure Synapse Analytics and Snowflake.
- Manage data governance, quality, and security protocols across diverse cloud environments.
- Implement performance tuning, automation, and CI/CD pipelines for data workflows to ensure high availability and reliability.
- Install, configure, and manage Cloudera Hadoop clusters, ensuring optimal performance of HDFS and YARN components.
- Tune Hive and Spark jobs to maximize resource utilization and minimize processing latency.
- Diagnose and resolve complex issues related to Linux servers, network bottlenecks, and cluster health.
Technical Expertise
- Expert-level knowledge of Snowflake architecture and Databricks integration.
- Extensive experience with the Cloudera ecosystem, including HDFS, Hive, and Spark.
- Proficiency in cloud security and governance tools such as Kerberos, Apache Ranger, and Atlas.
- Hands-on experience with secrets management using HashiCorp Vault and privileged access management via CyberArk.
- Strong scripting skills in Python, Ansible, and Shell for automating administrative tasks and deployments.
- Experience with Azure-native data tools like Azure Synapse and Azure Data Factory.
Professional Standards
- Collaborate with cross-functional teams to ensure seamless cloud migration activities with minimal business disruption.
- Create and maintain comprehensive documentation for system configurations, operational procedures, and troubleshooting guides.
- Work closely with vendors like Cloudera and Snowflake to stay updated on the latest releases and security patches.
- Provide high-level technical support and mentorship to junior data engineers and administrators.
Project Context
This role is ideal for an architect who thrives in complex environments involving legacy system modernization. You will be responsible for ensuring data integrity during the migration process and validating that the new cloud-based solutions meet or exceed the performance of the previous on-premise systems. The project requires a proactive approach to identifying potential bottlenecks and implementing automated solutions to prevent them.
Special Requirements
Onsite requirement in Minneapolis or Dallas; 6-month duration; Migration focus: Cloudera to Azure.
Compensation & Location
Salary: $165,000 – $215,000 per year (Estimated)
Location: Minneapolis, MN
Recruiter / Company – Contact Information
Recruiter / Employer: Qualis1 Inc
Email: swaroop@qualis1inc.com
Recruiter Notice:
To remove this job posting, please send an email from
swaroop@qualis1inc.com with the subject:
DELETE_JOB_ID_988