Job ID: JOB_ID_8386
Job Summary
We are seeking a skilled DevOps Engineer with extensive hands-on experience in Cloudera platform deployment, configuration, and administration. The ideal candidate will manage, automate, and optimize enterprise data platforms built on Cloudera (CDP/CDH), ensuring high availability, performance, security, and cost efficiency. This role requires advanced knowledge of HDFS, Hive, HBase, Solr (Cloudera Search), Ozone, Cloudera Data Services, and Ranger, coupled with strong DevOps and automation practices. The position is 100% onsite in Scottsdale, AZ.
Key Responsibilities
- Platform Deployment & Configuration: Install, configure, and upgrade Cloudera clusters using Cloudera Manager across on-prem and/or cloud environments. Provision and configure services including HDFS, Hive, HBase, Solr (Cloudera Search), Ozone, Data Services (e.g., Data Engineering, Data Warehouse, Machine Learning), and Ranger. Set up and manage Kerberos, TLS/SSL, AD/LDAP integration, and Ranger policies for fine-grained access control.
- Operations & Reliability: Own day-to-day cluster administration, including capacity planning, quota management, service restarts, rolling upgrades/patching, and backup/restore procedures. Monitor and tune cluster and service performance (NameNode/ResourceManager health, GC tuning, YARN queues, Hive LLAP/Tez, HBase region servers, Solr cores/collections). Implement SLA/SLO monitoring, alerting, and dashboards; drive root cause analysis and incident response.
- Security & Governance: Maintain a secure environment through Ranger policies, Kerberos principals/keytabs, TLS certificates, and compliance checks. Support data governance and auditing requirements, integrating with enterprise secrets and key management systems as needed.
- Automation & DevOps: Build and maintain Infrastructure as Code (IaC) and configuration automation using tools like Ansible and Terraform. Develop operational runbooks and automation scripts in Python/Bash for provisioning, patching, and routine administrative tasks. Integrate platform workflows with CI/CD pipelines (Git) for repeatable, version-controlled changes.
- Data Services & Ecosystem Support: Administer and optimize Hive metastore, ACID tables, compactions, and query engines (Tez/Spark). Manage HBase schemas, region splitting/balancing, and performance tuning. Operate Solr (Cloudera Search) for indexing, schema management, and query performance. Support Ozone object store operations, storage policies, and migration use cases. Collaborate with data engineering teams on job orchestration, resource management, and troubleshooting.
- Reliability Engineering: Implement high availability (HA) for critical components; design Disaster Recovery (DR) strategies and execute failover tests. Focus on capacity and cost optimization across compute and storage, recommending rightsizing and lifecycle policies.
- Documentation & Collaboration: Create and maintain architecture diagrams, topology documentation, SOPs/runbooks, and security documentation. Partner with platform, security, and data engineering teams, providing L2/L3 support and knowledge transfer.
Required Qualifications
- 3-8 years of hands-on experience administering Cloudera (CDH/CDP) in production environments.
- Strong administration skills with HDFS, Hive, HBase, Solr (Cloudera Search), Ozone, Cloudera Data Services, and Ranger.
- Proficiency in Linux (RHEL/CentOS/Ubuntu) systems administration and shell scripting (Bash).
- Practical experience with Kerberos, TLS, LDAP/AD, and Ranger policy management.
- Automation experience with Ansible and scripting in Python for operational tasks.
- Experience with monitoring and logging tools (Cloudera Manager, Grafana/Prometheus/Elastic or equivalents).
- Solid understanding of networking (DNS, load balancing, firewalls), storage, and JVM/GC fundamentals.
- Familiarity with Git-based CI/CD and change management practices in regulated environments.
Good to Know
- AWS and Cloudera on AWS experience is a plus.
Special Requirements
100% Onsite. Candidates with experience in Ozone, Airflow, Ranger configuration, Atlas. Strong architectural understanding. Visa status not specified, but 'visa' mentioned in subject line implies potential for sponsorship considerations or specific visa types.
Compensation & Location
Salary: $120,000 – $170,000 per year (Estimated)
Location: Scottsdale, AZ
Recruiter / Company – Contact Information
Email: eta.singh@innovyt.com
Recruiter Notice:
To remove this job posting, please send an email from
eta.singh@innovyt.com with the subject:
DELETE_JOB_ID_8386