Job ID: 3181611
This is an exciting opportunity for an Associate Principal Azure Databricks Architect with extensive experience to join a dynamic team in Atlanta, GA. The role demands a seasoned professional with 11 to 15 years of specialized expertise in Azure data services, ready to lead and architect highly scalable data solutions. The successful candidate will be at the forefront of designing, implementing, and optimizing enterprise-grade data platforms that support critical analytics, reporting, and data warehousing initiatives.The Azure Databricks Architect will leverage deep expertise in the Azure ecosystem to drive advanced analytics capabilities and ensure robust data integration across diverse sources. This position requires a strong commitment to data quality, security compliance, and performance tuning across all implemented solutions. Beyond technical leadership, the role involves guiding technical teams, fostering skill development, and ensuring the delivery of high-quality, well-documented data architectures.
Key Responsibilities:
- Lead the comprehensive design and implementation of enterprise-grade data solutions, primarily utilizing Azure BLOB Storage, Azure Data Factory, and Azure SQL.
- Optimize and manage scalable data pipelines to efficiently support various analytics, reporting, and data warehousing initiatives, ensuring high performance and reliability.
- Apply extensive expertise in Azure data services to support and enhance advanced analytics capabilities within the organization.
- Collaborate effectively with cross-functional teams to seamlessly integrate diverse data sources and rigorously ensure the highest standards of data quality and integrity.
- Proactively adopt and integrate emerging Azure data technologies and best practices into existing and new architectural designs.
- Ensure stringent security compliance and conduct thorough performance tuning across all data solutions to maintain optimal operational efficiency.
- Provide technical guidance and mentorship to development teams, fostering skill development and ensuring the delivery of high-quality, robust data solutions.
- Develop and maintain comprehensive documentation for all aspects of the data architecture, ensuring clarity, accuracy, and accessibility.
Roles and Responsibilities:
- Design, develop, and meticulously maintain robust ETL (Extract, Transform, Load) workflows using Azure Data Factory and Azure Synapse Analytics.
- Manage and optimize Azure SQL databases, including Azure BLOB storage and Data Lake solutions, to ensure efficient data storage and retrieval.
- Lead critical data integration and transformation efforts to effectively support business intelligence and advanced AI initiatives.
- Implement advanced performance optimization strategies across the data platform to maximize efficiency and responsiveness.
- Collaborate closely with various stakeholders to define clear data models, strategic integration approaches, and comprehensive solution roadmaps.
- Proactively troubleshoot and resolve complex pipeline and infrastructure issues, minimizing downtime and ensuring continuous data flow.
- Lead architecture reviews, ensuring all designs and implementations align perfectly with organizational standards and best practices.
- Provide authoritative technical leadership and champion best practices within the entire Azure data ecosystem.
- Contribute to InfraDevOps engineering efforts, focusing on deployment automation for data solutions.
- Engineer Python scripts and APIs specifically for RLS (Row-Level Security) user management and general guidance within the Databricks environment.
Experience and Skills:
- A minimum of 14 years of experience, with a strong specialization in Azure data services.
- Proven track record as an Associate Principal or similar senior-level role, leading and architecting scalable data solutions.
- In-depth knowledge of Azure BLOB Storage, Azure Data Factory, Azure SQL, Azure Synapse Analytics, and Azure Data Lake.
- Strong understanding of ETL/ELT processes and data warehousing concepts.
- Experience with Python and API development for data management and security.
- Familiarity with InfraDevOps principles and deployment automation.
- Excellent communication and collaboration skills to work with cross-functional teams and stakeholders.
This onsite position in Atlanta, GA, offers a challenging yet rewarding environment for an experienced Azure Databricks Architect to drive significant impact through innovative data solutions. The ideal candidate will be a visionary leader capable of guiding technical teams and shaping the future of data architecture.
Special Requirements
Kindly send resume with Current location and Visa.
Compensation & Location
Salary: $130,000 – $180,000 per year (Estimated)
Location: Atlanta, GA
Recruiter / Company – Contact Information
Recruiter / Employer: Reveille Technologies, Inc
Email: prema@reveilletechnologies.com
Recruiter Notice:
To remove this job posting, please send an email from
prema@reveilletechnologies.com with the subject:
DELETE_3181611