NEWPosted 4 hours ago

Job ID: JOB_ID_9257

Job Role: Azure DataBricks Solution Architect

**Key Responsibilities**

  • Design and implement scalable data platforms and pipelines using Databricks (including Spark, Delta Lake, MLflow, etc.).
  • Work with stakeholders to develop modern data architectures that meet business requirements.
  • Lead the migration from legacy platforms to the Databricks Lakehouse architecture.
  • Establish data governance, quality, and security standards in collaboration with InfoSec and Compliance teams.
  • Optimize data ingestion, transformation, and consumption processes.
  • Mentor data engineers and developers on best practices for using Databricks.
  • Integrate Databricks with enterprise tools such as Power BI, Tableau, Kafka, Snowflake, and others.
  • Develop and implement machine learning/AI workflows within a Databricks environment.
  • Collaborate with cloud architects to ensure a robust infrastructure setup on AWS, Azure, or GCP.
  • Produce technical documentation, architectural diagrams, and data models.

**Required Qualifications**

  • Over 8 years of experience in data engineering or architectural roles.
  • More than 5 years of experience in architecting solutions with Databricks.
  • Expertise in Apache Spark, Delta Lake, MLflow, and Lakehouse architecture.
  • Proficiency in SQL, Python, and/or Scala.
  • Practical experience with cloud platforms such as AWS, Azure, or GCP.
  • Strong understanding of distributed computing, performance tuning, and data security.
  • Experience with CI/CD pipelines, DevOps tools, and orchestration tools like Airflow or Data Factory.

**Preferred Qualifications**

  • Databricks Certified Data Engineer or Solutions Architect.
  • Knowledge of MLOps and deploying machine learning models into production.
  • Experience with data mesh, data fabric, or similar enterprise data architectures.

Special Requirements

Onsite

Compensation & Location

Salary: $120,000 – $160,000 per year (Estimated)

Location: Tampa, FL

Recruiter / Company – Contact Information

Email: ankitkumar.s@kksoftwareassociates.com

Interested in this position?
Apply via Email

Recruiter Notice:
To remove this job posting, please send an email from
ankitkumar.s@kksoftwareassociates.com with the subject:

DELETE_JOB_ID_9257

to delete@join-this.com.