NEWPosted 4 hours ago

Job ID: JOB_ID_3705

Job Summary

We are seeking an experienced AWS Data Architect with strong Databricks expertise to design and implement end-to-end data lakehouse solutions on AWS. This role involves leading a team of data engineers, collaborating with stakeholders, and ensuring the scalability, security, and performance of our data platform.

Key Responsibilities

  • Architecture & Design: Define and design end-to-end data lakehouse architecture leveraging Databricks, Delta Lake, and cloud-native AWS services.
  • Create reference architectures for batch, real-time, and streaming data pipelines.
  • Architect data ingestion, curation, storage, and governance frameworks.
  • Ensure the platform is scalable, secure, and optimized for performance and cost.
  • Establish standards for data lineage, metadata management, and compliance.
  • Work with enterprise architects to align Databricks solutions with overall cloud strategy (AWS).
  • Leadership & Delivery: Lead and mentor a team of data engineers in building robust data pipelines.
  • Collaborate with data scientists, BI teams, and business stakeholders to enable advanced analytics and AI/ML use cases.
  • Drive adoption of DevOps and CI/CD practices for data engineering.
  • Review designs and solutions to ensure adherence to architectural principles.
  • Implementation & Optimization: Build, optimize, and manage large-scale PySpark/SQL pipelines in Databricks.
  • Enable real-time data processing through Kafka, Kinesis, or Event Hubs.
  • Implement security best practices including RBAC, data masking, and encryption.

Qualifications

  • Proven experience as a Data Architect with a focus on cloud platforms, specifically AWS.
  • Extensive experience with Databricks, Delta Lake, and related data lakehouse technologies.
  • Strong proficiency in PySpark and SQL for data pipeline development.
  • Experience with real-time data streaming technologies (Kafka, Kinesis, Event Hubs).
  • Deep understanding of data engineering best practices, DevOps, and CI/CD.
  • Experience in defining and implementing data governance, security, and compliance standards.
  • Excellent leadership and communication skills, with the ability to mentor teams and collaborate with business stakeholders.
  • Experience with enterprise architecture and aligning solutions with business strategy.

Special Requirements

C2C, Remote and travel

Compensation & Location

Salary: $70 – $90 per year (Estimated)

Location: Remote

Recruiter / Company – Contact Information

Email: prashanth.aptask@gmail.com

Interested in this position?
Apply via Email

Recruiter Notice:
To remove this job posting, please send an email from
prashanth.aptask@gmail.com with the subject:

DELETE_JOB_ID_3705

to delete@join-this.com.