Job ID: JOB_ID_961

Role Overview

Quantum World Technologies is seeking a veteran Azure Databricks Architect for a critical, long-term contract engagement in Iselin, NJ. This role is designed for a senior-level professional with over 15 years of experience in the IT industry, specifically focusing on big data architecture and cloud-native data engineering. As an onsite architect, you will be required to be present at the Iselin facility five days a week, providing direct leadership and technical oversight to the data engineering teams. This position is pivotal in building the next generation of data lakehouse architectures for our global clients.

Key Responsibilities

  • Data Pipeline Engineering: Design, build, and maintain highly scalable ETL/ELT pipelines using Databricks. Utilize PySpark, Spark, and SQL to transform and process massive datasets with high efficiency.
  • Lakehouse Architecture: Implement and manage advanced Databricks features including Delta Lake, Unity Catalog, Lakehouse Architecture, Table Triggers, and Delta Live Pipelines.
  • Cloud Integration: Seamlessly integrate data from a variety of sources, including Azure Blob Storage, Azure Data Lake Storage (ADLS), and various relational and non-relational database systems.
  • Performance Optimization: Continuously monitor and optimize Databricks workloads to ensure cost efficiency and peak performance. Troubleshoot complex data pipeline issues to maintain data reliability and accuracy.
  • Governance and Security: Establish and enforce data security protocols, access controls, and governance standards using Unity Catalog, ensuring full compliance with organizational and regulatory data policies.
  • DevOps and Deployment: Utilize Databricks Asset Bundles for the seamless deployment of jobs, notebooks, and configurations across multiple environments. Manage version control for all data artifacts using GitLab.

Technical Requirements

  • Core Skills: Mastery of Databricks, PySpark, Azure Cloud Services, and SQL.
  • Experience: A minimum of 15 years of professional experience in IT, with a significant portion dedicated to data architecture.
  • Tools: Proficiency with Databricks Asset Bundles, GitLab, and Spark Streaming frameworks.
  • Certifications: While optional, an Azure Data Engineer Associate or Databricks Certified Data Engineer Associate certification is highly preferred.
  • Visa Constraints: This position is strictly open to candidates on H1B, H4 EAD, or L2S visas only.

Professional Environment

In 2026, the role of a Data Architect has shifted toward real-time data processing and automated governance. This position offers the chance to work on high-stakes projects that utilize the full breadth of the Azure ecosystem. Candidates must demonstrate not only technical prowess but also the ability to collaborate effectively with cross-functional teams to deliver tailored data solutions that meet complex business requirements.


Special Requirements

Visa: H1B / H4 EAD / L2S Only. PPN Must. Experience: 15+ years. Mode: Onsite 5 days/week in Iselin, NJ.


Compensation & Location

Salary: $145,600 – $150,000 per year

Location: Iselin, NJ


Recruiter / Company – Contact Information

Recruiter / Employer: Quantum World Technologies Inc.

Email: mohd.anas@quantumworldit.com


Interested in this position?
Apply via Email

Recruiter Notice:
To remove this job posting, please send an email from
mohd.anas@quantumworldit.com with the subject:

DELETE_JOB_ID_961

to delete@join-this.com.