Job ID: JOB_ID_3178435
About the Role:
We are seeking an expert Databricks Consultant with a strong background in Data Engineering to join our highly technical organization. The ideal candidate will not only be a practitioner but a true expert in the Databricks ecosystem, capable of defending architectural decisions and writing production-grade code in a high-performance environment. This role requires a proactive individual who can work independently, prioritize effectively, and identify opportunities for improvement. You will be expected to operate in a loosely defined scope, contributing to the definition of priorities and driving work forward.
Key Qualifications:
- Apache Spark Expertise: Strong experience with Apache Spark, including various techniques for optimizing Spark workloads.
- Spark Structured Streaming: Proven experience with Spark Structured Streaming for real-time data processing.
- Spark SQL Optimization: Deep understanding of Spark SQL and query performance optimization techniques.
- Infrastructure as Code: Experience with Terraform for infrastructure management.
- Databricks Asset Bundles: Familiarity and experience with Databricks Asset Bundles for managing Databricks projects.
Nice to Have:
- Application Development: Experience with application development, particularly in conjunction with Databricks Apps.
- Linux Environments: Comfort and proficiency working in Linux environments.
- Financial Markets Background: Prior background or understanding of financial markets, such as market making, trading, or related domains.
Working Style:
- Independent Work: Ability to work independently and manage your own workload effectively.
- Proactive Improvement: Proactively identify opportunities for process and system improvements.
- Adaptability: Comfortable operating in a loosely defined scope, taking initiative to define priorities and drive projects forward.
- Problem Solving: Strong analytical and problem-solving skills to tackle complex data engineering challenges.
About DCONINC:
DCONINC is a highly technical organization with extensive experience in leveraging the Databricks platform to deliver robust data solutions. We pride ourselves on our deep expertise and our ability to tackle complex challenges in high-performance environments. Join a team where your skills are valued, and you can make a significant impact.
Location:
This role is based in Chicago, IL and requires onsite presence.
Employment Type:
This is a W2 Contract position.
Compensation & Location
Salary: $70 – $90 per year (Estimated)
Location: Chicago, IL
Recruiter / Company – Contact Information
Recruiter / Employer: DCONINC
Email: shashi@dconinc.com
Recruiter Notice:
To remove this job posting, please send an email from
shashi@dconinc.com with the subject:
DELETE_JOB_ID_3178435