Job ID: 1863
Role Overview
Arbor Teksystems is seeking a highly experienced and technically proficient DataBricks Developer for a critical 12-month contract engagement located onsite in Palm Beach, Florida. This senior-level position requires a professional with a minimum of 10 years of experience in the data engineering and big data landscape. The successful candidate will be instrumental in designing, developing, and optimizing sophisticated data processing pipelines within the Databricks environment, leveraging the full power of the Lakehouse architecture to drive business insights and operational excellence.
Key Responsibilities and Duties
- Design and implement end-to-end data processing pipelines using Databricks, Spark, and Delta Lake technologies.
- Perform deep-dive performance tuning and optimization of Spark jobs to ensure maximum efficiency and cost-effectiveness.
- Collaborate extensively with data science and analytics teams to integrate complex data solutions into production environments.
- Support and advance data architecture initiatives that incorporate cutting-edge Databricks features such as Delta Live Tables and Autoloader.
- Provide high-level system support and troubleshooting for Databricks-based tools, ensuring system reliability and resolving performance bottlenecks.
- Create comprehensive documentation for technical processes, system behaviors, and data flows to facilitate knowledge sharing.
- Lead knowledge transfer sessions and mentor team members on advanced data processing techniques and Databricks best practices.
- Establish, implement, and enforce robust data governance and security protocols within the Databricks workspace, utilizing Unity Catalog for centralized management.
- Ensure all data management activities comply with relevant regulatory requirements and internal security standards.
- Develop and maintain interactive data visualization dashboards to provide stakeholders with actionable insights.
Technical Requirements and Qualifications
- A minimum of 10 years of professional experience in data engineering, software development, or a related technical field.
- Expert-level proficiency in the Databricks platform, including hands-on experience with Spark (Python, Scala, or SQL).
- Strong understanding of big data technologies and the ability to optimize data analysis and pipeline performance at scale.
- Proven experience in integrating Databricks solutions with existing enterprise systems and cloud platforms (Azure or AWS).
- Familiarity with advanced querying tools and data visualization services such as Tableau or Power BI.
- Solid grasp of data modeling, ETL/ELT design patterns, and data warehousing principles.
- Experience implementing CI/CD pipelines for data engineering projects to ensure automated and reliable deployments.
- Excellent communication skills, with the ability to translate complex technical concepts for non-technical stakeholders.
Work Environment and Project Scope
This position is strictly onsite in Palm Beach, Florida, requiring the candidate to be present in the office to collaborate with the local team. The initial contract duration is 12 months, with a strong possibility of extension based on project milestones and performance. As a senior developer, you will play a pivotal role in shaping the data strategy for our client, working on high-impact projects that utilize the latest advancements in the Databricks ecosystem. Arbor Teksystems is dedicated to providing our consultants with challenging and rewarding opportunities that foster professional growth and technical excellence.
About Arbor Teksystems
Arbor Teksystems is a premier software company and staffing firm that specializes in connecting top-tier technology talent with industry-leading organizations. With over 21 years of experience, we pride ourselves on our deep technical expertise and our commitment to delivering exceptional value to our clients and consultants alike. Our headquarters are located in Coconut Creek, Florida, and we support a wide range of clients across various industries, helping them achieve their digital transformation goals through innovative technology solutions and expert staffing services.
Special Requirements
Onsite requirement in Palm Beach, FL; 12-month contract with extension potential; 10 years experience required; No specific visa restrictions mentioned.
Compensation & Location
Salary: $185,000 – $225,000 per year (Estimated)
Location: Palm Beach, FL
Recruiter / Company – Contact Information
Recruiter / Employer: Arbor Teksystems
Email: dhananjayp@arborteksys.com
Recruiter Notice:
To remove this job posting, please send an email from
dhananjayp@arborteksys.com with the subject:
DELETE_1863