Job ID: JOB_ID_2267
Role Overview: Database Architect (Databricks Expert)
As we move into 2026, the landscape of data architecture has evolved significantly, placing Databricks at the center of the enterprise data ecosystem. This role, based in the financial hub of Boston, MA, requires a visionary Database Architect who can bridge the gap between complex data engineering and high-level business strategy within the Capital Markets domain. The successful candidate will be responsible for the end-to-end design and implementation of a modern Lakehouse architecture, ensuring that data is not only stored efficiently but is also highly accessible for real-time analytics and regulatory reporting.
Technical Leadership and Databricks Mastery
The core of this position involves leveraging the full power of the Databricks platform. You will be expected to design scalable Delta Lake solutions that handle massive volumes of structured and unstructured data. Expertise in Apache Spark is non-negotiable, specifically regarding performance tuning, memory management, and the optimization of complex join operations. You will lead the transition from traditional data warehousing to a unified Lakehouse model, implementing Medallion architecture patterns (Bronze, Silver, Gold) to ensure data quality and lineage. Your deep understanding of Spark SQL, Python, and Scala will be critical in developing robust data pipelines that support the high-frequency data needs of a modern trading environment.
Cloud Infrastructure and AWS Integration
Operating within an AWS environment, you will architect solutions that utilize a wide array of cloud-native services. This includes integrating Databricks with Amazon S3 for cost-effective storage, AWS Lambda for event-driven processing, and AWS Glue for metadata management. Security is paramount in the financial sector; therefore, you will design and implement sophisticated IAM policies, encryption at rest and in transit, and VPC peering to ensure that the data platform meets the most stringent compliance standards. You will also be responsible for managing the lifecycle of EC2 instances used for compute clusters, optimizing for both performance and cost-efficiency.
Capital Markets Domain Expertise
This is not a generalist role. We require a professional who understands the intricacies of Capital Markets. You must be familiar with the data flows associated with equities, fixed income, and derivatives trading. Experience with reference data management, market data feeds, and the data requirements for regulatory bodies (such as SEC or FINRA) is highly desirable. You will work closely with quantitative analysts and risk managers to ensure that the data platform supports complex risk modeling and real-time portfolio valuation. Your ability to translate financial business requirements into technical specifications will be a key measure of your success.
Strategic Responsibilities and Soft Skills
Beyond the technical implementation, you will serve as a strategic advisor to the executive leadership team. You will define the long-term data strategy, evaluate emerging technologies, and establish best practices for data governance and master data management. As a senior leader, you will mentor junior data engineers and architects, fostering a culture of technical excellence and continuous improvement. Strong communication skills are essential, as you will be required to present complex architectural concepts to non-technical stakeholders and drive consensus across cross-functional teams. This role offers the opportunity to shape the future of data in one of the world’s leading financial centers.
Special Requirements
Capital Markets domain expertise required. C2C engagement.
Compensation & Location
Salary: $190,000 – $250,000 per year (Estimated)
Location: Boston, MA
Recruiter / Company – Contact Information
Recruiter / Employer: Global IT Family LLC
Email: vishal@globalitfamily.com
Recruiter Notice:
To remove this job posting, please send an email from
vishal@globalitfamily.com with the subject:
DELETE_JOB_ID_2267