Job ID: JOB_ID_931
Position Overview: AWS Glue Data Quality Engineer & MCP / AI Engineer
Scalable Systems Inc is currently seeking a highly motivated and technically proficient AWS Glue Data Quality Engineer & MCP / AI Engineer for a hybrid role based in Schaumburg, Illinois. This position is designed for a senior-level professional with 6 to 8 years of experience in the digital landscape, specifically focusing on Amazon Web Services (AWS) cloud computing, data quality frameworks, and the burgeoning field of Artificial Intelligence and Generative AI. As the data landscape evolves, the need for high-quality, reliable data becomes paramount, and this role sits at the heart of that mission. The successful candidate will be responsible for setting up and managing the Master Control Program (MCP) on our data warehouse and implementing AWS Glue Data Quality rules to ensure the highest standards of data integrity and governance. This role requires a blend of traditional data engineering excellence and forward-thinking AI integration capabilities.
Key Responsibilities and Duties
- Architect and implement AWS Glue Data Quality rules to automate the monitoring and validation of data assets within the AWS ecosystem.
- Configure and manage the MCP (Master Control Program) setup on the enterprise data warehouse to streamline data orchestration and processing.
- Develop and integrate AI and Generative AI products and tools into existing data workflows to enhance predictive capabilities and operational efficiency.
- Establish and enforce data governance policies to ensure compliance with industry standards and internal data management protocols.
- Collaborate with data architects and business stakeholders to define data quality requirements and translate them into technical specifications.
- Conduct comprehensive testing of data quality rules within the Data Warehouse (DWH) environment to identify and resolve anomalies.
- Optimize AWS Glue jobs for performance and cost, ensuring efficient use of cloud resources.
- Provide technical leadership and mentorship to junior engineers in the areas of AWS cloud services and data engineering best practices.
- Stay abreast of the latest developments in AI, Gen AI, and cloud technologies to drive continuous improvement in our data platforms.
- Participate in the full software development lifecycle (SDLC), including requirements gathering, design, development, testing, and deployment.
Required Skills and Qualifications
- A minimum of 6-8 years of professional experience in data engineering, cloud computing, or a related field.
- Deep expertise in Amazon Web Services (AWS), with a specific focus on AWS Glue, S3, Redshift, and Lambda.
- Proven experience in implementing Data Quality (DQ) frameworks and Data Governance strategies.
- Strong knowledge of AI and Generative AI tools, including experience with LLMs and prompt engineering.
- Proficiency in programming languages such as Python or Scala, particularly for data processing tasks.
- Solid understanding of Data Warehousing concepts, ETL/ELT processes, and SQL.
- Experience with MCP setup and management in a large-scale data environment.
- Excellent analytical and problem-solving skills, with the ability to troubleshoot complex data issues.
- Strong communication skills, both written and verbal, with the ability to present technical concepts to non-technical stakeholders.
- Ability to work effectively in a hybrid work model, balancing remote productivity with in-person collaboration in Schaumburg, IL.
Industry Impact and Collaboration
In this role, you will not only be managing data but also shaping the future of how our organization leverages information. By ensuring data quality at the source and integrating AI-driven insights, you will empower decision-makers across the company. You will work in a collaborative environment where innovation is encouraged and technical excellence is rewarded. The hybrid nature of this role in Schaumburg allows for a perfect balance of focused independent work and high-impact team brainstorming sessions. We are looking for a visionary who understands that data is the lifeblood of modern enterprise and is committed to maintaining its purity and utility through advanced engineering practices.
Special Requirements
Hybrid role in Schaumburg, IL. Requires 6-8 years of experience. Domain: AWS Cloud and AI. Max rate $50/hr C2C.
Compensation & Location
Salary: $95,000 – $104,000 per year
Location: Schaumburg, IL
Recruiter / Company – Contact Information
Recruiter / Employer: Scalable Systems Inc
Email: ankit.dubey@scalable-systems.com
Recruiter Notice:
To remove this job posting, please send an email from
ankit.dubey@scalable-systems.com with the subject:
DELETE_JOB_ID_931