Job ID: JOB_ID_1891
Role Overview
We are seeking a highly skilled Lead Data Engineer for a critical 6-month contract position based in Austin, Texas. This role requires a professional who can operate onsite five days a week and possesses a deep technical background in SQL, Python, and modern data warehousing solutions like Snowflake. As a lead, you will be responsible for driving data projects from conception to delivery, collaborating with offshore teams, and interacting directly with business stakeholders to translate requirements into robust technical solutions.
Key Responsibilities
- Design and implement complex data pipelines and ETL processes using Python and SQL.
- Lead the development of dimensional data models, ensuring high performance and scalability.
- Manage and optimize Snowflake architecture, including time travel, clustering, and micro-partitioning.
- Develop streaming applications and microservices using Apache Kafka and Python client libraries.
- Automate data pipelines and schedule processes within DataLab, connecting with DataLake and S3 environments.
- Perform thorough impact analysis on business requirements and provide suitable architectural solutions.
- Collaborate with offshore development teams to ensure seamless project delivery and code quality.
- Optimize SQL performance through advanced tuning techniques, including the use of materialized views and recursive queries.
Technical Requirements
- Expert-level proficiency in SQL: Joins, Self-Joins, Views, Materialized Views, Cursors, and Recursive queries.
- Strong experience with ETL and Dimensional Data Modelling (SCD Type 1, 2, 3).
- Advanced Python programming skills, specifically with Pandas, PyParsing, NumPy, and Airflow.
- Hands-on experience with Snowflake: SnowSQL, SnowPipe, and performance optimization.
- Experience with streaming technologies like Apache Kafka (Confluent or Kafka-Python).
- Familiarity with Vertica and SingleStore is highly desirable.
- Proven track record in leading data projects and interacting with business units.
Professional Expectations
The successful candidate will demonstrate exceptional leadership qualities, taking full ownership of project delivery. You must be able to participate actively in business discussions, providing technical insights that align with organizational goals. This position is strictly onsite in Austin, TX, and requires a candidate who is ready to hit the ground running in a fast-paced environment.
Special Requirements
Need TX ID for submission; LinkedIn profile required; Preference for local Austin candidates; Must mention visa status in reply.
Compensation & Location
Salary: $60 – $60 per year
Location: Austin, TX
Recruiter / Company – Contact Information
Recruiter / Employer: Tekgence Inc.
Email: jitendra.kumar@tekgence.com
Recruiter Notice:
To remove this job posting, please send an email from
jitendra.kumar@tekgence.com with the subject:
DELETE_JOB_ID_1891