NEWPosted 4 hours ago

Job ID: JOB_ID_9557

About the Role:

We are seeking a mid-level Data Engineer with 4-6 years of overall experience to join our team. You will play a crucial role in developing data solutions in collaboration with business analysts, guided by lead data engineers. Your responsibilities include ensuring the delivery of consistent, reliable, and sustainable outcomes while contributing to data management practices that enhance the accuracy and trustworthiness of data assets throughout the organization.

Key Responsibilities:

  • Develop and maintain data pipelines and architectures using ETL/ELT processes.
  • Optimize data pipelines for performance and efficiency.
  • Collaborate with business analysts and lead data engineers on data solution development.
  • Ensure data accuracy and trustworthiness through robust data management practices.
  • Implement and manage data security practices, including encryption and anonymization.
  • Work with heterogeneous datasets and integrate them into a cohesive data structure.
  • Utilize scripting languages, preferably Python, for data manipulation and automation.
  • Contribute to DevOps and CI/CD pipelines for automated testing and deployment.
  • Manage metadata and employ metadata-driven design principles.
  • Understand infrastructure considerations for scaling data pipelines in distributed environments.
  • Participate in data modeling and schema design.
  • Ensure code integrity and collaboration through version control systems.

Required Competencies and Skills:

  • Experience: 4-5 years of experience in SQL, data engineering, and data modeling techniques.
  • Snowflake: Minimum 1 year of experience with Snowflake.
  • Data Warehouse and Data Lake: Experience with modern data architectures including data lakehouse, data warehouse, and data lake.
  • Project Leadership: Experience leading full lifecycle, large, complex reporting, or data engineering efforts.
  • Data Pipeline Development: Experience building and optimizing data pipelines, pipeline architectures, and integrated datasets using various data integration technologies (ETL/ELT, data replication/CDC, message-oriented data movement, API design, etc.).
  • DevOps and CI/CD: Experience with DevOps, CI/CD pipelines, and automated testing.
  • Scripting Languages: Experience with any scripting languages, preferably Python.
  • Self-Motivated: Must be self-motivated and able to work with minimal supervision.
  • Analytical Skills: Possess strong analytical, problem-solving, and root cause analysis skills.
  • Communication: Good communicator and coordinator.
  • Data Security: Working knowledge of data security practices, including encryption, anonymization, and masking.
  • Data Flow Management: Proficient in data pipeline orchestration techniques for efficient data flow management.
  • Metadata Management: Experience in metadata management and employing metadata-driven design principles to enhance data usability and governance.
  • Version Control: Strong understanding of version control systems for maintaining code integrity and collaboration.
  • Infrastructure Scaling: Knowledge of infrastructure considerations for scaling data pipelines within distributed computing environments.

Preferred Competencies and Skills:

  • Snowflake, Databricks and Qlik: Experience working with Snowflake (streams and tasks, dynamic tables), Databricks (or Spark) and Qlik technologies (Replicate and Compose). At least 1 year of hands-on Snowflake repository experience.
  • Agile Methodologies: Experience working using agile methodologies.
  • Industry Experience: Experience in Manufacturing or Agriculture industry.
  • Data Vault Method: Knowledge of the data vault method, model, and architecture.
  • Innovative Thinking: Ability to think innovatively to implement creative solutions to problems.

Additional Information:

  • Location: Arden Hills, MN (On-site)
  • This role is for local candidates only.
  • No GC/GC EAD profiles will be considered.

Special Requirements

No GC/GC EAD profiles. Local candidates only. On-site.

Compensation & Location

Salary: $70 – $90 per year (Estimated)

Location: Arden Hills, MN

Recruiter / Company – Contact Information

Email: yanka@fusiongs.com

Interested in this position?
Apply via Email

Recruiter Notice:
To remove this job posting, please send an email from
yanka@fusiongs.com with the subject:

DELETE_JOB_ID_9557

to delete@join-this.com.