NEWPosted 3 hours ago
Job ID: JOB_ID_5248
Job Description: Data Engineer
We are looking for a results-driven Data Engineer with over a decade of experience in data engineering across cloud platforms, totaling 12 years in IT. This is a 100% onsite contract position in New York, NY, requiring local candidates. We are seeking profiles with 13+ years of experience.
Key Responsibilities:
- Build and manage GCP data pipelines using tools like Cloud Composer and Cloud Dataflow.
- Develop and deploy applications on Google Kubernetes Engine (GKE).
- Implement security and compliance on GCP, ensuring data privacy and regulatory adherence.
- Optimize cost and resource usage within GCP environments.
- Process data efficiently using AWS services such as Amazon EMR, Redshift, and Glue.
- Architect scalable, cost-effective solutions on AWS, with proficiency in configuring AWS Lambda for serverless computing.
- Set up AWS Kinesis streams to process real-time data.
- Utilize AWS DynamoDB to create scalable, low-latency NoSQL databases.
- Optimize and manage Amazon Redshift data warehouses for high-performance analytics.
- Integrate AWS services into CI/CD pipelines for continuous integration, delivery, and deployment.
- Set up and secure AWS Virtual Private Cloud (VPC) environments.
- Manage Azure virtual machines (VMs) for cloud infrastructure operations.
- Manage on-premises data infrastructure, including data warehouses and databases.
- Implement CI/CD pipelines using tools like Jenkins and GitLab CI/CD.
- Perform automated testing, including unit, integration, and regression testing.
- Gather and analyze project requirements to ensure alignment with business goals.
- Contribute to successful outcomes through data-driven analytics and collaborative teamwork in an Agile environment.
Technical Skills Required:
- Languages & Scripting: Spark, Python, Java, Scala, Hive, Kafka, SQL
- Cloud Platforms: AWS OR GCP
- Data Warehousing & Analytics: Redshift or Snowflake or Big Query
- Data Integration & ETL: AWS Glue, Aws EMR, Spark, Data Bricks
- CI/CD: AWS Code Pipeline, Jenkins, CloudFormation, Docker, Kubernetes
- Databases: AWS DynamoDB, Amazon Redshift
- Version Control: Git
Additional Requirements:
- 13+ years of experience required.
- Must be local to New York.
- No CPT or cards.
- Onsite: 100%
Special Requirements
Need 13+ years profiles only. DONT SHARE BELOW 13 YEARS. NO , CPT AND CARDS. NEED LOCALS TO NEW YORK.
Compensation & Location
Salary: $65 – $80 per year (Estimated)
Location: New York, NY
Recruiter / Company – Contact Information
Email: usjobs@nvoids.com
Recruiter Notice:
To remove this job posting, please send an email from
usjobs@nvoids.com with the subject:
DELETE_JOB_ID_5248