Data Engineer

Our direct end client which is one of the Fortune 500 company and an international life insurance and financial services firm is urgently looking to hire AWS Data Engineer - Newark, NJ (Hybrid). This is a Contract opportunity.AWS Data Engineer Newark, NJ 07102 (Hybrid 3 days office & 2 days work from home)Nature of Contract - Contract Role Job Description:We are seeking an experienced AWS Data Engineer with a strong background in ETL processes, Data Warehousing, and Data Lakes, to join our dynamic team. The ideal candidate will have hands-on experience in building scalable, high-performance data pipelines using AWS services. As part of our data engineering team, you will work closely with data architects, data analysts, and data scientists to design, implement, and maintain data solutions that drive critical business decisions.Key Responsibilities:ETL Development: Design, develop, and maintain ETL pipelines for transforming large datasets from various data sources into structured formats for analysis and reporting.Data Warehouse Management: Implement and optimize data warehousing solutions using AWS Redshift and other AWS data services to ensure efficient storage, retrieval, and analysis of large datasets.Data Lake Architecture: Build and manage data lakes using AWS S3, AWS Glue, and Lake Formation to ingest, store, and process structured and unstructured data.Serverless Data Processing: Leverage AWS Lambda for building serverless data workflows and real-time data processing pipelines.Data Processing: Utilize Python, PySpark, and SQL for data processing, transformation, and automation of data pipelines.Collaboration: Work closely with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand data requirements and deliver high-quality solutions.Monitoring & Optimization: Monitor data pipelines and data workflows for performance, quality, and efficiency; optimize resource usage to minimize costs.Data Governance & Security: Implement best practices for data governance, data quality, and data security within the AWS ecosystem.Key Qualifications:Experience in data engineering, with a strong focus on AWS services and building data pipelines, data lakes, and data warehouses.AWS Expertise: Proficient in AWS services including S3, Redshift, Glue, Athena, Lambda, EMR, and Lake Formation.ETL & Data Warehousing: Hands-on experience with designing and managing ETL processes, building data warehouses, and optimizing SQL queries for high performance in distributed environments.Programming Skills: Strong programming skills in Python and SQL, with experience in PySpark for large-scale data processing.Data Lakes: Experience building and managing scalable, secure data lakes on AWS.Serverless Architecture: Familiarity with AWS Lambda for creating serverless data processing workflows.Data Management: Experience with data governance, data quality frameworks, and securing data at rest and in transit.Problem Solving: Strong analytical and problem-solving skills, with the ability to troubleshoot and optimize data pipelines and munication: Excellent collaboration and communication skills to work effectively with technical and non-technical teams.Looking forward to hear from you...!!!Best Regards, Bharat Sharma Sr. Talent Acquisition - Executive Iris Software 200 Metroplex Drive, Suite #300 Edison, NJ 08817

Created: 2024-10-24