Data Engineer II
Tekwissen - austin, TX
Apply NowJob Description
Overview: TekWissen Group is a workforce management provider throughout the USA and many other countries in the world. Our client is a company operating a marketplace for consumers, sellers, and content creators. It offers merchandise and content purchased for resale from vendors and those offered by third party sellers. Job Title: Data Engineer II Location: Austin, TX 78758 Duration: 6 Months Job Type: Contract Work Type: Hybrid Job Description: Sales, Marketing and Global Services (SMGS) AWS Sales, Marketing, and Global Services (SMGS) is responsible for driving revenue, adoption, and growth from the largest and fastest growing smalland mid-market accounts to enterprise-level customers including public sector. The AWS Global Support team interacts with leading companies and believes that world-class support is critical to customer success. AWS Support also partners with a global list of customers that are building mission-critical applications on top of AWS services. Client Web Services (AWS), a leading cloud computing provider and subsidiary of , is seeking a talented and experienced Data Engineer to join our AWS Marketing Insights team. In this pivotal role, you will be responsible for designing, building, and maintaining robust data pipelines and data infrastructure to support data-driven insights across the organization. Key Job Responsibilities: As a Data Engineer on the AWS Marketing Insights team, your pivotal role will revolve around designing, building, and maintaining robust data pipelines and infrastructure to drive data-driven insights. Core responsibilities include architecting scalable and fault-tolerant pipelines to extract, transform, and load data from various sources into data warehouses or lakes. Leveraging cutting-edge tools and technologies, you'll implement ingestion, transformation, and integration processes, ensuring stringent data quality through validation, cleansing, and deduplication. You'll design and implement high-performance, scalable, and cost-efficient data storage solutions. Utilizing CI/CD principles, you'll automate infrastructure deployment and maintenance processes, ensuring a streamlined data ecosystem. Data modeling and engineering will be crucial, involving designing and implementing optimized data models, developing and maintaining ETL processes, and collaborating with analysts and functional managers to understand data needs and provide tailored data structures. Ensuring data governance, security, and compliance will be paramount. You'll implement robust policies and processes, enforce access controls, encryption, and auditing mechanisms, and collaborate cross-functionally to establish and maintain data governance standards. Continuous improvement and automation will be woven into your daily activities, continuously evaluating and optimizing processes, pipelines, and infrastructure, implementing automation and monitoring tools, and staying ahead of emerging data engineering technologies and trends. BASIC QUALIFICATIONS: 3+ years of data engineering experience with data modeling, warehousing and building ETL pipelines Knowledge of professional software engineering & best practices for full software development life cycle, including coding standards, software architectures, code reviews, source control management, continuous deployments, testing, and operational excellence Knowledge of distributed systems as it pertains to data storage and computing Experience with SQL A good candidate can partner with business owners directly to understand their requirements and provide data which can help them observe patterns and spot anomalies. Bachelor's degree in computer science, engineering, analytics, mathematics, statistics, IT or equivalent PREFERRED QUALIFICATIONS: Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions Experience with non-relational databases / data stores (object storage, document or key-value stores, graph databases, column-family databases) Master's degree in computer science, engineering, analytics, mathematics, statistics, IT or equivalent Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS Experience building world-class data environments with a high emphasis on data quality and data security Strong problem-solving and analytical skills, with the ability to translate business requirements into technical solutions Story Behind the Need - Business Group & Key Projects: Business Group: AWS Candidate Requirements: REQUIRED SKILLS: Looking for Sr. Data engineer Very comfortable with Data modelling, data warehousing ETL, Scripting. Orchestration, Data Pipeline, Taxonomy Python, Scala or Spark, SQL Looking for someone who is already AWS cloud services like S3, lambda, glue, EMR, Lake formation, step function, ec2 Experience with AWS services with minimum 2 years is a Must Years of Experience: 5+ years of experience Degree or Certification: BS in Computer science or Statistics or engineering Masters Preferred Data engineer Certification AWS certification Top 3 must-have hard skills: AWS Cloud services Data engineering Python or Scala TekWissen® Group is an equal opportunity employer supporting workforce diversity.
Created: 2024-10-16