Application Enablement - Senior Data Engineer (Hybrid)

Qualifications B.Sc. or higher degree in computer sciences or an equivalent field required 3-6 years of relevant experience Solid experience with AWS services (S3, IAM, Redshift, Sagemaker, Glue, Lambda, Step Functions, CloudWatch) Experience with platforms like Databricks, Dataiku Proficient in Python / Java Proficient in Jenkins, CloudFormation, Terraform, Git, Docker 2-3 years of Spark - PySpark Ability to work in cross functional teams Responsibilities Data Engineer for Application Enablement will be part of the Scientific data consumption product team In this role, they will work with product teams, technical teams, SMEs and stakeholders to define, design, develop and maintain data products In this role, they will work closely with multi-disciplinary teams helping to solve complex data problems and building data products to enable AI/ML They will have to understand complexities in Research data and work with product team to make data understandable and analytics ready The Scientific Data Consumption Product Line (SDC) provides a combination of technology, infrastructure, software, and personnel to support large scale scientific data consumption and computing comprising of the Scientific Data Platform, Modeling and Machine Learning Platforms, High Performance Computing (HPC) workflows, and "experience" products such as visualization, modeling workbenches, and analytics development environments Design, develop and maintain data pipelines to extract data from a variety of sources and populate data lake and data warehouse Develop the various data transformation rules and data modeling capabilities Collaborate with Product Analyst, Data Scientists, and Machine Learning Engineers to identify and transform data to make data understandable Work with data governance team and implement data quality checks and maintain data catalogs Use Orchestration, logging, and monitoring tools to build resilient pipelines Use test driven development methodology when building ELT/ETL pipelines Use Git for version control and understand various branching strategies Work as part of an agile team Create technical documentation as needed Benefits Final determinations with respect to salary will take into account a number of factors, which may include, but not be limited to the primary work location and the chosen candidate's relevant skills, experience, and education Available benefits include bonus eligibility, health care and other insurance benefits (for employee and family), retirement benefits, paid holidays, vacation, and sick days Remember to check your CV before applying Also, ensure you read through all the requirements related to this role. #J-18808-Ljbffr Remote working/work at home options are available for this role.

Created: 2025-01-01