Senior Data Engineer

$59.50 - $85.00 (est. hourly)Job Summary:Our client is seeking a Senior Data Engineer to join their team! This position is located in Glendale, California.Duties:Contribute to maintaining, updating, and expanding existing Core Data platform data pipelinesBuild tools and services to support data discovery, lineage, governance, and privacyCollaborate with other software/data engineers and cross-functional teamsTech stack includes Airflow, Spark, Databricks, Delta Lake, Snowflake, Kubernetes, and AWSCollaborate with product managers, architects, and other engineers to drive the success of the Core Data platformContribute to developing and documenting both internal and external standards and best practices for pipeline configurations, naming conventions, and moreEnsure high operational efficiency and quality of the Core Data platform datasets to ensure solutions meet SLAs and project reliability and accuracy for all stakeholdersBe an active participant and advocate of agile/scrum ceremonies to collaborate and improve processes for the teamEngage with and understand customers, forming relationships to prioritize both innovative new offerings and incremental platform improvementsMaintain detailed documentation of work and changes to support data quality and data governance requirementsDesired Skills/Experience:5+ years of data engineering experience developing large data pipelinesProficiency in at least one major programming languageStrong SQL skills and ability to create queries to analyze complex datasetsHands-on production environment experience with distributed processing systems such as SparkHands-on production experience with data pipeline orchestration systems such as Airflow for creating and maintaining data pipelinesExperience with at least one major Massively Parallel Processing (MPP) or cloud database technologyExperience in developing APIs with GraphQLDeep understanding of AWS or other cloud providers as well as infrastructure as codeFamiliarity with Data Modeling techniques and Data Warehousing standard methodologies and practicesAdvanced understanding of OLTP vs. OLAP environmentsBenefits:Medical, Dental, & Vision Insurance Plans401K offered

Created: 2025-01-16