Lead Data Engineer, Data Reliability

Lead Data Engineer, Data Reliability Job ID 10103077 Location Santa Monica, California, United States / Bristol, Connecticut, United States / San Francisco, California, United States / New York, New York, United States / Seattle, Washington, United States Business Disney Entertainment & ESPN Technology Date posted Jan. 21, 2025Job Summary: On any given day at Disney Entertainment & ESPN Technology, we're reimagining ways to create magical viewing experiences for the world's most beloved stories while also transforming Disney's media business for the future. Whether that's evolving our streaming and digital products in new and immersive ways or delivering Disney's unmatched entertainment and sports content, every day is a moment to make a difference to partners and to hundreds of millions of people around the world. The Data Reliability Engineering team for Disney's Product and Data Engineering team is responsible for maintaining and improving the reliability of Disney Entertainment's big data platform, which processes hundreds of terabytes of data and billions of events daily. The Lead Data Engineer will help us in the ongoing mission of delivering outstanding services to our users allowing Disney Entertainment to be more data-driven. You will work closely with our partner teams to monitor and drive improvements for reliability and observability of their critical data pipelines and deliverables. This is a high-impact role where your work informs decisions affecting millions of consumers, with a direct tie to The Walt Disney Company's revenue. We seek people who are passionate about solving the toughest challenges and working at scale, using, supporting, and building distributed systems in a fast-paced collaborative team environment. Assist in designing and developing a platform to support incident observability and automation. Lead project work efforts internally and externally setting project deliverables, review design documents, perform code reviews and help mentor junior members of the team. Collaborate with engineering teams to improve, maintain, performance tune, and respond to incidents on our big data pipeline infrastructure. Own building out key components for observability and intelligent monitoring of data pipelines and infrastructure. Build solutions to continually improve our software release and change management process. Minimum Qualifications: 7+ years of experience working on mission critical data pipelines and ETL systems. 7+ years of hands-on experience with big data technology, systems and tools such as AWS, Hadoop, Hive, and Snowflake. Expertise with common Data Engineering languages such as Python, Scala, Java, SQL. Experience with workflow orchestration tools such as Airflow. Deep understanding of end-to-end pipeline design and implementation. Bachelor's degree in Computer Science, Information Systems, Software, Electrical or Electronics Engineering, or comparable field of study. #DISNEYTECH #J-18808-Ljbffr

Created: 2025-03-01