Director, Data Engineering
Confluent - boston, MA
Apply NowJob Description
With Confluent, organizations can harness the full power of continuously flowing data to innovate and win in the modern digital world. We have a purpose that drives us to do better every day - we're creating an entirely new category within data infrastructure - data streaming. This technology will allow every organization to create experiences and use the power of data in ways that profoundly impact the way we all live. This impact is our purpose and drives us to do better every day. One Confluent. One team. One Data Streaming Platform. Data Connects Us. About the Role: Are you passionate about pushing the boundaries of what's possible with data? Do you dream of driving business growth through cutting-edge data infrastructure and innovative solutions? Join our team and help us build the central nervous system of our company, empowering better and faster decision-making through world-class data engineering and data science. Our Data Team is at the forefront of creating the data foundation and tooling that will shape the future of our organization. As a Director of Data Engineering, you will build the strategy and lead a team of high-performing Data Engineers, to execute a vision that will enable scalable, agile, and impactful data science and analytics across the company. What You Will Do: Recruit, manage, and develop a global team of data engineers, data architects, and leaders Build a robust, reliable, and 24x7 available internal data platform to power Confluent's analytic, ML, and AI use case Own and drive the vision, strategies and roadmap of Data Engineering, and lead the team to execute. Specifically, be responsible for building: Highly available, scalable and easy to use Data warehouse and foundational datasets, to enable self-serve BI reporting and analytics across the company Robust, highly available, and cost-effective Data systems and tools Streaming analytics infrastructure and data products, to build Confluent on Confluent Data governance and quality control measures Partner with BI, Data Science and x-functional stakeholders and partners, including Product, Engineering, Business Systems, and function operation teams, to align on Data Engineering teams' dependencies, roadmap, priorities, engagement model, and key processes Be a thought leader, identify high impact project opportunities and process changes, and improve productivity of the overall Data Team Oversee the design and maintenance of scalable and reliable data architecture What You Will Bring: Bachelor or advanced degree in Computer Science, Engineering, or related technical discipline 10+ years of experience in the Data Engineering domain in the industry, from companies with a strong data driven culture. 5+ years of experience managing a Data Engineering team, with a focus on partnering with Data Science, enterprise systems, and Business Unit embedded operations teams. Lead and manage the data engineering team, fostering a collaborative and high-performance culture. Hands on experience with GCP including BigQuery & Airflow Broad experience with other cloud native data solutions, tools, and infrastructure Solid understanding of DevOps practices, including Infrastructure as Code (IAC), containerization (Docker/Kubernetes), and CI/CD pipelines. Design, build, and maintain scalable data pipelines using Airflow and other orchestration tools. Ensure data governance, documentation, lineage, and compliance with industry standards and regulations. Experience with Kafka in a production environment. Working knowledge of programming languages, i.e. SQL, Python, Java/Scala Strong ability to communicate cross-functionally, derive requirements and architect; to synthesize, simplify and explain complex problems to different types of audiences, including executives. What Gives You an Edge: Experience with enterprise business systems such as Salesforce, NetSuite, Anaplan, Marketo, Zendesk, etc. Experience with other Kafka components such as Connect and Flink Product mindset to understand business needs, and come up with scalable engineering solutions Familiarity with modern data lake technologies, including Apache Iceberg, for efficient and scalable data management and query optimization Come As You Are At Confluent, equality is a core tenet of our culture. We are committed to building an inclusive global team that represents a variety of backgrounds, perspectives, beliefs, and experiences. The more diverse we are, the richer our community and the broader our impact. Employment decisions are made on the basis of job-related criteria without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or any other classification protected by applicable law. At Confluent, we are committed to providing competitive pay and benefits that are in line with industry standards. We analyze and carefully consider several factors when determining compensation, including work history, education, professional experience, and location. This position has an annual estimated salary of $221,300 - $265,500, an annual bonus, and a competitive equity package. The actual pay may vary depending on your skills, qualifications, experience, and work location. In addition, Confluent offers a wide range of employee benefits. To learn more about our benefits click HERE ( . Click HERE ( to review our Candidate Privacy Notice which describes how and when Confluent, Inc., and its group companies, collects, uses, and shares certain personal information of California job applicants and prospective employees. #LI-Remote
Created: 2024-11-05