Lead Data Engineer

LEAD DATA ENGINEERSAN FRANCISCO BAY AREA (1-2 days Onsite)$200,000 - $220,000 BASE + BONUS & EQUITYTHE COMPANY:This wellness startup company focuses on developing supplements and probiotics aimed at enhancing gut health, improving digestion, and supporting metabolic balance. Leveraging scientific research and personalized data insights, the company tailors its formulations to meet individual health needs.THE ROLE:This role will design, build, and optimize the infrastructure required for seamless data flow and analytics. The role involves managing scalable data pipelines, supporting ML initiatives, and ensuring data integrity, making it ideal for a hands-on engineer who thrives in a fast-paced, high-impact environment.Design, build, and maintain scalable ETL pipelines using tools like DBT, Fivetran, and AirflowOptimize and manage data warehouse and lakehouse environments on platforms like Snowflake, ensuring data availability, reliability and performanceImplement and manage scalable workflows using Docker, Kubernetes, and other systems to automate data processing Collaborate with other teams to support ML model deployment in productionEnsure data compliance with standards and regulations (GDPR, CCPA), manage data lineage, and maintain metadata for secure data handling practices Develop and execute processes for data validation, cleansing, and anomaly detection for data quality assurance YOUR SKILLS AND EXPERIENCE:5+ YOE in data engineeringStart-Up or Retail industry experienceAdvanced SQL and Python skillsExperience working with a modern data stack (ex: Snowflake, Fivetran, dbt, airflow, etc)Strong experience with cloud platforms (GCP, AWS, Azure) and tech like Hive, Postgres, RedisProven experience working autonomously and spearheading projects with minimal oversight(Experience with Kafka, Spark, Kubernetes a plus)MUST BE AUTHORIZED TO WORK IN THE US

Created: 2025-01-14