Senior Data Platform Engineer

Job Summary We are looking for a mid-level backend engineer who loves to build cloud services "” a systems engineer who is comfortable in every stage of the design, implementation, testing, and deployment process. In particular, we are hiring an engineer who can develop and deploy cloud-based data analytics services to be used by data engineers, analysts and data scientists. These initial services are similar to AWS EMR-on-EKS, EMR Studio, etc.Note: We are looking for a mid to senior level data platform engineer who is based in the Bay Area and can come to the office up to 2-3 times per week. This position requires someone who has experience building data platform tools for developers, rather than just being an end userThe Team and Our ValuesWe are a team of software engineers of various technical backgrounds and at various stages in our careers. We value diverse viewpoints and have a culture built on respect, creativity, and collaboration. We value self-motivation and self-learning; we are proactive in our actions and always eager to know more. We are always enthusiastic to share knowledge and expertise.Position Details:Location: Mountain View, CA (Hybrid/Onsite 2-3 days a weekTypeFull TimeJob ResponsibilitiesBuilding, implementing and deploying cloud services, especially data analysis-related tools.Integrate with other cloud services running in our client's private cloud.Participate in a globally distributed team of engineers that uses the cloud platforms to deliver services to include functional scoping and work distribution as subject matter expertSkills & CompetenciesStrong CS Computer Science backgroundProficiency in one of the public cloud platforms such as AWS, GCP and AzureExcellent organizational skills with the ability to set priorities and meet deadlinesVersatility in playing multiple roles and a willingness to learn new skills and take on diverse responsibilitiesProficiency in learning new techniques, languages, and toolsAbility to work with a small team of engineers to build, implement and commercialize a data analysis platform that manages tools including Spark, Flink, Airflow and SupersetStrong analytical skills for troubleshooting unexpected system pathologiesDemonstrated initiative and bias for actionInnovative mindset with the ability to work with minimal supervisionUnderstanding of Waterfall and Agile methodologiesGood communication skillsOwnership - Take ownership of projects, ensuring excellence in execution and accountability for results. Foster a sense of responsibility and pride in delivering high-quality workInnovation - Drive innovation by proposing and implementing creative solutions to challenges. Stay abreast of industry trends and technologies, bringing fresh ideas to the tableCustomer focus - Understand and prioritize customer needs, striving to exceed expectations in every interaction. Collaborate with cross-functional teams to ensure the delivery of customer-centric solutionsTeamwork - Embrace a collaborative and inclusive approach, working seamlessly with colleagues to achieve common goalsEducation & ExperienceBachelor's degree in Computer Science or related field. A graduate degree is a plus.At least 5 years of experience developing cloud services, using data platform services is a big plus.Hands on experiences in AWS-SDKs, AWS-CLI, Golang, Java, Python, SQL, TerraformHands on experiences and the internals of big data tools such Spark, Dela Lake, Jupyterhub and analytics toolsHands on experience in Docker, Kubernetes, Jenkins, Helm, Ansible and shell scriptingExperience in managing software across hundreds of servers distributed among multiple data centers, understanding the unique trade-offs and pitfalls involvedParticipation in the open-source community is a plusBlackstone Talent Group is a wholly owned subsidiary of Blackstone Technology Group, a global IT services and software firm that implements technological solutions across commercial industry verticals and the US Federal Government. Blackstone's global talent augmentation practice was founded in 1998. Blackstone Talent Group has offices in San Francisco, Denver, Houston, Colorado Springs, and Washington, DC. We specialize in providing clients the best talent across a variety of industries and sectors.

Created: 2025-01-14