Senior Software Engineer, Data Platform

About Stack: Stack is developing revolutionary AI and advanced autonomous systems designed to enhance safety, reliability, and efficiency of modern operations. Stack's autonomous technology incorporates cutting-edge advancements in artificial intelligence, robotics, machine learning, and cloud technologies, empowering us to create innovative solutions that address the needs and challenges of the dynamic trucking transportation industry. With decades of experience creating and deploying real world systems for demanding environments, the Stack team is dedicated to developing an autonomous solution ecosystem tailored to the trucking industry's unique demands. About the Team: The Data Platform team is part of the Platform Infrastructure Engineering and Reliability group, and is responsible for designing, implementing and maintaining the Stack AV on-premises data platform. The team supports large scale OLAP/OLTP and feature engineering workloads for multiple Product Development groups across the company. The team is tasked with building a highly-available and scalable data infrastructure to power our critical services and pipelines. Members of the team are expected to have a strong focus on requirements gathering and design process to ensure our platform meets the needs of the business and our internal customers. Responsibilities: Design, implement, maintain, and operate the on-premises data platform for large-scale OLAP/OLTP and feature engineering workloads. Engage in requirements gathering and participate in the design process to align the platform with business and internal customer needs. Provide production-grade support to internal engineering teams, emphasizing observability, instrumentation, and defined service level objectives (SLOs). Collaborate cross-functionally within the organization to meet customer use cases and deliver business value. Automate routine administrative tasks and create alerts to proactively identify system issues. Identify and implement new features in OSS products to support business needs, contribute these improvements back to OSS projects. Work with outside vendors by providing critical product feedback and advocating for new features and changes to support business needs. Develop and implement security best practices at the data, application, infrastructure layers. Troubleshoot performance issues and identify / eliminate performance bottlenecks in any part of the system stack. Qualifications: Computer Science degree (or equivalent experience will be considered). 7+ years of total experience with at least some of that running a service and providing support to users. Expert Level Programming skills in 2+ languages like Python, Java, C++ or SQL, hands on experience running Trino (or Presto), familiarity with Object Storage and open table formats such as Iceberg, DeltaLake, experience with Apache Spark, hands on experience with Terraform, Kubernetes and ArgoCD. Strong Communications Skills, ability to provide and receive constructive feedback, willingness to participate in daily stand-ups, desire to learn new technologies and keep up to date with industry trends and technology advancements. #LI-SS1 We are proud to be an equal opportunity workplace. We believe that diverse teams produce the best ideas and outcomes. We are committed to building a culture of inclusion, entrepreneurship, and innovation across gender, race, age, sexual orientation, religion, disability, and identity. Check out our Privacy Policy. Please Note: Pursuant to its business activities and use of technology, Stack AV complies with all applicable U.S. national security laws, regulations, and administrative requirements, which can restrict Stack AV's ability to employ certain persons in certain positions pursuant to a range of national security-related requirements. As such, this position may be contingent upon Stack AV verifying a candidate's residence, U.S. person status, and/or citizenship status. This position may also involve working with software and technologies subject to U.S. export control regulations. Under these regulations, it may be necessary for Stack AV to obtain a U.S. government export license prior to releasing its technologies to certain persons. If Stack AV determines that a candidate's residence, U.S. person status, and/or citizenship status will require a license, prohibit the candidate from working in this position, or otherwise be subject to national security-related restrictions, Stack AV expressly reserves the right to either consider the candidate for a different position that is not subject to such restrictions, on whatever terms and conditions Stack AV shall establish in its sole discretion, or, in the alternative, decline to move forward with the candidate's application.

Created: 2024-11-05