Sr. Software Engineer

Sr. Software Engineer LOCATION | Portland or Remote Job Description The Hydrolix data lake platform allows data scientists to drastically improve their model training and development velocity. Our platform integrates seamlessly with state-of-the-art model development technologies. At Hydrolix, you'll play a pivotal role in building infrastructure solutions targeted at the developer ecosystem for model development. You'll find creative ways to unlock the power of the Hydrolix platform for a broad set of developers. Key Responsibilities Develop robust, efficient, and performant backend systems for querying and processing massive datasets. Design, build, and optimize integrations with distributed processing frameworks like Apache Spark. Collaborate with various teams including Core Platform, Data Intake, API, Product, and Sales to understand customer needs and develop innovative solutions. Contribute to research and engineering decisions, particularly in the areas of integration with Spark environments in AWS EMR, Microsoft Fabric, and Snowflake. Enhance our data processing capabilities and develop advanced features. Work across various components of our platform, from data ingestion pipelines to performance optimization and third-party integrations. Qualifications and Skills Highly experienced backend distributed systems developer, with a proven ability to deliver high quality production software on Linux/Unix platforms. Proficiency in one or more compiled programming languages, Scala or Java. Experience with distributed systems and distributed processing frameworks, such as Spark, Hive, Trino. Familiarity with open table formats like Apache Iceberg, Apache Hudi, and Delta Lake. Familiarity with open storage formats like Parquet and Avro. Curious mindset with a demonstrated ability to learn new technologies and programming languages. Exceptional analytical, communication, and problem-solving skills. To apply, please send your resume, cover letter, and any relevant references to . We look forward to seeing how you can make an impact at Hydrolix. Hydrolix provides equal employment opportunities without regard to an applicant's race, sex, pregnancy, sexual orientation, gender identity or expression, genetic information, national origin, age, physical or mental disability, medical condition, religion, marital status, or veteran status. Applicants with disabilities may be entitled to reasonable accommodation under the terms of the Americans with Disabilities Act and certain state or local laws. A reasonable accommodation is a change in the way things are normally done which will ensure an equal employment opportunity without imposing undue hardship on Hydrolix. Please inform us if you need assistance completing any forms or to otherwise participate in the application process. #J-18808-Ljbffr

Created: 2025-02-06