Software Engineer - Machine Learning Pipelines

RWE Supply & Trading Americas, LLC To start as soon as possible, fulltime, permanent Your future plans We are building our core AI Lab team to explore creative applications of AI methods to challenges in the renewable energy industry. To help us innovate and build industry-leading AI models, we are seeking a highly motivated software engineer with a strong background in designing and implementing production-grade pipelines for machine learning models. As a key member of our engineering team, you will play a pivotal role in architecting, developing, and optimizing end-to-end pipelines that enable the deployment and scaling of advanced machine learning solutions in real-world applications. The successful candidate will play a critical role in developing and maintaining the tech stack of the lab and will work with senior scientists and engineers from a variety of fields. RWE is the third largest producer of wind power in the world, so you will have a material impact on renewable energy production across the globe. We operate a hybrid model that requires employees to be in the office at least three days per week to foster collaboration and teamwork, while offering the flexibility to work remotely as applicable. If you're passionate about building scalable pipelines for state of the art production machine learning models and thrive in a fast-paced, collaborative environment, we'd love to hear from you! Your responsibilities will include: Design, develop, and operate complex machine learning and multi-faceted data fusion pipelines in a production environment Collaborate closely with data scientists, machine learning engineers, and scientists to integrate machine learning models into scalable production systems Develop reusable components, libraries, and frameworks to streamline pipeline development and maintenance Optimize pipeline performance, reliability, and resource utilization Continually expand your knowledge of the latest advancements in machine learning technologies, cloud services, and software engineering best practices with an eye towards identifying and integrating exceptional new components into the AI lab's production repertoire Contribute to a team culture where diverse viewpoints, backgrounds and expertise are welcomed Your powerful skills 2+ years of experience building, deploying, and monitoring complex pipelines that operate at an hours-level cadence Experience in large scale data processing and distributed systems such as Apache Spark Proficiency in Python, Julia, and/or Mojo Experience with cloud computing platforms such as AWS, Azure, or Google Cloud Platform Strong understanding of containerization technologies (Docker, Kubernetes) and orchestration tools Familiarity with version control systems (e.g., Git), continuous integration/continuous deployment (CI/CD) pipelines, and infrastructure-as-code tools Excellent problem-solving skills, attention to detail, and a passion for learning and innovation Strong communication and collaboration skills, with the ability to work effectively in cross-functional teams and contribute to a positive team climate Advantageous, but not a must Experience with stream processing frameworks (e.g., Apache Kafka, Apache Flink) for real-time data ingestion and processing Knowledge of serverless computing and event-driven architectures for building scalable and cost-effective pipelines Experience with Google Cloud Platform MLOps tools (e.g., Vertex AI) Familiarity with monitoring, logging, and debugging tools for distributed systems (e.g., Prometheus, ELK Stack) Proficiency in database technologies for data storage and retrieval (e.g., PostgreSQL, MongoDB, BigQuery) Understanding of security best practices for securing data pipelines Expertise working with large geospatial weather and climate datasets as well as the Pangeo stack What we value most is passion, collaboration, diversity of backgrounds and expertise, willingness to learn and innovate, and a determined and resilient work ethic. Even if you think you do not yet display all the skills above, we would still like to hear from you. Our offer We really appreciate you going the extra mile and using every ounce of energy when the heat is on. That's why we want to make your time with us as enjoyable as possible. At RWE Supply & Trading we value our employees and strive to create a supportive and inclusive work environment. With a range of competitive benefits, we not only offer excellent development prospects and an attractive remuneration package, but also take care of your well-being and understand that life-work integration is essential. Also our offer includes the following perks: Task oriented and hybrid working model Diverse and multicultural team in a highly dynamic and rapidly growing business Relocation expenses for moving to the greater Seattle area if you are not already local Salary: $120,000 - $170,000 /career Any questions? Patrycja Bartela (Recruiting), E: Apply now with just a few clicks: ad code 88351 We look forward to meeting you! We value diversity and therefore welcome all applications, irrespective of sex, disability, nationality, ethnic and social background, religion and beliefs, age or sexual orientation and identity. Of course, you can find us on LinkedIn, Facebook, Twitter and Xing, too. RWE Supply & Trading is the interface between RWE and the energy markets around the world. Around 2,000 employees from over 70 different countries trade electricity, gas, commodities and CO2 emission allowances. The trading entity also ensures the commercial optimisation of RWE's power plant dispatch and markets electricity from RWE.

Created: 2024-11-05