Scala / Python Engineer

W2 OnlyLOCATION: On site in NYC 4 daysweekOur major streaming client is seeking a Senior Software Engineer - you will be working on building highly resilient and scalable data pipelines which will publish enriched data of transactions into their Data Lake and analytical data warehouses. This role is highly multi-functional and gives the opportunity to work with Product, Information Security, Data, Analytics, Business Operations, Finance, and various other functions across the company as they consume, enrich and publish highly impactful data.TECH STACK:1. Scala.2. Python.3. Spark.4. Databricks.RESPONSIBILITIES:-Build sophisticated and highly impactful systems-Write code in Java, Scala, Kotlin, Python, Spark-Use AWS products and services (EC2, S3, Lambda, DynamoDB, SQS, RDS, ElastiCache, CloudFront, Kinesis etc.)-Use ETL products like Databricks- critical-Use Data Warehouses like Snowflake-Develop RESTful services-Work with SQL and NoSQLREQUIRED SKILLS:- DEGREE REQUIRED IN CS or other Engineering degree-7+ years of software experience-Experience in one or more of the following:-Building large datasets and scalable services-Deploying and running services in AWS, and engineering big-data solutions using technologies like Databricks, EMR, S3, Spark-Container systems such as Docker or Kubernetes-Drive and maintain a culture of quality, innovation and experimentation-Work in an Agile environment that focuses on collaboration and teamworkAdditional Information Looking for someone who can work independently as well as in a team dynamic. Looking for previous experience in taking ownership of featurefunctionality. Previous experience creating well tested services. Ability to investigate any technical component as well as understand and contribute to overall systems architecture. This is highly sensitive and critical business integration to be supported Critical for revenue reconciliation and recognition.External Job Posting

Created: 2024-10-27