Databricks Data Engineer
Smart IT Frame LLC - New York City, NY
Apply NowJob Description
Job Title: Databricks Data Engineer Location: NYC, NY (Hybrid)Work Type: Full TimeJob Description:-· This role will be part of the Data Strategy team spanning across the client Capital Markets and securities teams, Americas Division's broker-dealer and swap-dealer entities.· This role will be involved in the active development of the data platform in close coordination with the team, beginning with the establishment of a reference data system for securities and pricing data, and later moving to other data domains.· The consulting team will need to follow internal developments standards to contribute to the overall agenda of the Data Strategy team.· The implementation of this strategic platform on client's Azure Cloud Platform will require solutions and know-how as listed in the qualifications below.Qualifications and Skills· 10+ years of experience in software development using Python, PySpark and its frameworks.· Proven experience as a Data Engineer with experience in Azure cloud.· Experience implementing solutions using -o Azure cloud serviceso Azure Data Factoryo Azure Lake Gen 2o Azure Databaseso Azure Data Fabrico API Gateway managemento Azure Functions· Well versed with Azure Databricks· Strong SQL skills with RDMS or noSQL databases· Experience with developing API's using FastAPI or similar frameworks in Python· Familiarity with the DevOps lifecycle (git, Jenkins, etc.), CI/CD processes· Good understanding of ETL/ELT processes· Experience in financial services industry, financial instruments, asset classes and market data are a plus.
Created: 2025-02-08