PySpark Developer
Pinnacle Group, Inc. - jersey city, NJ
Apply NowJob Description
Job Title: PySpark DeveloperLocation: Jersey City, NJ OR Columbus, OH (Hybrid 3 days onsite)Contract to Hire**No C2C**GC & USC onlyRequiredAnalysis of data to drive design on assigned projects. Develop APIs, Data ingestion pipelines using AWS services and create notebooks in databricks.Design, Develop and modify Databricks notebooks using PySpark. Perform root cause analysis for long running jobs and implement solutions.Understand current data flow architecture and rewrite the code to process data in AWSDatabricks platform.Agile SDLC Strong experience is strongly preferred. Ingest data into AWS data platform for various use cases which include real time streaming, batch processing etc. Maintain technical acumen by pursuing formal and informal learning opportunities about technology.
Created: 2024-07-07