Senior Data Engineer

Senior Data Engineer Whippany, NJ As a Barclays Senior Data Engineer, you will be joining our expanding Surveillance development team in Whippany office. You will be involved in holistic surveillance build out which will require excellent understanding and hands-on experience in big data (Hadoop - Cloudera stack) technologies like hive, spark, Kafka, Angular JS to architect, develop and support sophisticated analytics pipeline using Machine Learning algorithms. Barclays is one of the world's largest and most respected financial institutions, with 329 years of success, quality and innovation behind us. We offer careers that provide endless opportunity - helping millions of individuals and businesses thrive, and creating financial and digital solutions that the world now takes for granted. What will you be doing? Designing, and developing analytical model using Big Data Technologies like Hadoop, Spark/Scala, Hive, python, Kafka, and the like Building of graph ingestion process and support graph User-Interface development using DataStax, Gremlin, D3, Angular Designing robust code from the point of view of performance, reuse and supportability, proper controls, consistent with best practices and with appropriate documentation Supporting the migration of Hadoop cluster which includes migration of feeds, ETL processes (Ab-Initio), scripts, Autosys, and machine learning models/code Implementing the organization mandated SDLC /Agile processes and built in controls for consistent delivery Demonstrating a proactive attitude while identifying or approaching a problem Showing the ability to identify the root cause, coming up with an efficient solution and if needed appropriately escalate issues and risks Discussing requirements and testing details with Tech Lead, Data Scientist, QA and business stakeholders What we're looking for: Minimum 4-year college degree with hands-on experience as a big data developer 5+ years with a proven record of multiple successful deliveries Experience with Hadoop (3+ years), Spark/Scala (3+ years), Python (2+ years), Angular (2+ years), Graph technologies (2+ years), Kafka (1+ year) Hands-on in UNIX (3+ years), Autosys (2+ years), and Java (2+ years) Experience in a variety of database technologies mainly Hive, Impala, Oracle or SQL server Skills that will help you in the role: Excellent analytical skills and compliance business knowledge and extremely organized and should have good oral and written communication skills Ability to influence architecture/design and communicate effectively to Senior management and stakeholders Hands-on experience in Ab-Initio ETL tool and Tableau business intelligence tool Experience working with global team which included Data Scientist, Business analyst and developers Where will you be working? At Barclays, we are proud to be redefining the future of finance and here at Whippany we are defining the future of the workplace and the future of the way we work and live. We are creating a unique community, one of four strategic tech-enabled hubs that will redefine opportunity for everyone who works here. Whatever you do at Whippany, you'll have every chance to build a world-class career in this world-class environment. We are an equal opportunity employer and opposed to discrimination on any grounds. It is the policy of Barclays to ensure equal employment opportunity without discrimination or harassment on the basis of race, colour, creed, religion, national origin, alienage or citizenship status, age, sex, sexual orientation, gender identity or expression, marital or domestic/civil partnership status, disability, veteran status, genetic information, or any other basis protected by law.

Created: 2024-11-02