Lead Full Stack Engineer -AI Data Engineer
Info Way Solutions - cary, NC
Apply NowJob Description
Lead Full Stack Engineer -AI Data Engineer Location - Cary NC (Hybrid) Key Responsibilities: • Hands on development and setup of data pipelines, databases, and data sources to build Client and AI apps. • Develop architecture and solution designs to deliver capabilities and features. • Develop iterative plans and strategies. Estimate as part of release plan and iteration planning • Mentor, motivate, influence, drive innovation, and coach broader technical team. Provide technical and solution guidance to the team. Conduct design and code reviews for the team delivery. • Oversight of junior developer and vendor development work • Key participant in user story breakdowns, user story elaboration, and user story reviews • Help drive broader understanding of AI tools and technologies • Serve as an escalation point for deployments, and change oversight, enabling highly visible business priorities. • Responsible for developing and maintaining SRE runbooks, and being available to diagnose and resolve production issues. Required Experience • 8+ years hands on development of realtime and batch data pipelines. • Data pipeline development using ETL tools to collect, process and transform raw data • Database setup on Azure or AWS for structured and unstructured data- PostgreSQL, MongoDB, CosmosDB, etc. • Use of tools to store, process, and retrieve data - Hadoop, Spark, Kafka, API's, data lakes • Expertise in programming languages and libraries - Python, Scala, PyTorch, NumPy, Pandas • 5+ years hands on DevOps skills. Prefer Azure DevOps otherwise similar alternate technologies is a must. • Hands on experimentation with prompt engineering, semantic search and GenAI • Advanced knowledge of the principles in software engineering. • 10+ years related work experience successfully delivered on large, complex projects with demonstrated technical leadership in delivery. Preferred Experience • BS/MS in Comp Science/IS. • Development of Semantic search using vector databases or similar solutions • Experience in structuring and creating training datasets for GenAI • Experience working in cross-functional, multi-location teams. Experience in SAFe, Agile methodology, tools, and Agile integration with Waterfall.
Created: 2024-10-29