Data Engineer

Job DescriptionData Engineer• Strong experience in python and Java programming with working knowledge of micro-services architecture.• Good experience Bigdata programming and Hadoop. Good understanding and knowledge of best practices for Hadoop, data modeling, data integration, data pipe-lining and data delivery.• Good experience in Spark, need to be able to tune the spark jobs.• Conduct code reviews to ensure adherence to quality standards.• Experience with design, implementation and optimization of large-scale data and analytics solution• Experience in building automated data pipelines and data stores including designing, implementing, testing, debugging, and deploying.• Experience in building metadata driven solutions that are reusable and highly configurable.• Experience in development of scripts using Unix, Python, etc for loading, extracting and transforming data.• Experience in developing production-ready data ingestion and processing pipelines using Java, Spark, Scala, Python.• Implement best practices for data engineering, including data modeling, performance optimization, and monitoring.• Excellent communication and analytical skills.• Proven experience as a technical lead or similar role in data engineering.• Strong understanding of data warehousing and data architecture principles.• Proficiency in SQL and other data manipulation languages.• Experience in data visualization tools and data integration platforms.

Created: 2025-02-21