Senior Data Engineer

Our client is looking for a Data Engineer to join their team. If you specialize in Python or PySpark, data bricks and cloud-based data platforms, we'd love to hear from you! This is a hybrid role in Cincinnati, OH.Top skills you need to have:Analyze, design and develop enterprise data and information architecture deliverables, focusing on data as an asset for the enterprise. Understand and follow reusable standards, design patterns, guidelines, and configurations to deliver valuable data and information across the enterprise, including direct collaboration with , where needed.Experience designing, building, and deploying scalable cloud-based solution architecturesExpertise in creating lakehouses in Azure and building Realtime Streaming Analytics Platform leveraging Azure ServicesExperience working with public cloud platforms such as AWS, AzureExpertised in Python, SQLExperience building data lakes & data warehouses to support operational intelligence and business intelligenceExperience working with Serverless Computing & Azure FunctionsExperience with Cosmos DB, Azure Data Explorer, Azure Synapse Analytics, Azure Data Lake, Azure Data Factory, Azure SQL, Azure Databricks, Azure Machine Learning or equivalent tools & technologiesExperience with Kafka andor other event streaming mechanismsExperience with monitoringalerting techniques and APM toolsExperience automating infrastructure provisioning, DevOps, or Continuous IntegrationDeliveryKnowledge of containerization and container orchestration technologies.Expertise with Object Oriented Programming Skills and Design PatternsGood understanding andor experience writing software in one or more languages, such as Java, Go, JavaScript, C++, or similarFamiliarity with standard IT security practices such as identity and access management, SSO, data protection, encryption, certificate, and key managementFamiliarity and good understanding of infrastructure - storage, networking etc.Strong analytical problem-solving skillsExcellent written and verbal communication skillsSelf-starter takes the initiative and works well under pressureBusiness-minded approach to time, costs, and milestonesLead the analysis of the technology environment to detect critical deficiencies and recommend solutions for improvementMust be very organized, able to balance multiple priorities, and self-motivatedAzure Certifications in Associate and Expert levels for Data Services preferredFamiliarity or experience with building AIML solutions.Key Responsibilities:Drive digital innovation by leveraging innovative new technologies and approaches to renovate, extend, and transform the existing core data assets, including SQL-based, NoSQL-based, and Cloud-based data platformsDrive the development and communication of enterprise standards for data domains and data solutions, focusing on simplified integration and streamlined operational and analytical usesDesign, develop, and implement integrations based on user feedback.Collaborate with solution architects, cloud services, enterprise data management & product managers to iterate on the design & implementation of Fulfillment Services Data StrategyDesign Azure-based technical architectures, migration approaches, and application optimizations that enable the ProductDraft and review architectural diagrams, interface specifications and other design documents such as Architectural Decision RecordsFocus on overall product's data quality and user experienceBuild standards, processes and procedures to deliver best resultsCreate data pipelines for various types of streaming use casesBe a technical advisor and troubleshoot to resolve technical challenges with data product related infrastructure and application(s)Promote the reuse of data assets, including the management of the data catalog for referenceMentor team members in data principles, patterns, processes and practicesImplement automation tools and frameworks (CICD pipelines).Troubleshoot production issues and coordinate with the development team to streamline code deployment.Author and publish data governance models, data lineage and data dictionary for Fulfillment Services data catalog.

Created: 2024-11-06