AWS Databricks Architect

The Possibilities are Endless When You ChallengeTheNorm Birlasoft combines the power of domain, enterprise, and digital technologies to reimagine business processes for customers and their ecosystem. Its consultative and design thinking approach makes societies more productive by helping customers run businesses. As part of the multibillion-dollar diversified CK Birla Group, Birlasoft with its 12,500+ professionals, is committed to continuing the Group's 162-year heritage of building sustainable communities. Job Title: AWS Databricks Architect Location: Raritan, NJ (Onsite 4-5 days onsite) Duration: FTE We are seeking an experienced AWS Databricks Architect to design and implement scalable, efficient data pipelines and architectures leveraging AWS services and Databricks. The ideal candidate will have a strong background in data engineering, cloud infrastructure, and analytics, with a focus on building end-to-end data solutions. Key Responsibilities: Architect and manage comprehensive data solutions on AWS, using Databricks for data engineering, machine learning, and advanced analytics. Integrate AWS services (e.g., S3, Redshift, EMR) with Databricks to build and optimize data pipelines for ETL, data processing, and real-time analytics. Optimize performance, scalability, and cost-efficiency of data storage, processing, and modelling within Databricks and AWS environments. Collaborate with data scientists, engineers, and business stakeholders to translate business needs into scalable technical solutions. Ensure the security, compliance, and governance of data across AWS and Databricks platforms. Qualifications : At least 10 years of experience in Data engineering and architecture Proven experience in AWS architecture and Databricks. Strong expertise in data engineering, cloud services (AWS), and analytics. Ability to collaborate with cross-functional teams and translate business requirements into technical designs. Experience in optimizing cloud costs, performance tuning, and ensuring data governance

Created: 2024-11-05