Senior Data Engineer
BrickRed Systems - beaverton, OR
Apply NowJob Description
We are looking for a Lead Data Engineer to join our team. The ideal candidate will play a key role in designing and implementing scalable, high-performance data lake solutions. You will be responsible for database management, creating data pipelines, optimizing storage strategies, and ensuring the security and integrity of data systems. The role requires deep expertise in cloud technologies, big data tools, and relational data modeling.Key Responsibilities:Design, develop, and maintain scalable cloud-based data lakes and pipelines using technologies such as Spark and Airflow.Implement data architecture solutions on platforms like Databricks or AWS to support big data workflows.Manage database systems, ensuring optimal performance, security, and scalability.Collaborate with business and technical teams to understand requirements and translate them into data architecture designs.Develop and maintain database standards, guidelines, and best practices.Use source control tools such as GitHub and implement CICD processes for data pipeline automation.Assist in designing user interfaces and business application prototypes.Provide expertise in data modeling, table design, and relational database organization.Participate in quality assurance and develop test application code in client-server environments.Qualifications:Bachelor's or Master's degree in Computer Science, Engineering, or related technical field, or equivalent experience.7+ years of experience in Data Engineering, with a focus on building scalable data solutions.Strong experience with big data tools like Spark, Airflow, and DatabricksAWS for building data pipelines.Proficiency with version control systems like GitHub and CICD pipeline integration.Experience working with cloud data lakes and large-scale data architectures.Familiarity with performance tuning, database optimization, and security best practices in cloud environments.About BrickRed Systems:BrickRed Systems is a global leader in next-generation technology, consulting, and business process service companies. We enable clients to navigate their digital transformation. BrickRed Systems delivers a range of consulting services to our clients across multiple industries around the world. Our practices employ highly skilled and experienced individuals with a client-centric passion for innovation and delivery excellence. With ISO 27001 and ISO 9001 certification and over a decade of experience in managing the systems and workings of global enterprises, we harness the power of cognitive computing hyper-automation, robotics, cloud, analytics, and emerging technologies to help our clients adapt to the digital world and make them successful. Our always-on learning agenda drives their continuous improvement through building and transferring digital skills, expertise, and ideas from our innovation ecosystem.
Created: 2024-10-21