Big Data Engineer

Dice is the leading career destination for tech experts at every stage of their careers. Our client, Jobot, is seeking the following. Apply via Dice today!Candidates should take the time to read all the elements of this job advert carefully Please make your application promptly.Leading Edge Technology. Remote! Recognized as one of the best places to work! Great Benefits!This Jobot Job is hosted by: Brooke MeyerAre you a fit? Easy Apply now by clicking the "Apply Now" button and sending us your resume.Salary: $120,000 - $170,500 per yearA bit about us:Serving the marketing and advertising industry. We bring together real-time survey data and insights on millions of consumers. We provide this insightful data about online behavior all in one platform.Why join us?100% remoteBeen recognized as one of the top places to work multiple times.Great BenefitsGreat company cultureWe work with Leading Edge Technology.We offer career growth and job stability.Open PTO & 10 Company Paid Holidays401k plan.Fun cultureProfessional DevelopmentJob DetailsAs an engineering team member for the big data team, you will be responsible for the technical direction and development of critical data ingestion pipelines that power the business. You will be able to provide support and technical direction to a team of highly skilled data engineers and facilitate interaction with the technical product management team members. You will be a member of a high-quality, dedicated and friendly team passionate about delivering quality products, solving hard problems, and transforming the data and insights industry.ResponsibilitiesCollaborate in the design, planning and development of products and initiatives to deliver on product requests for the data engineering squadOversee production, quality assurance, quality control, testing and maintenance as required.Bachelor's degree in Computer Science, Computer Engineering, or equivalent7+ years experience professional experience in software engineering, data engineering, or a related field3+ years of experience in Spark/Scala DataFrame/Dataset APIsPrior experience with debugging and problem solving in Big data ecosystemProven experience in tuning multi terra byte / Peta byte scale Spark ApplicationsPrior relational database experience is requiredDeep knowledge of software architecture and engineering standard methodologies, especially modern cloud computing stacks for processing Big Data.Experience with AWS as a cloud provider, Spark, Kafka, Hadoop, Elastic Stack, Java, Docker for containers, etc.Strong understanding of the different parts of the software development lifecycle, from exploration and design to delivery to productionGood understanding of principles of solution architecture, technical design, data structures, and data modelingPrior experience with Non-functional requirement is requiredExcellent communication skillsPositive attitude and excellent teamworkPreferred QualificationsDemonstrated success in implementing scaled high cardinality data systemExperience in using probabilistic data structuresLove for open-source technologiesInterested in hearing more? Easy Apply now by clicking the "Apply Now" button. Big Data Engineer#J-18808-Ljbffr

Created: 2024-11-05