Data Engineer

Piper Companies is looking for a Data Engineer to join an elite environmental industrial engineering firm in Washington, DC, to cluster large datasets across various container and data platforms.Please make an application promptly if you are a good match for this role due to high levels of interest.Responsibilities of the Data Engineer include:Achieve and maintain proficiency with cluster and framework sizing, installation, debugging, performance optimization, migration, security and automation.Collaborate with data scientists, analysts, business users, and IT teams to design, implement, and deploy data services and analytics.Use Continuous Integration/Continuous Delivery (CI/CD) concepts to engineer a standardized data environment.Recommend and advise on optimal data models for data ingestion, integration, and visualization.Integrate data from a variety of data source types.Qualifications for the Data Engineer include:6 years of experience in data engineering.3+ years cloud experience: Azure, AWS, or Google Cloud Platform.Experience with Snowflake, Databricks, Spark SQL, PySpark.Expertise with Python.Bachelors or Masters Degree in relevant field of study preferred.Compensation for the Data Engineer includes:Salary: $135,000-145,000.Comprehensive Benefits Package: Cigna Medical, Cigna Dental, Vision, 401K w/ADP.#J-18808-Ljbffr

Created: 2024-11-05