W2 Only - Data Engineer IV

Position: Data EngineerLocation: Philadelphia, PA (1900 Market Street)Role OverviewWe are looking for an experienced Data Engineer to design, develop, and maintain robust data models and ETL processes. The ideal candidate will have a strong background in data modeling, integration, and AWS cloud technologies, coupled with expertise in data management practices within a financial context.Key ResponsibilitiesData Model and Structure DefinitionDevelop conceptual, logical, and physical data models across diverse financial datasets.Collaborate with product management and the economic research team to gather requirements and translate them into data models that align with transactional, analytical, and operational objectives.Ensure data models are structured to support business goals and are optimized for performance and reliability.Data Integration and ETLDesign and implement ETL processes to effectively integrate data from various sources into data lakes.Maintain high data quality, consistency, and integrity throughout the data lifecycle.Create and manage documentation for data models and ETL processes.Minimum RequirementsAWS Expertise: 5+ years of experience working with AWS technologies such as S3, Redshift, and RDS.DBT: 3+ years of hands-on experience with dbt (Data Build Tool) for data transformation.Orchestration Tools: 3+ years of experience with orchestration tools like Airflow, Prefect, or Dagster.Programming Skills: Proficiency in Python or Java.Big Data Familiarity: Knowledge of big data technologies such as Hadoop, Spark, Kafka, Delta Lake, Iceberg, and Arrow.Data Governance: Experience with data governance tools like Monte Carlo or Atlan.Problem-Solving and Communication: Strong analytical skills with the ability to work effectively in a collaborative team environment.If you believe you are in the job market or interested in making a change, please email me the resume along with contact details on .

Created: 2024-11-17