Principal Software Engineer, (tick history data is a ...

Full Job DescriptionWe are seeking a highly skilled and innovative Principal Software Engineer to join our Data Solutions Engineering team, part of a major initiative within the Data Solutions (DS) business unit. This position plays a critical role in developing a world-class tick data historical database, leveraging Big Data tools like Snowflake to service various client-facing applications. As part of this role, you will be working closely with Product Subject Matter Experts (SMEs) and collaborating with both internal teams and external vendors to structure, optimize, and enhance data services.Key responsibilities for this accomplished developer will include but are not limited to the following:Design and prepare tick data for ingestion into Snowflake, collaborating with internal and external teams to ensure best practices are followed.Fine-tune Snowflake database performance, managing partition keys and indexes while minimizing costs and optimizing data consumption for data pipelines for applications, including End-of-Day bulk feeds, on-demand APIs, and Snowflake data sharing.Improve tick data offerings by researching technologies, loading Level 2 data, and optimizing time-binned data access.Explore, design, and architect potential new storage layers and database architectures that could outperform Snowflake for managing tick history data. Lead proof of concept (POC) initiatives to evaluate the feasibility, performance, and scalability of these alternative solutions.Design and architect scalable APIs and data connector frameworks.Leading the architecture, design, development, and launch of high available, low latency, flexible and scalable APIs.Mentor and assist other junior engineers in design, implementation, and code reviews.Stay up to date with advancements in Big Data technologies and data warehousing tools.Ensure adherence to data security, privacy, and compliance standards.Drive innovation by evaluating emerging tools and technologies that could improve data management and performance.Determine operational feasibility by evaluating analysis, problem definition, requirements, solution development and proposed solutions.Demonstrate a thorough knowledge of data structures and algorithms, object-oriented programming, and software engineering principles.Ensuring that deployed products are properly maintained throughout their lifecycle.This position requires to participate in on-call support on a rotation basis with the team.Minimum Requirements:10+ years of related work experience with a focus on data engineering and cloud data Skills:Experience in building RESTful APIs, data pipelines, and managing bulk data processes.Expertise in database architecture, performance tuning, and data ingestion techniques.Demonstrated expertise in Python and related scripting languages to automate complex data workflows, optimize ETL processes, and develop robust data integration solutions.Strong analytical skills with the ability to make data-driven decisions.Experience working with any relational working with Cloud infrastructure (AWS, Azure etc.)Experience working with Snowflake or related technologies.Knowledge of financial market data, tick data, and Level 2 data is a big plus.Familiarity with various levels of testing - unit, regression, integration, and load is a plus.Additional or Desired Skills:Experience with finance and financial market data is a plus.Experience with Big Data technologies (e.g., Spark, Hadoop) is a plus.Understanding of Java and frameworks like Spring Boot is a plus.Familiarity building RESTful services is a plus.Experience with NoSQL storage is a plus.Experience with AWS tools and technologies is a plus.Experience with multithreaded, caching, and high availability software development is a plus.Self-starter with deep interest in learning new technologies and taking different approaches to solving complex problems.Strong written and interpersonal communication skills to interact with business analysts, peers, and management.Able to work as part of a geographically diverse team as an individual contributor and within a team as well.Ability to lead and take full ownership of assigned tasks.Ability to articulate and quickly adopt development best practices.Ability to create and review :Bachelor's Degree or equivalent in Computer Science or related fieldThe budgeted salary range for this position in the states of Connecticut and New York is $160,000.00 - $210,000.00At FactSet, we celebrate diversity of thought, experience, and perspective. We are committed to disrupting bias and a transparent hiring process. All qualified applicants will be considered for employment regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or veteran status. FactSet participates in E-VerifyFactSet is an Equal Opportunity Employer - M/F/Veteran/Disability/Sexual Orientation/Gender IdentityVEVRAA Federal ContractorRequest Priority Protected Veteran & Disabled Referrals for all of our locations within the stateThe EEO is the Law poster is available here.FactSet Research Systems Inc. endeavors to make our website accessible to any and all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please contact Jennifer Passeck, Lead Recruiting Specialist, Human Resources at +1 (203) or Opportunity Employment PolicyIt is the policy of FactSet Research Systems Inc. ("FactSet") to provide equal employment and advancement opportunities to all qualified employees and applicants for employment regardless of their race, color, religion, sex, age, sexual orientation, gender identity or expression, national origin, physical or mental disability, genetic information, protected veteran status, pregnancy, military or military reserve obligations, or any other class or status protected by law. This policy applies to all policies and procedures related to recruitment, hiring, training, promotion, compensation, benefits, transfer, discharge, and other terms and conditions of employment. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability or protected veteran status. If you have questions concerning this policy, please contact the Human Resources department at +1 (203) . Minimum Salary: 52,169 Maximum Salary: 52,169 Salary Unit: Yearly

Created: 2024-11-05