Data Engineer

Key Skills

AWS, Java Programming, Python Programming, Scala Programming, SQL

Job Description

The Data Engineer is responsible for leading the migration of legacy systems to the Data Lake and providing technical leadership in support of Trepp’s initiatives in data ingestion and pipeline automation, with a focus on the design and implementation of Spark/EMR and streaming platforms. The Data Engineer reports into the Data Engineering organization. 

The ideal candidate will have a bachelor’s degree in Computer Science or closely related subject; an advanced degree is preferred. In addition, 7 or more years’ experience in migrating complex IT systems in enterprise organizations. The position requires strong technical skills and must be able to collaborate effectively with a group of high performing individuals. The position requires an individual who can collaborate on setting mid/long term goals and objectives, then be self-directed to estimate timelines and take ownership of the work, while communicating with stakeholders on a regular basis. The data engineering role sets an example for junior team members through modelling best practices and provides guidance during weekly team calls, feedback through code reviews etc., and generally supports the knowledge and skills development of junior team members. 

Data Engineering, Design and Development Requirements: 

• Demonstrate knowledge of batch and streaming pipelines technologies
• Be responsible for core analytics, data lake and date pipeline products.
• Demonstrate knowledge of Data Quality and Data Governance.
• Build data applications, products, integrate with third-party data and technology platforms.
• Demonstrate expertise in comprehension and construction of complex SQL queries
• Act as a Subject Matter Expert to the organization for Trepp’s ingestion frameworks, including AWS and future providers, networking, provisioning, and management 
• Demonstrate leadership ability to back decisions with research and the “why,” and articulate several options, the pros and cons for each, and a recommendation 
• Maintain overall industry knowledge on latest trends, technology, etc.

Qualifications: 

• Bachelor’s degree in computer science, systems analysis or a related study, or equivalent experience 
• 7+ years of experience with Python or Java, or Scala and AWS (Lambda, ECS, EMR)
• 7+ years of experience with SQL (DDL, DML, complex queries)
• Experience with SQL RDBMS implementations and RDS is a plus
• Experience with AWS enterprise implementations (Lambda, ECS, Spark, Kinesis, DMS)
• Experience with Spark / EMR (or similar) implementations
• Exposure to multiple, diverse technologies and processing environments 
• Knowledge of components within a technical architecture
• Experience with Agile and SDLC, Git workflows, and CI/CD
• Strong preference for process and documentation
• Strong understanding of network architecture and application development methodologies.

Salary Range: 

• Base salary starting from $180k plus bonus eligible

Benefits and Perks

• Base + target bonus compensation structure
• Medical, Dental, Vision insurance
• 401K (with employer match)
• Life insurance, long term disability, short term disability all covered by the company
• Flexible paid time off (PTO)
• Sixteen (16) weeks paid primary caregiver leave(Biological, adoptive, and foster parents are all eligible)
• Four (4) weeks paid parental leave
• Pet insurance
• Laptop ​+ WFH equipment​
• Career progression plan
• Pre-tax commuter benefit with company subsidy (For NYC-office based employees only)
• Involvement in Diversity and Inclusion programs
• Fun company events and volunteering opportunities

Workplace Policy:

NYC, Dallas, and London office-based positions: Trepp’s offices follows a 3-2 hybrid-working policy with the expectation of in-office work on Tuesday-Thursday and the option to work from home on Monday and Friday. 

Remote positions: Employees in remote roles have the option of working remotely and may occasionally travel to a Trepp office or elsewhere for required meetings or team-building events. 

Applicants for employment in the US must have work authorization that does not now or in the future require sponsorship of a visa for employment authorization in the United States and with Trepp (i.e., H1-B visa, F-1 visa (OPT), TN visa or any other non-immigrant status).