Senior Data Engineer

Key Skills

Amazon Athena, Amazon RedShift, Apache Hadoop, Apache Hive, AWS, AWS Glue, Bash scripting, Big Data Technology, Data Catalog, Data Engineering, Data science techniques, Design, Google Cloud Platform (GCP), Infrastructure as code, Python Programming, SPARK Programming, SQL

Job Description

Annalect’s unique approach to data and technology – one that relies on transparency, neutrality, and interoperability – allows us to deliver purpose-built and scalable solutions that make data actionable. Our advanced teams of product leaders, data scientists, consultants, and engineers enable us to meet the business goals of our internal and external clients.

Team Overview:

The Annalect Engineering team is an engaged and innovative group of technologists that includes backend, frontend, full-stack, and data engineers. It is comprised of remote team members who are highly collaborative and committed to a culture of work/life balance and continual learning and development.

Qualifications

Required Skills And Qualifications

• BS, MS or PhD in Computer Science, Engineering, or equivalent real-world experience 
• Significant experience with Python is essential
• Experience with big data and/or infrastructure. Bonus for having experience in setting up Petabytes of data so they can be easily accessed. Understanding of data organization, i.e., partitioning, clustering, file sizes, file formats. Data cataloging with Hive/Hive metastore or Glue or something similar.
• Experience working with relational databases.
• Experience with Hadoop, Hive, Spark, or other data processing tools
• Experience building scalable data pipelines (Airflow experience a plus)
• Significant experience working with AWS and/or GCP
• Proven ability to independently execute projects from concept to implementation to launch and to maintain a live product
• Experience designing and managing data flows
• Experience designing systems and APIs to integrate data into applications
• 8+ years of Linux, Bash, Python, and SQL experience
• 4+ years using Spark and other Hadoop ecosystem software
• 4+ years using AWS cloud services, esp. EMR, Glue, Athena, and Redshift
• 4+ years managing team of developers
• Passion for Technology: Excitement for new technology, bleeding edge applications, and a positive attitude towards solving real world challenges

Responsibilities

Position Overview:

Annalect is currently seeking a data engineer to join our technology team. In this role you will build Annalect products which sit atop cloud-based data infrastructure. We are looking for people who have a shared passion for technology, design & development, data, and fusing these disciplines together to build cool things. In this role, you will work on one or more software and data products in the Annalect Engineering Team. You will participate in technical architecture, design and development of software products as well as research and evaluation of new technical solutions.

Key Responsibilities:

• Steward data and compute environments to facilitate usage of data assets
• Design, build, test and deploy scalable and reusable systems that handle large amounts of data
• Manage small team of developers
• Perform code reviews and provide leadership and guidance to junior developers
• Learn and teach new technologies

Perks of working at Annalect

• Culture! We have an incredibly fun, collaborative environment that encourages engagement and work/life balance
• Generous PTO that includes vacation days, personal days, a fantastic Summer Friday program and extended time off around the holiday season.
• As part of Omnicom, we have the backing and resources of a global billion-dollar company, but also have the flexibility and pace of a “startup” - we move fast, break things, and innovate.

Compensation Range: $120,000 to $150,000. This is the pay range the Company believes it will pay for this position at the time of this posting. Consistent with applicable law, compensation will be determined based on

 relevant experience, other job-related qualifications/skills, and geographic location (to account for comparative cost of living)

. The Company reserves the right to modify this pay range at any time. For this role, 

Benefits include: health/vision/dental insurance, 401(k), Healthcare Flexible Spending Account, Dependence Care Flexible Spending Account, vacation, sick, personal days, paid parental leave, paid medical leave, and STD/LTD insurance benefits.