Software Engineer - Data Infrastructure (4+ years of experience)

Key Skills

Agile methodologies, Apache Airflow, Big Data Technology, Data management, Data pipelines, Effective communication skills, Infrastructure as code, Luigi, Machine learning techniques, NoSQL, Planning and organization, Project management, SQL, Teamwork

Job Description

Responsibilities:

• Design, implement, and maintain highly scalable data management systems.

• Assist in building and optimizing machine learning model data pipelines.

• You evaluate and debug your work, striving for high quality.

• Work with the broader product team to understand requirements, evaluate trade-offs, and deliver the right solutions.

• Advocate for and apply best practices when it comes to availability, scalability, operational excellence, and cost management.

Requirements:

• Bachelor's degree in Computer Science, Engineering, or a related technical field.

• Minimum of 4 years of experience in a data engineer role, with a proven track record in a technically challenging environment.

• Experience with relational SQL and NoSQL databases.

• Experience with data pipeline and workflow management tools (ex Azkaban, Luigi, Airflow, etc.)

• Experience with stream-processing systems and big data tooling

• Strong analytic skills related to working with unstructured datasets.

• Proficiency in relevant programming languages.

• Strong project management and organizational skills.

• Exposure to machine learning model pipelines is a huge plus.

• Ability to work in a fast-paced and agile development environment.

• Excellent communication and teamwork skills.

Benefits:

• Comprehensive medical, dental, and vision plans

• Anything you need to do your best work

• We’ve done team off-sites to places like Paris, London, Park City, Los Angeles, Upstate NY, and Nashville with more planned in the future.

Captions provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.