Data Engineer II

Key Skills

Amazon Simple Storage Service (S3), Apache Kafka, AWS, Azure, Continuous Integration & Continuous Delivery - CI/CD, Data Modeling, Data Warehousing, Git, GitLab, Java Programming, MongoDB, NoSQL, Python Programming, Scala Programming, SQL

Job Description

At Raven, we help farmers serve the world. This purpose guides the work and passion of our team members, who operate at the intersection of agriculture, technology, and innovation. For over 65 years, we’ve dedicated ourselves to learning more so we can grow as individuals and as a team. Today, we are united by our mission to develop a better and more sustainable planet for each of us.

Summary

Design, develop, and evaluate infrastructure, data processors, and persistence from concept through production stage, and make modifications as needed.

Essential Functions

• Work with teams generating and consuming data to understand the purpose, application, valid states, and interoperability of data needs.
• Identify needs and develop infrastructure to satisfy the data pipeline for consuming data that retains target uptime.
• Develop data processors to validate data entering the pipeline before it’s consumed by end users.
• May maintain and extend Data Governance and Data catalogs as appropriate.
• Isolate unhealthy data to retain data catalog health.
• Develop and extend tools to aid in the discovery and reporting of data for system and end user insight.
• May generate transformed data exports to support other teams.
• Aid in tracking data utilization to shape enhancements to the Data Catalog.
• Keep abreast of new developments in the domains of cloud computing and data science.

Qualifications

• Minimum of a Bachelor’s degree in Engineering, in field related to specific position.
• Architecting, implementing and maintaining end-to-end data pipelines, identifying and using adequate data storage solutions
• Helping to label, clean, standardise, create and maintain datasets within the company
• Skills:
• One or more programming languages: Linux scripting, Python, Java, R, or Scala.
• Relational and non-relational databases (SQL, NoSQL, Hadoop, MongoDB, Kafka)
• Understanding of cloud providers (AWS and/or Azure):
• E.g., S3, Athena, Lambda, SQS, SNS, Glue, DynamoDB
• Possess a solid engineering background and a passion for data
• Has curiosity to investigate data inconsistencies and is able to point out key issues
• Desirable skills:
• Experience with CI/CD pipelines, DevOps (Git. GitLab, Docker, Terraform), Computer Vision
• The basic concepts behind machine learning 
• Managing data security and privacy
• Experience with data visualization and tools such as Tableau, PowerBI, etc.
• Experience with Data Warehousing, Data Modeling.
• Well-developed problem analysis and problem-solving techniques.
• Team player who is self-motivated and has ability to work with minimal supervision.
• Ability to communicate effectively with team members and leadership staff across a wide variety of specialties.

Benefits

Not all benefits are created equal, but we’ve got you covered. Raven not only offers a wide range of benefits that encourage wellness and preventative care, but we also provide the right tools and programs to help you achieve it. Our benefits package includes medical, dental, vision, company-paid life and disability insurance and 401k. We offer workplace flexibility policies to promote work/life balance in addition to paid time off (PTO) benefit. Team Members can also take advantage of additional benefit programs such as education assistance, our onsite fitness center or fitness center reimbursement, employee assistance program (EAP) and much more.

EEOC Statement

Raven is committed to providing equal employment opportunity to all qualified employees and applicants. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, genetic information, citizenship, ancestry, marital status, protected veteran status, disability status or any other status protected by federal, state, or local law.