Sr. Data Engineer (Poland)

Key Skills

Amazon Simple Storage Service (S3), AWS, B2B, CircleCI, Data Analysis, Data Engineering, Data Lake, Data Modeling, Data pipelines, Docker, DynamoDB, ETL/ELT technologies, Machine learning techniques, NoSQL, Postgres, Python Programming, SDLC, SQL

Job Description

Craft is looking for an experienced and motivated Data Engineer to join a team responsible for a key product within the organization. As a core member of this team you will have a great say in how solutions are engineered and delivered. Craft gives engineers a lot of responsibility, which is matched by our investment in their growth and development.

We’re growing quickly and looking to hire data engineers for several of our teams. Each team is looking for someone with strong data engineering experience, Python coding experience, and solid software engineering practices. In addition to those skills, each team has a more specific list of qualifications that they’re targeting based on the specific needs of the team. If you feel that you could be a fit for one or multiple teams here, please apply and we’ll be sure to discuss each team and their needs during the initial interview!

What You'll Do:

• Building and optimizing data pipelines (batch and streaming).

• Extracting, analyzing and modeling of rich and diverse datasets.

• Designing software that is easily testable and maintainable.

• Support Data Engineering Lead in setting data strategies and vision.

• Keep track of emerging technologies and trends in the Data Engineering world, incorporating modern tooling and best practices at Craft.

• Work on extendable data processing systems that allows to add and scale pipelines.

• Apply machine learning techniques such as anomaly detection, clustering, regression classification, summarisation to extract value from our data sets.

What We're Looking For (General Qualifications):

• 4+ years of experience in Data Engineering.

• 4+ years of experience with Python.

• Experience in developing, maintaining, and ensuring the reliability, scalability, fault tolerance and observability of data pipelines in a production environment.

• Strong knowledge of SDLC and solid software engineering practices.

• Knowledge and experience of Amazon Web Services (AWS) and Databricks (nice to have).

• Demonstrated curiosity through asking questions, digging into new technologies, and always trying to grow.

• Strong problem solving and the ability to communicate ideas effectively.

• Familiar with infrastructure-as-code approach.

• Self-starter, independent, likes to take initiative.

• Have fundamental knowledge of data engineering techniques: ETL/ELT, batch and streaming, DWH, Data Lakes, distributed processing.

Familiarity with at least some technologies in our current tech stack:

• Python, PySpark, Pandas, SQL (PostgreSQL), Airflow, Docker

• Databricks & AWS (S3, Batch, Athena, RDS, DynamoDB, Glue, ECS)

• CircleCI, GitHub, Terraform

What Each Team is Looking For (Team Specific Qualifications):

• One team is looking for someone who is more of a Data Platform Engineer. The focus will be on data platform development and creating and maintaining reusable components and tools for data engineers to build high-quality data services. Looking for: experience with AWS, Databricks, Spark/PySpark (including Spark Structured Streaming), PostgreSQL, CDC solutions, Kafka, and data lakes.

• Another team is looking for a Data Engineer with Back-End Experience. The focus will be on API development and traditional data engineering tasks. Looking for: strong background in Python plus experience with Pandas, data transformations, asyncio, creating APIs (GraphQL, microservices), loading for API consumption, orchestration with Airflow, Kafka, NoSQL and SQL databases, and building data pipelines

• Same team as above is also looking for a Data Engineer with search engine experience (Elastic Search). The focus will be on search engine development. Looking for: experience with ElasticSearch, some level of knowledge of Golang (or willingness to learn), strong background in Python plus experience with Pandas, data transformations, asyncio, creating APIs (GraphQL, microservices), loading for API consumption, orchestration with Airflow, Kafka, NoSQL and SQL databases, and building data pipelines.

Please note: Experience with all technologies is not required to be considered for any of these roles.

What We Offer:

• Option to work as a B2B contractor or full-time employee

• Competitive salary at a well-funded, fast-growing startup

• PTO days so you can take the time you need to refresh!

• Full-time employees: 28 PTO days allotted + 13 public holidays (41 total paid days off)

• B2B contractors: 15 PTO days allotted + 13 public holidays (28 total paid days off)

• Uncapped sick leave so you can focus on your health when you need it

• 100% remote work (or hybrid if you prefer! We have coworking place in center of Warsaw.)

A Note to Candidates:

We are an equal opportunity employer who values and encourages diversity, equity and belonging at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, caste, or disability status.