Senior Software Engineer, Big Data

Key Skills

Aartificial intelligence, AWS, Big Data Technology, Data Engineering, Data Lake, DynamoDB, Java Programming, Lakehouse, Machine learning techniques, Postgres, REDIS, Software Development, Spring Boot

Job Description

We’re looking for a self-motivated, highly driven Big Data Engineer to bolster our Data Platform teams. Our team is focused on building the data platform to support data driven products and strategic outcomes for our customers. We do this by providing an extensible and flexible compute platform to access highly available, mission critical data sets.

Why Attentive needs you

• Architect high-throughput data solutions that power our most critical operations, ensuring scalability and efficiency.
• Expand and enhance our self-service data platform, collaborating with cross-functional teams to fuel our AI, ML, and analytics goals.
• Tackle complex distributed data challenges, streamline system integrations, and uphold high standards of data quality and governance.
• Lead the charge in automating data workflows, driving innovation and enabling rapid prototyping across our entire data ecosystem.
• Champion cutting-edge big data technologies, keeping our platform at the forefront of industry advancements and enabling strategic outcomes.
• Unify data from diverse systems, paving the way for experimentation and innovation while empowering teams with intuitive tools and frameworks.

About you

• Proven experience as a Big Data Engineer with a focus on large-scale data processing.
• In-depth knowledge of big data technologies such as Hadoop, Spark, Flink and/or Kafka.
• Proficiency in programming languages such as Java, Scala, or Python.
• Experience with ETL and Data pipeline orchestration tools like Apache Airflow, DBT, etc.
• Strong understanding of object-oriented design, data structures, algorithms, profiling, and optimization.
• You have development experience with data tools such as Snowflake, Google BigQuery, Databricks Lakehouse, AWS Athena, Apache Trino, or Presto.
• You’ve experience with open source data storage formats such as Apache Iceberg, Parquet, Arrow, or Hudi.
• You are knowledgeable about data modeling, data access, and data replication techniques, such as CDC.
• You have a proven track record of architecting applications at scale and maintaining infrastructure as code via Terraform.
• You are excited by new technologies but are conscious of choosing them for the right reasons.

Our scale

• 8,000 brands powered by Attentive sent over 2.2 billion text messages over Cyber Week 2023 (Black Friday/Cyber Monday) representing a growth of 31% from 2022.
• We sent 32 billion SMS messages in 2023, up 32% YoY. That’s an average of 87 million per day.
• Our production cluster contains over 18,000 containers which serve 200+ services.
• Our streaming services process over 80 billion events per month.

What we use

• We use a wide variety of technology and we’re always looking for the best solutions to solve hard problems.
• Our backend is Java / Spring Boot microservices, built with Gradle, coupled with things like DynamoDB, Pulsar, AirFlow, Postgres, Planetscale, and Redis, hosted via AWS.
• Our frontend is built with React and TypeScript, and uses best practices like GraphQL, Storybook, Radix UI, Vite, esbuild, and Playwright.

You'll get competitive perks and benefits, from health & wellness to equity, to help you bring your best self to work.

For US based applicants:

• The standard base salary range for this position is $150,000 - $220,000 annually + equity + benefits
• Our salary ranges are determined by role, level, and location.