Principal Data Engineer- Secureworks- 100% Remote

Key Skills

Java Programming, Python Programming, SQL, AWS, GoLang, Apache Kafka, Scala Programming, CSS3, SPARK Programming, Streaming APIs, Apache Flink, Large scale data processing, AWS Glue

Job Description

100% Remote to United States Based candidates

We are the engineering team behind Taegis , a Security Platform-as-a-Service that is beautiful, simple and a delight to use. We protect organizations by providing battle-tested, best-in-class cybersecurity solutions that reduce risks, improve security operations, and accelerate return on investment for Security and Information Technology teams.

We are hiring a senior engineer to work on our Taegis platform. You will be working on a cross-functional team that is completely remote. Ideally, you have worked on maintaining data pipelines at scale preferably using Kafka and Spark. Our technology stack is hosted in AWS (Amazon Web Services). We want to find motivated individuals who want to do their best work rather than finding someone who has done this before. If you have a curious mindset, and the drive to get things done you will fit right in.

You will be working with us on the Dataflow team. The Dataflow team is responsible for ensuring ingested customer data is trustworthy, resilient, and securely accessible to customers and applications. You will have plenty of opportunities to add your own input into our software.

We host bi-annual weeklong hackathons to display your creative and innovative side. We have components that started as hackathon projects that are now empowering the Taegis platform.

We are looking for individuals that are curious, eager to learn and are diligent and kind. Our teams work well because we place trust in them to succeed. As a senior engineer we expect you to help elevate the skills of the team through technical mentorship. We would love you to show us how we can improve what we do. 

You have about five years' industry experience, but we care less about how long you have been active and more about what you have done. We believe in radical candor and healthy debate. We like strong opinions loosely held. You should be comfortable working with remote employees, which means using video calls and frequent written communication.

Technologies and skills required to get the job done

• Knowledge of data ingest techniques (e.g., historical vs. stream processing) and related technologies (e.g., Hudi, Apache Flink, Spark, Spark Streaming, Kafka-Connect)
• Performance tuning Spark or Flink jobs
• Performance turning large scale Kafka Clusters
• Java, Scala, Golang
• Skills to reason about the design of analytics applications
• AWS S3, AWS Glue, EMR
• Docker or similar containerization technology