Sr. Data Engineer - AI Platforms

Key Skills

3D data processing, Aartificial intelligence, Apache Kafka, Data Engineering, Data science techniques, Databricks, ETL frameworks, Java Programming, Machine learning techniques, NoSQL, Python Programming, Scala Programming, SQL

Job Description

We are looking for a highly skilled Data Engineer with expert-level knowledge to assume a key role in managing data, both at rest and in streaming, and to lead efforts in data management and optimization. Your proficiency in ETL pipeline development, data tools and your deep understanding of data management principles will be instrumental in ensuring our data infrastructure operates efficiently.

What You Will Do

• Data Management Leadership: Provide technical leadership in data management, overseeing data at rest and data streaming, and guiding the team.

• ETL Pipeline Development: Design, develop, and maintain efficient ETL pipelines to process and transform data, ensuring data quality, integrity, and consistency.

• Databricks Expertise: Optimize data processing by using your expertise in Databricks, develop Spark-based solutions, and enhance data integration and analytics capabilities.

• Streaming Data: Manage streaming data sources and implement real-time data processing solutions using tools like Apache Kafka or similar technologies.

• Data Transformation: Implement and manage data routing, transformation, and enrichment using Cribl or similar data pipeline orchestration tools.

• Data Optimization: Work on data optimization initiatives, including performance tuning, indexing, and data compression, to ensure efficient data storage and retrieval.

• Data Security and Compliance: Collaborate with security teams to ensure data security and compliance with data privacy regulations.

• Documentation: Build comprehensive documentation for data management processes, ETL pipelines, and facilitating knowledge transfer within the team.

Basic Qualifications

• 5+ years’ experience as a Data Engineer with a deep understanding of data management, ETL pipelines and streaming data.
• 5+ years’ experience writing code using Python, Scala and/or Java.
• 2+ years’ expertise in Databricks, Apache Spark, Snowflake and/or similar data processing frameworks.
• BA / BS degree with 4+ years of experience (or) MS degree with 2+ years of experience as a data engineer.

Preferred Qualifications

• Experience with data streaming technologies (e.g., Apache Kafka, Apache Flink) and real-ime data processing.
• Familiarity with AI and machine learning concepts and the ability to work with data scientists and AI engineers.
• Familarity with scaling and designing schemas and sue cases using Vector DB's like Weaviate, Pinecode or Qdrant.
• Experience working on SQL or NoSQL data stores.
• Proficiency in tools like Cribl or similar for data pipeline orchestration and transformation.
• Knowledge of data security and compliance principles.

Why Cisco Secure

WeAreCisco, where each person is unique. We bring our talents to work as a team each day, helping power an inclusive future for all. Get to know us!

We’re global, we’re adaptable, we’re diverse, and our security portfolio is as extensive as it is groundbreaking. Have you heard of Threat, Detection & Response, Zero Trust by Duo, Common Services Engineering, or Cloud & Network Security? Those are only a few of our product teams! The only thing we’re missing is YOU.

Join an enterprise security leader with a start-up culture, committed to driving innovation and giving you the opportunity to make an impact. We #InnovateToWin and we know we’re better together, that’s why we’re dedicated to inclusivity, collaboration and diversity in everything we do.

We’re proud to be the Best Security Company in 2021 with the Best Authentication Technology and the Best Small and Mid-Size Enterprises Security Solution in 2022 by SC Media. Cisco Secure continues to grow and evolve year after year with 100% of Fortune 100 Companies using our products, and we’re excited to see the new heights we’ll reach with your passion for security, your customer focus, and your desire to change things up!

What else can you expect? An ongoing investment in your growth—that’s why we offer many employee resource groups (called Inclusive Communities), mentorship programs, and hundreds of learning resources to consistently level up your experience and explore your interests. Because when you succeed, we succeed!

Cisco Secure offers an environment that combines cool, technology with some of the brightest, most diverse set of people I’ve ever had the pleasure of working with. - Chief of Staff, Engineering