Staff Data Engineer (R&D Software Engineer)

Key Skills

Analytical and Problem solving, Apache Airflow, Continuous Integration & Continuous Delivery - CI/CD, DevOps, Google BigQuery, Google Cloud Platform (GCP), Google Dataflow, Public Health

Job Description

Job Description:

Broadcom Software

Staff Software Engineer (Data Engineer) (ICB-4)

Hyderabad, Telangana, India

Are you motivated by designing sophisticated solutions that solve hard problems with the smartest technologists for large Fortune 500 customers? Do you enjoy working together in a team dedicated to data science and data engineering? Do you want to create, teach, learn, and innovate with us as we explore the transformational effects of intelligent automation tools in the realm of data? Join us and be part of our mission to deliver cutting-edge data solutions across diverse platforms, applications, and operating systems, as we work together to drive innovation in the world of data science and data engineering.

If this sounds exciting to you, we are looking for engineers like you to join our Agile Teams in the Shared R&D group. Our teams value respect, trust, transparency, collaboration, teamwork, having fun, and giving back to the community. We believe that diversity of thought and backgrounds makes us stronger, makes our products better, and makes our customers happier.

What you will accomplish

As a Staff Software Engineer specializing in Python, BigQuery, and Google based Data Solutions, your role will involve crafting technical designs and implementing intricate solutions within these specific domains. You'll be utilizing the power of Python and leveraging Google Cloud Platform's data tools, including but not limited to BigQuery, Dataflow, and Storage, to address the current and future requirements of our customers while strictly adhering to Secure SDLC (Software Development Life Cycle) processes. Your expertise in these areas will be instrumental in shaping the success of our projects and ensuring the delivery of top-tier data solutions. In this role, you can expect to:

• Lead the design and development of robust, scalable, and high-performance data pipelines and data warehousing solutions, utilizing GCP's data services, with a strong focus on Google BigQuery.

• Define and implement data engineering best practices, standards, and methodologies tailored to GCP's data ecosystem.

• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver data solutions that meet business needs, leveraging GCP's data tools and services.

• Oversee the integration of data from various sources within GCP, ensuring data quality, accuracy, and consistency, while capitalizing on GCP's data integration capabilities.

• Drive the adoption of modern data engineering technologies, tools, and frameworks within the GCP environment.

• Mentor and provide guidance to junior data engineers, fostering their growth and expertise in GCP data solutions.

• Perform data profiling, data cleansing, and data transformation as necessary, harnessing GCP's data manipulation and transformation tools.

• Monitor and optimize the performance of data pipelines, addressing any issues or bottlenecks within GCP's data infrastructure.

• Ensure data security, privacy, and compliance with relevant regulations (e.g., GDPR) within the context of GCP's data security features.

• Stay up-to-date with industry trends and emerging technologies in data engineering, with a focus on advancements within GCP's data ecosystem.

• Make significant contributions to designs, delivering high-quality work that advances the product stability, scale, and technology relevance to customers.

• Seek out and incorporate feedback from end users, stakeholders, and peers at every stage of the product lifecycle.

• Build strong, collaborative relationships with Product Managers, Engineering, Documentation, Support, and field teams, who assist in product adoption.

• Internalize the long-term AI powered workload automation vision, think holistically about the product and its place in our customers’ businesses, and have an influential voice in the solution roadmap.

• Work in cadence with our mature Agile teams, embracing a mindset of rapid learning, experimentation, iteration, and close collaboration.

• Thrive in an environment that balances autonomy with teamwork, rewards divergent as well as convergent thinking, and values your participation in long-term and short-term product decisions.

Skills & experience

To qualify for this position, you must have:

• Bachelor’s degree with eight (8) years software development experience, or Master’s degree with five (5) years of software development experience, or a PhD. Relevant degree fields include Computer Science, Math, Statistics, etc. coupled with certifications in technologies like Databases, Data Science, Cloud platforms, etc.

• Strong software development experience in building enterprise grade products with deep knowledge in applying System Design concepts

• Experience in collaborating with customers to understand their pain points, solve their problems; conducting solution demos of new features and gathering feedback to further improve the solution

To be successful, you will come to this role with solid coding, system design skills and a collaborative mindset:

• A track record of well-executed challenging design and implementation projects.

• Enthusiastic and proactive about collaborating with customers, Product Managers, Engineers, UX Researchers, and other technology experts in the organization to understand needs and deliver great solutions.

• Passionate about learning new technologies, new methods, and new skills.

• Measurable outcomes - You will need to set quantifiable objectives that encapsulate quality attributes of a system. The fitness of the application is measured against set marks.

• Have a good understanding of agile teams, practices, and principles.

• Ability to contribute to all stages of Secure SDLC

To really stand out as the perfect person for this role, you may also have:

• Expertise in evaluating multiple design approaches, prototyping new technologies, design systems, etc.

• Working experience in an Agile product development environment and working with large Agile teams.

• Passion for coaching, and generally sharing what you know.

• Possess expertise in designing and implementing data solutions using GCP technologies, including but not limited to:

• Google Cloud BigQuery

• Google Cloud Dataflow

• Google Cloud Storage

• Google Cloud Dataprep

• Google Cloud Dataproc

• Google Cloud Pub/Sub

• Google Cloud Composer

• Strong programming skills in Python and experience with data tools specific to GCP.

• Excellent understanding of data modeling, schema design, and data governance within the GCP environment.

• Experience with data pipeline orchestration and workflow management tools (e.g., Apache Airflow) in conjunction with GCP.

• Knowledge of DevOps practices and tools for CI/CD (Continuous Integration/Continuous Deployment) as applied to GCP data solutions.

• Exceptional problem-solving skills and the ability to troubleshoot complex data issues in the GCP ecosystem.

Broadcom Software - Agile Operations Division

Join Broadcom Software (#BroadcomSW), a world leader in business-critical software that modernizes, optimizes, and protects the world’s most complex hybrid environments. With our engineering-centered culture, we are building an extensive portfolio of industry-leading infrastructure and security software. Together, we solve big customer problems with some of the top technical talent in the industry.

In the Agile Operations Division, we offer business-critical software solutions that help the world’s leading companies transform their operating model to be more agile. Our ValueOps, NetOps, and Automation solutions help these organizations drive innovation and achieve operational excellence to realize better business outcomes – and better experiences for their customers.

Our industry success is built on a decades-long track record of delivering transformational solutions to teams who plan, build, test, and operate mission-critical software for the world’s largest and most complex businesses. To do this, we respond quickly and thoughtfully, innovate in the context of customer needs, and collaborate inclusively with customers and internal partners. Our business will nurture your intellect and give you opportunities to expand your skills even further. 

Broadcom is proud to be an equal opportunity employer. We will consider qualified applicants without regard to race, color, creed, religion, sex, sexual orientation, gender identity, national origin, citizenship, disability status, medical condition, pregnancy, protected veteran status or any other characteristic protected by federal, state, or local law. We will also consider qualified applicants with arrest and conviction records consistent with local law.