Enterprise Data Design (Data Engineer, Staff)

Key Skills

Big Data Technology, Continuous Integration & Continuous Delivery - CI/CD, Data Engineering, Data science techniques, Databricks, DevOps, Effective communication skills, Machine learning techniques, Python Programming, SPARK Programming, SQL

Job Description

Qualcomm India Private Limited is seeking a Staff IT Data Engineer to join our Enterprise Architecture, Data and Services (EADS) Team. This pivotal role focuses on designing, developing, and supporting advanced data pipelines across a multi-cloud environment, with a primary emphasis on Databricks . The successful candidate will play a crucial role in facilitating data ingestion from diverse sources, processing data using a standardized data lake approach, and provisioning data for analytical endeavors. The role demands a robust implementation of DevSecOps practices, including Continuous Integration/Continuous Deployment (CI/CD), Infrastructure as Code (IaC), and automated testing to enhance data operations, monitor and optimize data loads, and define data retention policies.

Principal Duties and Responsibilities:

• Experienced at designing, architecting, and presenting data systems for customers and managing the delivery of production solutions of those data architectures.

• 5+ years of experience in data engineering, architecture, or analytics roles.

• Expertise with the Databricks platform, including cluster management, Delta Lake, MLFlow and Unity catalog with Collibra integration for data catalog, lineage, and quality

• Experience with ingesting data to Databricks platform through Fivetran

• Proficiency in Spark, Python, SQL, and ETL frameworks.

• Experience with cloud platforms, preferably AWS and their integration with Databricks.

• Strong understanding of data warehousing concepts, big data processing, and real-time analytics.

• Excellent communication and interpersonal skills, with the ability to work across technical and non-technical stakeholders.

• Familiarity with machine learning frameworks and libraries.

• Knowledge of DevOps practices and CI/CD pipelines for data platforms.

Minimum Qualifications:

• Bachelor’s degree in computer engineering, Computer Science, Information Systems, or a related field, with 5+ years of IT-related work experience; or 7+ years of IT-related work experience without a Bachelor’s degree.
• At least 10 years of programming experience, preferably in Python or Java using OOPS, Data Structures and Algorithms.
• At least 5 years of Databricks with experience in Designing, developing, and optimizing scalable data pipelines, leveraging Databricks and Apache Spark
• At least 10 years of experience with SQL and/or NoSQL Databases.
• At least 3 years of experience with Data Structures and algorithms.
• 10+ years of strong data modelling (Functional, Logical and Physical) and data architecture experience in Data Lake and/or Data Warehouse.
• At least 3 years of experience with CI/CD and DevSecOps using Jenkins.
• At least 2 years of experience with design and development of Data APIs (python, flask/fastapi, etc.) to expose data in the platform and supporting Document and Graph stores using Polyglot persistence.
• At least 2 years of experience with event/message-based integrations (inbound and outbound) on the platform.

Preferred Qualifications:

• Databricks Certified Data Engineer or Databricks- AWS platform architect.
• Experience or exposure to other cloud platforms such as Azure and GCP.
• Knowledge of Big Data handling with PySpark.

Education Requirements:

• A Bachelor of Science in Computer Science, Information Technology, Engineering, or a related field, or 7+ years of equivalent professional experience.

Minimum Qualifications:

• 5+ years of IT-related work experience with a bachelor’s degree in computer engineering, Computer Science, Information Systems or a related field.

• 7+ years of IT-related work experience without a bachelor’s degree.

• 3+ years of work experience with programming (e.g., Java, Python).
• 3+ years of work experience with SQL or NoSQL Databases.
• 3+ years of work experience with Data Structures and algorithms.

Minimum Qualifications:

• 5+ years of IT-related work experience with a Bachelor's degree in Computer Engineering, Computer Science, Information Systems or a related field.

• 7+ years of IT-related work experience without a Bachelor’s degree.

• 3+ years of work experience with programming (e.g., Java, Python).
• 3+ years of work experience with SQL or NoSQL Databases.
• 3+ years of work experience with Data Structures and algorithms.

Applicants: Qualcomm is an equal opportunity employer. If you are an individual with a disability and need an accommodation during the application/hiring process, rest assured that Qualcomm is committed to providing an accessible process. You may e-mail disability-accomodations@qualcomm.com or call Qualcomm's toll-free number found here. Upon request, Qualcomm will provide reasonable accommodations to support individuals with disabilities to be able participate in the hiring process. Qualcomm is also committed to making our workplace accessible for individuals with disabilities. (Keep in mind that this email address is used to provide reasonable accommodations for individuals with disabilities. We will not respond here to requests for updates on applications or resume inquiries).

Qualcomm expects its employees to abide by all applicable policies and procedures, including but not limited to security and other requirements regarding protection of Company confidential information and other confidential and/or proprietary information, to the extent those requirements are permissible under applicable law.

To all Staffing and Recruiting Agencies: Our Careers Site is only for individuals seeking a job at Qualcomm. Staffing and recruiting agencies and individuals being represented by an agency are not authorized to use this site or to submit profiles, applications or resumes, and any such submissions will be considered unsolicited. Qualcomm does not accept unsolicited resumes or applications from agencies. Please do not forward resumes to our jobs alias, Qualcomm employees or any other company location. Qualcomm is not responsible for any fees related to unsolicited resumes/applications.

If you would like more information about this role, please contact Qualcomm Careers.