Senior Data Engineer

Key Skills

Algorithms, Analytical and Problem solving, Apache Hadoop, AWS, Azure, Data Engineering, Data Lake, Data security, Effective communication skills, ETL/ELT technologies, Google Cloud Platform (GCP), Machine learning techniques, PySpark, Python Programming, PyTorch, Scikit-learn, SPARK Programming, SPARQL, SQL, TensorFlow

Job Description

The Data Engineer will develop, implement & test programs and scripts to automate tasks and data processing as well as utilize SQL for operation use. Responsibilities include performing data analysis, managing and monitoring data security & document procedures and best practices.

Duties and Responsibilities:

• Optimize and enhance data processing performance by identifying and resolving performance issues.
• Develop, implement & test scripts and programs in Python to automate data processing and analysis tasks.
• Utilize complex SQL for data extraction, manipulation, transformation, loading, optimizing performance and efficiency.
• Design, model and optimize data models and data structure for efficient reporting analysis, data visualization and data sharing.
• Collaborate with other teams such as business intelligence, applications, and consultants, to understand and meet client’s data needs and challenges.
• Perform data analysis and profiling to identify data quality issues anomalies and opportunities for improvement.
• Participate in managing and monitoring data security and access anomalies.
• Document and update procedures and best practices related to Python, libraries, algorithms, and related data processing technologies and propose innovative solutions.

Requirements and Qualifications:

• Must have from 4 - 8 years of experience in data engineering
• Cloud computing platforms: AWS/Azure/GCP
• Experience in data integration (ETL/ELT) development using Python, PySpark, and SparkSQL.
• Data warehouse technologies: Redshift/Snowflake/BigQuery
• Data lake technologies: Hadoop, Spark, and Hive
• Orchestration: Airflow/Control-M/(Any Orchestration tool)
• Machine learning frameworks: TensorFlow, PyTorch, and sci-kit-learn
• Excellent problem-solving and analytical skills.
• Strong communication and interpersonal skills
• Excellent English communication

Please read the Job Description very well before applying

Recruitment fraud is a scheme in which fictitious job opportunities are offered to job seekers typically through online services, such as false websites, or through unsolicited emails claiming to be from the company. These emails may request recipients to provide personal information or to make payments as part of their illegitimate recruiting process. DXC does not make offers of employment via social media networks and DXC never asks for any money or payments from applicants at any point in the recruitment process, nor ask a job seeker to purchase IT or other equipment on our behalf. More information on employment scams is available here.