Lead Data Engineer - R01539793

Key Skills

Analytical and Problem solving, AWS, Azure, Big Data Technology, Data Engineering, Data science techniques, Google Cloud Platform (GCP), Java Programming, Machine learning techniques, Natural Language Toolkit - NLTK, NoSQL, Python Programming, PyTorch, Scikit-learn, SQL

Job Description

Primary Skills

• ETL Fundamentals, HDFS, Hive, MapReduce, Modern Data Platform Fundamentals, Oozie, PLSQL, Python, Spark - Pyspark, Spark - Scala, SQL

Secondary Skills

• Java

Specialization

• Big Data Engineering: Associate BI Engineer

Job requirements

• Previous experience as a data engineer or in a similar role Strong and hands-on Knowledge of programming languages (e.g. Java and Python).
• Experience with popular Python frameworks such as Django, Flask or Pyramid.
• In-depth understanding of the Python software development stacks, ecosystems, frameworks and tools such as Numpy, Scipy, Pandas, Dask, spaCy, NLTK, sci-kit-learn and PyTorch.
• Experience with popular Python frameworks pysaprk,databricks,flink nosql db could be added advantages.

Preferred skills and qualifications

• Technical expertise with data models, data mining, and segmentation techniques.
• Hands-on experience with SQL database design Great numerical and analytical skills Data engineering certification.
• Familiarity with database technologies such as SQL and NoSQL.
• Excellent problem-solving ability with solid communication and collaboration skills.
• Knowledge of data science and machine learning concepts and tools.
• A working understanding of cloud platforms such as AWS, Google Cloud or Azure.
• Contributions to open-source Python projects or active involvement in the Python community.