Senior Data Engineer - REMOTE Contractual role

Key Skills

Aartificial intelligence, Amazon Elastic Compute Cloud-EC2, Amazon Simple Storage Service (S3), Analytical and Problem solving, AWS, Azure, Big Data Technology, Business Analytics, Continuous Integration & Continuous Delivery - CI/CD, Data Analytics, Data Visualization, Data Warehousing, Effective communication skills, ETL/ELT technologies, HDFS, Java Programming, NoSQL, Planning and organization, Python Programming, Russian Language, Scrum Agile Methodology, Shell Scripting language, SQL

Job Description

Responsibilities

Key responsibilities

• The candidate is expected to have a solid background on software development with strong python coding skills and solve challenging problems.
• Web crawling, data cleaning, data annotation, data ingestion and data processing.

• Reading and collating complex data sets
• Creating and maintaining data pipelines
• Continual focus on process improvement to drive efficiency and productivity within the team
• Use of Python, SQL, ES, Shell etc. to build the infrastructure required for optimal extraction, transformation, and loading of data
• Provide insights into key business performance metrics by building analytical tools that utilize the data pipeline

• Support the wider business with their data needs on an ad hoc basis 

Qualifications

To qualify, you must have 

• 3+ years of programming experience, solid coding skills in Python, Shell, and Java

• Bachelor's degree in computer engineering, Computer Science, or Electrical Engineering and Computer Sciences.
• Good corporate capacity, good communication skills.
• Experience with Web crawling, cleaning.
• Experience with solution architecture, data ingestion, query optimization, data segregation, ETL, ELT, AWS, EC2, S3, SQS, lambda, Elastic Search, Redshift, CI/CD frameworks and workflows.
• Working knowledge of data platform concepts - data lake, data warehouse, ETL, big data processing (designing and supporting variety/velocity/volume), real time processing architecture for data platforms, scheduling and monitoring of ETL/ELT jobs

• PostgreSQL and programming (preferably Java, Python), proficiency in understanding data, entity relationships, structured & unstructured data, SQL and NoSQL databases
• Knowledge of best practice in optimizing columnar and distributed data processing system and infrastructure
• Experienced in designing and implementing dimensional modelling
• Experience in MS Azure ( Transition from private to Azure cloud ideal)
• Knowledge of machine learning and data mining techniques in one or more areas of statistical modelling, text mining and information retrieval.

Ideally, you’ll also need 

• Strong analytical and data visualization skills 
• In-depth market and domain knowledge 
• An innovative and creative approach to problem-solving 
• Excellent communication and presentation skills 

This is a REMOTE Full Time Contractor role for 12 months. 

What we look for:

If you are a performance-driven, inquisitive mind with the agility to adapt to ambiguity, you will fit right in. You should be eager to explore opportunities to build meaningful collaborations with stakeholders and aspire to create unique customer-centric solutions. Bias for action and a passion to conquer new frontiers in the Big Data Analytics space is at the heart of the Presight community.