Data Engineer- Big Data

IBM
Apply Now

Job Description

Your Role and Responsibilities

You analyze and organize the data needed and work closely with data scientists to query data to uncover the stories hidden in data and find patterns in the numbers. As Data Engineer, you’ll help gather and collect data, store data, perform batch processing, and real-time processing.

You’ll work closely with other teams to determine what data management systems are appropriate and which data are needed for analysis. As an Associate Data Engineer, you’ll be able to wrestle with and help solve problems associated with database integration and messy, unstructured data sets.

  • Implement and validate predictive models as well as create and maintain statistical models with a focus on big data
  • You’ll incorporate a variety of statistical and machine learning techniques
  • Design and implement various enterprise search applications such as Elasticsearch/Splunk for client requirements
  • Use programming skills like Java, Python, Scala, etc., to build pipelines to extract and transform data from a repository to a data consumer
  • Use and apply Extract, Transform, and Load (ETL) tools and/or data integration or federation tools to prepare and transform data as needed
  • Communicate with internal and external clients to understand and define business needs, providing analytical solutions
  • Use leading edge tools such as Linux, SQL, Python, Spark, Hadoop, Java, and Cloud Vendors such as AWS, Azure, etc.
  • Work in an Agile, collaborative environment, partnering with other scientists, engineers, consultants and database administrators of all backgrounds and disciplines to bring analytical rigor and statistical methods to the challenges of predicting behaviors
  • Build teams or writing programs to cleanse and integrate data in an efficient and reusable manner, developing predictive or prescriptive models, and evaluating modeling results
  • Ask business and industry questions to identify appropriate modeling techniques
  • Communicate results to technical and non-technical audiences

  • You’re great at solving problems by looking at thing differently, debugging, troubleshooting, and designing & implementing solutions to complex technical issues
  • You thrive on teamwork and have excellent verbal and written communication skills
  • Strong fundamentals in Mathematics and Computer Science (algorithms)
  • You have strong technical and analytical abilities, a knack for driving impact and growth, and some experience with programming/scripting in a language such as Java or Python
  • You’re proficient at least one of the statistical programming languages such as R, Python, Scala or SAS, SPSS, MATLAB
  • Basic understanding or experience with predictive/prescriptive modeling skills
  • You have an interest in, understanding of, or experience with Design Thinking and Agile Development Methodologies
  • You have a basic understanding of Cloud (AWS, Azure, etc.)

Company Info.

IBM

IBM is a leading cloud platform and cognitive solutions company. Restlessly reinventing since 1911, we are the largest technology and consulting employer in the world, with more than 290,000 employees serving clients in 177 countries. IBM Research provides unparalleled insight into business, industry and society by leveraging advanced computing architectures and methodologies to solve some of the world’s most pressing challenges.

  • Industry
    Information Technology,Computer software,Computer hardware
  • No. of Employees
    292,500
  • Location
    New Orchard Road, Armonk, New York, NY 10504, USA
  • Website
  • Jobs Posted

Get Similar Jobs In Your Inbox

IBM is currently hiring Big Data Engineer Jobs in Islamabad, Pakistan with average base salary of ₨100,000 - ₨270,000 / Month.

Similar Jobs View More