Data Engineer

Key Skills

Java Programming, Python Programming, SQL, Apache Hadoop, Scala Programming, Apache Hive, MapReduce, Apache Pig, Teradata, Sqoop, SPARK Programming, ETL frameworks

Job Description

Job Summary:

At Lowe’s, we deliver the right home improvement products with the best service and value. A critical part behind that mission is data, and our team is working to bring that data to life. Easily accessible, highly accurate and reliable data is what our team is striving for, so the business can work toward our common mission. As a Data Engineer on this team, you’ll be developing test and data validation plans along with performing end-to-end testing. Additionally, our data engineers provide technical support for our production environment where you’ll get an opportunity to solve challenging problems on our very fun and energetic team!

Key Responsibilities:

• Supports systems integration testing (SIT) and user acceptance testing (UAT), define test and validation plans, and ensures quality deployments
• Translates business requirements and specifications into testing and validation plans; partners with Product Manager to understand business needs and functional specifications
• Automates and simplifies testing, validation and operations processes
• Technical support and operation activities for the data hub and pipelines
• Solves technical problems and engages the right people; solutions are testable, maintainable, and efficient
• Occasional development work with guidance of a senior colleagues
• Participates in continuous improvement activities including training opportunities; continuously strives to learn data engineering best practices and apply them to daily activities
• Monitoring of the data hub and related activities
• Write technical documents, including testing and validation plans and procedures

Qualifications

Minimum Qualifications:

• Bachelor's Degree in Engineering, Computer Science, CIS, or related field (or equivalent work experience in a related field)
• 2 years of experience in Data, BI or Platform Engineering, Data Warehousing/ETL, or Software Engineering
• 1 year of experience working on project(s) involving the implementation of solutions applying development life cycles (SDLC)

Preferred Qualifications:

• Master's Degree in Computer Science, CIS, or related field
• 2 years of IT experience developing and implementing business systems within an organization
• 4 years of experience working with defect or incident tracking software
• 4 years of experience with technical documentation in a software development environment
• Experience with database technologies Data Engineering
• 2 years of experience in Hadoop or any Cloud Bigdata components (specific to the Data Engineering role)
• Experience in Java/Scala/Python, SQL, Scripting, Teradata, Hadoop (Sqoop, Hive, Pig, Map Reduce), Spark (Spark Streaming, MLib), Kafka or equivalent Cloud Bigdata components (specific to the Data Engineering role)