Data Engineer II, Supply Chain Technology

Key Skills

Java Programming, Python Programming, C++, C Programming, SQL, Apache Hadoop, Scala Programming, Machine learning techniques, Data science techniques, PyTorch, TensorFlow, MapReduce, R Programming

Job Description

Wayfair Data Solutions is the engine that powers an enterprise obsessed with data. We move fast, iterating quickly on big business problems. We work smart, applying technology to unlock insights and provide outsized value to our customers. We swing big, knowing our customers won’t benefit from micro optimizations. Leveraging the largest data set for products sold in the Home space, this team treats data as an asset and determines how to maximize its business value and extend our competitive advantage.

As a Data Solutions Engineer, you will be a hands-on technical leader who designs and delivers Business Intelligence, Data Warehousing and Big Data Solution for our Supply Chain Technology Organization.

What You'll Do

• Own and develop technical architecture, design and implementation of big data platforms and business analytics solutions to empower your stakeholders to solve their data driven analytics and reporting needs
• Build, schedule, and manage data movement from application origin through batch and streaming systems to make it available for key business decisions.
• Develop a robust, sustainable plan for the data area going forward, including projecting space requirements, procuring technology, and partnering with engineering on improvements to the data, 100TB+ highly desired.
• Ensure data products are aligned with the rapidly evolving needs of a multi-billion-dollar business.
• Provide consulting to application and data engineering organizations on best practices for designing applications to enable easy analytics; be an expert on large-scale data processing.

Who You Are

• A true expert on big data, comfortable working with datasets of varying latencies and size and disparate platforms.
• Excited about unlocking the valuable data hidden in inaccessible raw tables and logs.
• Attentive to detail and with a relentless focus on accuracy.
• Excited to collaborate with partners in business reporting and engineering to determine the source of truth of key business metrics.
• Familiarity with distributed data storage systems and the tradeoffs inherent in each one.
• Minimum 5+ years of relevant experience
• Data modeling, extensive experience with SQL, Python, and exposure to cloud computing (AWS, Azure or Google, Google Cloud Preferable).
• Experience with one or more higher-level JVM-based data processing tools such as Beam, Dataflow, Spark or Flink.
• Experience designing and implementing different data warehousing technologies and approaches, such as RDBMS and NoSQL, Kimball vs. Inmon, etc. and how to apply them.
• Experience scheduling, structuring, and owning data transformation jobs that span multiple systems and have high requirements for volume handled, duration, or timing.
• Prior projects working with optimizing storage and access of high volume heterogeneous data with distributed systems such as Hadoop, including familiarity with various data storage mediums and the tradeoffs of each
• Prior data infrastructure experience in support to a Service driven organization is a plus but not essential.
• Bachelors or Masters in Computer Science, Computer Engineering, Analytics, Mathematics, Statistics, Information Systems, Economics, Management or other quantitative discipline fields with a strong academic record