Principal Data Engineer

Key Skills

Java Programming, Python Programming, C++, C Programming, SQL, Cloud computing, Scala Programming, Machine learning techniques, Data science techniques, MATLAB Programming, PyTorch, TensorFlow, R Programming

Job Description

What We’re Looking For:

Data Engineering has built a best-in-class data platform leveraging tools such as snowflake, dbt_ and Prefect. Now that the foundations have been laid the team is beginning to look toward what is next; and evolving our foundation to climb to the next rung of the analytics maturity model. edX/2U is looking to add a Principal Data Engineer to set their vision on that next rung and to help us climb.

Your work will impact edX/2U employees across the company and enable us to continue to mature as a data-driven organization and achieve our potential to transform education for learners globally. The Data Engineering (DE) team’s work lies at the foundation of all that we do. The accurate, timely and usable data that DE provides to the organization drives business reporting and decision-making, product innovation, customer-facing data offerings and more.

Data Engineering works alongside data analysts and scientists, product engineering, and business stakeholders across the organization to provide the data platform and technical solutions that enable us to drive value from its data. If you are looking to make an outsized impact on an organization, Data Engineering at edX/2U is the place for you.

Responsibilities Include, But Are Not Limited To:

• Design, develop, and maintain Data Engineering’s best in class architecture
• Collaborate with engineering, analytics and product teams to refine project requirements and drive technical solutions
• Be data driven in your work, instrumenting the tools Data Engineering builds and tuning system performance
• Proactively communicate issues, status or roadblocks
• Effectively communicate and share your knowledge with team members through mentoring, code reviews, pair programming, and presentations
• Stay on top of data trends; experiment with and evaluate new solutions, technologies, or vendors to evolve our data platform as new needs emerge

Things That Should Be In Your Background:

• Strong understanding of cloud-based data warehousing and ELT/ETL techniques and processes
• Experience building efficient data pipelines, performance tuning, and integrating disparate data sources and types, including high volume semi-structured and unstructured data (e.g., JSON, etc.)
• A deep understanding of SQL
• Experience working in Python
• Collaborative and pragmatic, with and enthusiasm for learning and continuous improvement

Other Attributes That Will Help You In This Role:

• Experience with Snowflake and dbt
• Experience with pipeline data pipeline tools such as Prefect, Luigi or Airflow
• Experience with or a desire to learn about Terraform and Kubernetes.
• Experience master data management, data modeling and preparing data for analysis
• Enthusiasm for Agile/Scrum processes
• Comfortable participating in on call rotations to support the Data Engineering infrastructure