Big Data Architect - Platform

Key Skills

Java Programming, Python Programming, C++, C Programming, SQL, Cloud computing, Scala Programming, Machine learning techniques, Data science techniques, MATLAB Programming, PyTorch, TensorFlow, R Programming

Job Description

Who are you?

Passionate and motivated. Driven, with an entrepreneurial spirit. Resourceful, innovative, forward thinking and committed. At Live Nation Entertainment, our people embrace these qualities, so if this sounds like you then please read on!

THE TEAM

Core Data Services team is at the center of Data and Analytics initiatives. We are building a modern data platform to support enterprise data needs. Our mission and yours too should you choose to, is to empower and enable our data community of data engineers, data scientists, analysts, product teams and decision makers to create value.

The Core Data Services team consists of Platform Engineering, Data Engineering, Data Enablement and Operations teams. We are building a highly functional, performant modern enterprise Data Lake while supporting our current data platforms so the focus is on maximizing functionality, creating value and content/data assets, cost optimizations and usability of the data delivery and services and all this is our measure of our success and defines us The Core Data Services Team!We are looking for a Big Data Architect - Platform, You!

WHAT THIS ROLE WILL DO

• Produce robust Architecture for developing new Systems using Kafka, Apache Spark, and Delta Lake
• Reverse Engineer and Re-Engineer existing ETL from RDBMS/Snowflake/Teradata/Big Query to Spark and Delta Lake.
• Help Platform team in high level Design and implementation details
• Collaborate with Data Engineering, Product, Infrastructure Operations and vendors
• Develop standards, and best practice document for Platform Service Consumers
• Assist in the recruiting process

TECHNICAL SKILLS/COMPETENCIES

• Agile development methodologies using the Atlassian suite: Jira, Confluence
• Good understanding of Data Lakes, Data Warehouses is a must
• Software development, coding expertise in the Data Enginering field using any of the Python/Spark/Scala/Java
• Decent expertise using ANSI SQL and Spark SQL is key to have
• Workflow automation, orchestration using Airflow, Rundeck, GoAnywhere or the equivalent tools stack
• Prior working knowledge of any of these : Databricks, Snowflake, Teradata, Oracle, Google BigQuery, Hadoop and related stacks is good to have
• Solid understanding of cloud services from Amazon AWS, Google GCP
• Good understanding of streaming (Kafka) and batch based data sources
• An understanding of diverse data sources and data formats (xml, json, yaml, parquet, avro, delta) and respective use cases is good to have:
• An excellent understanding of the nuances that add complexities around time zones, geo, various data formats, data types across different storage systems is nice to have

BENEFITS & PERKS

Our motto is ‘Taking Care of Our Own’ through 6 pillars of benefits:

• HEALTH: Medical, Vision and Dental benefits for you and your family, including Flexible Spending Accounts (FSA) and Health Savings Accounts (HSAs)
• YOURSELF: Generous paid time off policy including paid holidays, sick time and paid days off for your birthday, Free concert tickets
• WEALTH: 401(k) program with company match, Stock Program
• FAMILY: New parent programs & support including caregiver leave and childcare cash, infertility support
• CAREER: Tuition reimbursement, student loan repayment internal growth and development programs & trainings
• OTHERS: Volunteer time off, crowdfunding network