Data Engineering, Senior Specialist – Project Regular [REMOTE]

Key Skills

Aartificial intelligence, Analytical and Problem solving, Data structuring, Machine learning techniques, NumPy, Pandas, PySpark, Python Programming, Regression Analysis, SciPy, SQL, Statistics

Job Description

Join the Clean Energy Revolution

You ask the right questions. You love using technology along with data engineering & data science to solve problems. You want your work to make a difference in the world. An innovative, connected, forward-thinking future is powered by innovative, connected, forward-thinking people who are not afraid to color outside the lines. We are working towards deployment of new technologies like mobile applications, advanced analytics, machine learning, automation, and other tools to improve data-driven decision making across the organization, increase efficiency, reliability, user adoption, customer satisfaction and safety improvements. 

You want to be a part of a collaborative team, where you will work with a supportive team of brilliant Data Architects and Data Engineers, in an environment that provides opportunities to learn and develop your expertise. Do you also want a role that has a meaningful impact, a role where you can literally see a direct correlation between your work and changing the world? Then this is a unique and meaningful career that you have been seeking.

You’ll not just be working on one of this century’s most pressing issues, you’ll be helping to solve it. You will work with some of the brightest minds in the industry, and will have a unique opportunity to solve some of the most interesting data challenges with efficiency and integrity, at a scale very few companies can match. Our team at SCE has a lot of exciting work ahead of us! Join us and use your unique gifts to help create us a pathway to fight climate change and improve air quality

Become a Data Engineering, Senior Specialist and build a better tomorrow. This position specializes in data engineering and design function specifically using technologies and platforms such as Palantir, Python, Javascript, and SQL. The responsibilities include performing extensive data mining, analysis, engineering, and design. The position is responsible for working with advanced analytics groups to facilitate data engineering activities covering data acquisition, extraction, normalization, transformation, management, and manipulation of large and complex data sets primarily using Python, Javascript and SQL (preferably on Palantir Foundry platform)

As a Data Engineering, Senior Specialist your work will help power our planet, reduce carbon emissions, and create cleaner air for everyone. Are you ready to take on the challenge to help us build the future?

A day in the life - Get ready to think big, work smart and shine bright!

Your role will focus on understanding business requirements, defining data requirements, identifying enterprise data sources, planning, designing, and building data acquisition from sources, defining data model, taxonomy, designing data ingestion pipelines, data normalization, data transformation, and consumption. You will develop and maintain data ingestion and consumption pipelines using Palantir Foundry, deriving data insights using platform capabilities towards the realization of analytics use cases. Some of your key responsibilities will be developing data insights, data mining, and support for AI/ML use cases training and deployment within SCE analytics landscape.

You will work closely with Data Architects, Data Engineers and Data Analysts across enterprise towards realization of high-valued analytical (AI/ML) use cases.

• Development of data transformation scripts using Python, PySpark, and SQL
• Development of documentation for data transformation scripts
• Development of design artifacts to describe technical components of scripts for long term maintenance and support
• Participation in daily scrum style meetings for update progress on tasks.
• Participation in sprint planning to provide estimates for time to complete tasks
• Support End-to-End testing of use cases

Qualifications

The essentials

• Five (5) or more of experience in data engineering, data mining, large scale data acquisition, transformation, and cleaning both structured and unstructured data

The preferred

• Bachelor’s degree in Computer Science, Information Systems, Engineering, Statistics/ Mathematics or equivalent STEM major
• Two (2) or more years of experience with Python, SQL software development
• One (1) or more years of experience with Javascript/ ES6/TypeScript software development
• Experience in data processing, especially large data sets, hands-on with data transformation, aggregation, filtering etc
• Experience in building automated, configurable data pipelines
• Development experience with one or more libraries: Pandas, NumPy, SciPy etc.
• Experience with Python development environments, including, but not limited to Jupyter, PyCharm, VS Code.
• Some familiarity with PySpark

Really nice to have

• Development experience with Palantir Foundry
• Knowledge of advanced statistical techniques and concepts (regression, properties of distributions, statistical tests and proper usage, etc.) and experience with applications of statistical methods.
• Experience creating and using advanced machine learning algorithms and statistics: regression, simulation, scenario analysis, modeling, clustering, decision trees, neural networks, etc.
• Understanding of electric utility use cases and data.
• Experience with CRISP-DM methodology for training and deploying analytical (AI/ML) models will be an advantage.
• High degree of analytical and problem-solving skills
• Understanding of data models/structures in electric utility domain
• Communicate effectively with analytics/data experts, business leaders, and management to develop data driven solutions and deliver data insights.

Testing

• This position requires testing and applicants who are identified to move forward in the selection process to interview, will have a hands-on Data Engineering Senior Specialist Performance Evaluation as part of the interview.

About Southern California Edison

We are committed to ensuring that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodations at (833) 343-0727.