Big Data Engineer

Key Skills

Aartificial intelligence, Amazon Simple Storage Service (S3), Analytical and Problem solving, Apache Hadoop, Apache Hive, Apache Pig, AWS, Azure, Big Data Technology, Data Analytics, Data Lake, Data Warehousing, Database, ETL/ELT technologies, Google Cloud Platform (GCP), HBase, Java Programming, Large data sets, Machine learning techniques, NoSQL, Python Programming, SQL Server

Job Description

POSITION SUMMARY:

The Data Engineer will develop a new data engineering platform that leverage a new cloud architecture and will extend or migrate our existing data pipelines to this architecture as needed. You will also be assisting with integrating the SQL data warehouse platform as our primary processing platform to create the curated enterprise data model for the company to leverage. You will be part of a team building the next generation data platform and to drive the adoption of new technologies and new practices in existing implementations. You will be responsible for designing and implementing the complex ETL pipelines in cloud data platform and other solutions to support the rapidly growing and dynamic business demand for data and use it to deliver the data as service which will have an immediate influence on day-to-day decision making.

GENERAL DUTIES/RESPONSIBILITIES (MAY INCLUDE BUT ARE NOT LIMITED TO):

• Interfacing with business customers, gathering requirements and developing new datasets in data platform
• Building and migrating the complex ETL/EDI pipelines from on premise system to cloud and Hadoop/Spark to make the system grow elastically
• Identifying the data quality issues to address them immediately to provide great user experience
• Extracting and combining data from various heterogeneous data sources
• Designing, implementing, and supporting a platform that can provide ad-hoc access to large datasets
• Modelling data and metadata to support machine learning and AI

SUPERVISORY RESPONSIBILITIES:

N/A

MINIMUM REQUIREMENTS:

To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.

Minimum Experience:

• 3+ years relevant experience in cloud based data engineering.
• Requires Spark and Scala
• Demonstrated ability in data modeling, ETL development, EDI Development and data warehousing.
• Data Warehousing Experience with SQL Server, Oracle, Redshift, Teradata, etc.
• Experience with Big Data Technologies (NoSQL databases, Hadoop, Hive, Hbase, Pig, Spark, Elasticsearch etc.)
• Experience in using Scala, .net, Java, Python and/or other data engineering languages
• Knowledge and experience of SQL Server and SSIS.
• Experience with X12(837,834,278) and HL7 transactions

Education/Licensure:

• Bachelors or Masters in Computer Science, Engineering, Mathematics, Statistics, or related field

Other:

• Excellent communication, analytical and collaborative problem-solving skills
• Building and migrating the complex ETL/EDI pipelines from on premise system to cloud and Hadoop/Spark to make the system grow elastically
• Preferred
• A Healthcare domain and data experience
• Healthcare EDI experience is a plus
• API development experience is a plus
• Industry experience as a Data Engineer or related specialty (e.g., Software Engineer, Business Intelligence Engineer, Data Scientist) with a track record of manipulating, processing, and extracting value from large datasets.
• Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets
• Experience building data products incrementally and integrating and managing datasets from multiple sources
• Experience leading large-scale data warehousing and analytics projects, including using Azure or AWS technologies – SQL Server, Redshift, S3, EC2, Data-pipeline, Data Lake, Data Factory and other big data technologies
• Experience providing technical leadership and mentor other engineers for the best practices on the data engineering space
• Linux/UNIX including to process large data sets.
• Experience with Azure, AWS or GCP is a plus
• Microsoft Azure Certification is a plus
• Demonstrable track record dealing well with ambiguity, prioritizing needs, and delivering results in an agile, dynamic startup environment
• Problem solving skills and Ability to meet deadlines are a must
• Microsoft Azure Certification is a plus
• Python and Java are a plus
• Experience with X12(837,834,278) and HL7 transactions preferred

Work Environment

• The work environment characteristics described here are representative of those an employee encounters while performing the essential functions of this job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.

ESSENTIAL PHYSICAL FUNCTIONS:

The physical demands described here are representative of those that must be met by an employee to successfully perform the essential functions of this job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.

• While performing the duties of this job, the employee is regularly required to talk or hear. The employee regularly is required to stand, walk, sit, use hand to finger, handle or feel objects, tools, or controls; and reach with hands and arms.
• The employee frequently lifts and/or moves up to 10 pounds. Specific vision abilities required by this job include close vision and the ability to adjust focus.
• Alignment Healthcare, LLC is proud to practice Equal Employment Opportunity and Affirmative Action. We are looking for diversity in qualified candidates for employment: Minority/Female/Disable/Protected Veteran.
• If you require any reasonable accommodation under the Americans with Disabilities Act (ADA) in completing the online application, interviewing, completing any pre-employment testing or otherwise participating in the employee selection process, please contact careers@ahcusa.com.

Alignment requires all new hires to follow local and/or state requirements regarding the COVID-19 vaccine and booster. If applicable, proof of vaccination and booster will be required as a condition of employment subject to legal exemptions. This policy, which Alignment reserves the right to modify, is part of Alignment’s ongoing efforts to ensure the safety and well-being of its staff and community and to support public health efforts.

Alignment Healthcare, LLC is proud to practice Equal Employment Opportunity and Affirmative Action. We are looking for diversity in qualified candidates for employment: Minority/Female/Disable/Protected Veteran.

If you require any reasonable accommodation under the Americans with Disabilities Act (ADA) in completing the online application, interviewing, completing any pre-employment testing or otherwise participating in the employee selection process, please contact careers@ahcusa.com.