Scala and Spark Developer

Key Skills

Apache Hadoop, Apache Hive, AWS, Confluence, DevOps, JIRA, MemSQL, PostgreSQL, Python Programming, Scala Programming, Shell Scripting language, SPARK Programming, SQL

Job Description

What You Will Do

• Work with business and technical leadership to understand requirements
• Participate in sprint planning sessions and help TPOs
• Troubleshooting the issues, provide effective solutions and application monitoring in productions environment.

Skills and Experience You Will Need

• 7+ years of strong development experience in Spark, Scala, Python, Shell scripting, PostgreSQL, and Hadoop
• In depth knowledge on Hadoop architecture and its components
• Strong working knowledge on Single Store (MEMSQL) database
• Should have good hands-on experience working with Indexes, Shard keys, column store, and reference tables using Single Store database.
• Must understand basic AWS services and hands on experience
• Basic to moderate Terraform development experience needed
• Should be able to demonstrate work experience in Hadoop, Spark, hive
• Strong hands-on experience on Scala and Spark is must
• Must have work experience on Hadoop as data warehouse/Data Lake implementations
• Strong experience on DevOps pipeline implementation
• Health care domain knowledge is a plus
• Troubleshooting the Hadoop Yarn jobs is must
• Strong experience in writing complex and effective SQLs, and Stored Procedures
• Strong development experience on Single Store database operations
• Strong profiling skills using Single Store database
• Strong query optimizations skills to improve performance of ETL process
• Implement Hadoop job orchestration using Shell scripting, and Airflow
• Experience in Agile and working knowledge on DevOps tools (Get, Maven, Jenkins, Sonar Cube, and Checkmarks)
• Unix Shell scripting and basic administration of Unix servers
• AWS (S3, EC2, SNS, SQS, Lambda, ECS, Glue, IAM, and Cloud Watch)
• Experience in Jira and Confluence
• Must participate in production support model.

Who We Are

GalaxE is a professional IT services firm that specializes in platform-driven solutions and the use of automation to achieve enterprise business transformation and mission-critical change for some of the largest companies in the world. Using our proprietary solution set, GxFource®, we apply machine learning techniques and predictive analytics tools as part of a broad artificial intelligence strategy that provides effective impact and data-driven business transformation.

Since its founding, GalaxE has been dedicated to advancing the benefits of technology. As we continue that legacy and look to the future, a focus on business enablement through agile, cost-efficient, and effective integration of people, process, and technology anchors our success. We revolutionize change in the costs of doing business that transform companies and their ability to leap beyond the competition.

At GalaxE we value people and are committed to diversity and inclusion where our employees are made to feel comfortable and are encouraged to be authentic. We focus on cultivating both traditional IT and non-traditional, new collar, workers through our Outsource to America®, program.

We are always looking for passionate, entrepreneurial-minded innovators and disrupters; game-changers that take ownership of the work they produce and bring it each and every day. Working with like-minded team members you will get a chance to discover, develop, and use cutting-edge technologies to transform the way we deliver creative business solutions.

Physical Requirements:

• Prolonged periods of remaining stationary at a desk and working on a computer
• Must be able to lift to 15 lbs., as needed
• Must be able to work on-site (corporate/client offices), as needed (not applicable for 100% remote roles)
• Occasionally required to bend, kneel, crouch, and reach overhead.
• Hand-eye coordination necessary to operate computers and various pieces of office equipment.
• Specific vision abilities required include close vision, the ability to tolerate fluorescent lighting, and the ability to adjust focus.

Employees must be able to perform the physical requirements of the position satisfactorily and, if requested, reasonable accommodations will be made to enable employees requiring accommodations to perform the essential functions of their jobs, absent undue hardship.