Senior Data Engineer

Key Skills

Amazon Simple Storage Service (S3), Apache Hadoop, Apache Kafka, AWS, AWS Glue, Big Data Technology, Data Engineering, Data Warehousing, Effective communication skills, Machine learning techniques, PowerBI, Python Programming, SPARK Programming, SQL

Job Description

Sr Data Engineer Should be able to:

• Serve: Help team members, customers, and volunteering to serve the greater community.
• Learn: Continuously acquire knowledge of emerging technologies and business operations.
• Innovate: Push boundaries and explore new technologies to enhance our data infrastructure.
• Connect: Foster face-to-face interactions to build relationships, recognizing that we're better together.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL processes in AWS environment.
• Architect and implement efficient data warehousing solutions, ensuring optimal performance and reliability.
• Collaborate with data scientists and analysts to understand business requirements and translate them into technical solutions.
• Optimize and tune existing data pipelines and queries to improve performance and reduce latency.
• Ensure data integrity, quality, and security across all data processes and systems.
• Troubleshoot and resolve data-related issues in a timely manner.
• Stay updated with industry trends and best practices in data engineering, recommending, and implementing new technologies and methodologies as needed.

Minimum Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related field.
• 5+ years of experience in data engineering, with a focus on SQL, Python, and data warehousing.
• Solid understanding of data warehousing concepts and best practices.
• Strong proficiency in SQL, with experience in writing complex queries, stored procedures, and performance tuning.
• Proficiency in Python for data manipulation, scripting, and automation.
• Hands-on experience with AWS data services such as Redshift, Lambda, Glue, S3, etc.
• Experience with version control systems such as Git.
• Strong analytical and problem-solving skills with attention to detail.
• Excellent communication and collaboration skills, with the ability to work effectively in a cross-functional team environment.

Preferred Qualifications

• Master's degree or higher in Computer Science, Engineering, or a related field.
• Experience with big data technologies such as Spark, Hadoop, or Kafka.
• Experience with modern reporting software – SSRS & Power BI
• Knowledge of machine learning concepts and frameworks.
• AWS certification (e.g., AWS Certified Developer - Associate, AWS Certified Solutions Architect).
• Experience with DevOps practices and tools for continuous integration and deployment.
• Familiarity with agile methodologies such as Scrum or Kanban.
• Lending experience.

Supervisory Responsibility

This position has no supervisory responsibilities.

Work Environment and Physical Demands

This job operates in a professional office environment. This role routinely uses standard office equipment such as computers, phones, photocopiers, filing cabinets and fax machines.

Position Type/Expected Hours of Work

This is a full-time position with a work schedule of Monday-Friday with some schedule variations as needed.

Travel

This position will require up to 10% travel.

EEO Statement

ACA provides equal employment opportunities (EEO) to all applicants for employment without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, disability, genetic information, marital status, amnesty, or status as a covered veteran in accordance with applicable federal, state and local laws. ACA complies with applicable state and local laws governing non-discrimination in employment in every location in which the company has facilities.