Big Data Architect (AWS)

Key Skills

Apache Airflow, AWS, Big Data Technology, Data Architecture, Data pipelines, Databricks, Google Cloud Platform (GCP), Java Programming, Python Programming, Scala Programming, SPARK Programming, SQL

Job Description

WE ARE

SoftServe is a global digital solutions company with headquarters in Austin, Texas, founded in 1993. Our associates work on 2,000+ projects with clients across North America, EMEA, APAC, and LATAM. We are about people who create bold things, make a difference, have fun, and love their work.

Big Data & Analytics is the Center of Excellence's data consulting and data engineering branch. Hundreds of data engineers and architects nowadays build Data & Analytics end-to-end solutions from strategy through technical design and proof of concepts to full-scale implementation. We have customers in the healthcare, finance, manufacturing, retail, and energy domains.

We hold top-level partnership statuses with all the major cloud providers and collaborate with many technology partners like AWS, GCP, Microsoft, Databricks, Snowflake, Confluent, and others.

IF YOU ARE

• An architect specializing in data pipeline creation
• Experienced with both batch and streaming processing
• Prepared to lead a team or take on leadership responsibilities
• Proficient in Python, Scala, or Java programming languages (at least one) and SQL for data manipulation and querying
• Skilled in developing data solutions on the AWS cloud platform, leveraging its services to build scalable and efficient data pipelines
• Knowledgeable in big data technologies such as Apache Spark, Databricks, and Flink for data processing and analysis
• Familiar with orchestration tools like Apache Airflow or Managed Apache Airflow (MWAA) for scheduling and monitoring data workflows
• Experienced with data streaming platforms like Apache Kafka, Amazon Managed Streaming for Apache Kafka (MSK), or Kinesis for real-time data processing
• Adept in working with data warehouses such as Amazon Redshift or Snowflake for data storage and analytics
• Proficient in breaking down customer requirements into development tasks, estimating project timelines, and leading teams of data engineers to achieve project goals

AND YOU WANT TO

• Be part of a team of data-focused engineers dedicated to continuous learning, improvement, and knowledge sharing every day
• Work with a cutting-edge technology stack, including services from major cloud providers that are at the forefront of innovation and may not yet be generally available
• Engage with customers from diverse backgrounds, ranging from large global corporations to emerging crypto startups preparing to launch their first product
• Be involved in the entire project lifecycle, from initial design and proof of concepts (PoCs) to minimum viable product (MVP) development and full-scale implementation
• Investigate new technologies, build internal prototypes, and share knowledge with the SoftServe Big Data Community

TOGETHER WE WILL

• Address different business and technology challenges, engage in impactful projects, use top-notch technologies, and drive multiple initiatives as a part of the Center of Excellence
• Support your technical and personal growth — we have a dedicated career plan for all roles in our company
• Investigate new technologies, build internal prototypes, and share knowledge with the SoftServe data community
• Upskill with full access to Udemy learning courses
• Pass professional certifications, encouraged and covered by the company

SoftServe is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment regardless of race, color, religion, age, sex, nationality, disability, sexual orientation, gender identity and expression, veteran status, and other protected characteristics under applicable law. Let’s put your talents and experience in motion with SoftServe.