Big Data Architect

Key Skills

C Programming, C++, Cloud computing, Data science techniques, Java Programming, Machine learning techniques, MATLAB Programming, Python Programming, PyTorch, R Programming, Scala Programming, SQL, TensorFlow

Job Description

As a Big Data Architect in our Professional Services team you will work with clients on short to medium term customer engagements on their big data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other technical tasks to help customers to get most value out of their data. RSAs are billable and know how to complete projects according to specification with excellent customer service. You will report to the RSA Manager/Lead.

The impact you will have:

• You will work on a variety of impactful customer technical projects which may include building reference architectures, how-to's and production grade MVPs
• Guide strategic customers as they implement transformational big data projects, 3rd party migrations, including end-to-end design, build and deployment of industry-leading big data and AI applications
• Consult on architecture and design; bootstrap or implement strategic customer projects which leads to a customers' successful understanding, evaluation and adoption of Databricks.
• Provide an escalated level of support for customer operational issues.
• You will work with the Databricks technical team, Project Manager, Architect and Customer team to ensure the technical components of the engagement are delivered to meet customer's needs.
• Work with Engineering and Databricks Customer Support to provide product and implementation feedback and to guide rapid resolution for engagement specific product and support issues.

What we look for:

• Deep hands-on expertise in Apache Spark (Scala or Python)
• 8+ years experience in Design and implementation of Big Data technologies (Apache Spark, Hadoop ecosystem, Apache Kafka, NoSQL databases) and familiarity with data architecture patterns (data warehouse, data lake, streaming, Lambda/Kappa architecture)
• 5+ years experience working as either:
• Software Engineer / Data Engineer / Big Data Engineer : query tuning, performance tuning, troubleshooting, and debugging Spark and other big data solutions.
• Familiarity with a full range of data engineering and data science approaches, covering theoretical best practices and the technical applications of these methods
• Experience building and deploying a range of data engineering pipelines into production, including using automation best practices for CI / CD
• Familiarity with databases and analytics technologies in the industry including Data Warehousing / ETL, Relational Databases, or MPP
• Experience with performance tuning, troubleshooting, and debugging SparkTM and other big data solutions
• Comfortable with talking up and down the IT chain of command including directors, managers, architects and developers
• Experience with cloud providers such as AWS, Azure or GCP
• Familiarity with AWS/EC2 cloud deployment models (Public vs. VPC)

Benefits

• Equity awards
• Paid parental leave
• Gym reimbursement
• Annual personal development fund
• Work headphones reimbursement
• Business travel accident insurance