Big Data Engineer

Key Skills

Apache Hadoop, C Programming, C++, Data science techniques, Java Programming, Machine learning techniques, MapReduce, Python Programming, PyTorch, R Programming, Scala Programming, SQL, TensorFlow

Job Description

At Cloudflare, we have our eyes set on an ambitious goal: to help build a better Internet. Today the company runs one of the world’s largest networks that powers approximately 25 million Internet properties, for customers ranging from individual bloggers to SMBs to Fortune 500 companies. Cloudflare protects and accelerates any Internet application online without adding hardware, installing software, or changing a line of code. Internet properties powered by Cloudflare all have web traffic routed through its intelligent global network, which gets smarter with every request. As a result, they see significant improvement in performance and a decrease in spam and other attacks. Cloudflare was named to Entrepreneur Magazine’s Top Company Cultures list and ranked among the World’s Most Innovative Companies by Fast Company. 

We realize people do not fit into neat boxes. We are looking for curious and empathetic individuals who are committed to developing themselves and learning new skills, and we are ready to help you do that. We cannot complete our mission without building a diverse and inclusive team. We hire the best people based on an evaluation of their potential and support them throughout their time at Cloudflare. Come join us! 

About the role

We are looking for Data Engineers to come join Cloudflare and help us build a scalable petabyte scale data lake and EDW using modern tech stack from the ground up. Success in this role comes from marrying a strong data engineering background with product and business acumen to deliver scalable data pipelines and BI solutions that can enable analytics using self-service user interface at Cloudflare in a simple and agile manner.

Your Responsibilities::

• Designs, builds and supports scalable and reliable data solutions that can enable self-service reporting and advanced analytics using open source technologies in an agile manner.
• Designs, builds and supports deployment and operation of technology architecture, solutions and software to capture, manage, store and utilize structured and unstructured data from internal and external sources
• Develops technical tools and programming that leverage machine learning and big-data techniques to cleanse, organize and transform data and to maintain and update data structures and integrity on an automated basis
• Close partnership with internal stakeholders and partners from Engineering, product, and business(Finance, Sales, Customer Experience, Marketing etc.).
• Ability to design application components and evolve architecture including UI, API/Services, Data Access, Integration, Application components etc.
• Capable of working closely with business and product teams to ensure data solutions are aligned with business initiatives and are of high quality.
• Analyze and support platform requirements for Data Science team
• Build tools to automate the monitoring or workload and take proactive measure to scale the platform or to fix the problem 

Basic Qualifications:

• Bachelor’s or Master’s Degree in Computer Science or Engineering or related experience required.
• 3+ years of development experience in Big data space working with Petabytes of data and building large scale data solutions using Google Cloud Platform, Apache Spark, Airflow, Kafka, Scala, Python, etc
• 1+ yr of experience with front end programming (React, Angular, HTML5, CSS etc.)
• Experience with API design and development of RESTful web services or GraphQL
• Knowledge of and experience with the backend frameworks like NodeJS, Golang, Python etc
• Experience with automation tools and frameworks (CI/CD pipelines)
• Working experience in Kubernetes, Docker etc.
• Possess a problem-solving attitude.
• Experience in the Internet security industry is preferred.