Lead Data Engineer

Key Skills

Unix Operating system, Java Programming, Python Programming, PowerBI, Big Data Technology, Apache Hadoop, Apache Kafka, Aartificial intelligence, Business Intelligence, Apache Cassandra, Keras software library, Natural Language Processing (NLP), TensorFlow, Presto, Apache Hive, ScyllaDB, Apache NiFi, SPARK Programming

Job Description

To ensure that Visa’s payment technology is truly available to everyone, everywhere requires the success of our key bank or merchant partners and internal business units. The Global Data Science group supports these partners by using our extraordinarily rich data set that spans more than 3 billion cards globally and captures more than 100 billion transactions in a single year.

Are you skilled at turning hard numbers into compelling stories and useful strategic insights? Do you solve complex data challenges with creative flair? Put those skills to work answering strategic questions for one of the world's most respected and innovative payments companies.

As a Data Engineer, you will be responsible for helping to blueprint and deliver modelled attributes, data assets, and self-serve workflows that solve clients' business objectives. You will get the chance to leverage your business acumen and technical knowledge of big data and data mining techniques. Based on deep understanding and knowledge of big-data engineering techniques, you will develop and maintain data and tools to enable data scientists to draw fact based insights and build models This function is critical in building market-relevant client solutions and intellectual property for Visa.

The position will be based at Visa's India office in Bengaluru, Karnataka.

Responsibilities

• Translate business requirements and source system understanding into technical solutions using Big Data & Java etc.
• Work with business partners directly to seek clarity on requirements
• Define solutions in terms of components, modules and algorithms
• Design, develop, document and implement new programs and subprograms, as well as enhancements, modifications, and corrections to existing software. 
• Create technical documentation and procedures for installation and maintenance.
• Write Unit Tests covering known use cases using appropriate tools
• Integrate test frameworks in development process
• Refactor existing solutions to make it reusable and scalable
• Work with operations to get the solutions deployed
• Take ownership of production deployment of code
• Collaborating with and/or lead cross functional teams, build and launch applications and data platforms at scale, either for revenue generating or operational purposes
• Come up with Coding and Design best practices
• Thrive in self-motivated internal-innovation driven environment
• Adapting fast to new application knowledge and changes.
• Be the Area/Data Asset owner of the area he/she works in.

Qualifications

Successful candidates frequently have a mix of the following qualifications:

• Bachelors in Computer Science, or Information Systems or related field
• 15 years of experience in data technologies and applications development
• 3+ years of experience in Hadoop using Core Java Programming, Spark, Kafka, Hive, Pig scripts, Sqoop on Linux/Unix environment
• Expertise in Cassandra, ScyllaDB, Nifi is a plus. 
• Agile development experience
• Expertise in Object Oriented Programming Language - Java/ Python
• Strong algorithms and data structures
• Ability to generate creative and innovative solutions for QA challenges and constraints
• Strong knowledge of database concepts and UNIX/LINUX
• Expert level SQL skills for data manipulation (DML) and validation (DB2)
• Experience using version control and bug tracking tools
• Result oriented with strong analytical and problem solving skills
• Work independently with minimal supervision
• Comfortable learning new technologies quickly
• Experience leading a small team good to have
• Excellent team player
• Strong interpersonal and communication skills

Apply Online at Visa