Principal Data Engineer

Key Skills

Java Programming, Python Programming, C++, C Programming, SQL, Cloud computing, Scala Programming, Machine learning techniques, Data science techniques, MATLAB Programming, PyTorch, TensorFlow, R Programming

Job Description

About the team:

PayU Finance is the credit and lending arm of the PayU brand (a wholly-owned subsidiary of the Prosus group. Previously Naspers group) headquartered in Amsterdam, Netherlands. PayU Finance India has disbursed about 20 billion loans to date by volume and has disbursed more than $280 million in consumer credit. PayU Finance provides consumers with easy access to affordable short-term loans up to INR 5 lacs that can be availed in the form of personal loans, point of sale EMI, and express loans. PayU Finance operates under two brands - LazyPay and PaySense with a focus on Buy now Pay later and personal loan products..

Excited yet? Continue reading to find out more about the role:

What you’ll be doing:

Job responsibilities:

• Design infrastructure for data, especially for but not limited to consumption in machine learning applications
• Define database architecture needed to combine and link data, and ensure integrity across different sources
• Ensure performance of data systems for machine learning to customer-facing web and mobile applications using cutting-edge open source frameworks, to highly available RESTful services, to back-end Java based systems
• Work with large, fast, complex data sets to solve difficult, non-routine analysis problems, applying advanced data handling techniques if needed
• Build data pipelines, includes implementing, testing, and maintaining infrastructural components related to the data engineering stack.
• Work closely with Data Engineers, ML Engineers and SREs to gather data engineering requirements to prototype, develop, validate and deploy data science and machine learning solutions

Requirements to be successful in this role:

• Strong knowledge and experience 5 + yrs in Python, Pandas, Data wrangling, ETL processes, Spark statistics, data visualisation, Data Modelling and Informatica.
• Strong experience with scalable compute solutions such as in Kafka, Snowflake
• Strong experience with workflow management libraries and tools such as Airflow, AWS Step Functions etc.
• Strong experience with data engineering practices (i.e. data ingestion pipelines and ETL)
• A good understanding of machine learning methods, algorithms, pipelines, testing practices and frameworks
• B. Tech / BE /MEng/MSc/PhD degree in computer science, engineering, mathematics, physics, or equivalent (preference: DS/ AI)
• Experience with designing and implementing tools that support sharing of data, code, practices across organizations at scale

What we offer :

• A positive, get-things-done workplace
• A dynamic, constantly evolving space (change is par for the course – important you are comfortable with this)
• An inclusive environment that ensures we listen to a diverse range of voices when making decisions.
• Ability to learn cutting edge concepts and innovation in an agile start-up environment with a global scale
• Access to 5000+ training courses accessible anytime/anywhere to support your growth and development (Corporate with top learning partners like Harvard, Coursera, Udacity)

What are we looking for

• Someone who takes ownership and believes in seeing through tasks to its completion despite facing any challenge.
• Someone who can work both independently and in collaboration with the team as and when the situation demands for it.
• Someone who is not averse to learning and growth and has an open mind about inputs/suggestions from any stakeholder.

Bonus point if you have:

• Experience in the Fintech domain and/ or B2C product experience 
• An engineering degree in Computer Science (or) software development experience 
• Worked on products with a massive user scale - 1 Mn+ DAUs especially 

What we offer

• A positive, get-things-done workplace
• A dynamic, constantly evolving space (change is par for the course – important you are comfortable with this)
• An inclusive environment that ensures we listen to a diverse range of voices when making decisions.
• Ability to learn cutting edge concepts and innovation in an agile start-up environment with a global scale
• Access to 5000+ training courses accessible anytime/anywhere to support your growth and development (Corporate with top learning partners like Harvard, Coursera, Udacity)