Python/PySpark Developer with Data Engineering

Hirdetés feladója: Career Oppurtinities
Munkavégzés helye: Budapest XI. kerület (Pest megye)
Jelentkezési határidő: 2022. február 24.
Várható kezdés: 2022. február 25.

Tata Consultancy Services (TCS) is an IT services, consulting and business solutions provider that has been partnering with the world’s largest businesses in their transformation journeys for the last fifty years. A part of the Tata Group, India’s largest multinational business group, TCS has over 450,000 of the world’s best-trained consultants in 46 countries. As a top tier brand TCS is the number 1. TATA brand contributor on top of Jaguar Land Rover, TATA Motors, TATA Steel and TATA Global Beverages. TCS’s first Global Delivery Center was established in Budapest, Hungary in February 2001.

Elvárások a jelölttel szemben

  • Degree: IT degree
  • English language knowledge

IT skills:

  • Python/PySpark with Big Data platforms – 5+ years
  • Analytical/aggregate functions like Max, Min, average
  • Good understanding of UDFs

Experience in the execution of certain tasks:

  • ETL experience on any tool
  • Hands-on experience in development using Python with Big Data platforms
  • Proficiency using joins and set operations to combine datasets adhering to the best practices for handling big data datasets
  • Window functions in Python
  • Scrum/Agile development methodologies

Szükséges nyelvismeretek

  • Angol - Középfok, szóban és írásban

Feladatok


Development:

  • Design, develop and maintain data transformation pipelines
  • Development on Big Data platforms
  • Write unit test cases to test the developed code
  • Create SQL queries, joins, work with set operations, handle big datasets
  • Write UDFs for requirements

Data engineering

  • Analyzing raw data
  • Developing and maintaining datasets
  • Improving data quality and efficiency

banner_mi_allo