[VNG]Data Engineer

Mã vị trí: 22-IFRS-0461
Nơi làm việc: Tp.Hồ Chí Minh
Lương: Thỏa thuận

Mô tả công việc

  • Ensure industry best practices around data quality, data monitor
  • Work with complex data structures, manipulate, cleanse data, and perform transformations to make insights from data
  • Responsible to ingest data from files, streams, and databases. Process the data with PySpark, Hive,...
  • Develop efficient software code for multiple use cases leveraging Spark and Big Data Technologies for various use cases
  • Provide high operational excellence guaranteeing high availability and stability

Yêu cầu

  • Bachelor’s degree in computer science, engineering, mathematics, or a related technical discipline.
  • Having at least 1 year of experience working as a Data Engineer role
  • Experience in Hadoop ecosystem including HDFS, MapReduce, YARN, Hive...
  • Experience in building large-scale data processing (batch-processing, stream processing)
  • Experience with Apache Spark preferably in PySpark
Good to have: 
  • Experience with data warehouse and data management (data architecture, data modelling, data quality, data integration)
  • Good at programming languages: Python
  • Experience with relational SQL and NoSQL databases
  • Experience working with Big Data
  • Experience in Data API
  • Experience in Airflow pipelines