Data Platform Lead
Consultant Jacky Ho
Date posted 05 September 20192019-09-05 2019-11-04 it Taipei TW TWD 1500000 2000000 2000000 YEAR Robert Walters https://www.robertwalters.com.tw https://www.robertwalters.com.tw/content/dam/robert-walters/global/images/logos/web-logos/square-logo.png
A world-leading technology company is recruiting a Data Platform Lead to join their team. In this role, you will be responsible for leading the data team to grow with the company.
- Collect business requirements and translate them into reliable solutions
- Design,build and maintain data lake, implement scalable data ingestion routines and high volume/throughput data pipelines in both near real-time and batch modes using best practices of data modelling, ETL/ELT processes in AWS cloud
- Integrate and select any Big Data tools and frameworks required to provide requested capabilities
- Above six years experience in big data technologies with thorough knowledge in the entire Hadoop technical stack, architecture, and infrastructure components
- Strong skills in RDBMS, NoSQL databases and Cloud
- Familiar with containers and micro-services
- Familiar with Scala and python
- two to three years hands-on experience in data streaming processing pipeline, Kafka, Spark, Flume or other equivalent skills.
- Familiar with Airflow
- People management experience
About the organisation
They have people and ethos to act with speed, innovation, enterprise and creativity. The scope of the offer, the size of the business, the freedom and autonomy to drive your career forward all adds up to a great place to work.