Data Engineer

Our client is looking for a Data Engineer in Taiwan.

Key Responsibilities:

• Build and Architect core datasets
• Implement efficient ETL processes
• Build reliable and scalable data pipelines that process petabytes of data
• Build tools and framework for data analysis and visualization
• Propose changes to the logging structures or supporting new kinds of data analysis
• Translate business requirements into projects and prioritize based on impact
• Evangelize data architecture and ETL best practices

Key Requirements:

• Proficiency in data architecture and/or data warehouse design patterns
• Proficiency in database schema design
• Proficiency in efficient batch and streaming ETL design
• Strong coding skills in Python or Java
• Strong SQL skills
• Experience with Big Data technologies such as Hadoop, Spark, Hive and Presto/Impala
• Experience with real time data processing using Kafka and Flink
• Experience with workflow management framework such as Airflow, Luigi
• Experience with visualization tools such as Tableau, Superset, Redash
• Excellent communication, interpersonal and cross-functional skills
• A passion for understanding analytics use cases for data, architecting intuitive datasets to support these use cases and optimizing our methods of producing these datasets
• B.S. or M.S. in Computer Science or a related field
• 4+ years of experience

Nice to have:

• Experience supporting analytics teams studying user behavior and product metrics
• Experience building analytics frameworks and tools with broad adoption