A Internet SaaS Company is seeking a Senior Data Engineer to join their innovative Data Infrastructure Team. This role offers the opportunity to work with vast amounts of data and leverage cloud technologies to build reliable infrastructure solutions that empower the entire company. The successful candidate will manage large-scale data infrastructure, processing petabyte-level datasets with leading cloud platforms.
Senior Data Engineer
Salary: Competitive and based on experience
Location: Taipei
Keywords: Data Engineering, Cloud Platforms, ETL Workflows, Data Pipelines, Python, Java
What you'll do:
- Design and implement efficient data pipelines and ETL workflows to process large-scale datasets.
- Extract raw data from platforms such as GCP, AWS, and Elasticsearch.
- Utilize tools like Glue, Step Functions, and Workflow to collect, clean, transform, and store data.
- Ensure data quality throughout the pipeline by understanding and applying business logic.
- Build and maintain robust data cleaning processes and ensure long-term stability and maintenance.
- Monitor data pipelines, troubleshoot issues, and proactively address quality concerns.
- Develop and optimize ETL processes to integrate data from multiple sources into a unified platform.
- Manage and maintain Elasticsearch systems to ensure data completeness, consistency, and availability.
- Document workflows, maintain data dictionaries, and provide clear documentation for team members.
- Write clean, well-documented, and maintainable code for team clarity and reuse.
What you bring:
- Proven experience in designing and maintaining large-scale data pipelines and ETL workflows.
- Strong hands-on experience with cloud platforms such as AWS, GCP or Azure.
- Proficiency in tools like Glue, Step Functions, Workflow as well as open-source technologies such as Hadoop, Spark, Kafka.
- Solid understanding of data extraction, transformation and storage processes.
- Experience managing Elasticsearch systems ensuring data reliability and performance.
- Strong programming skills in Python, Java or other relevant languages.
- Ability to troubleshoot data quality issues and optimize pipeline performance.
- Excellent documentation skills to maintain workflows, data dictionaries and clear technical notes.
- Strong problem-solving skills and the ability to adapt workflows to evolving requirements.
- Passion for learning new technologies and staying updated with data engineering trends.
What sets this company apart:
Our client is a forward-thinking company that values innovation and collaboration. They are committed to providing their employees with an environment where they can thrive and make a real impact. Their Data Infrastructure Team manages large-scale data infrastructure, processing petabyte-level datasets with leading cloud platforms. They build scalable, flexible, and secure storage and processing systems to ensure data reliability and accessibility. The team works closely with business, analytics, and engineering teams to enable seamless workflows and actionable insights.
What's next:
Ready to take your career to the next level? Apply now!
Apply today by clicking on the link provided!
