Senior Data Engineer
Primary Location: Taiwan, Taipei ID de la oferta R0000035260 Categoría Data Managementsobre este trabajo
- Architect, implement, and optimize ETL/ELT workflows using tools such as Databricks and Informatica to ingest and process large datasets.
- Deploy and manage data infrastructure on Azure and AWS, including containerized services and serverless components.
- Partner with data scientists, software engineers, and business stakeholders to translate requirements into scalable data solutions.
- Monitor and tune pipeline performance, implement robust monitoring/alerting (e.g., Prometheus, DataDog), and troubleshoot production issues.
- Define and enforce data validation rules, lineage tracking, and governance standards to ensure accurate and compliant data usage.
- Build CI/CD pipelines for data code, automate deployments, and support model operationalization workflows.
- Share knowledge of data engineering best practices, conduct code reviews, and mentor junior engineers.
Qualification:
- Bachelor’s or Master’s degree in Computer Science, Engineering, Data Science, or related field.
- 8+ years of hands-on experience designing and building data pipelines and infrastructure.
- Strong proficiency in data engineering tools and technologies, such as Apache Spark, Hadoop, Kafka, and cloud-based platforms (AWS, Azure, or GCP).
- Hands-on experience with data modeling, ETL processes, and distributed data processing frameworks.
TRABAJOS PARA TI
There is no jobs to view
En la actualidad no tiene trabajos guardados para ver.
Asegúrese de aceptar las cookies “Funcional” para habilitar este módulo de modo que muestre los enlaces a los trabajos guardados. Podrá revisarlos aquí cuando vuelva a visitar esta página..
Más que un trabajo
