數據工程師
Job Description
我們正在尋找一位具備數據工程和 DevOps 技能的專業人才，負責設計、實施和維護高效的數據管道及基礎設施管理。理想的候選人將專注於構建和優化 ETL 工作流程，並擁有部署及管理自動化數據平台和應用的經驗。此職位將結合數據工程和 DevOps 職能，確保數據基礎設施的穩定性、擴展性與高效性。
We are looking for a professional with expertise in data engineering and DevOps to design, implement, and maintain efficient data pipelines and infrastructure management. The ideal candidate will focus on building and optimizing ETL workflows and have experience deploying and managing automated data platforms and applications. This position will combine data engineering and DevOps functions to ensure the stability, scalability, and efficiency of the data infrastructure.
Job Requirement
主要職責：
1.設計、實施和維護高效的 ETL 管道，確保數據流動、轉換和加載過程的自動化。
2.撰寫、優化並調試複雜的 SQL 查詢，用於數據提取、轉換和加載。
3.管理數據基礎設施，確保其可靠性、擴展性和性能。
4.實現並維護 CI/CD 管道，自動化數據管道和應用的部署、測試和升級。
5.與數據科學家、分析師及後端工程師合作，確保數據需求的滿足。
6.開發並維護相關文檔，記錄數據處理流程、基礎設施設置和操作流程。
Key Responsibilities:
1.Design, implement, and maintain efficient ETL pipelines to automate the flow, transformation, and loading of data.
2.Write, optimize, and debug complex SQL queries for data extraction, transformation, and loading.
3.Manage data infrastructure to ensure its reliability, scalability, and performance.
4.Implement and maintain CI/CD pipelines to automate the deployment, testing, and upgrading of data pipelines and applications.
5.Collaborate with data scientists, analysts, and backend engineers to ensure data requirements are met.
6.Develop and maintain relevant documentation, including data processing workflows, infrastructure setup, and operational procedures.
Other Conditions
必備條件:
1. 熟練使用 Apache Airflow 或其他工作流程管理工具來自動化數據管道。
2. 精通 SQL 查詢設計、優化及故障排除。
3. 熟悉 Docker 和其他容器化技術，用於應用和數據管道的部署。
4. 擁有設計和維護 CI/CD 管道的經驗
5. 具備 DevOps 實踐的經驗，特別是在數據基礎設施和應用部署方面。
加分項目:
1. ML Ops 流程經驗：設計和自動化機器學習模型生命周期。
2. 模型監控：監控模型在生產中的性能與穩定性。
3. 模型解釋性工具：熟悉 SHAP、LIME 等解釋性工具。
Must Have:
1.Proficient in using Apache Airflow or other workflow management tools to automate data pipelines.
2.Expertise in SQL query design, optimization, and troubleshooting.
3.Familiar with Docker and other containerization technologies for deploying applications and data pipelines.
4.Experience in designing and maintaining CI/CD pipelines.
5.Experience with DevOps practices, especially in data infrastructure and application deployment.
Nice to have:
1.ML Ops experience: Design and automate the machine learning model lifecycle.
2.Model Monitoring: Monitor the performance and stability of models in production.
3.Model Interpret ability Tools: Familiar with interpret ability tools like SHAP, LIME, etc.
Job Status Description
Expatriate
No business trip required
Working Hours
Day Shift
Remote Work
On-site
Job Location
台北市中山區樂群三路126號14樓
Holiday
Complies with Labor Standards Act
Onboard Day
Based on interview
Number of Vacancies
2-5 people
Stock and Bonus
Other Bonus
Experience Required
3-5 years
Education Required
University / Bachelor degree or equivalent
Department Required
Computer Engineering
Language Required
Additional Salary Information
◆員工團體保險 ◆員工教育訓練補助 ◆年終獎金/三節禮品 ◆優於勞基法規定的特休 ◆員工旅遊 ◆尾牙聚會 ◆慶生會 ◆每週下午茶時光 ◆零食櫃、全自動咖啡機、麵包、牛奶、水果 ◆營養午餐/伙食補助 ◆健康檢查 ◆明亮舒適的辦公環境 ◆部門聚餐及團建活動 Employee Benefits: ◆Group Insurances ◆Group Insurance ◆-Employee Training Subsidy ◆Year-End Bonus ◆Festival Gifts ◆Paid Time Off (PTO) beyond Labor Law requirements ◆Year-End Party ◆Birthday Celebrations ◆Weekly Afternoon Tea ◆Snack Bar, Coffee Machine, Bread, Milk , fruits ◆Lunch Subsidy ◆Health Check-up ◆Team Building Activities ◆Bright and Comfortable Office Environment
Salary Structure
Application Process
-
Resume Screening
...
Hiring Companies More Jobs
華翰物產實業股份有限公司
華翰物產成立於 1992 年，總部設於台灣高雄，2021年10月台北辦公室正式營運。 海外首設立的辦事處位於新加坡，經過業務擴增及拓展，目前已有許多海外辦公據點，包含中國、越南、印尼、英國、澳洲、俄羅斯…等國，在全球業務中，我們致力於符合華翰核心價值觀的方式開展工作，包含持續性、誠信、尊重、誠實和負責。 We established in 1992, with commercial head quarter in Singapore and across our global operations, we are committed to working in ways that ar......
- 能源、其他
- 100~500人
- 高雄市新興區青年一路156號
Be the First to Apply for These Hot Jobs!
IM POSSIBLE TAIWAN Ltd.
Account Manager, Web3, Global Business
We are seeking a highly motivated and detail-oriented professional to join our team as an Account Manager, Web3, Global Basis Business. The ideal candidate will bring strong client relationship skills, organizational capabilities, and a proactive mindset to support both internal operations and exter...
- 無管理責任
- 積極招募中Updated
方俊工程有限公司
監工工程師
1.監督及控管施工進度、品質、成本。 2.管理及解決施工問題。 3.協調各方溝通。 4. 需會操作AutoCad或Revit等軟體。 5. 協助其他文書作業及圖面繪製。 6. 其他主管交辦事項。 7.需有電力相關證照。 福利制度： 【保險類】勞保、健保、團體意外險、勞工退休金 【獎 金】端午獎金、中秋獎金、春節獎金、年終績效獎金、工作獎金 【訓 練】 新進人員教育訓練、證照課程補助 【其 它】免費宿舍、員工制服、公務機、尾牙聚餐 態度積極、有責任感、 對工作熱忱、出勤狀況佳、 善於溝通及抗壓性夠 方俊工程有限公司歡迎你的加入！ 若您想接受挑戰，歡迎您投遞履歷...
- 管理11~20人
- 積極招募中Updated
Join Us
Follow us to get the latest news about talent pools, jobs, and more!
