Data engineer
| Job ref no. | TRM |
| Job level | Middle |
| Work experience | 6 years |
| Education | Bachelor Degree |
| Location | Kowloon |
| Employment type | Full Time |
| Benifits | 5 days work |
| Industry | Mass Transportation |
| Job function | Information Technology (IT) |
| Post on | 2024-02-01 |
Our client is a large corporation seeking System Analyst to join their team.
• Optimize, enhance, and support cloud-based data platform on Microsoft Azure
• Involve in cloud data platform enhancement project lifecycle with external vendor including design, development, testing, deployment, and documentation
• Work with Data Analyst to perform data preparation, cleansing, build optimized data models and visualization in Power BI
• Perform proof of concept for cloud data products
• University degree or above, major in IT, Computer Science, Data Science or other relevant disciplines
• 6 - 9 years working experience related to data platform
• Experience in Python and SQL (Hands on experience on Spark, Azure Data Factory, Event Hub / Kafka / Event Messaging, Azure Data Lake Storage Gen2, Databricks, Unity Catalog, Power BI Purview will be an advantage)
• Knowledge of Data & Analytics Multi Tenancy
• Knowledge of Tenancy Costing separation design (Workspace and Data Authorization)
• Knowledge on Data Lakehouse platform architecture
• Knowledge on ETL, Data Streaming, data pipeline, data model implementation and data visualization
• Knowledge on DataOps, MLOps, AIOps, ModelOps and FinOps
• Experience in software development lifecycle (SDLC)
• With strong sense of responsibility, self-motivated, committed, strong analytical and problem-solving skills, good interpersonal & communication skills, team player
• Contribute as a strong single contributor and also have ability to manage junior data engineers.
• Understand how to govern engineering activities and also plan.