Department:
FSD

Job nature:
(T26) To assist the Systems Manager in planning, designing, implementing and managing artificial intelligence (AI) and Generative AI projects in the Fire Services Department (FSD). The Contract Systems Analyst will provide technical and project support covering AI infrastructure, computing hardware, Large Language Models (LLMs), model deployment and serving, open-source AI technologies, system integration, performance evaluation, security, capacity planning and ongoing operation of AI solutions. The staff will participate in the evaluation and implementation of different AI technologies and solutions, and may be assigned to other AI-related or application-related IT projects according to operational needs.

Responsibilities:
(T26)
1. To assist the Systems Manager in planning, designing, managing, implementing and supporting AI, Generative AI and related IT projects in the Department
2. To conduct technical studies, proof-of-concept exercises and evaluations of AI technologies, including LLMs, AI computing hardware, software platforms, model serving solutions and open-source AI technologies
3. To perform hands-on installation, configuration, deployment, integration, testing and troubleshooting of AI models and AI-related software components in on-premises, virtualised, containerised or other computing environments
4. To evaluate and deploy LLMs and other AI models, including model selection, model configuration, inference serving, quantisation, model optimisation and integration with application systems and APIs
5. To evaluate AI computing infrastructure and hardware, including CPU, GPU, NPU, memory, storage and network requirements, and to assist in capacity planning, resource sizing and performance optimisation for different AI workloads
6. To assess and make use of suitable open-source AI models, frameworks, libraries and platforms, including evaluation of their technical capabilities, compatibility, licensing, maintainability, security and suitability for departmental use
7. To design, implement and evaluate AI solution architectures, including model serving, retrieval-augmented generation, knowledge bases, vector databases, application integration, AI guardrails and other supporting components where applicable
8. To conduct AI model and system benchmarking, including evaluation of model quality, accuracy, response latency, throughput, concurrency, resource utilisation, scalability and other relevant performance indicators
9. To assist in the preparation and implementation of data preparation, model evaluation, prompt design, retrieval and knowledge management approaches required by AI applications
10. To coordinate with user divisions, internal IT teams, contractors, vendors and service providers on requirements analysis, architecture design, implementation, integration, testing, deployment and ongoing support of AI solutions
11. To monitor project progress and contractor deliverables to ensure compliance with technical requirements, quality standards, implementation schedules, security requirements and contractual obligations
12. To assist in assessing AI security and governance requirements, including data protection, access control, model security, prompt injection, sensitive information leakage, AI output risks, software supply-chain risks and other AI-related security concerns
13. To prepare and review technical documentation, including architecture designs, technical specifications, evaluation reports, benchmark reports, implementation plans, testing plans, operating procedures and project progress reports
14. To prepare technical specifications and conduct technical evaluation for the procurement of AI hardware, software, platforms, models and related professional services
15. To provide technical support and troubleshooting for AI infrastructure, AI platforms, models and related application services, including investigation of performance, compatibility and operational issues
16. To keep abreast of developments in AI technologies, LLMs, open-source AI ecosystems and AI infrastructure, and to assess their potential application in the Department
17. To be able to work under pressure, willing to work overtime if required on other ICT related duties
18. To perform other AI-related, application-related or ICT duties as assigned by the supervisor or the Government Representative from time to time; and
19. To provide on-call technical support and perform overtime work, including work outside normal office hours, on Saturdays, Sundays and public holidays, as and when necessary and upon the request of the Government Representative.

Requirements:
1. A Bachelor&;#8217;s degree or above in Computer Science, Computer Engineering, Information Technology, Artificial Intelligence, Data Science, Software Engineering or a related discipline, or an equivalent qualification
2. At least four
(4) years&;#8217; post-qualification information technology experience, of which at least two
(2) years should involve AI, machine learning, Generative AI, or other related technical areas
3. Practical and hands-on experience in deploying, configuring, integrating or supporting AI or LLM solutions
4. Good knowledge of LLM technologies and their implementation, including model inference, tokenisation, context handling, prompt processing, model serving, quantisation and performance optimisation
5. Practical knowledge of AI computing infrastructure and hardware, including CPU, GPU, NPU, memory, storage, networking and their impact on AI model deployment and performance
6. Experience with Linux environments, scripting and container technologies, and practical knowledge of deploying applications or AI workloads using containers
7. Experience with programming or scripting languages commonly used in AI development and integration, such as Python, and experience in integrating systems through APIs
8. Knowledge of the open-source AI ecosystem, including open-source LLMs, model repositories, AI frameworks, inference engines and related tools
9. Experience in evaluating AI solutions in terms of functionality, performance, resource utilisation, scalability and suitability for production use
10. Good analytical, problem-solving and troubleshooting skills, with the ability to investigate technical issues across application, model, software and infrastructure layers
11. Experience in preparing technical documentation, architecture designs, technical specifications, evaluation reports and project deliverables
12. Experience in coordinating contractors, vendors, users and technical teams in the implementation of IT or AI projects
13. Good command of written and spoken Chinese and English
14. Hands-on experience in deploying open-source LLMs or Generative AI solutions in an on-premises environment will be an advantage
15. Experience in model serving and inference technologies, model optimisation, quantisation or distributed AI inference will be an advantage
16. Experience in Retrieval-Augmented Generation (RAG), vector databases, embedding models, reranking, knowledge bases or AI agent technologies will be an advantage
17. Experience in AI infrastructure capacity planning, GPU/NPU resource management, performance benchmarking or high-performance computing will be an advantage
18. Experience in AI security, model governance, security risk assessment or implementation of security controls for AI systems will be an advantage; and
19. Experience in implementing AI solutions in large-scale environments will be an advantage.

Technical skills:
Data Administration (12)
IT Planning (12)
IT Security (12)
Linux System Administration (12)
Server Virtualisation Technology (6)
Source Control Management System (12)
Structured Query Language (12)
System Implementation and Maintenance/Support (36)
Web Programming (12)
Web Services (12)
XML (24)