Barw Barw Medical Journal 2960-1959 2024 05 07 Assessment of Nursing Skill and Knowledge of ChatGPT, Gemini, Microsoft Copilot, and Llama: A Comparative Study 10.58742/bmj.v2i2.87 eng Dilan S. Hiwa College of Medicine, University of Sulaimani, Madam Mitterrand Street, Sulaymaniyah, Kurdistan, Iraq. dilan.sarmad.hiwa@gmail.com Sarhang Sedeeq Abdalla Smart Health Tower, Madam Mitterrand Street, Sulaymaniyah, Kurdistan, Iraq. sarhang.17000584@univsul.edu.iq Aso S. Muhialdeen Smart Health Tower, Madam Mitterrand Street, Sulaymaniyah, Kurdistan, Iraq. aso.muhialdeen@gmail.com Hussein M. Hamasalih College of Nursing, University of Sulaimani, Sulaymaniyah, Kurdistan, Iraq. hussein.hama@gmail.com Sanaa O. Karim College of Nursing, University of Sulaimani, Madam Mitterrand Street, Sulaymaniyah, Kurdistan, Iraq. sanaa.karim@gmail.com 2024 04 02 Introduction Artificial intelligence (AI) has emerged as a transformative force in healthcare. This study assesses the performance of advanced AI systems—ChatGPT-3.5, Gemini, Microsoft Copilot, and Llama 2—in a comprehensive 100-question nursing competency examination. The objective is to gauge their potential contributions to nursing healthcare education and future potential implications. Methods The study tested four AI systems (ChatGPT 3.5, Gemini, Microsoft Copilot, Llama 2) with a 100-question nursing exam in February of 2024. A standardized protocol was employed to administer the examination, covering diverse nursing competencies. Questions derived from reputable clinical manuals ensured content reliability. The AI systems underwent evaluation based on accuracy rates. Results Microsoft Copilot demonstrated the highest accuracy at 84%, followed by ChatGPT 3.5 (77%), Gemini (75%), and Llama 2 (68%). None achieved complete accuracy on all questions. Each of the AI systems has answered at least one question that only they got correctly. Conclusion The variations in AI answers underscore the significance of selecting appropriate AI systems based on specific application requirements and domains, as no singular AI system consistently surpassed others in every aspect of nursing knowledge.