• J Chin Med Assoc · Mar 2024

    Comparative analysis of GPT-3.5 and 4.0 in Taiwan's medical technologist certification: A study in AI advancements.

    • Yang Wan-Hua, Yun-Hsiang Chan, Huang Cheng-Pin, and Tzeng-Ji Chen.
    • Department of Pathology and Laboratory, Taipei Veterans General Hospital Hsinchu Branch, Hsinchu, Taiwan, ROC.
    • J Chin Med Assoc. 2024 Mar 29.

    BackgroundThis study examines the comparative effectiveness of GPT-3.5 and GPT-4.0, in the certification of medical technologists (MT) in Taiwan, exploring their adeptness in processing complex medical language and their contributory role in the educational and communicative aspects of professional healthcare training.MethodsThis study used GPT-3.5 and 4.0 to test the medical laboratory technician professional college entrance examination questions. The questions in different fields, including six subjects, such as Clinical Physiology and Pathology, Hematology, and Blood Bank, among others were answered one-on-one using two GPT versions, simulating the situations during exam preparation.ResultsA total of 480 questions were analyzed and the results showed that both versions of the GPT met the certification standards. Version 4.0 was better than version 3.5 for all subjects, particularly in Clinical Biochemistry (score 96.25) and Microbiology (score 91.25). Outstanding performance compared to version 3.5, which had an average score of 65.42 and a maximum score of 77.5. Overall, version 4.0, which was significantly better than version 3.5 in both median and average scores, reflects a significant improvement in professional knowledge processing capabilities.DiscussionThe GPT can provide valuable support for both the upstream and downstream processes of MT certification. Future research can further explore the application of GPT in different educational and certification contexts and improve the passing rate of medical personnel in the certification process. This study provides useful information for exploring the potential applications of GPT in certifying medical examiners. Furthermore, it provides new directions for future research in medical education.Copyright © 2024, the Chinese Medical Association.

      Pubmed     Copy Citation     Plaintext  

      Add institutional full text...

    Notes

     
    Knowledge, pearl, summary or comment to share?
    300 characters remaining
    help        
    You can also include formatting, links, images and footnotes in your notes
    • Simple formatting can be added to notes, such as *italics*, _underline_ or **bold**.
    • Superscript can be denoted by <sup>text</sup> and subscript <sub>text</sub>.
    • Numbered or bulleted lists can be created using either numbered lines 1. 2. 3., hyphens - or asterisks *.
    • Links can be included with: [my link to pubmed](http://pubmed.com)
    • Images can be included with: ![alt text](https://bestmedicaljournal.com/study_graph.jpg "Image Title Text")
    • For footnotes use [^1](This is a footnote.) inline.
    • Or use an inline reference [^1] to refer to a longer footnote elseweher in the document [^1]: This is a long footnote..

    hide…