This academic project focused on developing a conversational chatbot within the medical domain by leveraging an open-source model. The primary objective was to improve the core GPT-2 model to create an assistant capable of providing precise, domain-specific information, using a fine-tuning approach.
My specific contributions to this group project were centered on the technical implementation and data-driven aspects of the chatbot.
This included:
Research & Ideation: I conducted in-depth research on the GPT-2 model and fine-tuning techniques. I also discovered and explored advanced methods like LoRA to enhance model training.
Data Collection & Analysis: I was responsible for the rigorous selection and collection of medical datasets for fine-tuning, ensuring the process adhered to ethical and legal requirements.
Fine-Tuning & Prompt Engineering: I led the fine-tuning of the GPT-2 model, adapting it to the specific needs of the project and correcting technical errors throughout the process. I also introduced prompt engineering to improve the quality of the chatbot's responses.
Interface & Deployment: I collaborated on the creation of an intuitive user interface using Gradio, enabling a simple question-and-answer format for user interactions. I also helped with the deployment of the chatbot on the Hugging Face platform for public access and real-time evaluation.
The model was also fine-tuned on basic english texts and Q&A because it was naturally bad at generating basic english text and understanding questions.
This project significantly enhanced my skills in AI and programming, and gave me a deeper understanding of the ethical and technical challenges of developing AI applications in a sensitive domain like medicine. The collaborative nature of the project and the need to solve complex technical problems were key to my professional development.
Question: "What is diabetes? "
Diabetes is a term used to describe a condition that is caused by a deficiency of insulin. Diabetes is a condition that is caused by a deficiency of insulin.
Diabetes is a condition that is caused by a deficiency of insulin.
Diabetes is a condition that is caused by a deficiency of insulin.
Diabetes is a condition that is caused by a deficiency of insulin.
Diabetes is a disease in which you have a low or high-calorie diet. Diabetics eat too much sugar and not enough protein. The high calorie intake causes blood glucose levels to rise.
High blood glucose levels cause damage to cells and organs. These damages are caused by the body's immune system attacking the pancreas, liver, and other cells.