W6B - Workshop: RecChat: Testing an AI-Based Conversational Search Engine for the eCOVID-19 RecMap
| Friday, September 22, 2023 |
| 9:00 AM - 9:45 AM |
| Conference Room 6/7 |
Speaker
Artur Nowak
Evidence Prime
RecChat: Testing an AI-Based Conversational Search Engine for the eCOVID-19 RecMap
9:00 AM - 9:45 AMAbstract
Background: The eCOVID-19 RecMap is a collaborative effort involving multiple international organizations and aims to catalog the best available recommendations on COVID-19. Using the PICO framework, it enables decision-makers to identify relevant recommendations. Recently, numerous chat-based search solutions are transforming the way users perform information retrieval. This workshop aims to evaluate how these technologies can be applied in the context of guidelines.
Objective: To engage participants in testing and providing feedback on the experimental AI-based conversational search engine, ultimately enhancing its functionality, usability, and potential for better integration with decision support systems for users seeking COVID-19 recommendations.
Format:
This interactive workshop will comprise four main components:
Introduction (10 minutes): Briefly present the eCOVID-19 RecMap portal and the AI-based conversational search engine, highlighting its potential benefits and the role of workshop participants in refining the tool.
Hands-on Testing (30 minutes): Participants will be divided into small groups and provided with access to the search engine. Worksheets will be provided with a list of examples, but participants will be encouraged to test it using various queries and scenarios, exploring the tool's effectiveness in identifying relevant COVID-19 recommendations.
Group Discussions and Feedback (40 minutes): Groups will reconvene to share their experiences and discuss the search engine's strengths and areas for improvement. A facilitator will guide the discussion and capture key points for refining the AI-based conversational search engine.
Closing Remarks and Next Steps (10 minutes): Summarize the workshop outcomes and outline future steps for incorporating the feedback and improving the search engine.
Objective: To engage participants in testing and providing feedback on the experimental AI-based conversational search engine, ultimately enhancing its functionality, usability, and potential for better integration with decision support systems for users seeking COVID-19 recommendations.
Format:
This interactive workshop will comprise four main components:
Introduction (10 minutes): Briefly present the eCOVID-19 RecMap portal and the AI-based conversational search engine, highlighting its potential benefits and the role of workshop participants in refining the tool.
Hands-on Testing (30 minutes): Participants will be divided into small groups and provided with access to the search engine. Worksheets will be provided with a list of examples, but participants will be encouraged to test it using various queries and scenarios, exploring the tool's effectiveness in identifying relevant COVID-19 recommendations.
Group Discussions and Feedback (40 minutes): Groups will reconvene to share their experiences and discuss the search engine's strengths and areas for improvement. A facilitator will guide the discussion and capture key points for refining the AI-based conversational search engine.
Closing Remarks and Next Steps (10 minutes): Summarize the workshop outcomes and outline future steps for incorporating the feedback and improving the search engine.
Paper Number
65
Biography
Artur Nowak is a co-founder and CTO of Evidence Prime. . Artur obtained a MSc degree in Computer Science from Jagiellonian University in 2011. The title of his thesis was "Semantic Search: Design and Implementation of a Vertical Search Service''. Since then he has been working on various technical projects as a software engineer in the area of Computer Science, Natural Language Processing and Information Retrieval. At Evidence Prime, he leads projects in the field of AI, especially in the context of systematic review automation.
Justyna Lityńska
Evidence Prime
Workshop Facilitator
Paper Number
0
Biography
Justyna Lityńska is a Product Manager at Evidence Prime. She provides support to users of GRADEpro and takes part in the constant improvement of its features. With a background in biotechnology and an interest in communication, she has been engaged in projects requiring a connection between IT professionals and the scientific community in order to facilitate breakthroughs in the field of healthcare with the latest technologies.
Bart Dietl
Evidence Prime
Workshop Facilitator
Paper Number
0
Biography
Bart Dietl is the head of Product Development at Evidence Prime. He provides the pioneers of Evidence Based Medicine and the GRADE method with new solutions and leads the process of creating new tools that facilitate the guideline development process.
