Evaluation of medical students’ expectations for multimedia teaching materials: Illustration by an original method using the evaluation of a web site on cardiovascular rehabilitation




Abstract


Introduction


Different multimedia tools have been developed to help medical students prepare for the National Ranking Examination (NRE), rendering their choice quite difficult. No study has specifically evaluated students’ expectations regarding these materials.


Objectives


To learn how medical students in Dijon assessed a website dedicated to cardiovascular rehabilitation, and collecting their suggestions in order to meet their expectations and the goals of second cycle medical studies.


Methods


Eighteen second-cyle students were evaluated in a semi-directed manner and in ecological situation, a website specifically designed for the national curricula on cardiovascular rehabilitation for obtaining the Diploma of Specialty Studies (DES) for physical medicine and rehabilitation (PM&R) residents. Students also had to fill out a pretest and a posttest (5 MCQs).


Results


The overall quality of the site was deemed satisfactory (65.6 ± 7.7 points/100). Medical information was considered better than non-medical data and site’s design (respectively 84.8 ± 8.1, 61.1 ± 20 and 64.4 ± 14.9/100). Students found the site useful in terms of understanding the items related to cardiovascular rehabilitation, although they judged it not completely in line with the NRE goals. The average score increased significantly between the pre-and post-test (6.8 ± 0.8 vs. 5 ± 1.5/8, p < 0.05).


Conclusion


This site appears to be significantly useful for short-term knowledge improvement, but only partially meeting the expectations of second-cycle students. It seems relevant to study further possibilities for customizing and providing summarized learning for the NRE. These elements could serve as building grounds for the future version of this website.


Résumé


Introduction


De nombreux outils multimédias se sont développés pour la préparation à 1’Examen classant national (ECN), rendant parfois difficile le choix des sources pour les étudiants. Aucune étude n’a évalué les attentes des étudiants concernant ces supports.


Objectifs


Connaître le jugement d’étudiants en médecine Dijonnais sur un site Internet concernant la réadaptation cardiovasculaire et leurs suggestions d’adaptations à leurs attentes et aux objectifs du second cycle.


Méthodes


Dix-huit étudiants de second cycle ont évalués de manière semi-dirigée en situation écologique le site Internet élaboré pour les cours nationaux de réadaptation cardiovasculaire du DES de MPR. Ils remplissaient également un prétest et un post-test (5 QCM).


Résultats


La qualité globale du site était jugée satisfaisante (65,6 ± 7,7 points/100). Les informations médicales étaient jugées meilleures que les informations extramédicales et la conception (respectivement 84,8 ± 8,1 ; 61,1 ± 20 et 64,4 ± 14,9/100). Les étudiants ont trouvé le site utile pour la compréhension des items relatifs à la réadaptation cardiovasculaire, même si il leur apparaît moyennement en adéquation avec le programme de l’ECN. La note moyenne a significativement augmenté entre le pré- et le post-test (6,8 ± 0,8 vs 5 ± 1,5/8 ; p < 0,05).


Conclusion


Ce site semble efficace pour l’amélioration à court terme des connaissances, mais ne répond que partiellement aux attentes des étudiants. Des possibilités de personnalisation et de révision rapide type « dernier tour » pour l’ECN apparaissent souhaitables. Ces éléments pourront servir de base pour l’amélioration de la version future.



English version



Introduction


Medical education is constantly evolving. This field had been traditionally based on exchanges and interactions in classrooms or amphitheaters with a group of students facing one teacher. Internet and specifically Web 2.0 sociable technologies and social software helped create a new type of e-learning and training environment, which is quite challenging for the most traditional types of curricula. Some even call it education or training 2.0 . Online training or e-learning, by using Web 2.0 becomes a “technical distance learning” media tool. This “technical distance learning” nature “highlights the practices of e-learning based on educational designs and media usage not widely implemented today on campus universities” .


Thanks to Internet, nowadays students can quickly access various types of information (text, audio, video files), and are thus capable of self-training and at a distance thus limiting the constraints of attending classes. According to Karsenti, “several studies have demonstrated that students learn more and in a shorter period of time with information and communication technologies (ICT) and e-learning than face-to-face in a classroom” . The authors also unveiled other advantages for distance learning such as flexibility, possibilities for each student to study at his or her own pace, increased communication and networking options as well as different types of teaching and training methods, thus increasing students’ motivation. Furthermore, according to Dubois “Integrating educational information and communication technologies (EICT) into medical education curricula is being discussed today in our universities” . However, if the benefits of integrating ICT in the educational field have been largely studied and used in other areas , validating that this learning mode is appreciated by students , it had remained quite confidential in medical studies until the last few years .


Furthermore, regarding the National Ranking Examination (NRE) that ends the second-cycle of medical studies in France, some online learning tools have been developed these past years since now, on top of paper references used by several generations of medical students, we can add a wide array of web-based documents (e.g. specialized websites, online conference, social networks or medical students social forums).


We can in fact differentiate:




  • private websites often funded by pharmaceutical labs such as Aventis-Internat (Aventis Residency available at aventis-internat.org ), the Hippocrates conference promoted by Servier Laboratories ( laconferencehippocrate.com ). They offer educational learning tools, (notes, written up medical questions); online self-evaluations (corrected documents, medical archives, medical imaging quizzes) and social forums open to medical students;



  • these past years real online conferences have also emerged with an online live examination once a week, such as:




    • Conf@Net available at Confnet.org ,



    • Conference+++ ( Conf-plus.com ). Each conference is available on the web at 7 pm at the same time when the live conference is being held at the Necker Hospital for Sick Children in Paris;




  • there are also some websites managed by medical students such as the French National Association of Medical Students (ANEMF on e-carabin.net ), or another site grouping medical students, i.e. remede.org , these websites offer useful recommendations and advice to students, social forum and links to course notes or corrected documents;



  • some sites with educational contents specifically targeted for students, often have a dedicated area for medical studies with reference to the NRE, such as:




  • the UNF3S (Online French-Speaking University of Health and Sport Sciences) hosting the online French-speaking medical university ( www.umvf.org ),



  • The website from the Nice University in France, Intern@TICE ( internatice.unice.fr ) offering students and teachers relevant web links for preparing for the NRE.



There is no privileged website used by all medical students to study for the NRE. Instead of being reassuring, these profuse sources of information tend to increase their anxiety and feeling of helplessness faced with the amount of knowledge to be acquired. This is why the quality of the working document is essential, and if the accuracy of the data remains the core issue, all students have their own specific method for acquiring specific medical data that guides their preferences. Thus, in light of the increasing evolution of information communication technologies it seemed quite important to learn about the opinions and expectancies of end-users on the content and design of a medical website in order to render it the most adapted to their needs. In fact, without being completely obsolete, the initial various technical or Internet connection problems have gradually been replaced by questions related to how to properly use this e-learning, for which there are no specific recommendations yet (e.g. slides, videos). . Furthermore, students’ expectations regarding these web contents are still not completely known and could differ from the message that web designers tried to deliver .


Medical students being “addicted” to these types of web resources, we based our work on their feedback while being inspired by an original evaluation methodology for medical education websites, already used in studies regarding e-learning expectations of patients with low-back pain .


Getting ready for the NRE remains a complex, difficult and long-term task filled with anxiety that can sometimes be quite overpowering. The NRE curriculum consists in 345 questions directly related to the objectives lined-up for the second part of their second cycle, organized around 11 transdisciplinary modules, 70 questions on “diseases and great syndromes”, and 53 questions based on clinical situations, i.e. “diagnostic orientation when faced with such and such symptoms”. Physical Medicine and Rehabilitation (PM&R) is the medical specialty from module 4, entitled “Disability, impairments, dependence” and includes five items:




  • n o . 49 “Clinical and functional evaluation of motor, cognitive or sensory disabilities”;



  • n o . 50 “Complications related to immobility and long bedridden periods”;



  • n o . 51 “Disabled children: orientation and care management”;



  • n o . 52 “Mental retardation. Legal rights, protection and assistance from a legal guardian”;



  • n o . 53 “Main physical medicine and rehabilitation techniques”.



Rehabilitation aspects are also covered in several other items, mainly the ones regarding debilitating chronic pathologies, especially cardiovascular disorders and cerebrovascular disease (Item n o . 129: “Cardiovascular risk factors and prevention”; Item n o . 131: “peripheral obliterating arterial disease of the aorta and the lower limbs; aneurisms”; Item n o . 132 “Chest pain and myocardial infarction”; Item n o . 133 “Cerebrovascular disease: Stroke”; Item n o . 250 “Cardiac insufficiency in adults”). Regarding those last two items, our department was involved in the design of a medical education website dedicated to students preparing for their Diploma of Specialized Studies (DES) in physical medicine and rehabilitation (PM&R) and Diploma of Inter-University Functional Rehabilitation (on a national level).


The aim of this study was to collect the opinions and critics of second-cycle medical students in Dijon, France on this website dedicated to cardiovascular rehabilitation, as well as asking for their suggestions for adapting the website to their expectations and meeting the national objectives of second-cycle medical studies. All this in order to evaluate the changes to be made for a further version of the website and evaluate the need or not to propose a version more-specifically designed to the expectancies of second-cycle medical students.



Material and methods



The educational tool


It was designed by the multidisciplinary team of the cardiovascular rehabilitation department of the PM&R unit of the University Hospital of Dijon, (Pr. Casillas, Dr. Vergès, Dr. Salmi-Belmihoub, physiotherapists, nurses and a nutritionist). This website was made possible with help from the pathway (la Passerelle), a service from the University of Burgundy which missions are to provide distant learning education (Center for open training and distant learning [CFOAD]: Centre de Formation Ouverte et à Distance) and creating multimedia resources (Multimedia Resources Creation Center [CReM] : Centre de Création de Ressources Multimédia). La Passerelle is the main gate for any multimedia project from the University of Burgundy and helps design, create and promote these projects.


This e-learning targeted at PM&R students preparing their DES or DIU (national education program) has been available online since May 2006 at http://passerelle.u-bourgogne.fr/publications/cofemer/RCV/ . It is the only educational tool of this type available in the French language and covering the field of cardiovascular rehabilitation. It was developed by a Hospital-University team from Burgundy responsible for the national teaching of PM&R for the DES as well as the most important French University Diploma (DU) for non-physicians healthcare professionals. Thus, this website was noted among the documents of reference for preparing these learning courses. It was also inserted as a web link on the COFEMER website (French College of PM&R Teachers – Collège Français des Enseignants en Médecine physique et Réadaptation).


It has been a well-noted education tool consulted and appreciated in spite of its limited interactivity. It was cited as an example of educational innovation several times in the field of medical studies for future MDs. It includes commented slideshows associated to pathophysiological elements and proposals for rehabilitation training program adapted to cardiovascular pathologies, which prevalence are on the rise: atherosclerotic coronary artery disease, chronic cardiac insufficiency, lower extremity arterial disease. These slideshows are also available without speaker’s comments. It provides videos that are relevant for educational demonstrations needed for understanding PM&R techniques while involving different types of healthcare professionals: e.g. physicians, physiotherapists, nurses, nutritionists.


However, it is a fixed learning tool, not taking into account the latest pathophysiological advances and therapeutic methods, especially in PM&R. Moreover, the clinical exploration methods (e.g.: standardized gait tests) and other exams (e.g. using the Brain Natriuretic Protein), useful to the individualization and adaptation of cardiovascular rehabilitation programs, have greatly evolved. Furthermore, the role and modalities of therapeutic education and effort strength training for this kind of rehabilitation have been considerably strengthened. Finally, new indications for similar types of care management requiring the same human and technical competencies have emerged: e.g. stroke patients, chronic respiratory insufficiency and chronic spine pain.


For these reasons, it seems quite justified to redesign this e-learning tool and update it in order to benefit from the latest technological advances in online multimedia and adapt it to the expectancies of different types of end-users, especially second-cycle medical students. These students do have very different objectives, they can be purely knowledge-oriented, i.e. items comprehension, or directed to preparing for the NRE which would render an updated simplified version probably quite unsuited to their expectancies.



Evaluation of the website by the students


This evaluation was conducted by second-cycle medical students during their residency in the PM&R department. The evaluation took place in a classroom by groups of three students. The students had 5 minutes to fill-out the pretest ( Appendix 1 ). The supervisor launched successively the three modules regarding the generalities on the website and cardiovascular rehabilitation in patients with coronary diseases. The education tool was projected from a laptop to a video projector and students were free to stop at any moment to relisten to certain points if they wanted to. The total time for watching the video was 50 minutes. After this time period, students had 5 minutes to fill-out the post-test (identical to the pretest) and 10 minutes to fill-out the evaluation questionnaire ( Appendix 2 ). The latter was inspired by an original assessment methodology for medical websites, already used in studies regarding patients’ expectancies in this field . The so-called “medical” information is specifically dedicated to the pathology, seen under the somatic, clinical and therapeutic angle. The so-called “extramedical” information is related to more general aspects of patients’ care management, excluding diagnostic or therapeutic care, such as social, professional and psychological impact of the pathology. Finally, the quality of the design was related to the site’s ergonomics and clarity of the presentations. The questionnaire ended with a space for students to express themselves and list their proposals for improving the existing version in order to better fit their needs and/or prepare for the NRE. Finally, the MCQs were corrected with the supervisor.



Analysis of the results


Evaluation scores, as well as pre- and posttest scores, are listed by their mean and standard deviation. The mean pre- and posttest scores were compared using the non-parametric Wilcoxon signed-rank test. The significance threshold was set at p < 0.05. The calculations were computed with the Statistica 7.0 software for Windows.



Results



Population


The evaluation was conducted by 18 students: six DCEM4 students (year 6 of medical school, preparing for the NRE) (four boys, two girls), eight DCEM3 students (year 5 of medical school) (six girls, two boys) and four DCEM2 (year 4 of medical school) students (two boys, two girls).



Evaluation of the learning support tool


The mean score for overall quality of the website was over 50/100 points (65.6 ± 7.7 pts) ( Table 1 ). The mean score for quality of medical information was very high (84.8 ± 8.1 pts), much higher than the ones for extramedical information (61.1 ± 20 pts) and design (64.4 ± 14.9 pts).



Table 1

Mean scores and standard deviations for the various items of the website evaluated by the students.

















Item evaluated Med Extra-Med Design Global
Mean Score (on 100 points) 84.8 ± 8.1 61.1 ± 20 64.4 ± 14.9 65.6 ± 7.7















Item evaluated Item comprehension Meeting NRE expectations Meeting personal expectations
Mean Score (on 100 points) 75 ± 8.7 41.2 ± 29 63.9 ± 13.6

Med: medical information on the pathology, approached under a somatic, clinical or therapeutic angle; Extra-Med: more general elements such as socioprofessional and psychological impact of the pathology; Design; website ergonomics and clarity of the presentation.


The mean score regarding the relevance of the website on cardiovascular rehabilitation items’ comprehension was also largely above average (75 ± 8.7 pts), globally matching the students’ expectations (63.9 ± 13.6 pts). However, their opinions regarding the website matching the NRE program was not as good, (41.2 ± 29 pts). The main limit reported was the lack of a synthetic module such as “take home message”.



Results of pre- and pos-test


The mean note at pretest was 5 ± 1.5 points out of 8 (Ranges: 2–7 points), improving significantly at 6.8 ± 0.8 (Ranges: 6 and 8 points) for the posttest ( p < 0.05) ( Fig. 1 ).




Fig. 1


Mean and standard deviation of pre- and posttest scores.



Discussion


The main results of this study show that the overall quality of this website, initially designed for third-cycle medical students, was globally well noted by second-cycle medical students (65.6 ± 7.7 pts out of 100), essentially due to the quality of purely medical information. For the actual version, its relevance lays mainly in helping understanding and reviewing the medical items covered, yet for students it doesn’t seem to be a properly adapted tool to prepare for the NRE. Comments from students allowed for unveiling some points to be improved and others to be developed in order to produce a new version better suited to their expectancies. Finally, the immediate impact of this type of multimedia support tool on improving students’ knowledge seems nevertheless quite relevant and interesting.


The quality of medical information is very well noted by students, which is quite reassuring since it is of course the prime objective for this type of educational learning tool. Nevertheless, the concept does not always seems to fully meet students’ expectations, especially regarding the module on generalities of cardiovascular rehabilitation relevance, based on too many epidemiological studies “There are too many studies quoted, with globally positive results but on elements that are often quite different, not helping to clarify the general relevance, even if the duration of the presentations was quite good” (DC3 student).


The quality of extramedical information is not judged as relevant (61.1 ± 20 pts) with however some very divided opinions, as illustrated by the large standard deviation. The lower score is possibly related to the fact that these notions were covered in a very rigid format, contrarily to aspects covering strength retraining with practical photos and videos. The notion regarding the relevance of global care management seems however quite well perceived: “it interesting to see that cardiac rehabilitation is not just about riding a bike” (DC2 student). This certainly represents an added value in the framework of preparing for the NRE, were points “collected” from transversal documents are more easily obtained by having a global vision of the patient.


Website design and concept were also differently appreciated by students with a mean score of 64.4 ± 14.9 pts. Some aspects are more technical than educational: for example one of the speakers was evaluated as “having a monotonous tone not forcing attention” (DC4 student). The global presentation, associating the video of the presenter and one slide summing up the main elements covered, does however seem to allow for a good comprehension of the relevant item (mean score for helping to understand the information 75 ± 8.7) but probably poorly adapted for a “last round” of studying for the NRE (meeting with NRE program’s curriculum was evaluated as poor, 41.2 ± 29 pts). This element is particularly underlined by DC4 students who are in the midst of preparing for the exam: “there are some missing slides for a summary of the main elements”; “it would be good to have a summary at the end of each covered theme” .


Finally, in spite of these noted imperfections, this educational learning tool did allow for a significant knowledge improvement based on the results from the pre- and posttests.


Nevertheless, this work presents several limitations.


The main bias is related to the low number of students recruited during their residency training within the department, who might have artificially over-noted some items to be “please” their teacher or in “fear” of not getting their residency training validated. The low number of students could not let us evaluate the possible specificities depending on their year of study. Furthermore, the website version evaluated was targeted at DES students when second-cycle students are essentially motivated by preparing for the NRE. Nevertheless, our objective was above all to learn about their opinions and proposals and this work brings up new pathways for discussion.


Furthermore, the impact on students’ knowledge was only evaluated on the short term only partially meeting the educational objective of any type of teaching.


Learning tools vary quite greatly from one student to the next but the reasons for these individual preferences have not been assessed in this study. Some previous studies, especially in Quebec, promote however the development of these multimedia educational tools : “the e-learning experience with courses available online conducted at the University of Quebec at Hull, brought us to the conclusion that virtual online courses had a very positive impact on students’ motivation, but there still is a huge gap between university classroom and the virtual classroom”.


Finally, one last limitation is in regards to the artificial nature of this evaluation. In fact, the students did not have to do a search using keyword to access the website. This method is nevertheless in accordance with the main objective of this study, i.e. evaluate students’ expectancies and not their research strategies, which requires a more complex methodology . It could still be relevant to make this website “stand out” from others by clearly having it referenced as following a quality chart, already clearly established for medical websites, such as labels or rules and regulations , for example “Health On the Net Foundation » (HON) 1


1 Health On the Net Foundation. http://www.hon.ch/ .

which is probably the oldest and more recognized website quality label, used by more than 300 websites actually recommended by the French National Health Agency (HAS). Furthermore, it would probably be interesting to specifically distinguish the websites according to their educational objectives: educational/comprehension or preparation for exams, especially the NRE. More specifically for educational websites, it seems important that teachers get involved in the creation of the websites by validating the content, and for them to be easily identifiable, in order to direct students towards the right sources, since the constant advances in ICT will probably change teaching modalities in the future. In fact, beyond knowledge transmission, teachers will also have to teach how to select relevant information using a critical mind. Thus, as recently written by Umberto Eco: “In the future, education will have to focus on the art of filtering, it will not be necessary to teach where Katmandu is or who was the first king of France after Charlemagne, since that information is available everywhere. However, we should ask students to look at 15 websites in order to determine which ones they deemed the most reliable. We should teach them comparative techniques” .



Conclusion


Second-cycle students did appreciate this website mostly for the quality of its medical contents and how it helped their comprehension on various items from pathophysiology to clinical data. This site seems quite effective for short-term knowledge improvement. However, this type of format does only partially meet students’ expectations in the framework of preparing for the NRE. Possibilities for personalizing the website and including some quick overview module for a “cramming” type of studying for the NRE seem to be good options. These elements could be the basis for improving the future version. An important progress could be a bigger interactivity as well as the possibility to make changes to the website by inserting, for example, a tab dedicated to the most recent references of the literature to lighten the slides, or a summary for NRE last-minute studying on each of the topics. Advances in Web 2.0 should also allow students to adjust the courses to their own needs. This would then make the website more adapted to various types of end-users who would be most likely to visit it. The total duration of such an educational tool, with an “à la carte” program should be between 60 and 90 minutes. Now that telemedicine is a reality, it seems highly relevant for Teachers’ colleges and Scientific Societies to be involved in order to put online valuable quality educational teaching modules. However, we should keep in mind that if these supports seem interesting, the place of an “attractive” teacher must remain quite central, in order to give people the same opportunities for accessing medical studies and not worsening social inequalities.


Disclosure of interest


The authors declare that they have no conflicts of interest concerning this article.





Version française



Introduction


L’enseignement est un univers en permanente mutation. Il était traditionnellement organisé sur les bases d’échanges ou d’interactions dans une salle ou un amphithéâtre regroupant étudiants et un enseignant. L’Internet, en particulier le Web 2.0 et les médias sociaux facilitent la mise en place d’un nouveau type d’enseignement et d’apprentissage, représentant un challenge pour les formes plus conventionnelles de pédagogie. Certains l’appellent même l’enseignement ou l’apprentissage 2.0 . La formation en ligne, se servant de cet outil, est une construction dite « technopédagogique ». Ce caractère technopédagogique, « met en évidence des pratiques de la formation à distance fondées sur une méthodologie de design pédagogique et sur un usage des médias peu mis en œuvre, jusqu’à aujourd’hui, pour les universités campus » .


Grâce à Internet les étudiants ont aujourd’hui la possibilité d’accéder rapidement aux sources d’informations, accessibles sous diverses formes (texte, audio, vidéo), et pourraient ainsi s’autoformer et limiter ainsi les contraintes de formations présentielles. D’après Karsenti, « de nombreuses études montrent qu’un étudiant peut apprendre plus, et plus vite, avec les technologies d’information et de communication (TIC) et les cours en ligne qu’en face à face dans une salle de classe » . Il pointe également d’autres avantages de la formation à distance comme la flexibilité, la possibilité pour chacun d’adopter un rythme qui lui est propre, les possibilités de communication et d’interactions accrues, et la variété des modes d’enseignement et d’apprentissage, augmentant la motivation des étudiants. Par ailleurs, selon Dubois « L’intégration des technologies de l’information et de la communication pour l’enseignement (TICE) dans la formation médicale est un thème d’actualité dans la majorité de nos facultés » . Cependant, si les bénéfices d’intégrer les TIC dans l’enseignement ont été largement étudiés et utilisés dans d’autres domaines , et que cette modalités est appréciée des étudiants , leur utilisation est resté limité jusqu’à ces dernières années dans les études médicales .


Dans le domaine en particulier de la préparation de l’Examen Classant National (ECN), qui clôture le second cycle des études médicales, des outils d’aide en ligne se sont largement développés ces dernières années puisque, aux collections de références papier utilisées par plusieurs générations d’étudiants, s’ajoutent désormais toute une panoplie de documents disponible sur Internet (sites spécialisés, conférences en ligne, blogs ou forum carabins, etc.).


On peut ainsi distinguer :




  • les sites dépendants d’organismes privés, souvent financés par des laboratoires pharmaceutiques comme par exemple Aventis-Internat ( aventis-internat.org ), la conférence Hippocrate soutenue par les Laboratoires Servier ( laconferencehippocrate.com ). Ils proposent des outils de travail (fiches, questions rédigées), des évaluations en ligne (dossiers corrigés, annales, quiz iconographiques) et des forums ouverts aux étudiants en médecine ;



  • depuis quelques années de véritables conférences en ligne sont apparues avec examen en direct une fois par semaine, comme par exemple :




    • Conf@Net accessible sur Confnet.org ,



    • Conférence+++ ( Conf-plus.com ) Chaque conférence est accessible par Internet à partir de 19 heures en même temps que la conférence ayant lieu à l’hôpital Necker à Paris ;




  • des sites sous la responsabilité d’étudiants en médecine comme l’Association nationale des étudiants en médecine de France (ANEMF) sur e-carabin.net ), un autre regroupement d’étudiants en Médecine sur remede.org , qui proposent des nombreux conseils aux étudiants, des forums et des liens vers des cours en ligne ou des dossiers corrigés ;



  • des sites de contenu pédagogique destinés spécifiquement aux étudiants, comportant un espace concernant les études médicales avec une partie réservée à l’ECN, tels que :




  • l’université numérique francophone des sciences de la santé et du sport (UNF3S) qui héberge l’université médicale virtuelle francophone ( www.umvf.org ).



  • le portail de la faculté de nice Intern@TICE ( internatice.unice.fr ) qui propose aux étudiants et aux enseignants une sélection de liens pertinents pour la préparation aux ECN.



Il n’existe pas de source privilégiée par l’ensemble des étudiants pour préparer l’ECN. À défaut de les rassurer, cette abondance de sources d’information aurait plutôt tendance à accroître l’anxiété et le sentiment d’impuissance devant la somme de connaissances à assimiler. La qualité du document de travail est donc capitale, et si l’exactitude des données reste évidemment le prérequis essentiel, les méthodes d’acquisition propres à chaque étudiant vont orienter leurs préférences. Ainsi, au vu de l’évolution galopante des TIC il apparaît important de connaître les avis et les attentes des utilisateurs sur le contenu et la forme du site pédagogique médical le plus adapté. En effet, sans disparaître complètement, les divers problèmes techniques ou reliés à l’accès à Internet ont ainsi graduellement fait place à des questionnements liés aux modalités d’utilisation de ce support, pour lequel il n’existe pas de recommandations spécifiques à l’heure actuelle (diaporamas, vidéos…) . De plus, les attentes des étudiants concernant ces supports sont imparfaitement connues et pourraient différer du message que les concepteurs du site ont pu vouloir délivrer .


Les étudiants du second cycle étant de gros « consommateurs » de ce type de ressources, nous nous sommes tourné vers eux pour ce travail, inspiré d’une méthodologie originale d’évaluation des sites Internet médicaux, déjà utilisée dans des travaux concernant les attentes de patients lombalgiques dans ce domaine .


La préparation de l’ECN demeure en effet pour les étudiants un travail de longue haleine, source d’anxiété parfois importante. Le programme de l’ECN est basé sur 345 questions directement en relation avec les objectifs de la seconde partie du second cycle, qui s’articulent sous la forme de 11 modules transdisciplinaires, 70 questions portant sur « maladies et grands syndromes », et 53 questions type « orientation diagnostic devant… ». La médecine physique et réadaptation (MPR) constitue la discipline médicale de support du module 4, intitulé « Handicap, incapacité, dépendance », et comporte cinq items :




  • n o 49 « Évaluation clinique et fonctionnelle d’un handicap moteur, cognitif ou sensoriel » ;



  • n o 50 « Complications de l’immobilité et du décubitus » ;



  • n o 51 « L’enfant handicapé : orientation et prise en charge » ;



  • n o 52 « Le handicap mental. Tutelle, curatelle, sauvegarde justice » ;



  • n o 53 « Principales techniques de rééducation et de réadaptation ».



Les aspects rééducatifs sont également envisagés dans de nombreux autres items, principalement ceux concernant les pathologies chroniques incapacitantes, et en particulier les pathologies cardio- et cérébrovasculaires (Item 129 : « Facteurs de risque cardiovasculaire et prévention » ; item n o 131 : « Artériopathie oblitérante de l’aorte et des membres inférieurs ; anévrysmes » ; item n o 132 « Angine de poitrine et infarctus myocardique » ; item n o 133 « Accidents vasculaires cérébraux » ; « Item n o 250 « Insuffisance cardiaque de l’adulte ». Concernant ces derniers items, notre service a participé à la conception d’un site d’enseignement destiné aux étudiants du diplôme d’étude spécialisé (DES) en MPR et du diplôme interuniversitaire de rééducation fonctionnelle (enseignement national).


L’objectif de ce travail était de recueillir le jugement d’étudiants en médecine Dijonnais du deuxième cycle sur ce site Internet concernant la réadaptation cardiovasculaire, et leurs suggestions d’adaptations à leurs attentes et au objectifs du second cycle. Cela dans le but d’évaluer les adaptations à apporter à une version ultérieure de ce site, et de juger de la nécessité ou non de proposer une version répondant plus spécifiquement aux attentes des étudiants du second cycle des études médicales.



Matériel et méthodes



Le support pédagogique


Il a été réalisé par l’équipe médicale et paramédicale de l’unité de réadaptation cardiovasculaire du pôle de rééducation-réadaptation du CHU de Dijon, (Pr Casillas, Dr Vergès, Dr Salmi-Belmihoub, les kinésithérapeutes, infirmières et la diététicienne). Ce support a été réalisé grâce à l’aide de « la Passerelle » qui est un service de l’université de Bourgogne dont les missions sont l’enseignement à distance (CFOAD : Centre de formation ouverte et à distance) et la création de ressources multimédia (CReM : Centre de creation de ressources multimédia). La Passerelle est le guichet unique pour tout projet multimédia de l’université de Bourgogne et aide les porteurs à élaborer leurs projets.


Ce téléenseignement sur la réadaptation cardiovasculaire, destiné aux étudiants du DES de MPR et du DIU (enseignement national) a été mis en ligne en mai 2006 sur le site http://passerelle.u-bourgogne.fr/publications/cofemer/RCV/ . Il s’agit du seul support pédagogique de ce type dans le domaine de la réadaptation cardiovasculaire en langue française. Il a été développé par une équipe hospitalo-universitaire bourguignonne qui est responsable sur ce thème de l’enseignement national au DES de MPR ainsi que du plus important DU français destiné aux paramédicaux. Ainsi, ce site était indiqué parmi les documents de référence pour la préparation à ces enseignements. Il a également été inséré comme lien sur le site du COFEMER (Collège français des enseignants en médecine physique et réadaptation).


Il a représenté un moyen pédagogique consulté et apprécié malgré son caractère d’interactivité limité. Il a été pris à plusieurs reprises comme exemple d’innovation pédagogique dans le domaine de l’enseignement destiné aux futurs médecins. Il comprend des diaporamas commentés associant des éléments physiopathologiques et des propositions de programmes de rééducation adaptés à des pathologies cardiovasculaires dont la prévalence est croissante : coronaropathies athéromateuses, insuffisance cardiaque chronique, artériopathie des membres inférieurs. Ces diaporamas sont également consultables sans l’orateur. Il permet la consultation de vidéos ayant un intérêt de démonstration pédagogique indispensable à la compréhension de la réadaptation, en faisant intervenir différents types de professionnels : médecins, kinésithérapeutes, infirmières, diététiciennes…


Il s’agit cependant d’un enseignement figé ne tenant pas compte des avancées des connaissances physiopathologiques et des moyens thérapeutiques, notamment rééducatifs. Par ailleurs les moyens d’investigations cliniques (exemple : tests standardisés de marche) et paracliniques (exemple : utilisation du Brain Natriuretic Protein) utiles à l’adaptation et à la personnalisation des programmes de réadaptation cardiovasculaire ont évolué. De plus le rôle et les modalités de l’éducation thérapeutique, pivot avec le reconditionnement à l’effort de cette réadaptation, ont été considérablement renforcés. Enfin, de nouvelles indications de prise en charge très proches et mobilisant les mêmes compétences humaines et techniques sont apparues : cérébrovasculaires, insuffisants respiratoires chroniques, rachialgiques chroniques…


Pour ces raisons la réélaboration d’un tel enseignement en ligne, actualisé et bénéficiant des avancées technologiques récentes dans le domaine des multi médias apparaît justifié, afin de le rendre modulable et adapté aux attentes de divers publics, en particulier les étudiants du second cycle. Ces étudiants ont en effets des objectifs variés, qui peuvent être pédagogiques purs, c’est-à-dire de compréhension des items, ou de préparation de l’ECN, ce qui rendrait une version actuelle simplifiée probablement inadaptée à leurs attentes.



L’évaluation du site par les étudiants


Cette évaluation a été faite par des étudiants du second cycle au cours de leur stage dans le service de MPR. L’évaluation s’est déroulée dans une salle de cours par groupe de 3 étudiants. Les étudiants disposaient de cinq minutes pour remplir le prétest ( Annexe 1 ). Le responsable lançait alors successivement les trois modules concernant les généralités sur le support et la réadaptation cardiaque chez le patient coronarien. Le support était visionné au moyen d’un ordinateur portable relié à un vidéoprojecteur, et les étudiants étaient libres de stopper à tout moment pour réécouter certains points s’ils le désirent. La durée totale du support visionné est de 50 minutes. À la suite de cette période, les étudiants disposaient de cinq minutes pour remplir le post-test (identique au prétest) et dix minutes pour compléter le questionnaire d’évaluation ( Annexe 2 ). Ce dernier est inspiré d’une méthodologie originale d’évaluation des sites Internet médicaux, déjà utilisé dans des travaux concernant les attentes des patients dans ce domaine . L’information dite « médicale » concerne spécifiquement la pathologie, envisagée sous l’angle somatique, clinique et thérapeutique. L’information dite « extramédicale » désigne des éléments plus généraux de la prise en charge, hors diagnostic ou thérapeutique, comme le retentissement socioprofessionnel et psychologique de la pathologie. Enfin la qualité de conception concerne l’ergonomie du site, sa clarté de présentation. Le questionnaire se terminait par une tribune libre dans laquelle il était demandé aux étudiants d’énoncer leurs propositions d’amélioration à apporter à la version actuelle afin qu’elle soit plus en adéquation avec leurs attentes et/ou la préparation de l’ECN. Pour finir, les QCM sont corrigés avec l’enseignant.



Analyse des résultats


Les scores des évaluations, ainsi que les scores des pré et post-test, sont décrits par leur moyenne et écart type. Les scores moyens des pré- et post-tests ont été comparés par un test non paramétrique de Wilcoxon. Le seuil de significativité est fixé à p < 0,05. Les calculs ont été effectués au moyen du logiciel Statistica 7.0 pour Windows.



Résultats



Population


L’évaluation a été réalisée par 18 étudiants : six DCEM4 (quatre garçons, deux filles), huit DCEM3 (six filles, deux garçons) et quatre DCEM2 (deux garçons, deux filles).



Évaluation du support d’enseignement


La note moyenne de qualité globale était supérieure à 50/100 points (65,6 ± 7,7 pts) ( Tableau 1 ). La note moyenne concernant les informations médicales était élevée (84,8 ± 8,1 pts), largement supérieure à celles de l’information extra-médicale (61,1 ± 20 pts) et de la conception (64,4 ± 14,9 pts).


Apr 23, 2017 | Posted by in PHYSICAL MEDICINE & REHABILITATION | Comments Off on Evaluation of medical students’ expectations for multimedia teaching materials: Illustration by an original method using the evaluation of a web site on cardiovascular rehabilitation

Full access? Get Clinical Tree

Get Clinical Tree app for offline access