Research | Mikko’s research topics at Kyoto University

Mikko’s research topics at Kyoto University

Project years: 2004 - 2007

Keywords:

virtual reality, haptics, psychomotor skills, training and education, physics-based simulation, medicine.

VR-based teaching of psychomotor skills in medicine

My doctoral thesis project is one of the few attempts of creating a record-and-replay type of skill-transfer using virtual reality based training simulators. The conventional way of teaching psychomotor skills in complex domains such as medicine is limited to visual replay of experts performing example cases. The examples are supplemented with inaccurate verbal guidance and feedback describing physical manipulation. We developed a multimodal annotation model for dynamic virtual environments which enables experts to describe their intention and critical physical aspects of their example performances and automatically create helpful guidance and feedback for novices who can learn the psychomotor skill more accurately than with the help of mere visual replays. Several evaluation studies demonstrated the benefits of this approach.

My studies were sponsored by the Japanese Government in a form of the prestige MEXT scholarship. To my knowledge, I was the first Finnish student to complete Kyoto University's doctoral degree program in the optimal 3 years covered by the funding scheme.

With this work we received awards from the Japanese Society for Medical Virtual Reality (JSMVR) in 2005 and the Japanese Society of Medical Imaging Technology (JAMIT) in 2006. It was part of the Medical Virtual Reality projects of the Medical Informatics group at Kyoto University.

Journal papers:

Naoto Kume, Mikko Rissanen, Yoshihiro Kuroda, Megumi Nakao, Tadamasa Takemura, Hiroyuki Yoshihara, Tomohiro Kuroda, Shinichiro Mori, Shinji Tomita and Koji Yoshimura. Evaluation of teaching digital rectal examination on annotated haptic VR simulator (in Japanese). Japanese Journal for Medical Virtual Reality, Vol. 7, No. 1, 2009, pp. 24-36. (JSMVR 2009; 7,1:24-36) Japanese Society for Medical Virtual Reality. DOI: 10.7876/jmvr.7.24

Mikko Rissanen, Yoshihiro Kuroda, Megumi Nakao, Naoto Kume, Tomohiro Kuroda, Keisuke Nagase and Hiroyuki Yoshihara. Annotated VR simulation records for surgical education – evaluating the benefits of real-time visualization of force exertion (in Japanese). Transactions of the Virtual Reality Society of Japan, Vol. 11, No. 4 (Special Issue on Education and Training), December, 2006, pp. 527-536. (TVRSJ 2006; 11,4:527-536) Virtual Reality Society of Japan. DOI: 10.18974/tvrsj.11.4_527

International conference papers:

Mikko J. Rissanen, Naoto Kume, Yoshihiro Kuroda, Tomohiro Kuroda, Koji Yoshimura and Hiroyuki Yoshihara. Asynchronous teaching of psychomotor skills through VR annotations: evaluation in digital rectal examination. In: Proceedings of Medicine Meets Virtual Reality (MMVR), Long Beach, CA, January 30-February 1, 2008, pp. 411-416. (Stud. Health. Technol. Inform. 2008;132:411-6) IOS Press.

Mikko J. Rissanen, Yoshihiro Kuroda, Tomohiro Kuroda and Hiroyuki Yoshihara. A novel interface for simulator training: describing and presenting manipulation skill through VR annotations. In: Proceedings of the 2nd International Conference on Virtual reality (ICVR), Beijing, P.R. China, July 22-27, 2007, pp. 523-532. (LNCS 2007; 4563:523-532) Springer. DOI: 10.1007/978-3-540-73335-5_57

Mikko J. Rissanen, Yoshihiro Kuroda, Megumi Nakao, Naoto Kume, Tomohiro Kuroda and Hiroyuki Yoshihara. Toward visualization of skill in VR: adaptive real-time guidance for learning force exertion through the "shaping" strategy. In: Proceedings of Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WorldHaptics), Tsukuba, Japan, March 22-24, 2007, pp. 324-329. (WHC'07; 324-329) IEEE Computer Society. DOI: 10.1109/WHC.2007.117

Mikko J. Rissanen, Yoshihiro Kuroda, Megumi Nakao, Tomohiro Kuroda, Keisuke Nagase and Hiroyuki Yoshihara. A novel approach for training of surgical procedures based on visualization and annotation of behavioural parameters in simulators. In: Proceedings of Medicine Meets Virtual Reality (MMVR), Long Beach, CA, February 6-9, 2007, pp. 388-393. (Stud. Health. Technol. Inform. 2007;125:388-93) IOS Press.

Mikko Rissanen, Yoshihiro Kuroda, Megumi Nakao, Naoto Kume, Tomohiro Kuroda and Hiroyuki Yoshihara. Annotated surgical manipulation for simulator-based surgical skill-transfer using SiRE – simulation record editor. In: Proceedings of the 3rd International Symposium on Biomedical Simulation (ISBMS), Zürich, Switzerland, July 10-11, 2006, pp. 122-131. (LNCS 2006; 4072:122-131) Springer. DOI: 10.1007/11790273_14

Mikko J. Rissanen, Yoshihiro Kuroda, Megumi Nakao, Naoto Kume, Tomohiro Kuroda and Hiroyuki Yoshihara. Editing recorded haptic data with SiRE – simulation record editor. In: Proceedings of EuroHaptics, Paris, France, July 3-6, 2006, pp. 543-546. (EH'06: 543-546) EuroHaptics.

Mikko J. Rissanen, Yoshihiro Kuroda, Naoto Kume, Megumi Nakao, Tomohiro Kuroda and Hiroyuki Yoshihara. Interactive authoring of example surgical procedures from recorded physics-based simulation. In: Proceedings of the 20th International Congress of Computer Assisted Radiology and Surgery, Osaka, Japan, June 28-July 1, 2006, pp. 154-156. (Int J Comput Assist Radiol Surg 2006; 1,supplement 1:154-156) Springer.

Mikko J. Rissanen, Yoshihiro Kuroda, Naoto Kume, Megumi Nakao, Tomohiro Kuroda and Hiroyuki Yoshihara. Audiovisual guidance for simulated one point force exertion tasks. In: Proceedings of the 6th ACM Virtual Reality Continuum and Its Applications, Hong Kong, P.R. China, June 14-17, 2006, pp. 365-368. (ACM VRCIA 2006: 365-368) ACM SIGGRAPH. DOI: 10.1145/1128923.1128989

Mikko Rissanen, Naoto Kume, Yoshihiro Kuroda, Megumi Nakao, Tomohiro Kuroda and Hiroyuki Yoshihara. Framework for annotation of haptic data in simulated surgical procedures. In: Proceedings of the 11th International Conference of Virtual Systems and Multimedia, Ghent, Belgium, October 3-7, 2005, pp. 647-656. (VSMM 2005: 647-656) ARCHAEOLINGUA.

International workshop/seminar papers:

Tomohiro Kuroda, Mikko Rissanen, Takafumi Terada, Masayuki Harada, Keisuke Nagase and Hiroyuki Yoshihara. Haptized shared VR based surgical simulator – applying to vocational experience. Abstract. In: Proceedings of Annual Meetings of the Society in Europe for Simulation Applied to Medicine (SESAM), Porto, Portugal, June 29-July 1, 2006. (SSIH 2006; 1, Issue 3:197) Lippincott Williams & Wilkins, Inc. (CD-ROM) DOI: 10.1097/01266021-200600130-00072

Domestic conference/seminar papers:

Mikko Rissanen, Naoto Kume, Yoshihiro Kuroda, Tomohiro Kuroda, Koji Yoshimura, Toshiyuki Kamoto, Osamu Ogawa and Hiroyuki Yoshihara. Evaluation of VR annotation based teaching using a digital rectal examination simulator. Abstract. In: Proceedings of the 7th Conference of Japanese Society for Medical Virtual Reality (JSMVR), Tokyo, Japan, August 31-September 1, 2007, p. 33. Japanese Society for Medical Virtual Reality.

Mikko Rissanen, Yoshihiro Kuroda, Naoto Kume, Megumi Nakao, Tomohiro Kuroda, Keisuke Nagase and Hiroyuki Yoshihara. Preserving evaluation-critical features of demonstrative haptic manipulation in surgical VR. In: Proceedings of the 26th Joint Conference of Medical Informatics (JCMI), Sapporo, Japan, November 1-3, 2006, pp. 1157-1160. Japan Association for Medical Informatics.

Mikko Rissanen, Yoshihiro Kuroda, Naoto Kume, Megumi Nakao, Tomohiro Kuroda, Keisuke Nagase and Hiroyuki Yoshihara. Usability evaluation of an editor for recorded haptic manipulation. In: Proceedings of the 11th Annual Conference of the Virtual Reality Society of Japan (VRSJ), Sendai, Japan, September 7-9, 2006. Virtual Reality Society of Japan. (CD-ROM)

Yoshihiro Kuroda, Mikko Rissanen, Koji Yoshimura, Megumi Nakao, Tomohiro Kuroda, Toshiyuki Kamoto, Hiroshi Oyama, Osamu Ogawa and Hiroyuki Yoshihara. Recording doctor's manipulation during rectum's examination on palpation simulator based on interaction of multiple elastic bodies (in Japanese). Abstract. In: Proceedings of the 6th Conference of Japanese Society for Medical Virtual Reality (JSMVR), Osaka, Japan, September 1-2, 2006, p. 42. Japanese Society for Medical Virtual Reality.

Yoshihiro Kuroda, Mikko Rissanen, Koji Yoshimura, Megumi Nakao, Tomohiro Kuroda, Toshiyuki Kamoto, Hiroshi Oyama, Osamu Ogawa and Hiroyuki Yoshihara. A study of VR-based skill teaching system for prostatic palpation (in Japanese). In: Proceedings of the 25th Conference of the Japanese Society of Medical Imaging Technology (JAMIT), Kyoto,J apan, July 21-22, 2006. Japanese Society of Medical Imaging Technology. (CD-ROM) (Recommendation award)

M.J. Rissanen, Y. Kuroda, N. Kume, M. Nakao, T. Kuroda and H. Yoshihara. Method for interactive editing of recorded physics-based VR simulation. In: Proceedings of the 50th Annual Conference of the Institute of Systems, Control and Information Engineers (ISCIE), Kyoto, Japan, May 10-12, 2006, pp. 661-662. Institute of Systems, Control and Information Engineers.

Mikko J. Rissanen, Naoto Kume, Yoshihiro Kuroda, Megumi Nakao, Tomohiro Kuroda and Hiroyuki Yoshihara. Annotation framework for simulated surgical manipulation. In: Proceedings of the 6th Conference of SICE System Integration (SI), Kumamoto, Japan, December 16-18, 2005. Japanese Society of Instrument and Control Engineers. (CD-ROM)

Mikko Rissanen, Naoto Kume, Yoshihiro Kuroda, Megumi Nakao, Tomohiro Kuroda and Hiroyuki Yoshihara. Visualization of force in annotated simulation record for palpation training (in Japanese). Abstract. In: Proceedings of the 5th Conference of Japanese Society for Medical Virtual Reality (JSMVR), Tokyo, Japan, September 30-October 1, 2005, p. 14. Japanese Society for Medical Virtual Reality. (Recommendation award)

Mikko Rissanen, Naoto Kume, Yoshihiro Kuroda, Megumi Nakao, Tomohiro Kuroda and Hiroyuki Yoshihara. Dynamic pressure visualization for mimicking simulated palpation of the aorta. In: Proceedings of the 46th Conference of Japan Ergonomic Society (JES), Tokyo, Japan, June 11-12, 2005, pp. 110-111. Japan Ergonomic Society.

Hands-on demonstrations:

Mikko Rissanen, Naoto Kume, Yoshihiro Kuroda, Tomohiro Kuroda and Hiroyuki Yoshihara. Representing ‘the essence’ of digital rectal examination skill from annotated simulation records. Hands-on demo at the 7th Conference of Japanese Society for Medical Virtual Reality (JSMVR), Tokyo, Japan, August 31-September 1, 2007.

Yoshihiro Kuroda, Megumi Nakao, Naoto Kume, Mikko Rissanen, Tomohiro Kuroda and Hiroyuki Yoshihara. VRASS simulation platform. Hands-on demo at the Medicine Meets Virtual Reality (MMVR), Long Beach, CA, February 6-9, 2007.

Mikko Rissanen, Yoshihiro Kuroda, Megumi Nakao, Naoto Kume, Tomohiro Kuroda, Keisuke Nagase and Hiroyuki Yoshihara. Annotation tool for modelling surgical skill from recorded simulation. Hands-on demo at the 6th Conference of Japanese Society for Medical Virtual Reality (JSMVR), Osaka, Japan, September 1-2, 2006.

Newsletters:

Mikko Rissanen. Participation report on the ISBMS 2006 conference. Virtual Reality Society of Japan: Newsletter Vol. 11, No. 8, August 2006.

Thesis:

Mikko Rissanen. Virtual reality based teaching of psychomotor skills: annotation model for asynchronous communication in dynamic virtual environments. Doctoral thesis, Kyoto University, September 2007. (Abstract in Japanese)

Patents:

Takashi Tsukasa, Kazuya Okamoto, Tatsuro Ishida, Hyongyong Kim, Takashi Nakai, Masayuki Kawasaki, Sachiko Okada, Mikko Rissanen, Naoto Kume, Yoshihiro Kuroda, Tadamasa Takemura, Tomohiro Kuroda, Keisuke Nagase and Hiroyuki Yoshihara. Air current measuring device (in Japanese). Japan Patent Application JP2008064533 (A) filed September 6, 2006.

Sources of inspiration:

The virtual teacher by R. Brent Gillespie et al. identified much of the challenges in the real world and opportunities in the virtual world that I focused on.

Engineering approaches of transferring psychomotor skills, especially the early work titled Toward machine mediated training of motor skills by Yasuyoshi Yokokohji, Takeo Kanade, Tsuneo Yoshikawa et al. and contemporary approach called Haptic video by Satoshi Saga, Susumu Tachi et al., lead me to focus on the theoretical foundation of learning and teaching which gave me the main perspective for the thesis.

David Shaffer et al. described the idea of practicing medicine in virtual environments in 1999. They called it as Virtual rounds which was the big picture of what we tried to realize for our parts.