平成28年度 第 1回 音声映像科学学際セミナー 開催のご案内 CFP: 2016 First Inter-disciplinary Seminar on Audio Visual Science 本学の協定校である臺灣の國立中正大學の先生をお招きして、標記のセミナー を開催致しますので、ふるってご参加ください。 We are organizing the following seminar by a Professor from National Chung-Cheng University, Taiwan, a partner University of Nagoya University. Everyone is welcome to participate. --------------------------------------------------------------------------------------------------------- [Title] Food Image Captioning with Verb-Noun Pairs Empowered by Joint Correlation [Speaker] Dr. Wei-Ta CHU (朱威達) Associate Professor National Chung-Cheng University (國立中正大學), Taiwan [Date/Time] June 21, 2016 (Tuesday) 10:30-11:30 [Location] Room #462, IB South Annex 4th floor Higashiyama Campus, Nagoya University * Building C3(1) in the following map: http://en.nagoya-u.ac.jp/map/index.html [Abstract] Studies of image captioning explosively emerge in recent two years. Though many elegant approaches have been proposed for general-purposed image captioning, considering domain knowledge or specific description structure in a targeted domain still remains undiscovered. In this paper, we concentrate on food image captioning where a food image is better described by not only what food it is but also how it was cooked. We propose deep frameworks to jointly consider multiple factors, i.e., food recognition, ingredient recognition, and cooking method recognition, and verify that recognition performance can be improved by taking multiple factors into account. With these three factors, food image captions composed of verb-noun pairs (usually cooking method followed by ingredients) can be generated. We demonstrate effectiveness of the proposed methods from various viewpoints, and believe this would be a better way to describe food images in contrast to general-purposed image captioning. [Biography] Dr. Wei-Ta CHU (朱威達) received the B.S. and M.S. degrees in Computer Science from National Chi Nan University, Taiwan, in 2000 and 2002, and received the Ph.D. degree in Computer Science from National Taiwan University, Taiwan, in 2006. He is now an Associate Professor in the Department of Computer Science and Information Engineering, National Chung Cheng University, Taiwan. His research interests include digital content analysis, multimedia indexing, digital signal process, and pattern recognition. He won the Best Full Technical Paper Award in ACM Multimedia 2006. He was awarded the Distinguished Alumni Award presented by National Chi Nan University in 2014, Best GOLD Member Award presented by IEEE Tainan Section in 2013, the K. T. Li Young Researcher Award presented by Institute of Information & Computing Machinery in 2012, and the Young Faculty Awards presented by National Chung Cheng University in 2011. His advised master students received several thesis awards from Institute of Information & Computing Machinery and the Chinese Institute of Electrical Engineering. He was a visiting scholar at Digital Video & Multimedia Laboratory, Columbia University, from July to August 2008. He will serve as Publication Co- Chair of IEEE International Conference on Visual Communications and Image Processing 2018 and Program Co-Chair of International Conference on Multimedia Modelling 2020. [Sponsor] IEEE Nagoya Section [Admission] Free [Registration] Not required [Contact] Ichiro IDE (井手一郎) (ext.3313; ide@is.nagoya-u.ac.jp)
