Home » AI Researchs » Research Team » Computer Vision

Introduction

Human vision, by enabling people to interpret their surrounding environment, is one of our most important senses, as many experts consider that 80% of what we perceive comes through vision. Put simply, Computer Vision is the sub-discipline of Artificial Intelligence which teaches machines to “see like a human”. More precisely, it consists of specific hardware, and/or software algorithms providing computers with the ability to capture, process and interpret images, videos or signals taken from a camera or other sensors.

Researchers started to work on Computer Vision in the 1960’s, achieving constant progress in this field. In the 2010’s, Deep Learning, a branch of Machine Learning, revolutionized Computer Vision. Among other breakthroughs, Deep Learning-based algorithms surpassed human in their ability to recognize human faces in 2014. Since then, Computer Vision is one of the hottest topics in the broad field of Artificial Intelligence. Computer Vision is nowadays applied in most of the aspects of our daily life: medicine, manufacturing, biometry, autonomous vehicles, digitization of paper documents and books for electronic access, military and law enforcement, recycling household waste or other environmental applications using aerial/satellite images, etc.

Our research group focuses on the conception and development of high-speed, light-weight and effective algorithms for analysis and understanding different types of images/videos: natural images/videos (taken through regular cameras), medical images, remote sensing images, document images. See the slides here for more detail.

Contact: Dr. Nguyen Thi Oanh, Email: oanhnt@soict.hust.edu.vn

Research Directions

We are especially interested in the tasks of object detection, classification, semantic segmentation and tracking.

Some keywords about our research directions include:

  • Multimodality
    • Spatio-temporal information
    • Raw data (or text) associated with the images
  • Domain adaptation
    • Transferring the model learned from one set of images to a different set of images
  • Limited resources constraints (linked to embedded systems)
    • Definition of light weight models
  • User interaction

Examples of methods we use include both traditional Image Processing methods and Machine Learning methods, especially Deep Learning (often with Convolutional Neural Networks and Recurrent Neural Networks).

Research Problems

Our research problems include, but are not limited to: 

  • Medical imaging:
    • Segmentation of colon polyps and identifying lesions at high-risk of malignancy (cancer) during endoscopy
    • Detecting brain degeneration for Alzheimer’s patients from 3D MRI images and clinical data
  • Traffic monitoring and autonomous vehicles
    • Vehicles and pedestrian tracking in videos, including embedding the proposed algorithms in edge devices
    • Semantic segmentation for intelligent vehicles 
  • Remote sensing – satellite image processing and analysis:
    • Adjusting Geostationary (GEO) satellite images with Low-Earth-Orbit (LEO) images
    • Study of Urban Heat Islands and their impact on the environment and humans 
  • Gesture recognition from videos:
    • Human Action Recognition
    • Hand Gesture Recognition 
  • Document analysis and understanding:
    • Incremental multimodal classification from streams of documents
    • Understanding ancient Vietnamese text (Han-Nom characters)
  • Biometry access control: face verification and anti-spoofing

Team Members

Assoc. Prof. Muriel VISANI
Team Leader

Dr. Dinh Viet Sang
Member

Dr. Nguyen Thi Oanh
Member

Dr. Tran Nguyen Ngoc
Member

Dr. Dang Tuan Linh
Member

Projects and Solutions

[VINIF2020] Development of a Real-time AI-assisted System to Detect Colon Polyps and Identify Lesions at High Risk of Malignancy During Endoscopy
[NAVER2020] Hand gesture recognition
BKAI-IGH NeoPolyp-Small: A dataset for fine-grained polyp segmentation

Collaborations

National partners (in Vietnam)

  • USTH: ICTLab & Space departments
  • MICA (HUST)
  • HUS-VNU
  • VNU-UET (FIMO)
  • VNUA (FIT)
  • HCMUS
  • Can Tho University
  • IRD: Institut de Recherche pour le Développement (Vietnam branch)

International partners

  • Asia-Pacific:
    • Australia: University of Technology Sydney, Bureau of meteorology, CSIRO, Griffith Uniersity, The University of Queensland
    • China: Lanzhou University
    • Japan: University of Tsukuba, Kochi University of Technology
    • South Korea: Chosun University
  • America:
    • USA: University of Hawaii
    • Brazil: University of Sao Paulo
  • Russia: Tula State University
  • Africa: Tunisia – Sfax University
  • Europe:
    • France: La Rochelle University, Poitiers University, Bordeaux University, INSA Lyon, Nancy University
    • Switzerland: Fribourg University
    • Spain: Universitat Autonoma de Barcelona

Latest Publications

Publications in 2022

  1. Namal Rathnayake, Tuan Linh Dang , Yukinobu Hoshino. Designing and Implementation of Novel Ensemble model basedon ANFIS and Gradient Boosting methods for Hand Gestures. SoICT 2022. 283-289. Hanoi-HaLong. 01/12/2022
  2. Keita Mitani, Namal Rathnayake, Upaka Rathnayake, Tuan Linh Dang, Yukinobu Hoshino. Brain Activity Associated with the Planning Process during the Long-Time Learning of the Tower of Hanoi (ToH) Task: A Pilot Study. Sensors. 1-14. 26/10/2022
  3. Namal Rathnayake, Upaka Rathnayake, Tuan Linh Dang, Yukinobu Hoshino. A Cascaded Adaptive Network-Based Fuzzy Inference System for Hydropower Forecasting. Sensors. 2905. 08/04/2022
  4. Trần Hoàng Hải, Nguyễn Thanh Hùng, Nguyễn Nhất Hải, Đặng Tuấn Linh, Huỳnh Quyết Thắng. eHUST - Một mô hình mẫu cho hệ thống quản trị Nhà trường hỗ trợ Chuyển đổi số tại Việt Nam. Thúc đấy Chuyển đổi số, Kinh tế tuần hoàn và kinh tế xanh - Hướng tới mục tiêu phát triển bền vững. 18-26. Trường Đại học Phenikaa. 12/11/2022
  5. Tuan Linh Dang, Thuy Hang Nguyen, Gia Tuyen Nguyen, Thang Cao. Traffic Collision Warning Using Deep Learning Models. ICIC Express Letters. 17-24. 01/08/2021
  6. Tuan Linh Dang, Sy Dat Tran, Thuy Hang Nguyen, Suntae Kim, Nicolas Monet. An improved hand gesture recognition system using keypoints and hand bounding boxes. Array. 1-10. 21/09/2022
  7. Namal Rathnayake, Upaka Rathnayake, Tuan Linh Dang, Yukinobu Hoshino. An Efficient Automatic Fruit-360 Image Identification and Recognition Using a Novel Modified Cascaded-ANFIS Algorithm. Sensors. 4401. 08/06/2022
  8. K. D. Nam, T. M. Nguyen, T. V. Dieu, M. Visani, T. -O. Nguyen and D. V. Sang. A Novel Unsupervised Domain Adaption Method for Depth-Guided Semantic Segmentation Using Coarse-to-Fine Alignment. IEEE Access. 101248-101262. 21/08/2022
  9. Tuan Linh Dang, Huu Thang Nguyen, Duc Manh Dao, Hoang Vu Nguyen, Duc Long Luong, Ba Tuan Nguyen, Suntae Kim, Nicolas Monet. SHAPE: a dataset for hand gesture recognition. Neural Computing and Applications. 21849–21862. 18/07/2022
  10. Tuan Linh Dang, Tran Sy Dat, Thuy Ha Hoang, Trong Nghia Nguyen, Tuan Minh Vu. Prototype of a parking system with path recommendation. SoICT2022. 309-316. Hanoi-HaLong. 01/12/2022
  11. N. T. Duc, N. T. Oanh, N. T. Thuy, T. M. Triet and V. S. Dinh. ColonFormer: An Efficient Transformer Based Method for Colon Polyp Segmentation. IEEE Access. 80575-80586. 25/07/2022
  12. Vien Truong Nguyen, Quang-Van Doan, Ngoc Nguyen Tran, Ly Thi Mai Luong, Pham Minh Chinh, Phong K Thai, Dung Phung, Hong H T C Le, Tran Ngoc Dang. The protective effect of green space on heat-related respiratory hospitalization among children under 5 years of age in Hanoi, Vietnam. Environmental Science and Pollution Research. 20/05/2022
  13. Nguyen Viet Manh, Kieu Dang Nam, Dinh Viet Sang, Thi-Oanh Nguyen. G2L: A Global to Local Alignment Method for Unsupervised Domain Adaptive Semantic Segmentation. Procedia Computer Science. 2698-2707. Verona, Italia. 06/09/2022
  14. Tuan Linh Dang, Nhat Minh Ngo. SDNs Delay Prediction Using Machine Learning Algorithms. The Third International Conference on Artificial Intelligence and Computational Intelligence (AICI 2022) (Kỷ yếu được đăng trong Biomedical and Other Applications of Soft Computing). 133-141. Online vì COVID19. 14/01/2022
  15. Tuan Linh Dang, Viet Tien Ha. Shop Product Tracking and Early Fire Detection Using Edge Devices. The Third International Conference on Artificial Intelligence and Computational Intelligence (AICI 2022) (Kỷ yếu được đăng trong Biomedical and Other Applications of Soft Computing). 121-131. Online vì COVID19. 14/01/2022

Publications in 2021

  1. NGUYEN S. AN, PHAN N. LAN, DAO V. HANG, DAO V. LONG, TRAN Q. TRUNG, NGUYEN T. THUY, DINH V. SANG. BlazeNeo: Blazing Fast Polyp Segmentation and Neoplasm Detection. IEEE Access. 43669 - 43684. 08/04/2021
  2. Phan Ngoc Lan, Nguyen Sy An, Dao Viet Hang, Dao Van Long, Tran Quang Trung, Nguyen Thi Thuy, Dinh Viet Sang. NeoUNet : Towards Accurate Colon Polyp Segmentation and Neoplasm Detection. International Symposium on Visual Computing. 15-28. 04/10/2021
  3. Nguyen Viet Hoai, Phan Huy Hoang, Doan Bao Linh, Dinh Viet Sang. An End-to-End Spatial-Aware Attention Method for Multi-Line License Plate Spotting. The 5th International Conference on Future Networks & Distributed Systems. 625–632. 15/12/2021
  4. Ekena Rangel Pinagé, David M. Bell, Matthew Gregory, Ngoc Nguyen Tran, Wenjie Zhang, Alfredo Huete. Effects of Tropical Forest Degradation on Amazon Forest Phenology. International Geoscience and Remote Sensing Symposium (IGARSS), 2020. 4516–4519. Waikoloa, HI, USA. 26/09/2020
  5. Hoang-Thuyen Nguyen, Thi-Oanh Nguyen. Attention-based network for effective action recognition from multi-view video. Procedia Computer Science, Elsevier, 25th International Conference on Knowledge-Based and Intelligent Information & Engineering Systems. 971-980. 18/05/2021
  6. Namal Rathnayake, Tuan Linh Dang, Yukinobu Hoshino. A Novel Optimization Algorithm: Cascaded Adaptive Neuro-Fuzzy Inference System. International Journal of Fuzzy Systems. 1-17. 19/02/2021
  7. Nguyen Ba Hung, Nguyen Thanh Duc, Thai Van Chien, Dinh Viet Sang. AG-ResUNet++: An Improved Encoder-Decoder Based Method for Polyp Segmentation in Colonoscopy Images. 2021 RIVF International Conference on Computing and Communication Technologies (RIVF). 1-6. 19/08/2021
  8. Tuan Linh Dang, Thang Cao, Yukinobu Hoshino. Engraved digit detection using HOG-real AdaBoost and deep neural network. Turkish Journal of Electrical Engineering & Computer Sciences. 138-151. 11/09/2020
  9. Dung Phung, Thong Nguyen-Huy, Ngoc Nguyen Tran, Dang Ngoc Tran, Van Quang Doan, Son Nghiem, Nga Huy Nguyen, Trung Hieu Nguyen, Trude Bennett. Hydropower dams, river drought and health effects: A detection and attribution study in the lower Mekong Delta Region. Climate Risk Management. 100280. 25/01/2021
  10. Tuan Linh Dang, Van Chuong Do. Fine-Grained Network Traffic Classification Using Machine Learning: Evaluation and Comparison. AICI 2021 (kỷ yếu được đăng trong Studies in Computational Intelligence Book Series, index bởi Scopus). 151-162. Viện Công nghệ thông tin, Viện Hàn lâm KHCN Việt Nam, Hà Nội, Việt Nam. 15/01/2021
  11. Nguyen Trong Thai, Nguyen Hoang Thuan, Dinh Viet Sang. An Improved Deep Neural Network Based on a Novel Visual Attention Mechanism for Text Recognition. 2021 RIVF International Conference on Computing and Communication Technologies (RIVF). 1-6. 19/08/2021
  12. Tran Thi Thanh Hai, Nguyen Tien Hai, Dinh Viet Sang. Significant Trajectories and Locality Constrained Linear Coding for Hand Gesture Representation. ICCE. 359-364. Phu Quoc, Vietnam. 13/01/2021
  13. Namal Rathnayake, Tuan Linh Dang, Yukinobu Hoshino. Performance Comparison of the ANFIS based Quad-Copter Controller Algorithms. 2021 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE). 1-8. Luxembourg. 11/07/2021
  14. Anh Son TA. Sovling problem. NICS. 17/01/2021
  15. Xuanlong Ma; Ngoc Nguyen Tran; Song Leng; Qiaoyun Xie; Alfredo Huete. Monitoring Savanna Vegetation Phenology Using Advanced Himawari Imager. IEEE International Geoscience and Remote Sensing Symposium IGARSS, 2021. 1597-1599. Brussels, Belgium. 11/07/2021
  16. Dinh Viet Sang, Lam Xuan Thu. FastTacotron: A Fast, Robust and Controllable Method for Speech Synthesis. International Conference on Multimedia Analysis and Pattern Recognition (MAPR). 1-6. 15/10/2021