Fundamental problems in computer vision lead to innovative technologies with human-health implications

It is common for patients that experienced a stroke to be affected by a loss in hand functionality afterward. Despite extensive physical therapy, many are never able to regain the same hand-functioning abilities to accomplish their daily activities. Dr. Gang Hua, of the Stevens Institute of Technology, tackles fundamental problems in computer vision, from both the algorithms and systems perspective, to enable technologies and systems that facilitate transforming the massive amount of unstructured real-world visual data into structured knowledge. In this way, Dr. Hua’s research builds technologies that can benefit people in their daily lives. By focusing on computational models where he and his team can intelligently coordinate software or robots, Dr. Hua allows people to collaborate with technology for improved health outcomes.

More exciting than the incredible innovation behind Dr. Hua’s technologies is the way his work is truly centered around the people the technologies aim to serve. His team, including five Ph.D. students and researchers that collaborate from other research institutes, are passionate about work that will have the greatest impact upon patient populations in need of technology’s assistance. Dr. Hua takes on the challenges of intelligently creating, understanding, managing, searching, visualizing, and interacting with the gigantic amount of data available to us and employing it to facilitate communication and social networking among users. While addressing such challenges requires a deep understanding of the problems Dr. Hua has recognized that it can also result in solutions that generalize to other related common problems. This opportunity to inspire technologies that can have direct implications on patients now and inspire future technologies for the health of our future continues to motivate Dr. Hua towards compassion-driven and patient-centered science.

Current research includes:

  • Hand Rehabilitation: The project on hand modeling, in support of hand rehabilitation, will produce technologies that will bring personalized hand rehabilitation therapy to patients with paretic hands, such as those produced from a brain stroke. Another project, entitled "Egocentric 3D vision glasses for modeling hand rehabilitation" is also in its preliminary investigation stage in Dr. Hua’s group. The objective of this project is to research a computer vision based cyber-physical systems centered around a pair of egocentric 3D vision glasses, to analyze users’ hand motion in their daily activities through non-invasive vision based sensing.

  • Co-Robot Wheelchair Project: Dr. Hua is researching the key enabling technologies in computer vision and machine learning for an egocentric vision based active learning co-robot wheelchair system to improve the quality of life for individuals that are older or disabled with limited hand functionality or no hand functionality who therefore rely upon wheelchairs for mobility. Using a pair of egocentric camera glasses, the wheelchair is able to actively solicit controls from the user when uncertainty is too high for autonomous operation, but also facilitates the robotic wheelchair system to learn from the solicited user controls. This way, the wheelchair system is able to evolve itself and is capable of handling more complicated environments in the future. When finished, this project is likely to enhance the quality of life for the 1% of our population who rely upon wheelchairs each day for their mobility.

Dr. Gang Hua became a researcher because he enjoys the process of discovering new knowledge and using it to build new technologies that benefit society. He is especially interested in building intelligent machines that can see and understand the world as humans can. Beyond his enthusiasm for new knowledge and the health it can bring for patients, Dr. Hua was also motivated by his own father, who after a brain stroke several years ago lost some of his hand functioning. Therefore, the combination of his own curiosities, the health of his family, and the hope to improve quality of life for patients globally, pushes Dr. Hua to continue research.

Gang Hua is an Associate Professor of Computer Science at Stevens Institute of Technology. Before that, he was a Researcher in IBM Research T. J. Watson Center from 2010 to 2011, a Senior Researcher in Nokia Research Center Hollywood from 2009 to 2010, and a Scientist in Microsoft Live labs Research from 2006 to 2009. He received his Ph.D. degree in Electrical and Computer Engineering from Northwestern University in 2006. His current research interests include pervasive media computing, human computer interaction, pattern recognition and machine learning, computer vision, intelligent image/video/multimedia processing, and multimedia information retrieval, mining and search. During summer 2005 and 2004, he was a research intern with the Speech Technology Group, Microsoft Research, Redmond, WA, and a research intern with the Honda Research Institute, Mountain View, CA, respectively. He received his M.S. in pattern recognition and intelligence system at XJTU in 2002. He was enrolled in the Special Class for the Gifted Young of XJTU in 1994 and received his B.S. in Automatic Control Engineering in 1999.

He received the Richter Fellowship and the Walter P. Murphy Fellowship at Northwestern University in 2005 and 2002, respectively. When he was at XJTU, he was awarded the Guanghua Fellowship, the Eastcom Fellowship, the Most Outstanding Student Exemplar Fellowship, the Sea-star Fellowship and the Jiangyue Fellowship in 2001, 2000, 1997, 1997 and 1995 respectively. He was also a recipient of the University Fellowship from 1994 to 2001 at XJTU. He is a member of both IEEE and ACM. As of August, 2009, he holds one US patent and has 16 more patents pending.

Website: http://www.cs.stevens.edu/~ghua/

PI, "NRI: An Egocentric Computer Vision based Active Learning Co-Robot Wheelchair", National Institute of Health (NIH) R01NR015371, 09/01/2014-08/31/2017

Google Research Faculty Award, Google Research, 2013

Microsoft Live Search Ship-It Award, Microsoft Corporation, 2007

Outstanding Reviewers, IEEE Conf. on Computer Vision and Pattern Recognition, 2010 and 2013

Terminal Dissertation Year Richter Fellowship, Northwestern University, 2005-2006

Patent List

Refer to http://www.cs.stevens.edu/~ghua/ghweb/Publication.htm for list of patents.