Moving Sound Simulation
In this project, moving sound is simulated by using Head-Related Transfer Function under the advisement of Assoc. Prof. Zhonghua Fu in Shaanxi Key Laboratory of Speech & Image Information Processing (China) . Also Doppler Effect and reverberation under different acoustic environment together with moving effect are implemented. Here is a video demo.
Hand Tracking with Kinect
This project is my Directed Research with MedVR Group at the Institude for Creative Technologies in USC under the advisement of Dr. Belinda Lange. The goal of this project is to use Kinect to track hand gestures like: Open/Close, Fist Rotation, Hand Flip, Sign Language, Pinching and so on (demo). Finally two games, Kintris (demo) and Cooking Mania (demo), are made using the gesture metioned above in Unity3D.
Human-Robot Interaction
On this project, I worked with Ross Mead under advisement of Prof. Maja J Matric. The focus of this project is to use audio information as cue together with other information like gesture, distance and orientation to help the robot behave in a socially proper way. The work I was involved in was to build a audio model to evaluate how well the robot can understand human speech under various conditions.
.
.
Player-Game Interaction
Analyzing video game play experience as a sequence of interaction between player and video game. Each interaction can be viewed as an event, where information is passed to player as a game challenge, and player reacts by making proper decision. Each event can be characterized in several aspects, such as the amount of information passed to player and the difficulty for player to make a proper decision. My current focus is to explore what kinds of interactions make a good player experience, then generate such experience procedurally.