Conquer the Physical Impairment
Designing prototypes for AR/Neural interfaces for harsh environment task assistance and collaboration.
2022, Not scientific thing, just daydreaming
Origin
The very first idea was originated when I was watching a cartoon, Jackie Chen Adventures, The Jade Monkey (S1,E11) [or maybe S1,E10].
Jackie Chen Adventures, Underwater Extracting and Fighting
Background
There is an underwatch extracting and fighting scene, constantly reminding me the powerful physical impairment that was applied to the task workers due to the harsh working environment (underwater). There was one particular moment that fired my thinking, [00:23-00:54]. Imagine if Jackie is the archaeologist lead, who told Jade to investigate a small particular region (In anime, they automatically know what to do, in reality, this is not gonna happen☹️), followed by a series of other complex task requirements, will Jade handle it? She might be overrun by the density of information received or took very long time to attempt to figure out the details to complete the task, especially in a physically impaired working environment. Moreover, if there was emergency took place (just like the fighting), how would Jackie analyze the situation in fastest speed and deliver the solution to all the teammates?
This encouraged me to brainstorm and research on some ideas to help the situation I described. During that time, since I was working on an AR project, I then built some connections between the usage of AR technology and neuroscience technologies like eye-tracking, BCI with their potential for visualization, communication, and collaboration.
Besides the proven potential of AR's application in underwater navigation (like this paper), In our scenario, we would like to explore more about its human-human collaboration potential.
This encouraged me to brainstorm and research on some ideas to help the situation I described. During that time, since I was working on an AR project, I then built some connections between the usage of AR technology and neuroscience technologies like eye-tracking, BCI with their potential for visualization, communication, and collaboration.
Besides the proven potential of AR's application in underwater navigation (like this paper), In our scenario, we would like to explore more about its human-human collaboration potential.
BCI for Decision Making
AR in Underwater Navigation
Daydreaming
These ideas and thoughts may not be strictly scientific nor carefully reviewed, but I would like to expand if I get a chance in the future.
In a harsh working environment, like I mentioned, underwater, human workers are hard to perform physical gestures and postures, which are critical in both verbal and non-verbal communication. In fact, underwater (high-pressure) is not the only scene that would apply physical impairment to human workers giving them an unususal feeling, the space, though nothing similar to underwater, however, will apply the impairment due to its micro-(or zero-)gravity environment. Nasa scientists have been utilizing AR/VR technologies to assist similar tasks such as spacecraft device maintainence, etc. (see their cool works here).
In the future, I'm quite interesting at innovating some sorts of interfaces that could help task assigning, emergency handling, efficient collaboration and communication in harsh working environments like underwater or space.
In a harsh working environment, like I mentioned, underwater, human workers are hard to perform physical gestures and postures, which are critical in both verbal and non-verbal communication. In fact, underwater (high-pressure) is not the only scene that would apply physical impairment to human workers giving them an unususal feeling, the space, though nothing similar to underwater, however, will apply the impairment due to its micro-(or zero-)gravity environment. Nasa scientists have been utilizing AR/VR technologies to assist similar tasks such as spacecraft device maintainence, etc. (see their cool works here).
In the future, I'm quite interesting at innovating some sorts of interfaces that could help task assigning, emergency handling, efficient collaboration and communication in harsh working environments like underwater or space.
AR Communication
Solution Analysis