Exploring the potential of using the body as a display and an input surface that's always there. Given the current limitations of hand occlusion, forearms seem to be the next choice. Even still, guessing the elbow position using IK is very shaky at the moment. Some findings below
The haptic feedback is incredible. First time I got it reasonably aligned, I was surprised at how good it felt. The back of our arm is quite sensitive and it's an area we don't touch very often. Would be interesting to see if there's a drop in sensitivity over time.
I think the intensity of the experience also comes from the tactile inputs from BOTH arms and the visual input all converging in one point. Even through clothes the feeling is quite strong, but obviously not ideal.
I imagined placing more interactive content on the non-dominant hand and informational content on the dominant hand where less interaction is expected.
I thought pinching would be a good solution to change content. But it was actually confusing to remember an abstract interaction, especially with bi-manual input. Pinching to go back/forward was better but still suffered from pinching imprecision.
Anchoring content around the forearm is easy to comprehend and benefits from muscle memory. But, aside from the limited wrist rotation, small movements can induce fatigue (especially at ROM limits), needs better viz and you lose the auto-hiding. But I'd like to explore this more
The forearm naturally lends itself to parallel swiping. Swiping perpendicularly by flexing the finger (to center of body) feels good, while the opposite is weird (touching with the fingernail). There is also increased fidelity starting a swipe from the top as opposed to the side.
You can follow @Ratkoooh.
Tip: mention @twtextapp on a Twitter thread with the keyword “unroll” to get a link to it.

Latest Threads Unrolled: