Virtual Force

#Product design

#User Experience design

With the continuous development of VR technology, humans are constantly moving towards the virtual reality experience in science fiction movies. In order to simulate the most realistic experience, we need to simulate the interaction of real-world objects and environments with people. Besides visual, auditory, and vibration, force feedback is also a significant interaction experience.

After my research, I found that no devices provide realistic force feedback in the home domain. Therefore, I conducted research and design to solve this problem, and finally developed a set of peripherals for the VisionPro headset, which allowed players to transform ordinary objects in their lives into game controllers and provided force feedback and vibration feedback.

Project stages

Background Research

Interviews

Conclusions

Target user group

User Journey Map

Scenario A: Hardcore player in Half-Life Alyx

Scenario B: Casual player in fishing simulator

Brainstorming

Technology capabilities & comparison

Part.01 Universal Attachment to ordinary objects

Part.02 Line Drag system

Modeling & Calculation

Force Simulation System

Design Attempt 01

Design Attempt 02

Coding

Since I am familiar with the iOS platform, I will assume that the platform is built on Apple Vision Pro

Software

Development thought: Based on Apple’s Homekit Sample code, add ARkit to recognize the hand gestures

Search for available accessories at home with HomeKit

Hardware

Development thought: Create HomeKit struct for each motor, and always keep data updated according to the App on headset

Create struct Motor for my motors, set them to Type Lightbulb, thus control them easily by adjusting the brightness because the control principle is PWM, same as motors’



Step 1

Attachment without vibration motors

Use ARKit to detect gestures

Create an accessory and its service, add the motors as characteristics, so that we can simply adjusting them, by changing the value of these characteristics.

Testing

Force simulation system

Step1

Test & measure components

Step 4

Control and circuit inspection

Step 2

Partial assemblance


Update the power of motors separately, to simulate force in the real world

Step5

Actual scenario testing

Grip attachment

Step 2

Attachment with vibration motors

Step 3

Current control circuit

Step 3

Vibration motors & battery & dev board assemblance

Final Showcase