DualSense Controller Can Generate Haptic Feedback from Sound Effects

Sony has presented a new set of tool that gives developers the ability to implement the functions of the DualSense controller and generate haptic feedback from sound effects in a very uncomplicated manner.

In a presentation on Sony’s upcoming technology, the company mentions that they have “created a haptic vibration waveform design environment that anyone can use” for this purpose. To a certain extent, this technology works automatically.

The wording of the document says: “Although DualSense will allow for more realistic game experiences, creators will also need more time and know-how to create high-quality vibrations. To reduce this burden, we have created a haptic vibration waveform design environment that anyone can use easily,” says Sony.

With the help of the tools, game developers should be able to create an “effective, natural, and comfortable vibration” in just a few steps. At the same time, a method was created with which “vibration patterns can be generated almost automatically” from the sound effects of a game.

Apparently, a lot of work was needed to achieve a convincing result: “The focus of our development was deep neural network technology,” says Sony. “But the problem was that there were few past studies that applied this technology to the sense of touch rather than to images and sounds.”

That’s why a lot of time was spent analyzing the data. Various algorithms were later studied and the developers sought advice from experts. “This allowed us to automate the generation of high-quality vibration waveforms to a certain extent, making it look as if they were created manually by the creators,” Sony said.

Ultimately, the new technology is intended to help make the PS5 more user-friendly for developers and ensure that they “can develop games quickly and easily.”

The PS5 will be released towards the end of the year at an unknown price.