Reality Modulation

Reality Modulation — a proposed category

RM

Reality Modulation

VRREPLACES REALITY
ARADDS TO REALITY
RMTRANSFORMS REALITY

This isn’t AI-generated imagery.

This isn’t a virtual world.

This isn’t digital content placed on top of reality.

This is reality — modulated.

02Three relationships with reality

VR

Virtual Reality

Replace

The physical scene disappears into a constructed digital environment.

AR

Augmented Reality

Add

The physical scene remains, and digital content is placed on top of it.

RM

Reality Modulation

Transform

The physical scene stays structurally intact — its color, light, and pattern transform.

Three different relationships with reality.

03What is Reality Modulation?

“Reality Modulation (RM) is the real-time computational transformation of the perceptual characteristics of a live physical environment while preserving the underlying real-world scene.”

Real-time

Computational

Physical world

Perceptual transformation

Scene preservation

RM is presented here as a proposed category framework for a class of real-time perceptual technologies. Related historical research exists across mediated reality, computer vision, image processing, augmented reality, and wearable displays.

04How RM works

Physical world

Camera / optical sensor

Reality Modulation engine

Transformation profile

Display / wearable

Modulated perception

Modulation dimensions

Chromatic

Spectral

Luminance

Contrast

Spatial

Temporal

Object-aware

Audio-reactive

Contextual

05More than a filter

A conventional photo filter modifies a captured image.

Reality Modulation can operate continuously on a live physical environment, changing visual perception as the environment changes.

Live

Real-time

Interactive

Environment-aware

Wearable

Capturable

The camera is the beginning.
The wearable changes the experience.

06The RM journey
01

Mobile RM

A phone already contains a camera, GPU, display, sensors, storage, and connectivity.

It can become a mass-market Reality Modulation device today.

App

02

Wearable RM

Move RM from something you hold to something you see continuously.

Wearable

03

RM Platform

Modulation profiles created for people, places, events, artists, venues, environments, accessibility, entertainment, education, travel, and creative expression.

Platform

07Modulation spectrum

Reality is not one setting.

Chromatic modulation

Transform color relationships.

Spectral modulation

Reveal or reinterpret wavelength information.

Luminance modulation

Alter perceived brightness relationships.

Contrast modulation

Expose structures otherwise difficult to perceive.

Spatial modulation

Transform regions or structures selectively.

Temporal modulation

Transform perception across time.

Object-aware modulation

Apply different transformations based on scene understanding.

Audio-reactive modulation

Allow sound and music to influence visual transformation.

Environmental modulation

Adapt transformation to location, lighting, context, or conditions.

Currently possible
Emerging
Future research direction
08The world is the content

The beach

The city

The forest

A concert

A familiar room

The beach. The city. The forest. A concert. A wedding. A party. A night drive. A familiar room.

Same world. Different perception.

09A consumer RM platform
VibraRays

VibraRays

VibraRays is developing consumer software and wearable technology centered on Reality Modulation.

Today

VibraRays mobile software brings live RM-style transformation to the phone through real-time camera experiences, photography, and video.

Next

VibraRays wearable technology is intended to move the experience from the screen in your hand toward continuous visual perception.

Future

An RM ecosystem of modulation modes, creators, places, events, and experiences.

AI can generate another world.

VR can take you into another world.

AR can add digital things to this world.

RM starts with the world that is already here.

The people are real.

The place is real.

The moment is real.

The world remains real.

Only your experience of it changes.

Reality.

Modulated.

Reality Modulation

Follow the development of Reality Modulation

RM white paper — coming soon