This is kind of how DynamicLand is. They use a system of projectors to create images next to objects, and color patterns to track object position and identity with cameras:
So, for example, you can place a keyboard next to a block of text to edit it.
There’s more to DynamicLand than that, but that’s what I’m reminded of.
Remember Microsoft’s surface dial?
Just make a touch screen and a bunch of those.
You can make your own interface outta touchscreen and attachable doodads.
This is kind of how DynamicLand is. They use a system of projectors to create images next to objects, and color patterns to track object position and identity with cameras:
So, for example, you can place a keyboard next to a block of text to edit it.
There’s more to DynamicLand than that, but that’s what I’m reminded of.