Skip to main content

Projection Mapping Workshop

Intro to Projection Mapping

(document under construction)

Pablo Valbuena - Augmented Sculpture

Lieven van Velthoven - Room Racers (2012 version)

Lieven van Velthoven - Virtual Growth (2017 version)

TYPES OF PROJECTION MAPPING

2D to 2D: &nbsp2D video on 2D surface, or camera-projector mapping 2D to 3D: &nbspmap 2D videos or images onto faces of 3D object 3D to 3D: &nbsp&nbsp&nbsp&nbsp map 3D (perspective) renders of virtual object onto the real one
Static vs. Interactive

SIMPLE 2D MAPPING

    perspective warping (cornerpoints)
    MapMap, MadMapper, TouchDesigner, Unity, etc. 
   (infrared) cameras 
  

   
    SOME EXAMPLES:
BARE CONDUCTIVE

Bare Conductive - Build An Interactive Projection Mapping Installation With MadMapper

FLIPPAPER

FLIPPAPER by Jérémie Cortial & Roman Miletitch, Music by Jay B Baby

INTERACTIVE POOL TABLE

Forge IT - Pool Live AR

2D OBJECT MAPPING

Map 2D video onto faces of a physical 3D object: - multiple 2D surfaces (potentially at various angles) - input & output mapping: 'unwrapping' & perspective warping - MapMap / MadMapper / TouchDesigner / etc. - great when the object is not overly complex

Luma Box - DIY “Thank You” Window Projection Tutorial

Luma Box - DIY “Thank You” Window Projection Tutorial

THOR HAMMER pt.1

Projection Mapping Tutorial - 3d Mapping with MadMapper

THOR HAMMER pt.2

Projection Mapping Tutorial - 3d Mapping with MadMapper

True 3D object mapping

map 3D (perspective) renders of object onto a real object

  • Uses a virtual 3D model of whatever you are projecting on
  • Map complex objects: no tedious mapping of individual surfaces
  • Allows for effects like re-lighting
  • Projected effects that are NOT 'flat' (i.e. colors, textures, shadows, etc.) can still look correct from a single 'sweet spot' (anamorphosis)
Re: by Carolien Teunisse and Bram Snijders

Re: by Carolien Teunisse and Bram Snijders

ANAMORPHOSIS EXAMPLES
    <!--<tr>
        <td colspan="2">
            <img src="https://www.lapiazzaweb.it/wp-content/uploads/2021/06/Peeta_Infocamere_Padova-scaled.jpg" alt="" title="" width="1920" />
        </td>
    </tr>
    <tr> <td height="290"> </td> </tr>-->

    <tr>
        <td colspan="2">
            <img src="https://graffiti-artist.net/wp-content/uploads/2020/01/text-anamorphic-illusion.jpg" alt="" title="" width="1920" />
        </td>
    </tr>
    <tr> <td height="290"> </td> </tr>

Pablo Valbuena @ Todays Art (The Hague, 2008)

3D object mapping HOW TO

SOME 3D OBJECT MAPPING TOOLS: - fSpy (camera (or projector!) viewpoint estimation)

  • 3D modeling
  • 3D scanning (Kinect, LIDAR, photogrammetry, handheld, etc.)
  • 3D printing / laser cutting (create sculpture from 3D design)
  • output from Blender / Unity / Unreal / Processing / etc.
  • Syphon / Spout
FSPY TUTORIAL

Sanning Arkitekter - Tutorial - How to use fSpy with Blender

FasterTutorialsCom - 3D Projection Mapping in Blender (fSpy + Blender)

    <!-- FSPY BLENDER KITCHEN TEST -->
    <tr>
        <td colspan="2">
            <video width="1920" height="1080" controls>
                <source src="./videos/fSpy Blender Kitchen Test 02.mp4" type=video/mp4>
            </video>
        </td>
    </tr>

    <tr>
        <td> <div style="text-align: left;"> <span class="credits">fSpy & Blender in my kitchen </span> </div> </td>
        <td> <div style="text-align: right;"> <span class="footer">UAL:CCI - Projection Mapping Workshop - 20 - 3D to 3D</span> </div> </td>
    </tr>
    <tr> <td height="490"> </td> <td height="490"> </td> </tr>
PHOTOGRAMMETRY FOR MAPPING

TMK Interactive - Photogrammetry for Projection Mapping

SNEAKER MAPPING

SPACEFILLER - How we made an interactive, projection-mapped topographic installation

TRACKING STUFF
body tracking

Panasonic - Real Time Tracking & Projection Mapping

face tracking

Nobumichi Asai (WOW) - Real Time Face Tracking & Projection Mapping

BEWARE OF LATENCY THOUGH!

Panasonic - latency: 240 FPS vs. 60 FPS

ROBOT-AIDED MAPPING: BOX

Bot & Dolly - Box

Now let's have a go ourselves!!

Try one of the following tutorials:

Mirabelle Jones - TouchDesigner projection mapping (web)
GitHub page

Coaction Lab - Intro to Touch Designer part 2 - Kantan Mapper:
Coaction Lab - Intro to Touch Designer part 2 - Kantan Mapper

Elburz Sokhabi - Intro to TouchDesigner for Projection Mapping
Elburz Sokhabi - Intro to TouchDesigner for Projection Mapping

Reflekkt - advanced 3D scanning + mapping
Reflekkt - advanced 3D scanning + mapping

SOME USEFUL LINKS: