Danseuse au bouquet / interactive

104513531When I started teaching, I was teaching a course called Virtual Environments. It was a really complex course for the students and for me. The people taking that course were people in their 7th semester of the Digital Arts program, so they were more advanced in areas of animation, design and programming. The expectation was high, specially because Augmented Reality was getting a lot of attention and part of the topics in the course was oriented to that.

IMG_5980My previous knowledge of augmented reality was very little. I once did this experiment with my business card:


You can see a black image (marker) that helps your webcam with the help of a .swf file process the coordinates of the business card and in real time display either a video or a 3D model or some sort of interaction. Mine displayed my demo reel. At that time there were not so many resources other than the ARToolkit but a lot of comments and helpful information was in Japanese.




I decided that I needed to teach augmented reality on this course and I started documenting on the history of this. I found out that there were two big areas for this, one was the virtual reality and the other was the augmented reality.

For virtual reality I discovered a lot of information on the matter and I´m impressed now that having a Head Mounted Display (Oculus Rift) is not so hard or expensive nowadays.

For the augmented reality area everything was very new but at the moment a great type of this technology emerged. This new type of augmented reality was known as 3D projection mapping.

This type of technology was perfect for the background of the Digital Arts students, they could do great visuals without sacrificing the interaction part.

One of my groups got attention in the Adobe Design Achievement Awards with this video:

We even got into the finals:


The thing I love about 3D projection mapping is that no matter how simple or complex your animation or your visuals are, the medium itself has a “je ne sais quoi” or something that makes your project succeed.

I haven’t done so many projections on facades, I’ve mainly focus on building my own structures, one of the projects that I’ve documented is this:

It is a projection mapping on a white mug and it is inspired by the painting Danseuse au bouquet, saluant sur la scène (Dancer with bouquet, bowing on stage) from Edgar Degas. The animation you see was done by doing a simple rotoscoping technique and the flowers are real footage.


The software I use for achieving this technique is a combination of Modul8 with MadMapper.

Many of my students love this technique and they have been doing experiments with Processing, Kinect and Arduino.