• fingers

    The idea behind Fin­gers was to build a plat­form, to exchange ideas and spread inspi­ra­tion by set­ting up a pubic touch­screen with a draw­ing appli­ca­tion, where stu­dents can share thoughts or opin­ions and get inspired by con­sum­ing cre­ations of others.

    Finally all team mem­bers agreed, that a multi-touch screen should be the inter­face of choice as users can inter­act most nat­u­rally in terms of paint­ing. From that point on, the team of four stu­dents has been split up, two respon­si­ble for build­ing the device, two for the soft­ware. From my expe­ri­ence level, I have been choosen as mem­ber of the soft­ware group, how­ever I man­aged the coor­di­na­tion between groups and there­fore par­tic­i­pated in design and real­iza­tion of the mul­ti­touch screen as well.

    The con­struc­tion fol­lowed a quite sim­i­lar approach than the one shown in the video below.

    The input image was refined by a ren­der­ing pipeline, using the Sun Java Media Frame­work (JMF) and Apple Quick­time to cap­ture images from the camera.

    Screenshot of pipeline input, as captured from the camera.

    A screen­shot of pipeline input, as cap­tured from the camera.

    Screenshot of pipeline output, after normalizing, sharpening, bitmapping and blurring.

    A screen­shot after pipeline of nor­mal­iz­ing, sharp­en­ing and bitmap­ping, before bluring.

    Out­put exam­ple on the right is not derived from input exam­ple on the left.

    Screenshot of the final application.

    Screen­shot of the final application.

    The ren­dered out­put image was finally com­pleted with a sim­ple GUI (based on Java AWT and Swing),  allow­ing users to start a new cre­ation, to save it or throw it away. In idle state, the GUI switched to pre­sen­ta­tion mode, show­ing saved pic­tures in ran­dom order. The whole device, i.e. touch sur­face, video pro­jec­tor, cam­era and com­puter would have been mounted in a box, using a mir­ror at the bot­tom to min­i­mize vol­ume, and placed in the foyer of the design depart­ment. But sadly, the touch inter­face has not been fin­ished until the end of the first term of my mas­ters stud­ies, after which I left the Uni­ver­sity of Applied Sci­ence of Augs­burg to join the Okkam project in Trento, Italy.

    » pre­sen­ta­tion slides (in German) »