Drawing with Sounds Processing sketch
Since learning to code, I have explained to colleagues that if they have any ideas or needs for specific apps to come to talk myself or my colleague Keith Manville (@open_sen) and we would look at how we could design a application which would meet their needs. This happened to Keith a few weeks ago and I don’t want to say too much as he has already written about the process of designing the app on his excellent blog which you can find here.
What he has created is a simple visual and audio app that will draw bezier curves and ellipses depending on where the mouse is positioned on the screen. In addition it will play notes from the midi synthesiser using the soundcipher library created by Andrew R Brown. The outcome is a simple cause and effect app that not only stimulates the user visually but also through sound. The app can also be used on a touchscreen which increases the accessibility for some students. In the short time in testing this app out with students, I have found that different students react differently to it. Some are more interested in the visual shapes that are produced whilst others are motivated by the audio coming from the app when touching the screen.
In addition to this, I have adapted the code slightly so that switch users can access the app. Instead of the shapes being drawn depending where the mouse x and y axis are, the shapes are drawn randomly. Again I have found similar results with students being engaged and stimulated by the visuals and sounds being produced.
Part of our ongoing project is to produce applications for students with special educational needs, we have wanted to make the applications easy to share with others. We have set up a wiki: http://processingsen.wikispaces.com/ and if you click on the applications page you will start to find some of the applications that we have coded to download and try with your students, Both Keith and myself would greatly appreciated any feedback and comments regarding the applications as this will help improve them and further applications for the future.
N.B – If you are interested in seeing the work we are doing with the Kinect in the classroom please visit the PLC page at http://kinectsen.wikispaces.com.