Specialist with healthcare and mobile workforce (enterprise) related mobile solutions. www.ehit.fi
ahoccc | 13 September, 2006 12:02
My previous blog “Symbian and smart monitoring of human motion” seemed to inspire a lot of people, so I decided to go deeper into this subject.
In this blog I present a real world working case for controlling your mobile using your muscles.
Case setup:
The application shows muscle activity as graphical trend and is capable of basic operations such as muscle balance calculations, muscle activity counters and min/max follow-up.
I think this is quite intriguing as it is but then I added possibility to map certain muscle activity level to Symbian commands (key press, key press sequences etc.). So, basically using muscle by contracting and relaxing I can execute certain commands for Symbian device. And these commands are sent to the foreground (active) application. In essence, the application monitors muscle activity in the background and sends commands to the active application based on muscle activity.
As a proof-of-concept, I configured muscle activity command sequence for the Nokia SnakeEx game controls. You know the Snake game, where you control snake in a maze trying to collect food and avoid crashing to the maze borders. Following picture shows the command sequence configured for this case.
All this means simply that when right bicep is contracted, snake turns clockwise and when left bicep is contracted, snake turns counter-clockwise.
However as you can see from above picture, it is not enough just to execute one command e.g. when turning clockwise but several depending on the current snake direction. Also when contracting both biceps at once, left softkey is executed. This allows you to initiate new game without touching the device.
This application actually works as a general muscle-controller for Symbian device. With a few adjustments, application could follow the active foreground application name and based on that change command set on-the-fly. So when you are in messaging application, you could e.g. use muscles to write messages with T9. And when some game is active, command set is related to that game. Also different muscle contract-relax sequences could be mapped to different actions as well as different muscle activity levels. As I see it, possibilities as enormous with this kind of “bio-control”. Even more, in this case only two-channels were utilised, but when adding more channels you could use more muscles and more controls.
I must say that when you have played the game for some time, you feel like you have been doing real workout.
[added later]
Please review the addition "Symbian device control using muscle activity - a case study part 2" to this case as well.
Business Opportunities/Services, Entertainment, Games, Healthcare |
Next |
Previous |
Comments (10) |
Trackbacks (0)
arturo_duro | 14/09/2006, 12:40
ahoccc | 14/09/2006, 14:52
Yes, heartbeat and GPS together are quite a powerful combination. There is also company called FRWD (www.frwd.fi) that manufactures device like that. Their device is a small "black-box" that has heartbeat monitoring, GPS as well as Bluetooth for on-line monitoring e.g. with Series60 devices.arturo_duro | 21/09/2006, 10:54
ahoccc | 21/09/2006, 19:14
You are quite correct about FRWD device. It is closed-box but it effectively avoids the multiple Bluetooth connection issue. But of course it comes with the down-side that you cannot use the device with separate applications. Would it be nice if there would be some kind of server API available that would route Bluetooth connections to clients that have requested it? This way several applications could listen incoming data flow from same Bluetooth device at the same time...mayankkedia | 14/12/2006, 16:52
Friendly Reader | 22/12/2007, 04:34
Does anybody have any information about the FRWD Bluetooth protocol?
I would like to know how to read strings like:
FRWD01FB0102```bhfbnhbrj```````````````````````````Z```lnZ```lnZ```ll````bb`dbhhVdfnrrrrrrrrrrrrrrrr*0C
I have a 1 GB memory chip on my Nokia 6682 and I'd like to record
performance data to that chip, and then parse the data on the phone and
schedule more exercise time in my calendar when I'm being lazy.
I have an FRWD F500.
Thank you.
kulvijay | 13/02/2008, 13:06
Hi i'm developing a small accelerometer based app for N95. I downloaded the RDAccelerometer plugin. I could not build the Moving ball app on carbide. Its throwing an error "Undefined symbol: 'class CRDAccelerometer * CRDAccelerometer::NewL(class MRDAccelerometerObserver &) (?NewL@CRDAccelerometer@@SAPAV1@AAVMRDAccelerometerObserver@@@Z)"...
i hv checked the mmp file..I did add the RDAccelerometer.lib.. i dnt hv any clue why its not working.. Plz help..
wat do i do????
mdrahman.nokia770 | 13/07/2008, 23:33
hi ahoccc,
I don't know how busy you are in these days. Can I request you to help me in one of my projects? I believe you are very capable of doing that. I am eagerly waiting to hear from you.
نوكيا | 15/11/2009, 15:28
We hope to see muscle phones :D loool
احدث نوكيا | كسر حماية نوكيا | تحميل كتب | برنامج عمل شهادة | مشكلة نوكيا | نوكيا 5800 | برامج نوكيا 5800 | العاب نوكيا 5800 | برامج نوكيا 5800 معربه | ثيمات نوكيا 5800 | نوكيا N95 | برامج نوكيا N96 | العاب نوكيا N96 | برامج نوكيا N95 معربه | ثيمات نوكيا N95 | نوكيا 6680 | برامج نوكيا N90 | العاب نوكيا N90 | برامج نوكيا N90 معربه | ثيمات نوكيا N90 | العاب نوكيا مميزه | ثيمات خلفيات | برامج نوكيا | العاب انجيج
Re: Symbian device control using muscle activity - a case study
coultonp | 13/09/2006, 13:06
This is very cool and a really innovative use of technology. I think this whole area of using mixed reality gaming has enormous potential for public health and its something I have been trying to pursue in my own research. Interestingly in the UK this week we report about the dangers of the sedentary lifestyle invoked by the computer screen http://news.bbc.co.uk/1/hi/uk/5338572.stm which provoked much discussion in the papers and on TV. I think the mobile development community has a lot to offer in this area and is perhaps something we should be promoting with greater vigour particularly for games.