Sittiphol Phanvilai's Forum Nokia Blog - NeuScreen : MultiTouch Screen Engine using Nokia N95

Call us loony

Call us loony, but it sure seems like Nokia's heralded N95 ends up in the middle of quite a few DIY endeavors. Sure enough, said mobile is at the heart of Sittiphol Phanvilai's latest project: NeuScreen. Put as simply as possible, the project creates a multi-touch engine for the N95, and in the demonstration waiting after the jump, a simple pen light is used to control objects on a TV screen that is connected to the aforementioned handset. Confused? Give the video a look, that always clears things right up. I just work at home application and will share with you people soon.

thanks

There seems a bit of a lag but otherwise it works!

Why do you need the "pen" ?

On Television the Weatherman uses just their finger and a "black-box" detects the smallest point furthest away (tip of finger) and makes that the active spot.

Your program does not need to use light from the pen. You can use just your finger. To make it easy paint a thimble green and stick it on your finger, then have the camera look for green.

Also make camera correct for "keystone" them you can move camera off to the side and out of the way.

You also need to make it work on white piece of paper (with NO Television). You hold camera (phone) in one hand, look at screen, draw on paper with finger and see result on phone's screen.
شات-العاب-
Once you get rid of the light-pen and the Television this will be portable (and popular). With character recognition and the ability to draw on cement (or blacktop) instead of white paper you can make easy to use "keyboard" for texting quickly.

Keep up the good work.

Its really interesting! Great work! :)

Regards
Gopal

Good work ....

Hi Rob_C,

Thanks a lot for your suggestion. :)

The main reason that why I didn't track finger directly instead of track the light pen was N95 CPU is too low to make full image processing. For now, it can operate at only 5 fps (320x240x24bpp) with high optimization.

However, I will try my best to make it more usable than now. May be the way to write on the white paper with finger.

Thank you once again. :)

> If you have any comment or suggestion please feel free to leave comment here.

There seems a bit of a lag but otherwise it works!

Why do you need the "pen" ?

On Television the Weatherman uses just their finger and a "black-box" detects the smallest point furthest away (tip of finger) and makes that the active spot.

Your program does not need to use light from the pen. You can use just your finger. To make it easy paint a thimble green and stick it on your finger, then have the camera look for green.

Also make camera correct for "keystone" them you can move camera off to the side and out of the way.

You also need to make it work on white piece of paper (with NO Television). You hold camera (phone) in one hand, look at screen, draw on paper with finger and see result on phone's screen.

Once you get rid of the light-pen and the Television this will be portable (and popular). With character recognition and the ability to draw on cement (or blacktop) instead of white paper you can make easy to use "keyboard" for texting quickly.

Keep up the good work.

Shit i'm really impressed with what i see. I think this can start to be a usefull addition for mobile phones as a presentation device. Cool work guy's

Really nice, it looks good!

Really nice work!!!

Congrats!

Decisely impressive!!

nice work

I have been toying with idea of doing a project using light as a positional aid to allow the phone to be positioned in space for while. Too slow!!!

But very nice work

NeuScreen

Great work, kind of similar to what Johnny Lee made using the infra red sensors, and wii remote, great that we have similar made available for our N95's.!

Excellent.

Now that is a cool project. Kudos Sittiphol!

Thanks all ^^

Ciao,

this is great! I am really amazed !! Great work!
Alessandro

Thats inspiring, I never even thought something like can happen.
Great work.

Very impressive. You can be proud of this, it's a fantastic project :)