Andreas Jakl's Forum Nokia Blog

Developer Events

mopius — Thu, 14 May 2009 22:57:29 +0300

Last week, I’ve been giving a talk at the first Austrian Android Developers Day (a2d2, organized by T-Mobile) about Android as a mobile operating system. It has been a very interesting experience – is there something that Nokia can possibly learn from this event?

Let’s start with the location: the event took place in Vienna. It was fully booked; nearly all attendants were from Austria. Most developer events that I know of try to gather an international audience and are therefore hosted in the larger cities. But the a2d2 clearly demonstrated that it’s perfectly feasible to host regional developer events. After all, the country size doesn’t say anything about the quality of developers: I've been told that when taking the number of inhabitants into account, most entries/finalists from the Android developer challenge came from Austria.

One of the most interesting aspects about the event was the mixed audience. About one third was actually developing for the platform, while another third didn’t really know a lot about Android beforehand! This is unique compared to most developer events, where attendants are experienced developers or managers who wish to extend their business. At the a2d2, students, small and big companies were all thrown together and enjoyed talking to each other. For example, several of our students (some from 2nd semester!) presented their projects at the tech sessions; on the other hand, there have been representatives from large companies like Red Bull or bwin. This resulted in a very relaxed atmosphere that lead to many new ideas.

The choice of date and time is the last fact I’d like to point out: the a2d2 started in the late afternoon and lasted until 10 pm. This made it a lot easier to attend after work, instead of having to take several days off to drive to some big developer event.

Developer Events

Obviously, huge events like the recent Nokia Developer Summit in Monaco are important as well. These serve the business target group and bring together the dedicated core of development companies, who can and want to spend the time and the resources required to travel there. The events demonstrate the dedication of Nokia to their business and show the value that lies in the ecosystem – which is bigger than on any other platform.

However, smaller companies, individuals and students are more or less left out. They need regional events that are easy to reach and cheap to attend. These events help to build the regional network that's needed to acquire new projects. And: this group is where the real innovation comes from. While they do not generate money for the platform or Nokia in the short term, it’ll pay off in the long run.

The interaction of Nokia with bloggers and with dedicated members of the community (through the FN Champions program) is excellent. Additionally, companies that are really interested in working on Nokia platforms are taken care of through the FN Launchpad / Pro programs.

Now, the goal should be to take care of the rest – developers who are not yet working on the platform, but might be interested. And those who are already doing something, but don’t have the resources to travel to big events or spend time on engaging in the online community. This is vital for creating a buzz around the platforms and for showing developers that they are being taken seriously. Just imagine how great it is for a student to be able to demonstrate his project at an event organized by a company like T-Mobile – or Nokia!

The Phone’s Compass as a Game Controller

mopius — Tue, 24 Mar 2009 22:08:07 +0200

CarChallenge is controlled through the compass of the mobile phone.

The Nokia 6210 Navigator is the first device from Nokia that features a magnetometer. It allows using the phone as a compass – very important for pedestrian navigation. GPS alone can only determine the direction in which you’re facing when you are moving. With a compass, the phone instantly knows in which direction you’re facing and rotates the map accordingly. This makes me happy when I step out of the underground and want to know where to go – without having to walk several meters only to find out that I chose the wrong direction.

A traditional compass only works when it is held horizontally. As Paul Coulton recently described in his Forum Nokia Blogs posting, the Nokia 6210 includes a 3-axis magnetometer. Through some calculations, it is possible to find out the absolute direction in which the phone is facing, no matter how the phone is oriented. The S60 Sensor Framework provides a processed sensor output that gives you the degrees relative to the North Pole.

Compass Applications

Traditional applications that greatly benefit from a compass are apps like the “Magic Wand” (recently described by Paul; our students have also been working on a similar app during the winter semester): just point the phone to a building and the phone tells you what it is. By combining information from GPS, the accelerometer and the compass, it is possible to determine where the user is pointing his phone and for example to augment the camera picture with additional information about what he sees.

Another possibility would be to use the same method for showing information about the stars and constellations. Just point your phone to a star and instantly get information about it. I’m not yet aware of any such applications for S60 phones that integrate the magnetometer. General planetariums are of course available, like for example Solun’.

A few days ago, I’ve been chatting with Philipp Breuss, one of the winners of the first Android challenge and now teaching Android at our Mobile Computing department in Hagenberg. He told me that there are currently two such planetarium applications that make use of the magnetometer for the Android platform; one of them being his own. An easy to understand concept that has great potential.

Compass Games

The compass is of course not limited to applications. A novel idea is to use it for controlling games. Christian Feldbacher and his colleagues Philipp Rakuschan and Clemens Stangl have been busy developing a 3D car game with a clever artificial intelligence over the last two semesters - called CarChallenge. As an experiment, we decided to include the compass as an additional control method.

Playing the game with the compass requires physical action – the car drives in the absolute direction you’re facing. Want to turn the car left? Just turn yourself to the left. How to turn the car around? Make a 180° turn yourself (e.g, from North to South).

In contrast to the compass, the acceleration sensor is only able to measure relative movements on this axis. The rather small resulting sidewise acceleration forces would not be sufficient for accurate game control. Instead, accelerometer based car games usually rely on tilting the device – something that can be measured easily through the different distribution of gravity to the three accelerometer axes. However, there would not be a difference at all if you’re facing to the North or the South – the gravity is always just directed downwards. Through the compass, the game is now able to integrate the absolute direction in which you’re facing.

His video on YouTube demonstrates the look and feel of the game, as well as the compass-based control mechanism. Of course, steering via the compass isn’t well suited for playing the game in a bus and is probably problematic for long gaming sessions. However, it’s great fun!

As a next step, why not make a game that determines how often you can turn around before you get dizzy and fall to the ground (detected by the accelerometer, to use the available sensors to their full extent)?

CarChallenge is essentially finished and will be released shortly. Watch the project page at symbianresources.com for updates!

Accelerometers Redefine the Game Experience

mopius — Thu, 19 Mar 2009 19:25:13 +0200

Accelerometers fully integrated into the game design - turn your phone to change the gravity of the environment!

Nearly nobody noticed the Nokia 5500 Sports, most likely the first phone equipped with an accelerometer that was accessible for 3rd party developers. gBoarder (application for recording snowboarding statistics like the number of crashes or jumps) and CarMeter (measures g forces when driving a car) were one of the few applications that made use of it - already released in February 2007.

When Nokia finally released the R&D API for the N95, the boom began and many acceleration sensor-based applications appeared. Many of them are useful (pyPozentica), others are just for fun (Light Sabre). And of course, there are some entertaining games as well (Groove Labyrinth, pyWuzzler).

Especially with the iPhone lacking any keyboard, many game concepts simply were not really possible – as an effect, the accelerometer got to be an accepted control method for commercial games. Racing games are a good example, where the tilt of the phone simulates a steering wheel. Much like in ShakerRacer, which uses the same concept for controlling a real car.

However, most of the games just use the acceleration sensor as an input method that fits to the game (up to some degree). Only very few games completely base the whole game concept on the use of the accelerometer. One of those few games has been developed by the Mobile Computing students David Berger and Stefan Poremba from the Hagenberg University o.a.S.

SlideEscape / SlidersEdge

On the first sight, the game SlideEscape / SlidersEdge could be seen as a normal jump & run. The fact that the left/right-movement of the character can be controlled by tilting the phone and jumping by quickly pulling the phone towards you is nice, but not something new either.

The innovation comes from the fact that turning the phone changes the gravity of the virtual game world. An example: the character is standing in front of an uncrossable abyss. How to get over it? Turn your phone upside down to walk on the ceiling and safely pass the depths!

Through this mechanism, the acceleration sensor not only influences the movement, but is directly integrated in the whole game experience as well as the level design. It’s not just an add-on that could be easily replaced by a key control mechanism (like in a racing game), but an essential part of the game.

The video on YouTube demonstrates how this works in real life:

The project is available as a free download from David’s official homepage, as well as from the project page at symbianresources.com.

Please note that the game is a prototype and therefore not really bug-free. The main game is a Java ME application. As it still isn’t possible to access accelerometer data from Java ME on Nokia phones, a native S60 application is provided as well, which runs in the background and provides acceleration data to the game via an internal socket (does not lead to data charges, even though the Java ME game warns you upon start-up).

Mobile Physics

mopius — Wed, 11 Mar 2009 19:21:54 +0200

Draw abstract objects on the screen; they will instantly get physical properties!

Physics engines simulate behaviour and motion of objects in a virtual world. With the increased processor resources available on today’s PCs, almost every game integrates a more or less advanced physics engine.

Even if the dedicated physics PCI card for the PC, the PhysX by AGEIA, did not really succeed in reaching the mass market, it increased the awareness that the game experience is greatly enhanced if physics are accurately simulated. Nowadays, NVidia has bought this company and physics simulations are often calculated directly on the 3D graphics hardware.

The oldest game I can remember that heavily relied on physics simulation was called The Incredible Machine. Released in 1993, players had to place various objects in a 2D plane to solve puzzles. This included placing machines, lights, ropes, balls and much more.

Another game, Bridge Builder, has now been around for quite some time (first release in 2000) and also uses physics as the main gameplay element. Players have to build bridges and ensure that they do not break. Later examples like World of Goo follow a similar basic concept, but make the game a lot more accessibly by integrating a different scenario and pleasant graphics.

Another possibility for games that mainly rely on physics simulation is represented by Crayon Physics. In a pre-defined scenario, players have to move an abstract object (like a circle) from its starting position to a target. This can be done by drawing 2D objects (like other circles that behave like balls, rectangles, or ropes); physical attributes are applied to those. Of course, solving the levels gets very challenging over time.

Mobile Physics

Even if advanced 3D physics like found in Half Life 2 would still be too much for today’s mobile devices, they are certainly up to the task of running 2D physics engines. A good example is Numpty Physics, available for free for the Maemo-platform.

David Berger, a student in the 3rd semester of Mobile Computing in Hagenberg, has now ported the open source 2D physics engine called Chipmunk to the S60 platform.

With the help of the OpenC++ libraries, it was possible to run the engine without any serious modifications. As the foundation for the user interface, he used the Mobile Paint example from Nokia. All objects that you draw on the screen instantly get physical properties and move according to the current gravity level as well as collisions with other objects.

David’s video on YouTube demonstrates how well the engine works. Unfortunately, there were some problems with regards to the screen update and the TV out when drawing – but as you can see in the video, the engine works totally fluid and fast. Now, I’m looking forward to seeing the first physics-based games on the S60 platform!

More information, the download of the demo plus source code is available on David’s website as well as on the project website on symbianresources.com.

Mopoid Workshop - Your Own Arkanoid-like Game for S60

mopius — Wed, 14 Jan 2009 00:23:36 +0200

Develop a full-blown Arkanoid-like game - and play it!

Probably the largest and longest free workshop for S60 development is now available in a completely rewritten and updated version. The unique aspect: everything is explained based on a fully working Arkanoid-like game called Mopoid.

While reading through 76 pages and 175 slides, you will explore most of the important concepts behind Symbian OS / S60 – including using the UI designer of Carbide.c++, scalable vector graphics, localizable text and of course all the traditional topics like the cleanup stack, descriptors or periodic timers.

The Origins

In 2004, I prepared my very first Symbian OS workshop at the University of Applied Sciences in Hagenberg. Its aim was to give a compressed overview of the most important concepts of development for S60 – in form of a large, fully working game. Students would implement certain parts; the specialities of native Symbian OS C++ development were explained right when they were relevant. I still remember working through the whole night on the day before the workshop, testing everything ten times to make sure that everything really worked as expected.

The Update

Back then, the tutorial was based on the free Borland C++ Builder Mobile Edition, which already featured a UI designer. While the IDE had potential, it was slow and buggy. Soon after, it was abandoned.

The mobile world moves quickly, and the tutorial soon got outdated. Still based on S60 1st Edition, the game wouldn’t run on current devices. Also, Borland C++ Builder does no longer exist, with the (much better) Carbide.c++ IDE now being the standard for Symbian OS development.

As it would have been a pity to simply let dust settle on Mopoid and watch it disappear, I decided to take on the task of updating the tutorial for today’s environment. The game has now been greatly extended and improved - for example, it includes support for scalable screens. Of course, most parts of the tutorial had to be rewritten as well. The slides are completely new.

The Future

The workshop was just published on the Symbian Developer Network and is now also available from symbianresources.com. The whole tutorial might be a bit too steep if you don’t have any experience with Symbian OS at all, but for a little more advanced developers, it’ll be interesting to see how all the idioms and concepts fit together in a real game.

The source code is released using the GPL license. Mopoid already supports level files, saving the high score and much more. If someone wants to add more features or levels, it’d be great to release a polished game without some rough edges to the public in the future!

Mobile Surveillance Tools

mopius — Sun, 04 Jan 2009 19:07:32 +0200

SpyPhone / BabyPhone is a Python-application that monitors the surrounding sound level.

At the core of every mobile phone, there’s still the voice channel. Therefore, every phone is equipped with a microphone that’s optimized at recording the human voice. Add the aspect that the phone is mobile and that the owner usually carries it with him all the time, it’s no surprising thought that the phone can be used as a remote surveillance tool.

BiBUnit is based on a rather simple concept and essentially accepts incoming video calls if a previously set number is calling, allowing you to monitor the surroundings through the phone camera. SpyManager on the other hand lets you take remote snapshots of through phone, also through a PC server application.

Similar, but with a different usage scenario is Phone Guardian, which allows remotely controlling aspects of the device in case it was stolen from you. SecureMe is built based on the same concept.

SkyeSpy turns the situation around and alerts the observer autonomously. The application on the "spy"-phone is able to monitor the audio level of the surroundings. If it exceeds a threshold, the phone will contact a previously paired phone per SMS or a call.

There might be other applications around that I missed, but the list should give you an overview of what is currently possible on a S60 phone.

SpyPhone / BabyPhone

Now the students Clemens Rainer and Daniel Haslinger went up to the task of implementing this application via PyS60 and have released their results for free as an open source application called SpyPhone or BabyPhone.

Like the SkyeSpy-application, the phone constantly monitors the audio level of the surroundings. If a pre-defined threshold is exceeded, the phone automatically calls the number of a pre-defined "agent".

A good use-case would be the monitoring of a baby. When it starts to cry, the phone will automatically call the number of the parents. As the call is a normal voice connection, they can hear what’s actually happening. If it sounds serious, it’s about time they pay a visit to the child.

Technically, the application is constantly working on two tasks. The first records the sound into a file on the device. In the meantime, the other task analyzes the previous sound file. The next step would be to add more sophisticated sound processing to the application. Instead of just calculating the volume like SkyeSpy does it as well, it would be possible to measure the frequencies in the recorded sounds and only react if these are in the range of the human voice.

As the SpyPhone / BabyPhone application is available as open source, it provides an ideal starting place for your own audio experiments in Python for S60.

Explore .sis-files Online

mopius — Sun, 04 Jan 2009 18:27:09 +0200

whatisinmysis.com analyzes the contents of your.sis files.

Ever wondered what's inside your .sis files? Which certificate was used to sign it? Does it have the right capabilities? Of course there are utilities that can help you with analyzing the contents. One of them is the SISXplorer utility, or you can also use the sisinfo Python-script. Both are available for free.

But what if you don't want to install an application just to take a look at the contents of the .sis-file? Or what if you are working on a friend's PC that doesn't have the same, perfect setup as your own? Stefan Damm got into this situation from time to time, and then decided to make an online tool available.

The website whatisinmysis.com is an online interface to the sisinfo Python-script. You simply upload the .sis-file to the website, and it will display all the information about its contents. Easy, fast and free. No setup on your PC is required. The privacy statement on the site ensures that your uploaded files are deleted immediately after analysis.

whatisinmysis.com will display the following:

Contents of .sis file and installation directory of each entry
Capabilities of each executable (exe, dll, .pyd)
Certificate chain

If you find online services like the new one from Stefan Damm interesting, you might also want to bookmark WhyTheFuckWontMySisFileInstall.com. It has got a slightly different focus: it provides information about the signing status and prints reasons or suggestions why installation of this .sis-file might fail on a device.

Of course, whatisinmysis.com has now also been added to symbianresources.com.

Protect your Skis with your Phone!

mopius — Wed, 10 Sep 2008 22:26:45 +0300

TDS-S uses NFC technology to secure your skis.

Near Field Communication (NFC) is mostly associated with micro payment systems or access solutions. These are the ideal use cases for rather slow, but contactless information transmission over distances of up to some centimeters.

Theft Deterrent System for Skis (TDS-S) is a novel approach to using NFC technology – it protects your skis from being stolen.

The students Markus Eder, Florian Lettner and Carina Madlmayr from the Mobile Computing department of the FH Hagenberg are fond of skiing – rather natural, considering they’re from Austria. Everyone who has already been on a slope in his life will know the slightly worrying thoughts when you go into a ski hut: “Are my skis still going to be here when I return?”

Especially if you know that there are more than 10,000 registered ski thefts every year only in Austria, it’s certainly not inappropriate to think about securing your expensive skiing equipment. Naturally, cameras outside of the restaurants usually don’t help much. If you consider what everyone is usually wearing when skiing, you’ll usually have a hard time to identify the thief should the police ever catch him. The only commercial solution that’s available today is to the skis together using a lock (like the simple bike locks). Unfortunately, this isn’t the most comfortable solution.

Near Field Communication is here to help

Surprisingly, NFC is the technology that proves to be incredibly useful to prevent ski theft, while still offering all the comfort you might want to have. The project “Theft Deterrent System for Skis (TDS-S)” is essentially about pairing the boot with the ski and doesn’t let the thief step into the binding if the secure code doesn’t match.

This is done by putting an MIFARE-tag into the boot. A small RFID-module is inserted into the ski and connected to one of the new bindings that electronically control the operation of the binding – like the Atomic Neox EBM. A Near Field Communication-enabled mobile phone or a PC is able to pair the boot with the ski. If anything else than the trusted boot steps into the binding, it refuses fastening and doesn’t let the thief drive away with your skis.

The project is currently still in development - you can read more about it at symbianresources.com or the project homepage. The first prototype has already been published and managed to be among the winners of several global competitions – the 1st Austrian NFC Developer Competition as well as the NFC Forum Global Competition. Who knows how much longer it’ll take until skis, which started out as simple wooden planks (The word “ski” meant “a stick of wood” in Old Norse) will finally turn into a product full of high tech.

NFC Congress

By the way, if you're interested in NFC, the place to go is the third annual NFC Congress from the 24th - 26th of February, 2009. It'll take place again in Hagenberg. After the successful previous two events, it has now turned even bigger and now consists of the conference, a workshop, an exhibition, a competition and even an IEEE scientific workshop day. Register now!

A video about the project:

Mobile Surround Sound

mopius — Mon, 01 Sep 2008 11:27:46 +0300

3D Sound on current mobile phones might mainly be a marketing gag – like the sound effects found on Nokia phones like the N95. It certainly does sound nice to have your ringtones swirl around and it works surprisingly well. But of course, it’s just simulated surround with two small speakers that are close together.

It will certainly be interesting to have technology from Dolby integrated into phones, like it was demonstrated at the CTIA Wireless in 2008. However, there is no precise information about future roadmaps or products.

What the students Stefan Damm and Arnold Ahrer from the Mobile Computing-department of the University of Applied Sciences in Hagenberg (Austria) created is a small solution to enable real surround sound through mobile phones - called Mobile Surround Sound.

It works by using four different mobile phones, which have to be placed into the corners of the room. Essentially, the phones are turned into speakers, albeit with a bit more intelligence than the usual speaker. A central control PC is connected via WLAN to the phones and is able to control them in real time.

Once all phones are connected, the PC starts the sound on all phones at the same time. The user can now move the sound source on the graphical interface of the server. This automatically adjusts the volume of the different speakers, thus leading to the impression that the sound is moving around in the room.

Also great to put your phones to good use if you've already got too many of them ;-)

The application was developed by Stefan and Arnold as a small project for the Interaction Technology course during the summer semester. It is written in Java (Server) / Java ME (Client) and is available for free (open source).

Automatically Calling Back Saves Money

mopius — Tue, 26 Aug 2008 18:18:15 +0300

Auto Call Back can help you to save money.

Starting with today, I'm now also on one of the hugely popular all-inclusive phone tariff plans. In Austria, every operator currently has a plan with a certain number of minutes (usually 1000 or more) included - essentially, a flat rate for around €19/month.

On the other hand, many friends and relatives have minute-based plans, which can be rather expensive if they're calling to other operators.

Rationally, it'd be the best if I call someone with a minute-based plan back and don't accept his call. In this scenario, nobody of us pays anything (extra). Obviously, it's a bit of work - you have to discard the call, go to the call history and call back.

Automatic Call Back

Already two semesters ago, two students (Dominik Brandlberger and Daniel Haslinger) developed a solution to this called "Auto Call Back" (why always invent strange names if it can be that simple?). The whole call-back process is automated by the application.

The result after one semester is a prototype and no commercial application - after all, both didn't have any serious Symbian OS development experience before and the whole issue turned out to be not so easy.

Apparently, you can't easily cancel calls that you don't own through the public CTelephony-APIs of S60 3rd Edition-phones - it only seems to work if you accept them first and immediately cancel them. However, this means that the caller already has to pay up to one minute, no matter how short the call was. Therefore, the application now cancels the calls through simulating the red key. The disadvantage here is that the mailbox has to be turned off for rejected calls.

But how does the app know for which contacts to do it? After the first initial experiments with an own database, the best solution turned out to put all those contacts into a special group. This also allows the user to easily manage the call-back contacts through the normal contacts-app of the phone; the call-back app doesn't have to re-invent the wheel.

The prototype is available for free, but of course not yet ready for real-world usage. It lacks many features and is by far not bug-free. Also, you need to sign it yourself through the Open Signed-process from Symbian Signed.

If anyone is clueless what application to develop next, I'd be very interested in getting a finished and polished application that can do exactly what the prototype can do. Or is there already anything around on the web that I didn't find?