Another week of wonder

The last few weeks have been action packed, and each week seems to have more than the last.
In the last month while in Sydney I have been to the Hotel, Hospitality and Design expo and the EduCause expo, both in Darling Harbour at the Sydney exhibition and convention center.

The nsquared team in Sydney has been working on optimizing the nsquared education pack for Windows 7 touch. This has been done on a range of devices; HP Touchsmart desktops, Tegatech TEGAV2 and the 3M 22 Inch touch screen.

The Managed Chatrooms website and service has been revamped and updated. Microsoft is among our customers of Managed Chatrooms, and our customers have stated using Managed Chatrooms for more events this month than ever before.

You may have noticed that Apple released a new product in March and the iPad app I wrote to help manage tasks on Exchange and SharePoint, ntask, has had an update to work better with Exchange 2003. Also on the iPad nsquared released coin swap, a game to teach children the value of money.

The Hotel Room of the Future

This week I have been at the Hotel Hospitality and Design Expo in Sydney. The nsquared team released the nsquared hospitality pack for Microsoft Surface. This includes three applications designed specifically for the hospitality industry, nsquared concierge, nsquared room service and nsquared tourist table. Each of these applications helps the hotel up-sell services that they offer directly or through affiliations.

News.com.au included an interview with me in their video about the hotel room of the future

Surface 2.0 chat on CodeCast

I recently had a chat with Ken on CodeCast about Surface 2.0, Kinect and a bunch of other Microsoft technologies.

It has been difficult in the last few months to discuss what we have been working on and there are still areas that we cannot discuss. Yet the cover has been lifted on the surface 2.0 project and I am proud to have been involved in the new software development that the team at nsquared has been creating.

Grab your headphones and listen to this easy going chat between Ken and myself.

Mix'11 Sessions Proposed, please vote now

Las Vegas will host Mix again this year, between April 12 and 14. As always I expect there will be a wide range of interests around Microsoft technologies represented at the event.
I proposed a total of nine talks for the event, sadly only three were accepted for the community voting. If you would like to attend any of these presentations please will you click on the link in the title and vote for them.

Wave, Touch, Pen, Speech, Mouse and Keyboard
In the last decade we have seen a variety of new interfaces popularized. With Microsoft Kinect you are the controller. There are screens that can see like Microsoft Surface. We have touch screens that can feel you and pen interfaces that provide rich digital inking capabilities. Speech technology to control an computer has existed for over a decade now. Yet we still are using the mouse and keyboard almost daily.In this session you will explore how the different input technologies can be applied to different categories of engagement. You will learn why the mouse and keyboard is here to stay and when you should take advantage of the other input technologies. This session will also provide you with some insight into how you can apply combinations of input to enhance your applications further.

How to build a great Microsoft Surface application
Microsoft Surface represents a new category in computing. Vision based screens enable unique interactions and they present fantastic opportunities for innovative software to be created. In this session you will learn what makes Microsoft Surface unique and how you can use that to build great software for Microsoft Surface. This session will cover the user interfaces and concepts that you need to apply in order to take advantage of the technology in MicrosoftSurface. With the imminent release of Microsoft Surface 2.0 this session will cover everything you need to build really amazing experiences for MicrosoftSurface.The company Dr.Neil works for has more applications certified for Microsoft surface than any other company in the world. This session will provide some insight into how they conjure up the magic that enables them to repeatedly build awesome Surface experiences.

Building Really Social Software
Technology can be both an inhibitor and an enabler of social engagement. This session presents a discussion on how technology can be used to enrich the dialogue between users. When you consider many forms of computing today you think of users staring into a screen and yet the most successful systems, such as twitter and Facebook, are really about how people converse with each other. In the last few years new categories of technology, such as Microsoft Surface and Kinect, have emerged that truly bring people together. This session will discuss the way these new technologies (and others) will change the way we can use technology to enhance human interactions.

Then with the other Surface MVPs we are proposing a discussion on all things relating to Natural User Interfaces.

The Microsoft Surface MVPs present: Natural User Interfaces, Today and Tomorrow; an interactive discussion and demonstration
Joshua Blake; Neil Roodyn; Dennis Vroegop; Rick Barraza; Bart Roozendaal; Josh Santangelo; Nicolas Calvi
The Natural User Interface (NUI) is a hot topic that generates a lot of excitement, but there are only a handful of companies doing real innovation with NUIs and most of the practical experience in the NUI style of design and development is limited to a small number of experts. The Microsoft Surface MVPs are a subset of these experts that have extensive real-world experience with Microsoft Surface and other NUI devices.This session is a panel featuring the Microsoft Surface MVPs and an unfiltered discussion with each other and the audience about the state of the art in NUI design and development. We will share our experiences and ideas, discuss what we think NUI will look like in the near future, and back up our statements with cutting-edge demonstrations prepared by the panelists involving combinations of Microsoft Surface 2.0, Kinect, and Windows Phone 7.

Please submit your vote for the sessions you would like to attend or hear. Remember many of the sessions get recorded and published online after the event.

The presentations that got rejected were:

Confuse me, lose me
Lets face it no one reads the manual anymore. Software should be so easy to use that the user can just walk up and start using it. So why is this not the case?
In this session Dr. Neil will discuss how interfaces can be built to enable users to get started with new technology and learn by using the system. A rich discussion of the pitfalls of complexity and how to simplify your user interface will allow you to leave this session with a set of tips to make your applications easier to use.
This session will provide an insight in to the thinking behind Natural User Interfaces as well as how to improve your Graphical User Interfaces.

Future Furniture
What will the furniture of the future look like? What functionality will it provide? This session provides you with a fun filled look into the way technology is being built into furniture and how furniture may look in our meeting rooms, our office and our homes in 10 years time.
Microsoft Surface has provided a glimpse into this future of furniture, where a table is no longer just an inert object but provides rich digital content. How else might our future change with new innovations that we expect to see emerge in the coming decade.

Look into my eyes
Face to face meetings provide the best way to really understand another person. Human interaction happens between people. Business transactions are agreements between people. It is easy to forget that everything we do in the software industry is still about people. In this session you will discover how technologies like Surface 2.0 can enrich the true social interactions between people. You will also learn why it is important for software developers to understand the nature of human engagement in order to build better

Now you’re speaking my language
Do you want to support multiple languages in your software? Can’t afford to pay for a translator to translate your software into every language? Microsoft Translator will help you support multiple languages in your application.
At Mix 09 Microsoft announced the release of the Microsoft Translator SDK. At Mix 10 Microsoft announced an update to the Microsoft Translator SDK include the Community Translation Framework. Come to this session to find out the new technology being released by the Microsoft Translator team.
Microsoft Translator is a team within Microsoft Research that focuses on natural language processing. The Microsoft Translator technology is used by Bing Translator, in Internet Explorer and in Office 2010.

So what exactly is technology anyway?
How are you reading this session abstract? Is it created with technology? Is the attendee badge you are wearing technology? One of the definitions of advanced technology is you will not notice it is there. It will blend into everyday life. With this concept in mind, Dr. Neil will discuss how we can move the technology we are building to the next level and become unnoticed by our users.
Come to this session to be awakened by the reality of what we are all creating in this world and learn how we can extend the reach of our technology into the everyday lives of our users.

If you would like to hear one of these presentations, please get in touch.

What is a table for?

Let me ask you a question, what is a table for?
It may seem like a strange question yet it is not something we typically think about.
Furniture is taken for granted, in fact sometimes the word furniture is employed to mean the adornments in or on an object. You could say someone with lots of facial jewelry has 'furniture on their face' or, as I have heard it said, they have 'face furniture'
In our everyday lives we utilize furniture to enhance comfort and to perform functions, it is these functions that are worth exploring.
Think of all the things you do at a table. Eat food, work on your computer, layout a puzzle game, hold a meeting, and many more 'events' occur at a meeting. Consider which of those events take great advantage of the horizontal surface that is presented by the table. Playing puzzle game with friends, or holding a meeting at a table is something that clearly requires a horizontal platform. The horizontal nature of a table with multiple sides open and available for people to sit, presents the ideal place for holding a meeting. It enables eye to eye contact, allowing all participants to engage in a much fuller conversation. Such a large portion of communication between people is non-verbal and by facing the other parties around a table we can pick up on these subtleties. We can understand from proximity and quick glances of the eyes the nature of personal relationships between people.
Many technical solutions ignore the human interactions that are crucial for us to work together and create far shallower modes of engagement. Instant messenger, for example, provides a mode of communication between multiple parties, each siting at their own workstation. The nuances of passion, humor and disgust during the conversation can be hinted at with the use of emoticons. These provide a limited set of clues to hint towards the users feeling as they make a statement. The vocabulary of these is not just limiting but also deceptive. A person may want you to feel they are being jovial while really they are sad. You would only ever pick this up if you actually with the person. The telephone can provide a better medium for judging the mood of someone, through the tone of their voice and through other audio clues.
Yet nothing bis better than sitting at the table with someone for truly understanding their feelings and position on a topic. Most digital content is still presented using vertically oriented displays, yet these displays act as barriers to the optimum personal communication.
When working with the Tablet PC team at Microsoft in 2003- 2005 one thing became very clear, the slate form factor could radically change the dynamics of a meeting room. In a typical meeting at Microsoft people will bring their laptops and sit around a table, each staring into their own screen. This is incredibly anti social and detrimental to the level of engagement of the people in the room. In a meeting where each participant had a slate device the device did not act a barrier between the individuals at the table. Tabletop computing now has the opportunity to take this to the next level. By sharing the content directly on the tabletop the number of barriers is further reduced. A personal screen can present personal distractions during a meeting (email, IM, etc...), on a shared screen the focus can be on just the content desired.
Today I presented these concepts to a potential client showing the nsquared business pack for Microsoft Surface. It is clear that these applications can really change the dynamics of a meeting. Even as we were discussing the requirements of the project we were sketching out the ideas on nsquared thoughts. Tabletop computing should start to bring new ways of human engagement to our meeting rooms in the coming years and this will help us to work better together than many earlier technologies.

Measuring the success of your tabletop application

Over the last 2 years I have been heavily involved in working with tabletop software, specifically software for Microsoft Surface. Having content displayed directly on the table top can radically change the interaction that occurs between the users sitting around the table. How we present the information on the table top will greatly impact on this interaction.

A number of researchers have spent considerable time and effort working on this challenge and recently at the ACM International Conference on Interactive Tabletops and Surfaces 2010 (http://www.its2010.org/) some of this research was presented. One of the more interesting (and arguably problematic) papers was presented by Tang, Pahud, Carpendale and Buxton; entitled VisTACO: Visualizing Tabletop Collaboration. The paper presents a way that researchers can scientifically understand the interactions of the users at a table. One of goals being to validate the design of a multi-user tabletop computer.

I say this can be problematic because while it is easy to track the user interaction on the table top, with software, this project (as described in the paper) attempts to solve a couple of other challenges; 1. does the interaction change if the people are not all physically sitting at the same table, 2. does the spatial position (configuration) of the users impact on the interaction models. The results are certainly useful but do they tell the whole story about the success of an interaction model?

From the work we have been doing in the real world with tabletop multi user deployments at nsquared there are other factors at play that are less easy to measure. The emotional connections that are made between people at a table during an interaction is often (maybe always?) more important than the actual physical interactions that have occurred. Creating an environment that encourages a rich and deep social engagement has been one of our goals at nsquared.

Our other goal at nsquared, which might be even harder to evaluate, is to enhance the intelligence of the people using the technology. More on this topic another day.

A quick glance back

Today I was writing an email to a customer and I was explaining what the nsquared team has achieved in it's short lifetime, I thought I would share this with you because it is something to be proud of.

The nsquared team is a small and high specialized group of developers and designers based in Sydney. We do have people in the Uk, USA and Hong Kong, but most of the development happens out of our studio in Sydney. Our main mission is to make the world a better place through the intelligent application of technology. For this reason one of our core areas of focus has been education, where we believe so many of the world issues can be solved. A number of our team are ex-teachers and have a passion for teaching and helping people reach their potential.

We often see technology as something that hinders social engagement and this was one of the key attractions of Microsoft Surface. The table is a place of social engagement and adding digital content to the table should be used to enhance the conversation. The nsquared education pack has been the outcome of this work and you can find out more about this here http://nsquarededucationpack.com/

We also realized from the work we were doing that business meetings could be improved around a table, and drawing people's attention away from their personal computing devices to a shared screen would help increase the value of business interactions, this lead us to build the nsquared business pack, more information is here http://nsquaredbusinesspack.com/

We also have been busy exploring other touch and gesture based technologies, the most dominant being the Apple iOS set of devices, iPod, iPhone and iPad. We have been building apps for ourselves and third parties now for close to 2 years for these devices.You can explore all of our products on this page http://nsquaredsolutions.com/products/

As leaders in the field of Surface and NUI (natural user interface) development we wrote the first book on Surface development, http://nsquaredsolutions.com/surfacebook/

We are also the only company in the world with more than one application certified for Surface, in fact we have more applications certified for Surface than Microsoft does! http://www.microsoft.com/surface/en/us/Pages/Product/Applications.aspx

Through the work we have been doing we were awarded the contract, by Microsoft, to deliver all the Surface development training to new partners in Europe in 2009 and 2010.

Earlier this year I was awarded by Microsoft the first Microsoft Surface Most Valuable Professional award. https://mvp.support.microsoft.com/profile=BD4DC19A-A1B7-49B4-90B2-EB41C67F980F

It is so great to achieved all of this and yet I feel we have only just started. We have so many great ideas and big goals for the technology we are working on. I am sure that his time next year we will have added some more fantastic achievements to this list.

Watch this space....

Certification For Microsoft Surface Applications

Over that last 2 years the nsquared development team has been building Microsoft Surface applications. We are one of the most accomplished teams in the world at developing tabletop computing experiences. We wrote the book Developing for Microsoft Surface and have delivered all the global training to Microsoft Partners for Surface development. The certification of 10 of our applications now puts another achievement on our list to validate we are masters of our craft.

It is important that customers can differentiate between validated experts and those that claim to know what they are doing. Building software for table top interfaces such as Microsoft Surface is not a skill that can easily be adapted from desktop programming skills. This is not about the technology, this is about creating simple, easy to use, and engaging experiences. At nsquared we are bringing our expertise in this space to produce applications that owners of Microsoft Surface can purchase, download, and start using today. Having our applications certified for Microsoft Surface provides a level of assurance to our customers that we are delivering high quality software that will deliver a rich Surface experience.

My belief is that within 5 years we will see a proliferation of table top computing devices and at nsquared we plan to be at the forefront of this revolution.

Another codecast interview

Last month when I was in Redmond I managed to catch up with my friend Ken Levy who drives the CodeCast podcast. We went for a great lunch at an indian restaurant and afterwards he set the ipod to record and we chatted about a number of topics, including Microsoft Surface, tablet devices, Microsoft Translator and the Messenger Connect SDK. All products I have been busy working with over the last couple years.

You can download the podcost from here.

Windows 7 Touch or Microsoft Surface

I have received a number of questions around the topic of touch on Microsoft Surface and Windows 7.

I have seen a variety of feedback from client and developers along these lines:

• Surface doesn't have a web browser, I must have a web browser
• Surface is just Windows with touch

While the work I have done with After-Mouse and nsquared has led to a web browser control being built for Surface, typically a user trying to browse the internet is not looking for a multi-user, social, computing experience and Windows 7 is much more suited to provide a single user experience. Browsing the internet (the way we do today with modern browsers) is a single user experience, you cannot have two users clicking in the same browser at the same time and expect to get meaningful results. At best a browser can provide an experience for multiple users with a driver-passenger model of engagement. One person is the driver and is the only user interacting directly with the browser, the other participants are passengers, observing the interactions and potentially providing verbal guidance to the driver.

The questions to ask are:

What is the client trying to achieve?
What is their vision? A good place to start is to understand the usage scenarios they are hoping for.

If the objective is really to get multiple people engaged then Microsoft Surface provides a far superior solution. For a single user touch experience go for Windows 7.

You should also note that while the touch is getting better in Windows 7, the shell in Windows 7 is not designed to be 100% driven by touch, whereas the Microsoft Surface Shell is designed for touch from the ground up. With Windows 7, touch enhances the mouse and keyboard interactions. With Surface touch replaces the mouse and keyboard interactions.

Where will it end up ?

I received a great question from one of my Surface students today.

They wanted to know if they can calculate where a ScatterViewItem is going to end up when it is flicked. Or the other way around, could you set an end point and set up the inertia processor to move an item to that location.

Lets say i have a ScatterViewItem on position point(30,130) and i want it to go to point(550,300).
How can I set the following:

// settings
inertiaProcessor.InitialOrigin = new Point(30,130);
inertiaProcessor.DesiredDeceleration = ?;
inertiaProcessor.InitialVelocity = ?;

// Restart Inertia
inertiaProcessor.Begin();

// Now please end up at: new Point(550,300);

Sadly there is no way to know this with precision. In theory you could use the physics formula to calculate this. The precision is not that accurate though so you would probably be a little off.

Remember one of the objectives of the ScatterView is to scatter things in an apparent random manner on the screen.

If you wanted to build an application where the exact location of movable items is important then a ScatterView control might not be the best option.

Another First: Surface MVP Award

I like to be the first to work with a new technology and many of the folks at Microsoft know this. Over the years I have worked with the leading edge of Microsoft technologies, COM, Smartphone (now Windows Phone), Tablet PC, Virtual Earth (now Bing maps) and most recently Surface.

I have been delivering training to a number of Surface partners for the last 18 months, written a book on Surface development and formed a Surface development team in Sydney within nsquared .

Microsoft has recognized my contributions to the Microsoft Surface community and I am really pleased to receive the first ever MVP award for Microsoft Surface.

Interviewed by Tse:

I was interviewed recently by Corwin Tse of TseDrive.com and the interview has now gone online.

Corwin asked some interesting questions about nsquared, Microsoft Surface and software development.

I hope you enjoy it.

Perception is everything

Mix10 was a great event. There was plenty of activity around the new announcements, Windows Phone 7 Series, IE9, Microsoft Translator, Silverlight 4 and Blend 4.

It is interesting to watch how the masses now say it is all about Silverlight and Windows Phone 7 series and nothing else matters. Again and again I hear how touch is the new interface for everything. This perception is clearly not correct and yet it is the perception of developers coming away from an event like Mix.

There were also some missing players from the conversation. One of them close to my heart was Microsoft Surface. I think when a Microsoft Product Group with high profile decides not to attend a big Microsoft event such as Mix it sends the wrong message to the developers and the geek community. Engadget recently published this article, which almost predicts the end of Surface as a product.

This is clearly not the truth. I have been busy training partners over the last 15 months, and these partners are busy building solutions for real customers buying Surface units.

New products like Surface take a long time to roll out. This is not helped by the fact that most Surface applications are still failing to meet the basic criteria of what it takes to be a great Surface application. A very quick litmus test to determine if an application is a good Surface application can be achieved by deciding if the application does anything that cannot be done on a vertical touch screen. If an application would work just as well on a vertical touch screen then it does nothing to take advantage of running on a Surface unit and is therefore not a great Surface software citizen.

If developers and designers can evolve their thinking to understand what makes a great Surface application, I expect Surface solutions to get better and more companies to want to buy them. Until then it will be a long slow process before Surface proliferates into the world.

Failing to protect a brand, Microsoft still doesn't get it

It astounds me to watch a company that employs so many really intelligent people repeatedly make the same mistakes around something simple like branding.

The latest example is the Mobile 'Surface' project being undertaken by Microsoft Research. Make no mistake, I think this is awesome research and it is thinking and projects like this that will lead us into future generations of computer interaction. The issue lies with the use of the Surface brand. Microsoft has a product called Microsoft Surface, it is very clear that such a new and innovative product needs to have a clear and concise purpose and place in the market.

When Microsoft themselves allow research projects such as the Mobile "Surface" and SecondLight projects to use the Surface brand it dilutes the message of what a Microsoft surface actually is as a product.

To make matters worse, Microsoft released Microsoft Surface applications in the Microsoft Touch Pack for Windows 7. This pack contains a number of touch applications that have the Surface brand associated. This further dilutes the value proposition for Microsoft Surface as a brand.
To protect the brand Microsoft needs to ONLY use the Surface name for the Microsoft Surface product and nothing else.

Why do I care so much? Because I have invested a lot of energy in helping to promote, and teach people about Microsoft Surface, teaching Surface application development, writing a book on Microsoft Surface, and working with nsquared to build rich Surface applications.

World's First Surface Book Released

I am pleased to announce the world's first Surface development book. Developing for Microsoft Surface has been created and compiled from the many training sessions I have delivered the world over, and focuses on crafting exceptional user experiences for Surface.

Guiding its readers on the complete journey from the initial unpacking of a Microsoft Surface unit, to the satisfying delivery of their first Surface application, Developing for Microsoft Surface deals mostly with the ideation of Surface application design. Along the way it is filled with plenty of hands on labs and practical exercises to help readers explore the adventure that is Microsoft Surface and hone their application development skills for this platform.

The book (rrp US $49.95) is available now in handy e-book format at the special introductory price of US $45.00. Click on the link below to get started now.

Another video in the learning and technology series

Today another video in the nsquared series on Education and technology went live. I talked to Maridee about how cross-disciplinary education benefits students. We discussed how technologies such as Surface, Semblio, and MultiPoint can help create great learning experiences.

Less is More with nsquared

Yesterday we had some fun in the nsquared office recording this video about how less is more...



Today we decided to release the 'more' version of this video, enjoy!

Microsoft Surface Shell

Time for another nsquared Surface discussion. This time we talk about the Microsoft Surface Shell.
We explain the components of the shell and how Microsoft Surface applications can integrate with the shell.

Surface Video Series

This month I have started working on a series of videos with the team at nsquared on Microsoft Surface. We are discussing a number of the topics I cover in my Surface development training courses. You can see the whole series on YouTube.