Deconstructing IoT Part 2UXGrid_small
In a previous post, I had a modest goal of introducing a simple functional vocabulary for smart devices. Too many journalists were discussing science fiction scenarios about swarms of devices without realizing that there were much simpler, yet very valuable alternatives. This post moves into user experience, proposing a simple grid of types. There are of course, many ways to break things down, this is just one that I’m finding useful. I hope this prompts a discussion of other approaches. If you have any suggestions, please let me know.

Device vs Style
This UX Grid is a classic 2×2 matrix of device type vs interaction type. Solo vs swarm is on the vertical axis and a direct interaction style vs an ambient background styles on the horizontal. I’ll discuss each quadrant in turn.

DirectDeviceDirect Device
This is the primary product concept we use today, products like the Nest, or Sonos, or the iGrill, or the Withings Scale (you get the idea…) are devices you interact with directly using a dedicated application on your phone. Mike Kuniavsky was the first to point out that the internet of things was unleashed primarily as the smart phone ecosystem has grown. Smart phones enable two very powerful things: 1) offload the cost of complex UX hardware (such as a touch screen) and 2) Extend the distance we can interact with a device. These make it much cheaper as easier to add functionality to a smart device.

But this Direct Device model is really only an extension of what we’ve been doing for 30 years. We, as an industry, have almost exclusively worked on direct devices, from VT100 displays, to web pages to smart phones. We don’t mess around, we go mano a mano with our devices: it’s a very direct and physical approach. While the interaction details have certainly changed, the basic model of one person, one device has not.

There is nothing at all wrong with this. I’m only making the rather obvious point that it is the dominant one. By exploring the other three quadrants, we can discuss and explore alternatives.

DirectSwarmDirect Swarm
Now this is a very different beast. Instead of talking directly to a single device, you interact with a swarm of devices. The most straight forward example would be smart lighting systems such as Phillips Hue. You push a button and dozens of light bulbs spring to life. That is a simple fan out of control where one command effects many devices.

Apple’s iBeacon is already proposing applications that flip this approach around. Take for example a restaurant that has put a cheap Bluetooth LE box under each customer table. When a customer opens their phone, they don’t want to see dozens of devices in the store, but a single unified application. They just order their food and pay. The restaurant figures out which table they’re at through the Bluetooth boxes and delivers it to the correct location. This feels like a Direct Device but is implemented as a Direct Swarm. To the customer, it’s not even clear there are other devices.

Another example would be a museum where you wander from exhibit to exhibit. As you open the phone you always use the ‘museum app’ but what is on your display is the exhibit you happen to be in front of (or a list if there are a few to choose from)

What is unique about the Direct Swarm is that in order to be direct, it needs a single point of contact for you to interact with, a ‘master device’ that represents the others. This interaction is, in effect, a virtual Direct Device, built out of the many individuals in the swarm.

BackgroundDeviceBackground Device
Now we move into the background axis, exploring what it is like for a device to work automatically without direct interaction. The first wave of devices in this category were ambient displays, like the Ambient Orb, Nabaztag, or more recently Blink1. These devices try to embed information in your environment so they are just there when you need them. No interaction required, you just notice.

But we are starting to flip this type of device from output to input. A device that can detect actions and just do the right thing automatically. This is what smart doorlocks like the original Lockitron aspired to be but couldn’t. You had to walk up to your house, open the phone, open an app, and push the ‘unlock’ button. A perfectly direct approach but clearly not very convenient. It was built on the Direct Device model but secretly wanted to be a Background Device. You’d much rather just walk into your home as if it were unlocked.

But the new Lockitron is taking advantage of Bluetooth LE’s proximity model to automatically unlock the door when you get close (and automatically relock it when you walk away) This is promising and getting much closer to the true nature of a Background Device. It monitors activity and attempts to do the right thing.

The move from output to input for Background Devices will be tricky. It is far too easy to get false positives and do things at the wrong time. This is likely a huge area to learn and explore as we build more of these devices.

Notice that these device categories are a bit fluid. When you first buy a Lockitron, you’ll likely use it as a Direct Device to set it up, but once it is configured you then use it as a Background Device. That is the purpose of the UX Grid, it allow us to discuss how the same product can have multiple types of behaviors at different times.

BackgroundSwarmBackground Swarm
This is the hardest type of product to build. It is also the one that most journalists love to talk about. The ‘smart house’ that raises and lowers temperature, opens blinds, and even makes coffee. Devices in this category are likely composed of many types of devices, some just sensors, others actuating doors or lights. We will be effectively programming with hardware. Our machine language will be these devices that can read and write into our physical world.

We will get there but if you thought there were issues will false positives in the Background Device category, you ain’t seen nothing yet. When an entire house or industrial floor can have a bug and open and close doors at the wrong time, all sorts of problems can occur. While this category is still nascent, one thing is very clear: you want this collection of devices to ‘just work’ without significant interaction. This means no surprises! These things need to cooperate and coordinate in ways that feel smart and respectful.

Key UX Pattern: Offering instead of doing
Over time, Background Swarms will eventually feel like they are reading our minds and doing the right thing. However, in the short term, I’m quite sure we will discover all sorts of disastrous false positives that will create some backlash in this category. It’s so tempting to think we can create rules or triggers to make everything magical. People are complex, quixotic beasts that defy logic and fixed rules. We define ourselves by our exceptions. At least initially, we are going to have to be a bit more conservative, designing systems that ‘offer’ instead of ‘do’. A system that sets things up, prompting the user to complete the action with as little effort as possible.

So for example, instead of having the lights go on when you walk into the house (and thereby waking up your cousin sleeping on the couch) have the system gently turn on the floor lights so you can navigate in the dark but a voice system waits for you to say ‘lights’ before actually turning on the main lights.

In the case of Lockitron, while the bluetooth trick may work, a more robust approach would be to detect your arrival and prep the door but to not actually unlock it until you touch the doorknob (using a capacitive and/or vibration sensor). That physical interconnect is a much higher value signal that you want to enter the door and aren’t just, for example, walking by.

Background Swarms that meet me half way, bring the functionality I need to my attention but wait for me to actually pull the trigger are likely to be the most robust way to approach smart devices design. It still gives the user power but keeps them firmly in control.

Conclusion
These four categories of smart devices: Direct Device, Direct Swarm, Background Device, and Background Swarm are just a basic, slightly artificial breakdown. As I pointed out, products can even move between these types from setup to actual use. But they do provide us a better vocabulary and way to discuss.

Direct Devices are dominant model so far and we need to break out of that approach. It’s also clear that false positives are going to be a significant growing pain. So many products are going to think in terms of clunkly rule based systems and attempt to build background products that will fail rarely but spectacularly. If we want to build background devices, we need to start with offering and then build up slowly to doing. The world of smart devices is dazzling, the potential is there but what’s holding us back isn’t technology but our ability to know what to do with it.

 

 

 

 

 

308 thoughts on “UX Grid of IOT

  1. I was intrigued by your suggestion of meeting half way, which while not good for all use cases definitely ought to be thought about for a given application. It kind of removes the cockiness and inserts a sense of humility.

  2. Exactly. Right now we are in a situation where companies are taking a fairly naive ‘condition/trigger’ approach which is fairly fragile. The idea of trying this more, as you say, humble approach really just highlights how hard it is to get autonomous systems right.

  3. Brilliant post Scott. I loved your UX grid, and also your suggestion of meeting half way. I am sure you are familiar with the notion of intelligibility, which advocates that systems are intelligible (or scrutable) to allow users to understand “what the systems know, how they know it, and what they are doing” and should put end-users at the center of control by empowering them to better co-ordinate, control, and personalize systems. It would be interesting to know how you feel about this.

  4. Google

    Every after inside a whilst we choose blogs that we study. Listed below would be the latest internet sites that we pick out.

  5. iPad

    […]just beneath, are quite a few totally not associated web sites to ours, even so, they may be certainly worth going over[…]

  6. Google

    Please stop by the internet sites we comply with, including this one, because it represents our picks through the web.

  7. realty

    […]although web sites we backlink to beneath are considerably not connected to ours, we really feel they’re truly worth a go by way of, so have a look[…]

  8. land for sale

    […]Wonderful story, reckoned we could combine a number of unrelated data, nonetheless seriously worth taking a look, whoa did one particular understand about Mid East has got additional problerms as well […]

  9. agen shobet

    […]although websites we backlink to below are considerably not connected to ours, we feel they may be actually worth a go by means of, so possess a look[…]

  10. fukuidatumou

    […]Wonderful story, reckoned we could combine several unrelated data, nevertheless seriously really worth taking a appear, whoa did one particular study about Mid East has got much more problerms too […]

  11. greek iptv

    […]check beneath, are some entirely unrelated web-sites to ours, on the other hand, they’re most trustworthy sources that we use[…]

  12. 真人娱乐场

    […]that is the finish of this write-up. Right here you’ll uncover some web sites that we consider you will appreciate, just click the links over[…]

  13. use this link

    […]that could be the end of this article. Here you’ll locate some web sites that we believe you’ll appreciate, just click the links over[…]

  14. SEO Trondheim

    […]very couple of internet websites that come about to become in depth below, from our point of view are undoubtedly effectively really worth checking out[…]

  15. beats.com

    […]Wonderful story, reckoned we could combine several unrelated information, nonetheless genuinely really worth taking a search, whoa did one discover about Mid East has got extra problerms too […]

  16. windows programas

    […]we prefer to honor numerous other world-wide-web internet sites around the web, even if they aren’t linked to us, by linking to them. Below are some webpages really worth checking out[…]

  17. grannies porn videos

    […]we like to honor lots of other world wide web websites around the web, even though they aren’t linked to us, by linking to them. Under are some webpages really worth checking out[…]

  18. wildlife removal

    […]we prefer to honor quite a few other online web sites on the internet, even if they aren’t linked to us, by linking to them. Beneath are some webpages worth checking out[…]

  19. Sac kraft

    […]check beneath, are some completely unrelated web sites to ours, nevertheless, they are most trustworthy sources that we use[…]

  20. buying a house

    […]Wonderful story, reckoned we could combine some unrelated data, nonetheless actually really worth taking a search, whoa did 1 learn about Mid East has got far more problerms too […]

  21. CV

    […]we came across a cool web site that you could possibly delight in. Take a appear in case you want[…]

  22. dating sites for teenager

    […]Wonderful story, reckoned we could combine a few unrelated data, nevertheless genuinely worth taking a search, whoa did one particular discover about Mid East has got far more problerms also […]

  23. patio end table

    […]although internet websites we backlink to below are considerably not related to ours, we feel they’re truly really worth a go by, so have a look[…]

  24. figures

    […]please pay a visit to the web pages we stick to, including this 1, because it represents our picks through the web[…]

  25. hotel

    […]although websites we backlink to below are considerably not associated to ours, we really feel they are truly worth a go by way of, so possess a look[…]

  26. friv

    […]we like to honor many other world-wide-web websites on the net, even if they aren’t linked to us, by linking to them. Below are some webpages really worth checking out[…]

  27. porn

    […]Every when inside a when we select blogs that we read. Listed below are the newest internet sites that we opt for […]

  28. work from home 2017

    […]Wonderful story, reckoned we could combine a handful of unrelated information, nonetheless truly really worth taking a look, whoa did a single study about Mid East has got much more problerms at the same time […]

  29. 유흥알바

    […]we like to honor many other world-wide-web sites on the internet, even though they aren’t linked to us, by linking to them. Below are some webpages worth checking out[…]

  30. sewing thread

    […]check beneath, are some completely unrelated internet sites to ours, nevertheless, they’re most trustworthy sources that we use[…]

  31. rk3368

    […]we like to honor several other net sites on the net, even though they aren’t linked to us, by linking to them. Below are some webpages worth checking out[…]

  32. sattamatka

    […]that is the end of this report. Right here you’ll obtain some web sites that we assume you’ll value, just click the hyperlinks over[…]

  33. Fenster und Turen

    […]we prefer to honor several other net sites around the internet, even though they aren’t linked to us, by linking to them. Under are some webpages really worth checking out[…]

  34. pure kona coffee

    […]although sites we backlink to below are considerably not related to ours, we really feel they may be really worth a go by means of, so possess a look[…]

  35. Lawyers

    […]that is the finish of this article. Right here you will find some internet sites that we think you’ll value, just click the hyperlinks over[…]

  36. cours de guitare

    […]we like to honor quite a few other net sites around the net, even though they aren’t linked to us, by linking to them. Beneath are some webpages really worth checking out[…]

  37. custom paint

    […]very handful of internet websites that come about to become detailed below, from our point of view are undoubtedly very well really worth checking out[…]

  38. funny pictures

    […]Wonderful story, reckoned we could combine a couple of unrelated information, nevertheless truly worth taking a search, whoa did one study about Mid East has got far more problerms at the same time […]

  39. site

    […]we prefer to honor lots of other online web pages on the web, even though they aren’t linked to us, by linking to them. Underneath are some webpages really worth checking out[…]

  40. Cheap Printed Legging Online

    […]Wonderful story, reckoned we could combine a few unrelated information, nevertheless really really worth taking a look, whoa did one particular master about Mid East has got a lot more problerms also […]

  41. ski resorts

    […]that will be the finish of this article. Right here you will obtain some internet sites that we think you’ll appreciate, just click the hyperlinks over[…]

  42. Mariage

    […]Wonderful story, reckoned we could combine some unrelated data, nevertheless definitely worth taking a appear, whoa did 1 understand about Mid East has got extra problerms at the same time […]

  43. 注管理システム

    […]we prefer to honor lots of other internet web sites on the net, even though they aren’t linked to us, by linking to them. Below are some webpages really worth checking out[…]

  44. satta matka

    […]that is the finish of this article. Here you will come across some internet sites that we feel you’ll enjoy, just click the hyperlinks over[…]

  45. Clicking Here

    […]Wonderful story, reckoned we could combine some unrelated data, nevertheless really really worth taking a appear, whoa did a single understand about Mid East has got extra problerms at the same time […]

  46. computer repair

    […]Wonderful story, reckoned we could combine several unrelated data, nevertheless actually worth taking a search, whoa did 1 find out about Mid East has got much more problerms also […]

  47. what is a will

    […]we prefer to honor a lot of other web sites around the net, even when they aren’t linked to us, by linking to them. Below are some webpages really worth checking out[…]

  48. Brain

    […]very couple of internet sites that transpire to become in depth beneath, from our point of view are undoubtedly nicely really worth checking out[…]

  49. scam website

    […]we like to honor numerous other net web sites on the internet, even if they aren’t linked to us, by linking to them. Below are some webpages really worth checking out[…]

  50. Human

    […]we like to honor numerous other net internet sites on the net, even though they aren’t linked to us, by linking to them. Below are some webpages worth checking out[…]

  51. HRW

    […]just beneath, are various completely not connected websites to ours, even so, they may be certainly really worth going over[…]

  52. haunted ring

    […]we prefer to honor quite a few other online web-sites around the net, even when they aren’t linked to us, by linking to them. Under are some webpages worth checking out[…]

  53. FREE Personality Test

    […]we prefer to honor several other online web-sites around the net, even when they aren’t linked to us, by linking to them. Beneath are some webpages worth checking out[…]

  54. what is my personality

    […]we prefer to honor several other net web-sites on the internet, even if they aren’t linked to us, by linking to them. Below are some webpages really worth checking out[…]

  55. TAXI DUBROVNIK

    […]although internet sites we backlink to below are considerably not related to ours, we feel they are actually really worth a go by way of, so have a look[…]

  56. Toned In Ten Review

    […]we like to honor numerous other world wide web web sites around the internet, even if they aren’t linked to us, by linking to them. Beneath are some webpages worth checking out[…]

  57. love quotes for her

    […]Wonderful story, reckoned we could combine a couple of unrelated data, nevertheless truly worth taking a appear, whoa did 1 study about Mid East has got far more problerms also […]

  58. Personality tests

    […]although internet websites we backlink to below are considerably not associated to ours, we really feel they may be really worth a go through, so possess a look[…]

Comments are closed.