{"id":92267,"date":"2016-05-14T12:00:27","date_gmt":"2016-05-14T10:00:27","guid":{"rendered":"http:\/\/mygaming.co.za\/news\/?p=92267"},"modified":"2016-05-14T08:40:11","modified_gmt":"2016-05-14T06:40:11","slug":"how-to-design-trustworthy-robots-that-wont-deceive-us","status":"publish","type":"post","link":"https:\/\/mygaming.co.za\/news\/gadgets\/92267-how-to-design-trustworthy-robots-that-wont-deceive-us","title":{"rendered":"How to design trustworthy robots that won&#8217;t deceive us"},"content":{"rendered":"<p>Does your car \u201cnot want\u201d to start on cold mornings? And does your toaster \u201clike\u201d burning your toast? This kind of intentional language is natural to us and built into the way we interact with the world \u2013 even with machines.<\/p>\n<p>This is because we have evolved to become extremely social animals, understanding others by forming mental models of what they are thinking. We use these skills to understand the behaviour of anything complicated we interact with, especially robots.<\/p>\n<p>It\u2019s almost like we believe that machines have minds of their own. And the fact that we perceive them as intelligent is partly why they have such potential. Robots are moving beyond industrial, commercial and scientific applications, and are already used in hospitals and care homes.<\/p>\n<p>Soon it will be normal to interact with robots in our daily lives, to complete useful tasks. Robots are also being used as companions, <a href=\"http:\/\/www.dailymail.co.uk\/video\/news\/video-1124231\/Robot-baby-seal-Paro-helps-elderly-dementia-patients-Hong-Kong.html\">particularly for elderly patients with cognitive impairment<\/a> such as dementia. After years of scientific study, this has <a href=\"http:\/\/www.innohoiva.fi\/wp-content\/uploads\/ICORR2009_0180.pdf\">proven very successful<\/a> at improving long-term quality of life.<\/p>\n<p>However, there are ethical concerns about vulnerable people forming relationships with machines, in some cases even believing them to be animals or people. Are robot designers intending to deceive patients? As robots become more important to us, how can we trust them not to mislead us, indeed should we trust them at all?<\/p>\n<p>In 2010, a group of academics produced ethical guidelines for how we should build robots, much like science fiction writer Isaac Asimov\u2019s <a href=\"http:\/\/www.auburn.edu\/~vestmon\/robotics.html\">famous laws<\/a>. Asimov stated that robots could not do anything to harm a human being; that a robot should always obey a human; and that a robot should defend itself so long as this didn\u2019t interfere with the first two rules. Similarly, these academics produced the <a href=\"https:\/\/www.epsrc.ac.uk\/research\/ourportfolio\/themes\/engineering\/activities\/principlesofrobotics\/\">EPSRC Principles of Robotics<\/a>.<\/p>\n<p>For me, the most interesting principle is number four: \u201cRobots are manufactured artefacts. They should not be designed in a deceptive way to exploit vulnerable users; instead their machine nature should be transparent.\u201d<\/p>\n<h2 class=\"my-4\">Hidden decisions<\/h2>\n<p>In my research group, we are conducting experiments with robots to investigate how well we understand them. Ultimately, we want to find out how we can best design robots to improve our mental models. We\u2019re trying to show that it\u2019s possible to create transparent robots that are useful, and when necessary emotionally engaging, despite having a transparent machine nature.<\/p>\n<p>We assert that if we can make robots more transparent, then we won\u2019t need to trust them, we\u2019ll always know what they are doing.<\/p>\n<p><a href=\"http:\/\/mygaming.co.za\/news\/wp-content\/uploads\/2016\/05\/Little-robot.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-92269\" src=\"http:\/\/mygaming.co.za\/news\/wp-content\/uploads\/2016\/05\/Little-robot.jpg\" alt=\"Little robot\" width=\"754\" height=\"503\" \/><\/a><\/p>\n<p>We use a simple robot that moves around a room avoiding objects while searching for humans. When it finds a human it flashes lights, does a small wiggle dance, and then trundles off seeking another one. Sometimes when in a corner it goes to sleep to save battery. That\u2019s all it does.<\/p>\n<p>We videoed the robot, showed this to a group of 22 people and asked them what the robot was doing and why.<\/p>\n<p>Some of the answers were remarkable. Based on cues from the environment, and the imaginations of the people, they came up with all sorts of ideas about what the robot was up to \u2013 views that were generally quite wrong.<\/p>\n<p>For instance, there is a bucket in the room, and several people were sure the robot was trying to throw something into it. Others noticed an abstract picture in the room and wondered if the robot was going to complete the picture.<\/p>\n<p>These people were mainly graduates in professional jobs, and several had science, technology, engineering or maths degrees. Almost all used computers every day. Although we did not program the robot, nor create the room explicitly to mislead, the observers were deceived.<\/p>\n<p><a href=\"http:\/\/mygaming.co.za\/news\/wp-content\/uploads\/2016\/05\/Robot-study.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-92271\" src=\"http:\/\/mygaming.co.za\/news\/wp-content\/uploads\/2016\/05\/Robot-study.png\" alt=\"Robot study\" width=\"1345\" height=\"1041\" srcset=\"https:\/\/mygaming.co.za\/news\/wp-content\/uploads\/2016\/05\/Robot-study.png 1345w, https:\/\/mygaming.co.za\/news\/wp-content\/uploads\/2016\/05\/Robot-study-768x594.png 768w\" sizes=\"auto, (max-width: 1345px) 100vw, 1345px\" \/><\/a><\/p>\n<p>We showed the same video to an almost identical second group. However this group was simultaneously shown a display demonstrating each decision in the robot\u2019s action selection system controlling its behaviour, synchronised with the robot moving around the room and tracking objects.<\/p>\n<p>It is a kind of dynamic heat map of the processes and decisions being made inside the robot\u2019s brain, making plain the focus of attention of the robot, and outlining the steps it takes to achieve its goals.<\/p>\n<p><iframe loading=\"lazy\" src=\"https:\/\/www.youtube.com\/embed\/7Pur3ADVPO4\" width=\"640\" height=\"360\" frameborder=\"0\" allowfullscreen=\"allowfullscreen\"><\/iframe><\/p>\n<p>The <a href=\"http:\/\/www.robwortham.com\/wp-content\/uploads\/2016\/05\/robot-transparency-experiment.pdf\">results<\/a>, to be published at the International Joint Conference on Artificial Intelligence in July, were remarkable. The second group came to a much better understanding of what the robot was doing, and why. We expected that result. What we didn\u2019t expect was that the second group were twice as sure that the robot was \u201cthinking\u201d.<\/p>\n<p>It seems that an improved mental model of the robot is associated with an increased perception of a thinking machine, even when there is no significant change in the level of perceived intelligence. The relationship between the perception of intelligence and thinking is therefore not straightforward.<\/p>\n<p>This is encouraging as it shows that we can have robots that are transparently machines and yet are still engaging, in that the participants attribute them with intelligence and thinking. We are beginning to show that designers can create something appealing without the need to hide the true capabilities of the robot.<\/p>\n<p>So, the robot butler of the future may have transparency built in. Perhaps you can ask it what its doing and it will tell you by showing you or talking about what\u2019s going on in its brain.<\/p>\n<p>We\u2019d like to see that mechanism built in to the low level brain code of the robot, so it has to tell it like it is. It would be nice for the user to be able to dial this up or down depending on how familiar they are with the tasks the robot is doing.<\/p>\n<p>We plan to try other ways of making robots transparent using speech technology, and combinations of graphics, text and speech, and we hope to be able to produce more detailed guidelines and better tools for robot designers to help them build robots we don\u2019t need to trust.<\/p>\n<p><a href=\"http:\/\/theconversation.com\/profiles\/rob-wortham-253443\">Rob Wortham<\/a>, PhD candidate in Intelligent Systems, <em><a href=\"http:\/\/theconversation.com\/institutions\/university-of-bath\">University of Bath<\/a><\/em><\/p>\n<hr \/>\n<p>This article was originally published on <strong><a href=\"http:\/\/theconversation.com\">The Conversation<\/a>.<\/strong> Read the <strong><a href=\"https:\/\/theconversation.com\/how-to-design-trustworthy-robot-butlers-that-we-wont-want-to-treat-like-humans-57783\">original article<\/a><\/strong>.<\/p>\n<h3 class=\"my-4\">More gaming news<\/h3>\n<p><strong><a title=\"Permalink to Some of the best ways game developers are fighting piracy\" href=\"http:\/\/mygaming.co.za\/news\/pc\/91137-some-of-the-best-ways-game-developers-are-fighting-piracy.html\" rel=\"bookmark\">Some of the best ways game developers are fighting piracy<\/a><\/strong><\/p>\n<p><strong><a title=\"Permalink to The Mall Gaming experience and your chance to win R150,000\" href=\"http:\/\/mygaming.co.za\/news\/features\/91519-competitive-gaming-in-south-africa-goes-mainstream-the-mall-gaming-experience-and-your-chance-to-win-r150000.html\" rel=\"bookmark\">The Mall Gaming experience and your chance to win R150,000<\/a><\/strong><\/p>\n<p><strong><a title=\"Permalink to 10 fun and free online browser games to play at work\" href=\"http:\/\/mygaming.co.za\/news\/pc\/91331-10-fun-and-free-online-browser-games-to-play-at-work.html\" rel=\"bookmark\">10 fun and free online browser games to play at work<\/a><\/strong><\/p>\n","protected":false},"excerpt":{"rendered":"<p>&#8220;Robots are manufactured artefacts. They should not be designed in a deceptive way to exploit vulnerable users; instead their machine nature should be transparent.&#8221;<\/p>\n","protected":false},"author":220,"featured_media":90209,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_sma_x_autopost_enabled":true,"_sma_x_custom_text":"","_sma_x_autopost_status":"idle","_sma_x_autopost_error":"","_sma_x_post_id":"","_sma_x_attempts":0,"footnotes":""},"categories":[8585],"tags":[18681,18677,3345,18679],"class_list":["post-92267","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-gadgets","tag-deception","tag-laws","tag-robots","tag-trust"],"_links":{"self":[{"href":"https:\/\/mygaming.co.za\/news\/wp-json\/wp\/v2\/posts\/92267","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mygaming.co.za\/news\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mygaming.co.za\/news\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mygaming.co.za\/news\/wp-json\/wp\/v2\/users\/220"}],"replies":[{"embeddable":true,"href":"https:\/\/mygaming.co.za\/news\/wp-json\/wp\/v2\/comments?post=92267"}],"version-history":[{"count":0,"href":"https:\/\/mygaming.co.za\/news\/wp-json\/wp\/v2\/posts\/92267\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/mygaming.co.za\/news\/wp-json\/wp\/v2\/media\/90209"}],"wp:attachment":[{"href":"https:\/\/mygaming.co.za\/news\/wp-json\/wp\/v2\/media?parent=92267"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mygaming.co.za\/news\/wp-json\/wp\/v2\/categories?post=92267"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mygaming.co.za\/news\/wp-json\/wp\/v2\/tags?post=92267"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}