{"id":28932,"date":"2022-12-07T13:56:16","date_gmt":"2022-12-07T14:56:16","guid":{"rendered":"https:\/\/peymantaeidi.net\/stem-cell\/?p=28932"},"modified":"2022-12-07T15:46:32","modified_gmt":"2022-12-07T15:46:32","slug":"the-smallest-robotic-arm-you-can-imagine-is-controlled-by-artificial-intelligence","status":"publish","type":"post","link":"https:\/\/peymantaeidi.net\/stem-cell\/2022\/12\/07\/the-smallest-robotic-arm-you-can-imagine-is-controlled-by-artificial-intelligence\/","title":{"rendered":"The smallest robotic arm you can imagine is controlled by artificial intelligence"},"content":{"rendered":"<div class=\"article-gallery lightGallery\">\n<div data-thumb=\"https:\/\/scx1.b-cdn.net\/csz\/news\/tmb\/2022\/the-smallest-robotic-a.jpg\" data-src=\"https:\/\/scx2.b-cdn.net\/gfx\/news\/2022\/the-smallest-robotic-a.jpg\" data-sub-html=\"Credit: Aalto University\">\n<figure class=\"article-img\">\n            <img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/peymantaeidi.net\/stem-cell\/wp-content\/uploads\/2022\/12\/the-smallest-robotic-a.jpg\" alt=\"The smallest robotic arm you can imagine is controlled by artificial intelligence\" title=\"Credit: Aalto University\" width=\"567\" height=\"530\" \/><figcaption class=\"text-darken text-low-up text-truncate-js text-truncate mt-3\">\n                Credit: Aalto University<br \/>\n            <\/figcaption><\/figure>\n<\/p><\/div>\n<\/div>\n<p>Researchers used deep reinforcement learning to steer atoms into a lattice shape, with a view to building new materials or nanodevices.\n                                              <\/p>\n<p>In a very cold vacuum chamber, single atoms of silver form a star-like <a href=\"https:\/\/techxplore.com\/tags\/lattice\/\" rel=\"tag\" class=\"textTag\">lattice<\/a>. The precise formation is not accidental, and it wasn&#8217;t constructed directly by <a href=\"https:\/\/techxplore.com\/tags\/human+hands\/\" rel=\"tag\" class=\"textTag\">human hands<\/a> either. Researchers used a kind of artificial intelligence called <a href=\"https:\/\/techxplore.com\/tags\/deep+reinforcement\/\" rel=\"tag\" class=\"textTag\">deep reinforcement<\/a> learning to steer the atoms, each a fraction of a nanometer in size, into the lattice shape. The process is similar to moving marbles around a Chinese checkers board, but with very tiny tweezers grabbing and dragging each atom into place.<\/p>\n<p>The main application for deep <a href=\"https:\/\/techxplore.com\/tags\/reinforcement+learning\/\" rel=\"tag\" class=\"textTag\">reinforcement learning<\/a> is in robotics, says postdoctoral researcher I-Ju Chen. &#8220;We&#8217;re also building robotic arms with deep learning, but for moving atoms,&#8221; she explains. &#8220;Reinforcement learning is successful in things like playing chess or video games, but we&#8217;ve applied it to solve <a href=\"https:\/\/techxplore.com\/tags\/technical+problems\/\" rel=\"tag\" class=\"textTag\">technical problems<\/a> at the nanoscale.&#8221; <\/p>\n<p>So why are scientists interested in precisely moving atoms? Making very small devices based on single atoms is important for nanodevices like transistors or memory. Testing how and whether these devices work at their absolute limits is one application for this kind of atomic manipulation, says Chen. Building new materials atom-by-atom, rather than through traditional chemical techniques, may also reveal interesting properties related to superconductivity or quantum states.<\/p>\n<p>The silver star lattice made by Chen and colleagues at the Finnish Center for Artificial Intelligence FCAI and Aalto University is a demonstration of what deep reinforcement learning can achieve. &#8220;The precise movement of atoms is hard even for human experts,&#8221; says Chen. <\/p>\n<p>&#8220;We adapted existing <a href=\"https:\/\/techxplore.com\/tags\/deep+reinforcement+learning\/\" rel=\"tag\" class=\"textTag\">deep reinforcement learning<\/a> for this purpose. It took the algorithm on the order of one day to learn and then about one hour to build the lattice.&#8221; The reinforcement part of this type of <a href=\"https:\/\/techxplore.com\/tags\/deep+learning\/\" rel=\"tag\" class=\"textTag\">deep learning<\/a> refers to how the AI is guided\u2014through rewards for correct actions or outputs. &#8220;Give it a goal and it will do it. It can solve problems that humans don&#8217;t know how to solve.&#8221;<\/p>\n<p>Applying this approach to the world of nanoscience materials is new. Nanotechniques can become more powerful with the injection of machine learning, says Chen, because it can accelerate the parameter selection and trial-and-error usually done by a person. <\/p>\n<p>&#8220;We showed that this task can be completed perfectly through reinforcement learning,&#8221; concludes Chen. The group&#8217;s research, led by professors Adam Foster and Peter Liljeroth, was recently published in <i>Nature Communications<\/i>.\n                                                                                \t\t\t\t\t\t\t\t\t\t\t<\/p>\n<div class=\"article-main__more p-4\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<strong>More information:<\/strong><br \/>\n\t\t\t\t\t\t\t\t\t\t\t\tI-Ju Chen et al, Precise atom manipulation through deep reinforcement learning, <i>Nature Communications<\/i> (2022).  <a data-doi=\"1\" href=\"https:\/\/dx.doi.org\/10.1038\/s41467-022-35149-w\" target=\"_blank\" rel=\"noopener\">DOI: 10.1038\/s41467-022-35149-w<\/a><\/p><\/div>\n<div class=\"d-inline-block text-medium my-4\">\n                                                Provided by<br \/>\n                                                                                                    <a href=\"https:\/\/techxplore.com\/partners\/aalto-university\/\">Aalto University<\/a><br \/>\n                                                    \t\t\t\t\t\t\t\t\t\t\t\t\t<a class=\"icon_open\" href=\"http:\/\/www.aalto.fi\/en\/current\/\" target=\"_blank\" rel=\"nofollow noopener\"><\/p>\n<p>\t\t\t\t\t\t\t\t\t\t\t\t\t<\/a><\/p><\/div>\n<div class=\"d-none d-print-block\">\n<p>\n                                                 <strong>Citation<\/strong>:<br \/>\n                                                 The smallest robotic arm you can imagine is controlled by artificial intelligence (2022, December  7)<br \/>\n                                                 retrieved  7 December 2022<br \/>\n                                                 from https:\/\/techxplore.com\/news\/2022-12-smallest-robotic-arm-artificial-intelligence.html\n                                            <\/p>\n<p>\n                                            This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no<br \/>\n                                            part may be reproduced without the written permission. The content is provided for information purposes only.\n                                            <\/p>\n<\/p><\/div>\n","protected":false},"excerpt":{"rendered":"<p>Credit: Aalto University Researchers used deep reinforcement learning to steer atoms into a lattice shape,<\/p>\n","protected":false},"author":1,"featured_media":28934,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"_links":{"self":[{"href":"https:\/\/peymantaeidi.net\/stem-cell\/wp-json\/wp\/v2\/posts\/28932"}],"collection":[{"href":"https:\/\/peymantaeidi.net\/stem-cell\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/peymantaeidi.net\/stem-cell\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/peymantaeidi.net\/stem-cell\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/peymantaeidi.net\/stem-cell\/wp-json\/wp\/v2\/comments?post=28932"}],"version-history":[{"count":2,"href":"https:\/\/peymantaeidi.net\/stem-cell\/wp-json\/wp\/v2\/posts\/28932\/revisions"}],"predecessor-version":[{"id":28935,"href":"https:\/\/peymantaeidi.net\/stem-cell\/wp-json\/wp\/v2\/posts\/28932\/revisions\/28935"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/peymantaeidi.net\/stem-cell\/wp-json\/wp\/v2\/media\/28934"}],"wp:attachment":[{"href":"https:\/\/peymantaeidi.net\/stem-cell\/wp-json\/wp\/v2\/media?parent=28932"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/peymantaeidi.net\/stem-cell\/wp-json\/wp\/v2\/categories?post=28932"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/peymantaeidi.net\/stem-cell\/wp-json\/wp\/v2\/tags?post=28932"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}