{"id":1515,"date":"2024-04-03T13:59:06","date_gmt":"2024-04-03T17:59:06","guid":{"rendered":"https:\/\/tickle.utk.edu\/mse\/?p=1515"},"modified":"2024-05-14T14:03:38","modified_gmt":"2024-05-14T18:03:38","slug":"kalinins-ai-microscopist-accelerates-nanoscale-material-characterization","status":"publish","type":"post","link":"https:\/\/tickle.utk.edu\/mse\/kalinins-ai-microscopist-accelerates-nanoscale-material-characterization\/","title":{"rendered":"Kalinin\u2019s AI Microscopist Accelerates Nanoscale Material Characterization"},"content":{"rendered":"

Weston Fulton Professor\u00a0Sergei Kalinin<\/a>\u00a0and his team watched with pride as their newest lab member identified an area of interest within the sample, recalibrated the probe to the optimal imaging parameters, and took another measurement.<\/p>\n

It was the first time that ISAACS, a University of Tennessee Knoxville supercomputer, had autonomously conducted a microscopy experiment.<\/p>\n

\u201cIn terms of simply putting human and artificial intelligence (AI) resources together, companies like Google are light years ahead of academia,\u201d said Kalinin, who works in the UT Department of Materials Science and Engineering (MSE). \u201cBut applying machine learning (ML) to real-world problems like scanning probe microscopy (SPM) is a different situation.\u201d<\/p>\n

Kalinin uses atomic force microscopy (AFM), a type of SPM, to study novel materials at the nanoscale.<\/p>\n

\u201cThere is no such thing as a perfectly uniform material,\u201d Kalinin said. \u201cThey have grain boundaries, internal defects, and other unpredictable microstructural elements that we need to understand before we apply the materials outside the lab.\u201d<\/p>\n

Once scientists identify a performance-impacting defect, they can recommend changes to the material\u2019s fabrication protocol, improving its future efficiency and performance.<\/p>\n

Unfortunately, those vital, nanometer-sized features can make up as little as one percent of a material\u2019s surface. Finding all of them usually involves taking detailed measurements on every part of the sample, which is not only exhausting to human operators but slows down the discovery of useful new materials.<\/p>\n

\u201cAt UT, our colleagues use lab robotics and combinatorial synthesis to make hundreds of materials in the time that it used to take to make one,\u201d Kalinin said, \u201cbut that is not enough to accelerate discovery. Development of new materials requires multiple scientists to come up with theories, propose experiments, execute experiments, and analyze results that feed back into our theories. For decades, material analysis has been the bottleneck in this process.\u201d<\/p>\n

Finding a way to perform measurements only on regions of interest would significantly accelerate material characterization, stimulating material discovery at an unprecedented rate.<\/p>\n

So Kalinin and his colleagues found a way.<\/p>\n

<\/div>\n

A Self-Driving Microscope<\/strong><\/p>\n

A static microscope may seem like an easier piece of equipment to automate than a moving car. However, while all cars are governed by similar safety and traffic laws, each operator on a microscope can have a different experimental priority.<\/p>\n

\u201cThe way a microscopy experiment progresses depends on the experience, goals, and prior training of the operator,\u201d explained Richard Liu, a postdoctoral researcher in Kalinin\u2019s lab who studied quantum materials during his doctoral research at Harvard. \u201cA microscopist studying high-key dielectrics for semiconductors will have very different goals than someone looking at lithium-ion batteries.\u201d<\/p>\n

Kalinin\u2019s PhD student Utkarsh Pratiush brought two years of industrial AI experience to the project.<\/p>\n

\u201cThe struggle here was making sure that the ML agent makes as good or better decisions than a human agent in a way that allows different teams to accomplish their specific goals,\u201d Pratiush said.<\/p>\n

The new microscopes and control schemes needed for such a project are typically not feasible for labs outside the private sector. However, with support from the US\u00a0Department of Energy<\/a>\u2019s\u00a0Energy Frontier Research Center for 3D Ferroelectric Microelectronics<\/a>, Kalinin\u2019s team was able to launch a new workflow integrating cutting edge technology, industry, and academia.<\/p>\n

Working with graduate student Utkarsh Pratiush, Liu began integrating UT\u2019s AFM, Jupiter, with the university\u2019s supercomputer, the\u00a0Infrastructure for Scientific Applications and Advanced Computing<\/a>\u00a0(ISAAC). Liu and Pratiush collaborated with members of UT\u2019s\u00a0Higher Performance and Scientific Computing<\/a>\u00a0office and Jupiter\u2019s manufacturer,\u00a0Oxford Instruments Asylum Research Inc.<\/a>, over several months to achieve the integration.<\/p>\n

On February 2, 2024, the new ML agent correctly identified its first area of interest on a material sample. Since then, Liu and Pratiush have employed the agent on a broad range of workflows ranging from simple feature discovery to image condition optimization and deep kernel learning, gathering useful data up to 100 times faster than can be achieved with the conventional total coverage method.<\/p>\n

\u201cThis is the strength of a university like UT: being able to bring together the people who do the instrumentation, modify the instrumentation, and make an effective workflow as a team,\u201d said Kalinin.<\/p>\n

Kalinin\u2019s team is committed to making the workflow publicly accessible and has already started broadening its application. With support from UT\u2019s\u00a0AI Tennessee Initiative<\/a>, MSE Professor\u00a0Gerd Duscher<\/a>\u00a0and his graduate student Austin Houston led the team in implementing the workflow on Duscher\u2019s scanning transmission electron microscope.<\/p>\n

\u201cOur success was dependent on other people\u2019s publicly available work, and now we want to turn around and make this automated SPM agent widely available to close the material characterization bottleneck,\u201d Kalinin said. \u201cThe key in any field is doing work that is not just useful as abstract knowledge but allows someone else to build upon it.\u201d<\/p>\n

Contact<\/strong><\/h2>\n

Izzie Gall (865-974-7203,\u00a0egall4@utk.edu<\/a>)<\/p>\n","protected":false},"excerpt":{"rendered":"

Sergei Kalinin\u2019s team constructed an atomic force microscope that autonomously performs experiments, boosting materials characterization to unprecedented rates.<\/p>\n","protected":false},"author":46,"featured_media":1516,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"inline_featured_image":false,"footnotes":""},"categories":[3,14],"tags":[434,435,436,437,9],"class_list":["post-1515","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-faculty","category-news","tag-atomic-force-microscope","tag-doe","tag-energy-frontier-research-center-for-3d-ferroelectric-microelectronics","tag-isaacs","tag-sergei-kalinin"],"yoast_head":"\nKalinin\u2019s AI Microscopist Accelerates Nanoscale Material Characterization - Materials Science and Engineering<\/title>\n<meta name=\"description\" content=\"Sergei Kalinin\u2019s team constructed an atomic force microscope that autonomously performs experiments, boosting materials characterization to unprecedented rates.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/tickle.utk.edu\/mse\/kalinins-ai-microscopist-accelerates-nanoscale-material-characterization\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Kalinin\u2019s AI Microscopist Accelerates Nanoscale Material Characterization - Materials Science and Engineering\" \/>\n<meta property=\"og:description\" content=\"Sergei Kalinin\u2019s team constructed an atomic force microscope that autonomously performs experiments, boosting materials characterization to unprecedented rates.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/tickle.utk.edu\/mse\/kalinins-ai-microscopist-accelerates-nanoscale-material-characterization\/\" \/>\n<meta property=\"og:site_name\" content=\"Materials Science and Engineering\" \/>\n<meta property=\"article:published_time\" content=\"2024-04-03T17:59:06+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-05-14T18:03:38+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/tickle.utk.edu\/mse\/wp-content\/uploads\/sites\/2\/2024\/05\/kalinin-micrscope.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"630\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/tickle.utk.edu\\\/mse\\\/kalinins-ai-microscopist-accelerates-nanoscale-material-characterization\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/tickle.utk.edu\\\/mse\\\/kalinins-ai-microscopist-accelerates-nanoscale-material-characterization\\\/\"},\"author\":{\"name\":\"\",\"@id\":\"\"},\"headline\":\"Kalinin\u2019s AI Microscopist Accelerates Nanoscale Material Characterization\",\"datePublished\":\"2024-04-03T17:59:06+00:00\",\"dateModified\":\"2024-05-14T18:03:38+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/tickle.utk.edu\\\/mse\\\/kalinins-ai-microscopist-accelerates-nanoscale-material-characterization\\\/\"},\"wordCount\":816,\"image\":{\"@id\":\"https:\\\/\\\/tickle.utk.edu\\\/mse\\\/kalinins-ai-microscopist-accelerates-nanoscale-material-characterization\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/tickle.utk.edu\\\/mse\\\/wp-content\\\/uploads\\\/sites\\\/2\\\/2024\\\/05\\\/kalinin-micrscope.jpg\",\"keywords\":[\"atomic force microscope\",\"DOE\",\"Energy Frontier Research Center for 3D Ferroelectric Microelectronics\",\"ISAACS\",\"Sergei Kalinin\"],\"articleSection\":[\"Faculty\",\"News\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/tickle.utk.edu\\\/mse\\\/kalinins-ai-microscopist-accelerates-nanoscale-material-characterization\\\/\",\"url\":\"https:\\\/\\\/tickle.utk.edu\\\/mse\\\/kalinins-ai-microscopist-accelerates-nanoscale-material-characterization\\\/\",\"name\":\"Kalinin\u2019s AI Microscopist Accelerates Nanoscale Material Characterization - Materials Science and Engineering\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/tickle.utk.edu\\\/mse\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/tickle.utk.edu\\\/mse\\\/kalinins-ai-microscopist-accelerates-nanoscale-material-characterization\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/tickle.utk.edu\\\/mse\\\/kalinins-ai-microscopist-accelerates-nanoscale-material-characterization\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/tickle.utk.edu\\\/mse\\\/wp-content\\\/uploads\\\/sites\\\/2\\\/2024\\\/05\\\/kalinin-micrscope.jpg\",\"datePublished\":\"2024-04-03T17:59:06+00:00\",\"dateModified\":\"2024-05-14T18:03:38+00:00\",\"author\":{\"@id\":\"\"},\"description\":\"Sergei Kalinin\u2019s team constructed an atomic force microscope that autonomously performs experiments, boosting materials characterization to unprecedented rates.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/tickle.utk.edu\\\/mse\\\/kalinins-ai-microscopist-accelerates-nanoscale-material-characterization\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/tickle.utk.edu\\\/mse\\\/kalinins-ai-microscopist-accelerates-nanoscale-material-characterization\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/tickle.utk.edu\\\/mse\\\/kalinins-ai-microscopist-accelerates-nanoscale-material-characterization\\\/#primaryimage\",\"url\":\"https:\\\/\\\/tickle.utk.edu\\\/mse\\\/wp-content\\\/uploads\\\/sites\\\/2\\\/2024\\\/05\\\/kalinin-micrscope.jpg\",\"contentUrl\":\"https:\\\/\\\/tickle.utk.edu\\\/mse\\\/wp-content\\\/uploads\\\/sites\\\/2\\\/2024\\\/05\\\/kalinin-micrscope.jpg\",\"width\":1200,\"height\":630,\"caption\":\"AI, self-driven microscope in Sergei Kalinin's lab.\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/tickle.utk.edu\\\/mse\\\/kalinins-ai-microscopist-accelerates-nanoscale-material-characterization\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/tickle.utk.edu\\\/mse\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Kalinin\u2019s AI Microscopist Accelerates Nanoscale Material Characterization\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/tickle.utk.edu\\\/mse\\\/#website\",\"url\":\"https:\\\/\\\/tickle.utk.edu\\\/mse\\\/\",\"name\":\"Materials Science and Engineering\",\"description\":\"University of Tennessee, Knoxville\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/tickle.utk.edu\\\/mse\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"\",\"url\":\"https:\\\/\\\/tickle.utk.edu\\\/mse\\\/author\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Kalinin\u2019s AI Microscopist Accelerates Nanoscale Material Characterization - Materials Science and Engineering","description":"Sergei Kalinin\u2019s team constructed an atomic force microscope that autonomously performs experiments, boosting materials characterization to unprecedented rates.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/tickle.utk.edu\/mse\/kalinins-ai-microscopist-accelerates-nanoscale-material-characterization\/","og_locale":"en_US","og_type":"article","og_title":"Kalinin\u2019s AI Microscopist Accelerates Nanoscale Material Characterization - Materials Science and Engineering","og_description":"Sergei Kalinin\u2019s team constructed an atomic force microscope that autonomously performs experiments, boosting materials characterization to unprecedented rates.","og_url":"https:\/\/tickle.utk.edu\/mse\/kalinins-ai-microscopist-accelerates-nanoscale-material-characterization\/","og_site_name":"Materials Science and Engineering","article_published_time":"2024-04-03T17:59:06+00:00","article_modified_time":"2024-05-14T18:03:38+00:00","og_image":[{"width":1200,"height":630,"url":"https:\/\/tickle.utk.edu\/mse\/wp-content\/uploads\/sites\/2\/2024\/05\/kalinin-micrscope.jpg","type":"image\/jpeg"}],"twitter_card":"summary_large_image","twitter_misc":{"Written by":"","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/tickle.utk.edu\/mse\/kalinins-ai-microscopist-accelerates-nanoscale-material-characterization\/#article","isPartOf":{"@id":"https:\/\/tickle.utk.edu\/mse\/kalinins-ai-microscopist-accelerates-nanoscale-material-characterization\/"},"author":{"name":"","@id":""},"headline":"Kalinin\u2019s AI Microscopist Accelerates Nanoscale Material Characterization","datePublished":"2024-04-03T17:59:06+00:00","dateModified":"2024-05-14T18:03:38+00:00","mainEntityOfPage":{"@id":"https:\/\/tickle.utk.edu\/mse\/kalinins-ai-microscopist-accelerates-nanoscale-material-characterization\/"},"wordCount":816,"image":{"@id":"https:\/\/tickle.utk.edu\/mse\/kalinins-ai-microscopist-accelerates-nanoscale-material-characterization\/#primaryimage"},"thumbnailUrl":"https:\/\/tickle.utk.edu\/mse\/wp-content\/uploads\/sites\/2\/2024\/05\/kalinin-micrscope.jpg","keywords":["atomic force microscope","DOE","Energy Frontier Research Center for 3D Ferroelectric Microelectronics","ISAACS","Sergei Kalinin"],"articleSection":["Faculty","News"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/tickle.utk.edu\/mse\/kalinins-ai-microscopist-accelerates-nanoscale-material-characterization\/","url":"https:\/\/tickle.utk.edu\/mse\/kalinins-ai-microscopist-accelerates-nanoscale-material-characterization\/","name":"Kalinin\u2019s AI Microscopist Accelerates Nanoscale Material Characterization - Materials Science and Engineering","isPartOf":{"@id":"https:\/\/tickle.utk.edu\/mse\/#website"},"primaryImageOfPage":{"@id":"https:\/\/tickle.utk.edu\/mse\/kalinins-ai-microscopist-accelerates-nanoscale-material-characterization\/#primaryimage"},"image":{"@id":"https:\/\/tickle.utk.edu\/mse\/kalinins-ai-microscopist-accelerates-nanoscale-material-characterization\/#primaryimage"},"thumbnailUrl":"https:\/\/tickle.utk.edu\/mse\/wp-content\/uploads\/sites\/2\/2024\/05\/kalinin-micrscope.jpg","datePublished":"2024-04-03T17:59:06+00:00","dateModified":"2024-05-14T18:03:38+00:00","author":{"@id":""},"description":"Sergei Kalinin\u2019s team constructed an atomic force microscope that autonomously performs experiments, boosting materials characterization to unprecedented rates.","breadcrumb":{"@id":"https:\/\/tickle.utk.edu\/mse\/kalinins-ai-microscopist-accelerates-nanoscale-material-characterization\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/tickle.utk.edu\/mse\/kalinins-ai-microscopist-accelerates-nanoscale-material-characterization\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/tickle.utk.edu\/mse\/kalinins-ai-microscopist-accelerates-nanoscale-material-characterization\/#primaryimage","url":"https:\/\/tickle.utk.edu\/mse\/wp-content\/uploads\/sites\/2\/2024\/05\/kalinin-micrscope.jpg","contentUrl":"https:\/\/tickle.utk.edu\/mse\/wp-content\/uploads\/sites\/2\/2024\/05\/kalinin-micrscope.jpg","width":1200,"height":630,"caption":"AI, self-driven microscope in Sergei Kalinin's lab."},{"@type":"BreadcrumbList","@id":"https:\/\/tickle.utk.edu\/mse\/kalinins-ai-microscopist-accelerates-nanoscale-material-characterization\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/tickle.utk.edu\/mse\/"},{"@type":"ListItem","position":2,"name":"Kalinin\u2019s AI Microscopist Accelerates Nanoscale Material Characterization"}]},{"@type":"WebSite","@id":"https:\/\/tickle.utk.edu\/mse\/#website","url":"https:\/\/tickle.utk.edu\/mse\/","name":"Materials Science and Engineering","description":"University of Tennessee, Knoxville","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/tickle.utk.edu\/mse\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"","url":"https:\/\/tickle.utk.edu\/mse\/author\/"}]}},"_links":{"self":[{"href":"https:\/\/tickle.utk.edu\/mse\/wp-json\/wp\/v2\/posts\/1515","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/tickle.utk.edu\/mse\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/tickle.utk.edu\/mse\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/tickle.utk.edu\/mse\/wp-json\/wp\/v2\/users\/46"}],"replies":[{"embeddable":true,"href":"https:\/\/tickle.utk.edu\/mse\/wp-json\/wp\/v2\/comments?post=1515"}],"version-history":[{"count":0,"href":"https:\/\/tickle.utk.edu\/mse\/wp-json\/wp\/v2\/posts\/1515\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/tickle.utk.edu\/mse\/wp-json\/wp\/v2\/media\/1516"}],"wp:attachment":[{"href":"https:\/\/tickle.utk.edu\/mse\/wp-json\/wp\/v2\/media?parent=1515"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/tickle.utk.edu\/mse\/wp-json\/wp\/v2\/categories?post=1515"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/tickle.utk.edu\/mse\/wp-json\/wp\/v2\/tags?post=1515"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}