{"id":1906,"date":"2024-02-06T14:35:19","date_gmt":"2024-02-06T14:35:19","guid":{"rendered":"https:\/\/www.umflint.edu\/cit\/?page_id=1906"},"modified":"2026-05-04T21:38:37","modified_gmt":"2026-05-05T01:38:37","slug":"smiles","status":"publish","type":"page","link":"https:\/\/www.umflint.edu\/cit\/research\/smiles\/","title":{"rendered":"SMILES Lab"},"content":{"rendered":"\n<div class=\"wp-block-umflint-templates umflint-template-default\"><div class=\"wp-block-umflint-jumbotron jumbotron jumbotron-fluid jumbotron-page-large  mb-3\" style=\"background-color: rgb(255,255,255);\">\n    <div class=\"container\">\n<div class=\"wp-block-umflint-card card card-default \"><h1 class=\"card-header\">Secure Modeling and Intelligent Learning in Engineering Systems Lab<\/h1><div class=\"card-body\">\n\n<div class=\"wp-block-buttons is-layout-flex wp-block-buttons-is-layout-flex\">\n<div class=\"wp-block-button\"><a class=\"wp-block-button__link has-secondary-background-color has-background has-custom-font-size wp-element-button\" href=\"https:\/\/www.umflint.edu\/cit\/research\/smiles\/members\/\" style=\"font-size:clamp(14px, 0.875rem + ((1vw - 3.2px) * 0.313), 18px);\">SMILES Lab Members<\/a><\/div>\n<\/div>\n\n<\/div><\/div>\n<\/div>\n    <img decoding=\"async\" class=\"jumbotron-image\" src=\"https:\/\/www-s3.umflint.edu\/wp\/uploads\/2024\/02\/SMILE-Page-24.jpg\" srcset=\"https:\/\/www-s3.umflint.edu\/wp\/uploads\/2024\/02\/SMILE-Page-24.jpg 2560w, https:\/\/www-s3.umflint.edu\/wp\/uploads\/2024\/02\/SMILE-Page-24-300x199.jpg 300w, https:\/\/www-s3.umflint.edu\/wp\/uploads\/2024\/02\/SMILE-Page-24-1024x680.jpg 1024w, https:\/\/www-s3.umflint.edu\/wp\/uploads\/2024\/02\/SMILE-Page-24-768x510.jpg 768w, https:\/\/www-s3.umflint.edu\/wp\/uploads\/2024\/02\/SMILE-Page-24-1536x1020.jpg 1536w, https:\/\/www-s3.umflint.edu\/wp\/uploads\/2024\/02\/SMILE-Page-24-2048x1360.jpg 2048w\" sizes=\"(max-width: 2560px) 100vw, 2560px\" alt=\"\" \/>\n    <\/div>\n\n<div class=\"wp-bootstrap-blocks-container container mb-2\">\n\t\n<div class=\"wp-bootstrap-blocks-row row\">\n\t\n\n<div class=\"col-12 col-md-3\">\n\t\t\t\n<button class=\"btn btn-section w-100 px-0 wp-menu-block-toggle mobile-nav-toggle d-none\" data-target=\"wp-menu-block-side-menu\">\n          <span class=\"h-100 mr-3 mt-1 d-block mobile-nav-icon\" aria-hidden=\"true\">\n\t\t\t<span class=\"mb-1 transition bg-dark d-block mobile-nav-icon-line\"><\/span>\n\t\t\t<span class=\"mb-1 transition bg-dark d-block mobile-nav-icon-line\"><\/span>\n\t\t\t<span class=\"mb-1 transition bg-dark d-block mobile-nav-icon-line\"><\/span>\n\t\t  <\/span>\n          College of Innovation &amp; Technology<\/button><nav id=\"wp-menu-block-side-menu\" class=\"wp-menu-block sidebar-nav wp-block-umflint-menu-block\"><div class=\"nav-sidebar-title-container\">\n                <div class=\"nav-sidebar-title\"><a href=\"https:\/\/www.umflint.edu\/cit\">College of Innovation &amp; Technology<\/a><\/div>\n                <a class=\"nav-sidebar-title-close\" href=\"#\" data-target=\"side-menu\" aria-label=\"Close\" aria-expanded=\"false\">\n                    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"100%\" height=\"50\" fill=\"currentColor\" viewBox=\"0 0 24 24\">\n                        <title>close<\/title><path d=\"M19,6.41L17.59,5L12,10.59L6.41,5L5,6.41L10.59,12L5,17.59L6.41,19L12,13.41L17.59,19L19,17.59L13.41,12L19,6.41Z\" \/>\n                    <\/svg>\n\t\t\t\t<\/a>\n            <\/div><ul id=\"menu-side-menu\" class=\"menu nav nav-sidebar flex-column\"><li itemscope=\"itemscope\" itemtype=\"https:\/\/www.schema.org\/SiteNavigationElement\" id=\"menu-item-2313\" class=\"menu-item menu-item-type-post_type menu-item-object-page menu-item-2313 nav-item\"><a title=\"Undergraduate Programs\" href=\"https:\/\/www.umflint.edu\/cit\/undergrad\/\" class=\"nav-link\">Undergraduate Programs<\/a><\/li>\n<li itemscope=\"itemscope\" itemtype=\"https:\/\/www.schema.org\/SiteNavigationElement\" id=\"menu-item-2320\" class=\"menu-item menu-item-type-post_type menu-item-object-page menu-item-has-children menu-item-2320 nav-item\"><a title=\"Graduate Programs\" href=\"https:\/\/www.umflint.edu\/cit\/grad\/\" class=\"nav-link\">Graduate Programs<\/a>\n<ul class=\"subitems-menu\" >\n\t<li itemscope=\"itemscope\" itemtype=\"https:\/\/www.schema.org\/SiteNavigationElement\" id=\"menu-item-3235\" class=\"menu-item menu-item-type-custom menu-item-object-custom menu-item-3235 nav-item\"><a title=\"FAQ\" href=\"https:\/\/go.umflint.edu\/FAQ\" class=\"nav-link\">FAQ<\/a><\/li>\n<\/ul>\n<\/li>\n<li itemscope=\"itemscope\" itemtype=\"https:\/\/www.schema.org\/SiteNavigationElement\" id=\"menu-item-1464\" class=\"menu-item menu-item-type-post_type menu-item-object-page menu-item-has-children menu-item-1464 nav-item\"><a title=\"Noncredit Certificates\" href=\"https:\/\/www.umflint.edu\/cit\/noncredit-certificate\/\" class=\"nav-link\">Noncredit Certificates<\/a>\n<ul class=\"subitems-menu\" >\n\t<li itemscope=\"itemscope\" itemtype=\"https:\/\/www.schema.org\/SiteNavigationElement\" id=\"menu-item-1467\" class=\"menu-item menu-item-type-custom menu-item-object-custom menu-item-1467 nav-item\"><a title=\"Foundations of Object Oriented Programming\" href=\"https:\/\/go.umflint.edu\/Algorithms\" class=\"nav-link\">Foundations of Object Oriented Programming<\/a><\/li>\n\t<li itemscope=\"itemscope\" itemtype=\"https:\/\/www.schema.org\/SiteNavigationElement\" id=\"menu-item-1465\" class=\"menu-item menu-item-type-custom menu-item-object-custom menu-item-1465 nav-item\"><a title=\"Foundations of Programming\" href=\"https:\/\/go.umflint.edu\/Programming\" class=\"nav-link\">Foundations of Programming<\/a><\/li>\n\t<li itemscope=\"itemscope\" itemtype=\"https:\/\/www.schema.org\/SiteNavigationElement\" id=\"menu-item-1466\" class=\"menu-item menu-item-type-custom menu-item-object-custom menu-item-1466 nav-item\"><a title=\"Foundations of Data Structures\" href=\"https:\/\/go.umflint.edu\/Structures\" class=\"nav-link\">Foundations of Data Structures<\/a><\/li>\n<\/ul>\n<\/li>\n<li itemscope=\"itemscope\" itemtype=\"https:\/\/www.schema.org\/SiteNavigationElement\" id=\"menu-item-12\" class=\"menu-item menu-item-type-custom menu-item-object-custom menu-item-12 nav-item\"><a title=\"Admissions\" href=\"https:\/\/www.umflint.edu\/admissions\/\" class=\"nav-link\">Admissions<\/a><\/li>\n<li itemscope=\"itemscope\" itemtype=\"https:\/\/www.schema.org\/SiteNavigationElement\" id=\"menu-item-1774\" class=\"menu-item menu-item-type-post_type menu-item-object-page menu-item-1774 nav-item\"><a title=\"Academic Advising\" href=\"https:\/\/www.umflint.edu\/cit\/academic-advising\/\" class=\"nav-link\">Academic Advising<\/a><\/li>\n<li itemscope=\"itemscope\" itemtype=\"https:\/\/www.schema.org\/SiteNavigationElement\" id=\"menu-item-2325\" class=\"menu-item menu-item-type-post_type menu-item-object-page menu-item-has-children menu-item-2325 nav-item\"><a title=\"Research\" href=\"https:\/\/www.umflint.edu\/cit\/research\/\" class=\"nav-link\">Research<\/a>\n<ul class=\"subitems-menu\" >\n\t<li itemscope=\"itemscope\" itemtype=\"https:\/\/www.schema.org\/SiteNavigationElement\" id=\"menu-item-2330\" class=\"menu-item menu-item-type-post_type menu-item-object-page menu-item-2330 nav-item\"><a title=\"Faculty Research Areas\" href=\"https:\/\/www.umflint.edu\/cit\/research\/faculty\/\" class=\"nav-link\">Faculty Research Areas<\/a><\/li>\n\t<li itemscope=\"itemscope\" itemtype=\"https:\/\/www.schema.org\/SiteNavigationElement\" id=\"menu-item-2338\" class=\"menu-item menu-item-type-post_type menu-item-object-page menu-item-2338 nav-item\"><a title=\"Labs &amp; Centers\" href=\"https:\/\/www.umflint.edu\/cit\/research\/labs-and-centers\/\" class=\"nav-link\">Labs &amp; Centers<\/a><\/li>\n\t<li itemscope=\"itemscope\" itemtype=\"https:\/\/www.schema.org\/SiteNavigationElement\" id=\"menu-item-2431\" class=\"menu-item menu-item-type-post_type menu-item-object-page menu-item-2431 nav-item\"><a title=\"NSF REU in Digital Accessibility\" href=\"https:\/\/www.umflint.edu\/cit\/nsf-reu-in-digital-accessibility\/\" class=\"nav-link\">NSF REU in Digital Accessibility<\/a><\/li>\n\t<li itemscope=\"itemscope\" itemtype=\"https:\/\/www.schema.org\/SiteNavigationElement\" id=\"menu-item-4094\" class=\"menu-item menu-item-type-post_type menu-item-object-page menu-item-4094 nav-item\"><a title=\"SMILES Lab\" href=\"https:\/\/www.umflint.edu\/cit\/research\/smiles\/\" class=\"nav-link\">SMILES Lab<\/a><\/li>\n\t<li itemscope=\"itemscope\" itemtype=\"https:\/\/www.schema.org\/SiteNavigationElement\" id=\"menu-item-3099\" class=\"menu-item menu-item-type-post_type menu-item-object-page menu-item-3099 nav-item\"><a title=\"Student Travel Funding Opportunities\" href=\"https:\/\/www.umflint.edu\/cit\/research\/student-travel-funding-opportunities\/\" class=\"nav-link\">Student Travel Funding Opportunities<\/a><\/li>\n<\/ul>\n<\/li>\n<li itemscope=\"itemscope\" itemtype=\"https:\/\/www.schema.org\/SiteNavigationElement\" id=\"menu-item-2658\" class=\"menu-item menu-item-type-post_type menu-item-object-page menu-item-has-children menu-item-2658 nav-item\"><a title=\"Center for Cybersecurity\" href=\"https:\/\/www.umflint.edu\/cit\/center-for-cybersecurity\/\" class=\"nav-link\">Center for Cybersecurity<\/a>\n<ul class=\"subitems-menu\" >\n\t<li itemscope=\"itemscope\" itemtype=\"https:\/\/www.schema.org\/SiteNavigationElement\" id=\"menu-item-2693\" class=\"menu-item menu-item-type-post_type menu-item-object-page menu-item-2693 nav-item\"><a title=\"Research\" href=\"https:\/\/www.umflint.edu\/cit\/center-for-cybersecurity\/research\/\" class=\"nav-link\">Research<\/a><\/li>\n\t<li itemscope=\"itemscope\" itemtype=\"https:\/\/www.schema.org\/SiteNavigationElement\" id=\"menu-item-2692\" class=\"menu-item menu-item-type-post_type menu-item-object-page menu-item-2692 nav-item\"><a title=\"Education\" href=\"https:\/\/www.umflint.edu\/cit\/center-for-cybersecurity\/education\/\" class=\"nav-link\">Education<\/a><\/li>\n\t<li itemscope=\"itemscope\" itemtype=\"https:\/\/www.schema.org\/SiteNavigationElement\" id=\"menu-item-2712\" class=\"menu-item menu-item-type-post_type menu-item-object-page menu-item-2712 nav-item\"><a title=\"Partnerships\" href=\"https:\/\/www.umflint.edu\/cit\/center-for-cybersecurity\/partnerships\/\" class=\"nav-link\">Partnerships<\/a><\/li>\n\t<li itemscope=\"itemscope\" itemtype=\"https:\/\/www.schema.org\/SiteNavigationElement\" id=\"menu-item-2723\" class=\"menu-item menu-item-type-post_type menu-item-object-page menu-item-2723 nav-item\"><a title=\"Outreach\" href=\"https:\/\/www.umflint.edu\/cit\/center-for-cybersecurity\/outreach\/\" class=\"nav-link\">Outreach<\/a><\/li>\n\t<li itemscope=\"itemscope\" itemtype=\"https:\/\/www.schema.org\/SiteNavigationElement\" id=\"menu-item-2773\" class=\"menu-item menu-item-type-post_type menu-item-object-page menu-item-2773 nav-item\"><a title=\"Research Affiliates &amp; Advisory Board Members\" href=\"https:\/\/www.umflint.edu\/cit\/center-for-cybersecurity\/members\/\" class=\"nav-link\">Research Affiliates &amp; Advisory Board Members<\/a><\/li>\n<\/ul>\n<\/li>\n<li itemscope=\"itemscope\" itemtype=\"https:\/\/www.schema.org\/SiteNavigationElement\" id=\"menu-item-71\" class=\"menu-item menu-item-type-post_type menu-item-object-page menu-item-71 nav-item\"><a title=\"Dean\u2019s Office\" href=\"https:\/\/www.umflint.edu\/cit\/deans-office\/\" class=\"nav-link\">Dean\u2019s Office<\/a><\/li>\n<li itemscope=\"itemscope\" itemtype=\"https:\/\/www.schema.org\/SiteNavigationElement\" id=\"menu-item-85\" class=\"menu-item menu-item-type-post_type menu-item-object-page menu-item-has-children menu-item-85 nav-item\"><a title=\"Faculty &amp; Staff\" href=\"https:\/\/www.umflint.edu\/cit\/faculty-staff\/\" class=\"nav-link\">Faculty &amp; Staff<\/a>\n<ul class=\"subitems-menu\" >\n\t<li itemscope=\"itemscope\" itemtype=\"https:\/\/www.schema.org\/SiteNavigationElement\" id=\"menu-item-1208\" class=\"menu-item menu-item-type-post_type menu-item-object-page menu-item-1208 nav-item\"><a title=\"Computer Science Faculty\" href=\"https:\/\/www.umflint.edu\/cit\/faculty-staff\/computer-science\/\" class=\"nav-link\">Computer Science Faculty<\/a><\/li>\n\t<li itemscope=\"itemscope\" itemtype=\"https:\/\/www.schema.org\/SiteNavigationElement\" id=\"menu-item-1041\" class=\"menu-item menu-item-type-post_type menu-item-object-page menu-item-1041 nav-item\"><a title=\"Engineering and Technology Faculty\" href=\"https:\/\/www.umflint.edu\/cit\/faculty-staff\/engineering-and-technology\/\" class=\"nav-link\">Engineering and Technology Faculty<\/a><\/li>\n\t<li itemscope=\"itemscope\" itemtype=\"https:\/\/www.schema.org\/SiteNavigationElement\" id=\"menu-item-818\" class=\"menu-item menu-item-type-custom menu-item-object-custom menu-item-818 nav-item\"><a title=\"Math and Natural Science Faculty\" href=\"https:\/\/www.umflint.edu\/cit\/faculty-staff\/math-and-natural-science\/\" class=\"nav-link\">Math and Natural Science Faculty<\/a><\/li>\n<\/ul>\n<\/li>\n<\/ul><\/nav>\n\t<\/div>\n\n\n\n<div class=\"col-12 col-md-9\">\n\t\t\t\n<nav aria-label=\"breadcrumb\"><ol class=\"breadcrumb mb-3\"><li class=\"breadcrumb-item\"><a href=\"\/\">Home<\/a><\/li><li class=\"breadcrumb-item\"><a href=\"https:\/\/www.umflint.edu\/cit\">College of Innovation &amp; Technology<\/a><\/li><li class=\"breadcrumb-item\"><a href=\"https:\/\/www.umflint.edu\/cit\/research\/\">Research<\/a><\/li><li class=\"breadcrumb-item active\" aria-current=\"page\">SMILES Lab<\/li><\/ol><\/nav>\n\n\n<h2 class=\"wp-block-heading has-primary-color has-text-color has-link-color wp-elements-b6b124a5aee913f2c88a35bac1ab070c\">AI Tools for Cybersecurity &amp; Neurodegenerative Diseases<\/h2>\n\n\n\n<h3 class=\"wp-block-heading has-medium-font-size\">Director and PI: Khalid Malik, Director of Cybersecurity Programs, Professor, Computing Division, CIT<\/h3>\n\n\n\n<p>The Secure Modeling and Intelligent Learning in Engineering Systems (SMILES) Lab is a forward-thinking interdisciplinary group of faculty and student researchers who are embracing outside-the-box thinking to develop cutting-edge AI-based solutions to some of the most pressing problems of our time. The translational research put forth by the SMILES team has an impact that extends beyond our community with marketable solutions in cybersecurity and healthcare that will benefit us all.<\/p>\n\n\n\n<p>The bold vision of the SMILES lab has identified pressing needs and put unwavering focus on building and improving AI tools to solve them. Malik and his team have published many journal and conference articles, and they are continually building on that foundation. Through rich relationships with industry and medical experts, the team has been able to meet very specific needs with relevant solutions.&nbsp;<\/p>\n\n\n\n<p>In addition to the external impact of SMILES research, the students working with SMILES projects are gaining a wealth of unique experiences. They are exposed to the latest in AI and cybersecurity tools, while constantly being supported to practice nimble, critical thinking that unlocks life-changing growth. With thoughtful mentorship from Malik, the students are empowered to practice persistence toward important tangible goals. These skills and the relationships they form will be lifelong and prepare them for a world that has much need for creative individuals who know how to bridge the gap between research and practice.<\/p>\n\n\n\n<h3 class=\"wp-block-heading has-primary-color has-text-color has-link-color has-medium-font-size wp-elements-654793bcb214bb669ca3a21a3d505119\"><strong>On This Page<\/strong><\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"#DeepFake\">Deepfake Detector<\/a><\/li>\n\n\n\n<li><a href=\"#Aneurysm\">NeuroAssist<\/a><\/li>\n\n\n\n<li><a href=\"#WebFiltering\">AI-based Web Filtering<\/a><\/li>\n\n\n\n<li><a href=\"#KnowledgeGraphs\">Automated Knowledge Graph Curation<\/a><\/li>\n\n\n\n<li><a href=\"#DigitalTwins\">Automotive Cybersecurity Education<\/a><\/li>\n<\/ul>\n\n\n\n<hr class=\"wp-block-separator has-text-color has-secondary-color has-alpha-channel-opacity has-secondary-background-color has-background mt-5 mb-5\"\/>\n\n\n\n<h2 class=\"wp-block-heading has-primary-color has-text-color has-link-color wp-elements-83235f72c27da0d7a420dcfa86203dd4\" id=\"DeepFake\"><\/h2>\n\n\t<\/div>\n\n<\/div>\n\n<\/div>\n\n\n\n<div class=\"wp-block-cover is-light\"><span aria-hidden=\"true\" class=\"wp-block-cover__background has-white-background-color has-background-dim-100 has-background-dim\"><\/span><div class=\"wp-block-cover__inner-container has-global-padding is-layout-constrained wp-block-cover-is-layout-constrained\"><div class=\"wp-bootstrap-blocks-container container mb-2\">\n\t\n\n<h2 class=\"wp-block-heading has-primary-color has-text-color has-link-color wp-elements-03ef59bce27aed4a1ae63f6eaa9fedd2\" id=\"DeepFake\">Development of an Explainable and Robust Detector of Forged Multimedia and Cyber Threats using Artificial intelligence<\/h2>\n\n\n\n<h3 class=\"wp-block-heading has-medium-font-size\">Funded by the <a href=\"https:\/\/www.nsf.gov\/\" target=\"_blank\" rel=\"noreferrer noopener\">National Science Foundation<\/a> and <a href=\"https:\/\/www.michiganbusiness.org\/services\/entrepreneurial-opportunity\/university-programs\/\" target=\"_blank\" rel=\"noreferrer noopener\">Michigan Translational Research and Commercialization<\/a><\/h3>\n\n\n\n<div class=\"wp-block-cover h-auto mt-3 mb-3\"><img loading=\"lazy\" decoding=\"async\" width=\"2560\" height=\"1700\" class=\"wp-block-cover__image-background wp-image-2200\" alt=\"\" src=\"https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/White-BG.jpg\" data-object-fit=\"cover\" srcset=\"https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/White-BG.jpg 2560w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/White-BG-300x199.jpg 300w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/White-BG-1024x680.jpg 1024w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/White-BG-768x510.jpg 768w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/White-BG-1536x1020.jpg 1536w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/White-BG-2048x1360.jpg 2048w\" sizes=\"auto, (max-width: 2560px) 100vw, 2560px\" \/><span aria-hidden=\"true\" class=\"wp-block-cover__background has-background-dim-0 has-background-dim\"><\/span><div class=\"wp-block-cover__inner-container has-global-padding is-layout-constrained wp-block-cover-is-layout-constrained\"><div class=\"wp-bootstrap-blocks-container container mb-2\">\n\t\n<div class=\"wp-bootstrap-blocks-row row\">\n\t\n\n<div class=\"col-12 col-md-4\">\n\t\t\t\t<\/div>\n\n\n\n<div class=\"col-12 col-md-4\">\n\t\t\t\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"555\" height=\"370\" src=\"https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Deep-Fake.png\" alt=\"Deep fake mask that indicates a swap\" class=\"wp-image-2196\" srcset=\"https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Deep-Fake.png 555w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Deep-Fake-300x200.png 300w\" sizes=\"auto, (max-width: 555px) 100vw, 555px\" \/><\/figure>\n\n\t<\/div>\n\n\n\n<div class=\"col-12 col-md-4\">\n\t\t\t\t<\/div>\n\n<\/div>\n\n\n\n<div class=\"wp-block-cover h-auto mb-3\" style=\"min-height:50px;aspect-ratio:unset;\"><img loading=\"lazy\" decoding=\"async\" width=\"2889\" height=\"244\" class=\"wp-block-cover__image-background wp-image-2197\" alt=\"\" src=\"https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Dk-to-Lt-Blue-Gradient-1.png\" data-object-fit=\"cover\" srcset=\"https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Dk-to-Lt-Blue-Gradient-1.png 2889w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Dk-to-Lt-Blue-Gradient-1-300x25.png 300w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Dk-to-Lt-Blue-Gradient-1-1024x86.png 1024w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Dk-to-Lt-Blue-Gradient-1-768x65.png 768w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Dk-to-Lt-Blue-Gradient-1-1536x130.png 1536w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Dk-to-Lt-Blue-Gradient-1-2048x173.png 2048w\" sizes=\"auto, (max-width: 2889px) 100vw, 2889px\" \/><span aria-hidden=\"true\" class=\"wp-block-cover__background has-background-dim-0 has-background-dim\"><\/span><div class=\"wp-block-cover__inner-container has-global-padding is-layout-constrained wp-block-cover-is-layout-constrained\"><div class=\"wp-bootstrap-blocks-container container mb-2\">\n\t\n<div class=\"wp-bootstrap-blocks-row row mb-0\">\n\t\n\n<div class=\"col-12 col-md-8\">\n\t\t\t\n\n<h2 class=\"wp-block-heading has-text-align-center has-large-font-size\">Deep Forgery Detector (DFD)<\/h2>\n\n\n\n<hr class=\"wp-block-separator has-text-color has-white-color has-alpha-channel-opacity has-white-background-color has-background\"\/>\n\n\n\n<p class=\"has-text-align-center mt-0 has-medium-font-size\"><em>Reveal Truth. Find Justice<\/em><\/p>\n\n\t<\/div>\n\n\n\n<div class=\"col-12 col-md-4\">\n\t\t\t\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"346\" height=\"137\" src=\"https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/demask.png\" alt=\"demask logo\" class=\"wp-image-2195\" srcset=\"https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/demask.png 346w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/demask-300x119.png 300w\" sizes=\"auto, (max-width: 346px) 100vw, 346px\" \/><\/figure>\n\n\t<\/div>\n\n<\/div>\n\n<\/div>\n<\/div><\/div>\n\n\n<div class=\"wp-bootstrap-blocks-row row\">\n\t\n\n<div class=\"col-12 col-md-2\">\n\t\t\t\t<\/div>\n\n\n\n<div class=\"col-12 col-md-8\">\n\t\t\t\n\n<p class=\"has-text-align-center has-primary-color has-text-color has-link-color wp-elements-f7778893b5aba30e6866f7a8c6cf93bf\"><strong><em>Secure Modeling and Intelligent Learning in Engineering Systems Lab<\/em><\/strong><\/p>\n\n\n\n<hr class=\"wp-block-separator has-text-color has-primary-color has-alpha-channel-opacity has-primary-background-color has-background mt-0\"\/>\n\n\t<\/div>\n\n\n\n<div class=\"col-12 col-md-2\">\n\t\t\t\t<\/div>\n\n<\/div>\n\n<\/div>\n<\/div><\/div>\n\n\n\n<figure data-wp-context=\"{&quot;imageId&quot;:&quot;6a2a1f775afda&quot;}\" data-wp-interactive=\"core\/image\" data-wp-key=\"6a2a1f775afda\" class=\"wp-block-image alignleft size-large is-resized inline-image-paragraph-left wp-lightbox-container\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"576\" data-wp-class--hide=\"state.isContentHidden\" data-wp-class--show=\"state.isContentVisible\" data-wp-init=\"callbacks.setButtonStyles\" data-wp-on--click=\"actions.showLightbox\" data-wp-on--load=\"callbacks.setButtonStyles\" data-wp-on-window--resize=\"callbacks.setButtonStyles\" src=\"https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Deepfake-News-1024x576.png\" alt=\"Seeing is believing - but for how long? demask logo.  Snapshots of recent news articles about the public concerns with Deepfakes.  Deepfake Audio is a Political Nightmare, Microsoft's new AI can simulate anyone's voice with 3 seconds of audio, AI Scam: Canadian Couple loses K to Fake Son's voice, AI Generated Deepfake of Japan's Prime Minister Sparks Concern\" class=\"wp-image-2150\" style=\"width:479px;height:auto\" srcset=\"https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Deepfake-News-1024x576.png 1024w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Deepfake-News-300x169.png 300w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Deepfake-News-768x432.png 768w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Deepfake-News-1536x864.png 1536w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Deepfake-News.png 1920w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><button\n\t\t\tclass=\"lightbox-trigger\"\n\t\t\ttype=\"button\"\n\t\t\taria-haspopup=\"dialog\"\n\t\t\taria-label=\"Enlarge\"\n\t\t\tdata-wp-init=\"callbacks.initTriggerButton\"\n\t\t\tdata-wp-on--click=\"actions.showLightbox\"\n\t\t\tdata-wp-style--right=\"state.imageButtonRight\"\n\t\t\tdata-wp-style--top=\"state.imageButtonTop\"\n\t\t>\n\t\t\t<svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"12\" height=\"12\" fill=\"none\" viewBox=\"0 0 12 12\">\n\t\t\t\t<path fill=\"#fff\" d=\"M2 0a2 2 0 0 0-2 2v2h1.5V2a.5.5 0 0 1 .5-.5h2V0H2Zm2 10.5H2a.5.5 0 0 1-.5-.5V8H0v2a2 2 0 0 0 2 2h2v-1.5ZM8 12v-1.5h2a.5.5 0 0 0 .5-.5V8H12v2a2 2 0 0 1-2 2H8Zm2-12a2 2 0 0 1 2 2v2h-1.5V2a.5.5 0 0 0-.5-.5H8V0h2Z\" \/>\n\t\t\t<\/svg>\n\t\t<\/button><\/figure>\n\n\n\n<p>Disinformation is a growing concern for society and is fueled by a new weapon: deepfaked multimedia. We have been told all of our lives to believe what we see with our own eyes, and for the first time, we can no longer trust them.&nbsp; AI generated Deepfakes have left the realm of science fiction, and are an unsettling reality that demands our immediate attention. <\/p>\n\n\n\n<p>A Deepfake is essentially a piece of media that has been either manipulated by or entirely generated by AI to appear as though it\u2019s an original artifact. With recent developments in Generative AI tools, the capabilities have grown to the point where humans cannot detect a difference anymore without assistance.<\/p>\n\n\n\n<p>Fake multimedia is a growing threat on the global stage. Misinformation is not a new tactic, but the tools today are far more advanced. A well-made AI video of a political or industry leader can spread false narratives about public or corporate policy and have a devastating public impact. Imagine a viral video in which some foreign head of state threatened an impending attack&nbsp;on the U.S. &#8211; but that video is indistinguishable from a real one.<\/p>\n\n\n\n<figure data-wp-context=\"{&quot;imageId&quot;:&quot;6a2a1f775b4ad&quot;}\" data-wp-interactive=\"core\/image\" data-wp-key=\"6a2a1f775b4ad\" class=\"wp-block-image alignleft size-large is-resized wp-lightbox-container\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"576\" data-wp-class--hide=\"state.isContentHidden\" data-wp-class--show=\"state.isContentVisible\" data-wp-init=\"callbacks.setButtonStyles\" data-wp-on--click=\"actions.showLightbox\" data-wp-on--load=\"callbacks.setButtonStyles\" data-wp-on-window--resize=\"callbacks.setButtonStyles\" src=\"https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Deepfake-Destabalize-1024x576.png\" alt=\"Deepfakes: The Most Dangerous Cyber Weapon. Below that, The destabilizing political impact of deepfakes...  A deepfake of Ukranian President Volodymyr Zelensky calling on his soldiers to lay down their weapons was reportedly uploaded to a hacked Ukranian news website. To the right of that is an image of POTUS Joe Biden with a news banner that says, the Realities of Nuclear War. Caption says Biden announcing that men and women would be drafted to fight in Ukraine.\" class=\"wp-image-2149\" style=\"width:496px;height:auto\" srcset=\"https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Deepfake-Destabalize-1024x576.png 1024w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Deepfake-Destabalize-300x169.png 300w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Deepfake-Destabalize-768x432.png 768w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Deepfake-Destabalize-1536x864.png 1536w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Deepfake-Destabalize.png 1920w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><button\n\t\t\tclass=\"lightbox-trigger\"\n\t\t\ttype=\"button\"\n\t\t\taria-haspopup=\"dialog\"\n\t\t\taria-label=\"Enlarge\"\n\t\t\tdata-wp-init=\"callbacks.initTriggerButton\"\n\t\t\tdata-wp-on--click=\"actions.showLightbox\"\n\t\t\tdata-wp-style--right=\"state.imageButtonRight\"\n\t\t\tdata-wp-style--top=\"state.imageButtonTop\"\n\t\t>\n\t\t\t<svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"12\" height=\"12\" fill=\"none\" viewBox=\"0 0 12 12\">\n\t\t\t\t<path fill=\"#fff\" d=\"M2 0a2 2 0 0 0-2 2v2h1.5V2a.5.5 0 0 1 .5-.5h2V0H2Zm2 10.5H2a.5.5 0 0 1-.5-.5V8H0v2a2 2 0 0 0 2 2h2v-1.5ZM8 12v-1.5h2a.5.5 0 0 0 .5-.5V8H12v2a2 2 0 0 1-2 2H8Zm2-12a2 2 0 0 1 2 2v2h-1.5V2a.5.5 0 0 0-.5-.5H8V0h2Z\" \/>\n\t\t\t<\/svg>\n\t\t<\/button><\/figure>\n\n\n\n<p>Using deepfaked audio and video in scams is increasingly possible. On Feb 4, 2024, a finance worker at a multinational firm was tricked with a Deepfake \u2018chief financial officer\u2019 video call and paid out <a href=\"https:\/\/www.cnn.com\/2024\/02\/04\/asia\/deepfake-cfo-scam-hong-kong-intl-hnk\/index.html\" target=\"_blank\" rel=\"noreferrer noopener\">$25 million to a scammer<\/a>.<\/p>\n\n\n\n<p>If large financial institutions can fall prey to these things, consider the vulnerability of an average citizen. According to a <a href=\"https:\/\/www.iproov.com\/blog\/deepfakes-statistics-solutions-biometric-protection\" target=\"_blank\" rel=\"noreferrer noopener\">2022 survey<\/a> of 16,000 people across eight countries, 71% of people said that they don\u2019t even know what a deepfake is.<\/p>\n\n\n\n<p>As we are discussing the threat of deepfakes to global security, democratic institutions, and scams on an international level, it\u2019s important to note that verified audio and video artifacts are now the norm as evidence in our judicial system. Deepfakes pose a significant threat to the integrity of that process.<\/p>\n\n\n\n<p>Meeting court evidentiary standards is a challenging task, especially in the absence of&nbsp;underlying metadata, like digital watermarks, or if the media is post-processed with anti-forensic intent. In early February 2024, social media platforms like Meta announced that they will require AI-generated content to be labeled as such, but that falls under the category of \u2018locks only keep out the honest.\u2019 Those intent on using these advanced tools for deception will not be putting labels on them.<\/p>\n\n\n\n<p>As the ability to create convincing fake videos has significantly increased, our need to authenticate legitimate digital media artifacts has grown as well. Beyond that, the tools needed to authenticate these media artifacts need to deliver assessments in an accessible way. Our judicial system, for example, is designed around a \u2018jury of peers\u2019 who won\u2019t have deep knowledge of AI and cybersecurity systems.<\/p>\n\n\n\n<p>To meet this essential demand, we have developed a Deep Forgery Detector. This research has been ongoing for over 6 years, backed by nearly $1M in grants from agencies like the National Science Foundation and MTRAC. This funding has enabled us to develop the DFD MVP with the appropriate tools and knowledge and we are working to further develop them into a product that will be usable by companies and individuals without a major background in cybersecurity.<\/p>\n\n\n\n<p>Student researchers associated with this project will gain the opportunity to learn how to use deep learning, Neurosymbolic AI, and Multimodal AI to develop tools to authenticate digital multimedia. The students will also learn how to protect detectors from anti-forensic attacks and gain experience in designing AI-based detectors to be transparent and explainable with accessible outputs. They will get the opportunity to work in interdisciplinary teams and solve problems beyond what they would encounter in a classroom setting.<\/p>\n\n\n\n<div class=\"wp-block-cover h-auto  mb-3\"><img loading=\"lazy\" decoding=\"async\" width=\"2560\" height=\"1700\" class=\"wp-block-cover__image-background wp-image-2200\" alt=\"\" src=\"https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/White-BG.jpg\" data-object-fit=\"cover\" srcset=\"https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/White-BG.jpg 2560w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/White-BG-300x199.jpg 300w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/White-BG-1024x680.jpg 1024w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/White-BG-768x510.jpg 768w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/White-BG-1536x1020.jpg 1536w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/White-BG-2048x1360.jpg 2048w\" sizes=\"auto, (max-width: 2560px) 100vw, 2560px\" \/><span aria-hidden=\"true\" class=\"wp-block-cover__background has-background-dim-0 has-background-dim\"><\/span><div class=\"wp-block-cover__inner-container has-global-padding is-layout-constrained wp-block-cover-is-layout-constrained\">\n<p class=\"has-text-align-center has-large-font-size\"><\/p>\n\n\n<div class=\"wp-bootstrap-blocks-container container mb-2\">\n\t\n\n<figure data-wp-context=\"{&quot;imageId&quot;:&quot;6a2a1f775ba04&quot;}\" data-wp-interactive=\"core\/image\" data-wp-key=\"6a2a1f775ba04\" class=\"wp-block-image aligncenter size-large is-resized wp-lightbox-container\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"576\" data-wp-class--hide=\"state.isContentHidden\" data-wp-class--show=\"state.isContentVisible\" data-wp-init=\"callbacks.setButtonStyles\" data-wp-on--click=\"actions.showLightbox\" data-wp-on--load=\"callbacks.setButtonStyles\" data-wp-on-window--resize=\"callbacks.setButtonStyles\" src=\"https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Deepfake-Journey-1-1024x576.png\" alt=\"SMILES Lab Journey. demask logo. Below that is a box with a timeline that moves from left to right, as follows: Purple, 1018, NSF, Testbed for Benchmarking Digital Audio Forensic Algorithms, Blue, 2019, NSF, REU Supplement to Forensic Examiner, Grey, 2020, MSGC, NSF, Towards Development of Deepfake Detection Framework, Green, 2021, NSF, REU Supplement to Forensic Examiner, Yellow, 2022, MTRAC, Deep Forgery Detector, Red, 2023, NSF, MTRAC, Explainable and Robust Detector (NSF), DFD (MTRAC).\nBelow this to left are four circles stacked diagonally. From bottom-left, Purple with fingerprint and magnifying glass, Report Generation, Visual, Textual. Red, Gear, Robustness, Ensembled Decision, Multiple Modal Verification, Blue, Brain with circuits, Explainability, NeuroSymbolic, Interpretable Features, Green, Generalizable, Common Knowledge, Human Psychology, Multimodal.\nBottom right has diagrams. SpoTNet: A Spoofing-aware Transformer Network for Effective Synthetic Speech Detection. \" class=\"wp-image-2204\" style=\"width:754px;height:auto\" srcset=\"https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Deepfake-Journey-1-1024x576.png 1024w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Deepfake-Journey-1-300x169.png 300w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Deepfake-Journey-1-768x432.png 768w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Deepfake-Journey-1.png 1280w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><button\n\t\t\tclass=\"lightbox-trigger\"\n\t\t\ttype=\"button\"\n\t\t\taria-haspopup=\"dialog\"\n\t\t\taria-label=\"Enlarge\"\n\t\t\tdata-wp-init=\"callbacks.initTriggerButton\"\n\t\t\tdata-wp-on--click=\"actions.showLightbox\"\n\t\t\tdata-wp-style--right=\"state.imageButtonRight\"\n\t\t\tdata-wp-style--top=\"state.imageButtonTop\"\n\t\t>\n\t\t\t<svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"12\" height=\"12\" fill=\"none\" viewBox=\"0 0 12 12\">\n\t\t\t\t<path fill=\"#fff\" d=\"M2 0a2 2 0 0 0-2 2v2h1.5V2a.5.5 0 0 1 .5-.5h2V0H2Zm2 10.5H2a.5.5 0 0 1-.5-.5V8H0v2a2 2 0 0 0 2 2h2v-1.5ZM8 12v-1.5h2a.5.5 0 0 0 .5-.5V8H12v2a2 2 0 0 1-2 2H8Zm2-12a2 2 0 0 1 2 2v2h-1.5V2a.5.5 0 0 0-.5-.5H8V0h2Z\" \/>\n\t\t\t<\/svg>\n\t\t<\/button><\/figure>\n\n\n\n<figure data-wp-context=\"{&quot;imageId&quot;:&quot;6a2a1f775bdc5&quot;}\" data-wp-interactive=\"core\/image\" data-wp-key=\"6a2a1f775bdc5\" class=\"wp-block-image aligncenter size-full wp-lightbox-container\"><img loading=\"lazy\" decoding=\"async\" width=\"612\" height=\"387\" data-wp-class--hide=\"state.isContentHidden\" data-wp-class--show=\"state.isContentVisible\" data-wp-init=\"callbacks.setButtonStyles\" data-wp-on--click=\"actions.showLightbox\" data-wp-on--load=\"callbacks.setButtonStyles\" data-wp-on-window--resize=\"callbacks.setButtonStyles\" src=\"https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Architecture-of-SpotNet-Framework.jpg\" alt=\"Flow chart leads from Icon of person speaking with arrow\ndown to speech signal icon. From there, arrow points to box labeled Data\nCleansing and Acoustics Signal Processing. In this box, Framing &amp; Windowing\nleads to Non Silence speech indices, leads to Speech indices normalization,\nleads to band pass filtering, leads to pre-emphasis, leads to Mel Spectogram,\nfollowed by an image of a mel spectrogram. An arrow leads to the right of the\nbox to two Spectral graphs, one labeled Envelops, and another labeled contrast.\nA bracket to the right of these graphs indicates the Knowledge Based\nRepresentation pulls an S data point from Envelops and a P data point from Contrast\nto create an SP data set. Arrow leads down to a box labeled Logical Spoofing\nTransformer Encoder (LSTE) in which an SP matrix leads through four Conv. And BN\nfilters to Token Encoding, labeled tokens Tk 1-n, then an arrow points to Transformer\nEncoder, and another arrow leads to Attentive Audio Representation. From this\nbox, an arrow points to a diagram labeled Spoofing Multi layer classification. This\ndiagram shows the data to flow through three layers labeled Dense, BN, and DO.\nDO is shown to be .5, and Dense is 128, relu in the first pass, 64 in the\nsecond, and 32 in the third. From these three, the arrow points to a box\nlabelled Flatten, which contains AE data 1-n. This then leads to one Dense box\nwith 128 Relu, one DO box with .5, and one final Dense box with 1, sigmoid. An\narrow leads to Speech Verification Output \u2013 real or spoof.\" class=\"wp-image-2202\" srcset=\"https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Architecture-of-SpotNet-Framework.jpg 612w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Architecture-of-SpotNet-Framework-300x190.jpg 300w\" sizes=\"auto, (max-width: 612px) 100vw, 612px\" \/><button\n\t\t\tclass=\"lightbox-trigger\"\n\t\t\ttype=\"button\"\n\t\t\taria-haspopup=\"dialog\"\n\t\t\taria-label=\"Enlarge\"\n\t\t\tdata-wp-init=\"callbacks.initTriggerButton\"\n\t\t\tdata-wp-on--click=\"actions.showLightbox\"\n\t\t\tdata-wp-style--right=\"state.imageButtonRight\"\n\t\t\tdata-wp-style--top=\"state.imageButtonTop\"\n\t\t>\n\t\t\t<svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"12\" height=\"12\" fill=\"none\" viewBox=\"0 0 12 12\">\n\t\t\t\t<path fill=\"#fff\" d=\"M2 0a2 2 0 0 0-2 2v2h1.5V2a.5.5 0 0 1 .5-.5h2V0H2Zm2 10.5H2a.5.5 0 0 1-.5-.5V8H0v2a2 2 0 0 0 2 2h2v-1.5ZM8 12v-1.5h2a.5.5 0 0 0 .5-.5V8H12v2a2 2 0 0 1-2 2H8Zm2-12a2 2 0 0 1 2 2v2h-1.5V2a.5.5 0 0 0-.5-.5H8V0h2Z\" \/>\n\t\t\t<\/svg>\n\t\t<\/button><\/figure>\n\n<\/div>\n<\/div><\/div>\n\n\n\n<p>This NSF partnership for innovation (NSF-PFI) and MTRAC-funded project seeks to further improve Deep Forgery Detector (DFD) technology built on NSF lineage award# 1815724: SaTC: CORE: ForensicExaminer: Testbed for Benchmarking Digital Audio Forensic Algorithms and MTRAC project titled &#8220;Deep Forgery Detector.\u201d  The DFD detects audio-visual forgeries, including various types of Deepfakes, that are used in the manipulation of digital multimedia, but new types are continuously appearing. Improvements to the DFD MVP will help to make it more robust against anti-forensics and also make it more accessible and explainable.<\/p>\n\n\n\n<p class=\"mb-2\">For details, see:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/nsf.gov\/awardsearch\/showAward?AWD_ID=1815724&amp;HistoricalAwards=false\" target=\"_blank\" rel=\"noreferrer noopener\">NSF Award Abstract: ForensicExaminer: Testbed for Benchmarking Digital Audio Forensic Algorithms<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/www.nsf.gov\/awardsearch\/showAward?AWD_ID=2231092&amp;HistoricalAwards=false\" target=\"_blank\" rel=\"noreferrer noopener\">NSF Award Abstract: Deep Forgery Detection Technology<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/www.michiganbusiness.org\/press-releases\/2021\/12\/mtrac-innovation-hub-for-advanced-computing-welcomes-third-cohort-of-early-stage-deep-tech-innovation-projects\/\" target=\"_blank\" rel=\"noreferrer noopener\">MEDC Press Release: MTRAC Innovation Hub for Advanced Computing Welcomes Third Cohort of Early-Stage Deep Tech Innovation Projects<\/a><\/li>\n<\/ul>\n\n\n\n<hr class=\"wp-block-separator has-text-color has-secondary-color has-alpha-channel-opacity has-secondary-background-color has-background mt-5 mb-5\"\/>\n\n\n\n<h2 class=\"wp-block-heading has-primary-color has-text-color has-link-color wp-elements-d92914760180db21977151849b496eb2\" id=\"Aneurysm\" style=\"text-transform:none\">NeuroAssist: An Intelligent Secure Decision Support System for the Prediction of Brain Aneurysm Rupture<\/h2>\n\n\n<div class=\"wp-bootstrap-blocks-row row\">\n\t\n\n<div class=\"col-12 col-md-6\">\n\t\t\t\n\n<h3 class=\"wp-block-heading has-medium-font-size\">Funded by the <a href=\"https:\/\/www.bafound.org\/\" target=\"_blank\" rel=\"noreferrer noopener\">Brain Aneurysm Foundation<\/a><\/h3>\n\n\n\n<p>Cerebrovascular accident, or stroke, is the leading cause of disability worldwide and the second leading cause of death. Additionally, stroke is the fifth leading cause of death for all Americans and a leading cause of serious long-term disability. Annually, 15 million people worldwide suffer a stroke, and of these, 5 million die and another 5 million are left permanently disabled.<\/p>\n\n\t<\/div>\n\n\n\n<div class=\"col-12 col-md-6\">\n\t\t\t\n\n<figure data-wp-context=\"{&quot;imageId&quot;:&quot;6a2a1f775c5a9&quot;}\" data-wp-interactive=\"core\/image\" data-wp-key=\"6a2a1f775c5a9\" class=\"wp-block-image alignright size-large is-resized wp-lightbox-container\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"576\" data-wp-class--hide=\"state.isContentHidden\" data-wp-class--show=\"state.isContentVisible\" data-wp-init=\"callbacks.setButtonStyles\" data-wp-on--click=\"actions.showLightbox\" data-wp-on--load=\"callbacks.setButtonStyles\" data-wp-on-window--resize=\"callbacks.setButtonStyles\" src=\"https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Aneurysm-Unmet-Needs-1024x576.png\" alt=\"Circle to the left and right. Smiles logo in top right. Title says: Subarachnoid Hemorrhage Prediction:Problems and Unmet Needs in Healthcare \nLeft circle says Challenges of AI in medicine and has a heart icon. 5 bubbles come from it. Purple, Limited Performance and High Training Cost \nBlue, Demand for Human in\nLoop Methods\nOrange, Data Privacy and \nIntegrity  \nGreen, Demand for Multimodal\n Representation Learning\nRed, Data scarcity, small \nDatasets, and Non-IID\nRight has concentric circles with Unmet needs in center. Outer circle, green, 1. Lack of Multimodal and Large Training Samples\nCurrent dataset deficiencies limit the ability of AI models that generalize effectively and hinders performance.\nDark Blue, 2, Privacy Preserving Decentralized Solutions\nExisting challenges revolve around the need for decentralized solutions that maintain the confidentiality of sensitive health data.\nYellow, 3. Lack of Explainability &amp; Human in Loop AI\nThe knowledge gap between AI and domain experts needs to be filled by explainable predictions. \nRed, 4. Lack of Interdisciplinary Approach\nAddressing complex cardio\/neuro vascular issues demands a synthesis of expertise from multiple disciplines.\n\" class=\"wp-image-2152\" style=\"width:503px;height:auto\" srcset=\"https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Aneurysm-Unmet-Needs-1024x576.png 1024w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Aneurysm-Unmet-Needs-300x169.png 300w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Aneurysm-Unmet-Needs-768x432.png 768w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Aneurysm-Unmet-Needs-1536x864.png 1536w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Aneurysm-Unmet-Needs.png 1920w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><button\n\t\t\tclass=\"lightbox-trigger\"\n\t\t\ttype=\"button\"\n\t\t\taria-haspopup=\"dialog\"\n\t\t\taria-label=\"Enlarge\"\n\t\t\tdata-wp-init=\"callbacks.initTriggerButton\"\n\t\t\tdata-wp-on--click=\"actions.showLightbox\"\n\t\t\tdata-wp-style--right=\"state.imageButtonRight\"\n\t\t\tdata-wp-style--top=\"state.imageButtonTop\"\n\t\t>\n\t\t\t<svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"12\" height=\"12\" fill=\"none\" viewBox=\"0 0 12 12\">\n\t\t\t\t<path fill=\"#fff\" d=\"M2 0a2 2 0 0 0-2 2v2h1.5V2a.5.5 0 0 1 .5-.5h2V0H2Zm2 10.5H2a.5.5 0 0 1-.5-.5V8H0v2a2 2 0 0 0 2 2h2v-1.5ZM8 12v-1.5h2a.5.5 0 0 0 .5-.5V8H12v2a2 2 0 0 1-2 2H8Zm2-12a2 2 0 0 1 2 2v2h-1.5V2a.5.5 0 0 0-.5-.5H8V0h2Z\" \/>\n\t\t\t<\/svg>\n\t\t<\/button><\/figure>\n\n\t<\/div>\n\n<\/div>\n\n\n\n<p>In order to prevent these deaths and disabilities, neurologists and neurosurgeons must be able to diagnose the root causes early and improve their clinical management. They also need to determine an individual\u2019s overall risk across multiple complex considerations, including cerebral aneurysms, arteriovenous malformations (AVM), and Cerebral Occlusive Disease (COD).<\/p>\n\n\n\n<p>Clinical management of diseases causing stroke is very complex. To illustrate the complexity, take the factor of Unruptured Intracranial Aneurysms by itself. Treating them is a complex decision-making process because the risk of rupture is not solely determined by the size of the aneurysm. Location\/artery matters a great deal; small aneurysms on certain arteries may rupture, while larger ones on other arteries may not.<\/p>\n\n\n\n<p>Beyond the isolated case of the aneurysms themselves, various degrees of arteriovenous malformations and plaque accumulation inside the carotid arteries can add other risk factors to the overall stroke risk. Our current assessments are not enough to meet this complexity.<\/p>\n\n\n<div class=\"wp-bootstrap-blocks-row row\">\n\t\n\n<div class=\"col-12 col-md-6\">\n\t\t\t\n\n<p>Lack of proper data often leads to a decision-making process that could aptly be described as \u2018better safe than sorry.\u2019 It is certainly true that surgical intervention is a successful method for eliminating the risk of stroke. However, these surgeries are invasive and may result in severe iatrogenic complications or neurological deficits so treating all aneurysms\/AVMs\/COD is not always worth that risk.<\/p>\n\n\t<\/div>\n\n\n\n<div class=\"col-12 col-md-6\">\n\t\t\t\n\n<figure data-wp-context=\"{&quot;imageId&quot;:&quot;6a2a1f775d7e4&quot;}\" data-wp-interactive=\"core\/image\" data-wp-key=\"6a2a1f775d7e4\" class=\"wp-block-image alignright size-large is-resized wp-lightbox-container\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"576\" data-wp-class--hide=\"state.isContentHidden\" data-wp-class--show=\"state.isContentVisible\" data-wp-init=\"callbacks.setButtonStyles\" data-wp-on--click=\"actions.showLightbox\" data-wp-on--load=\"callbacks.setButtonStyles\" data-wp-on-window--resize=\"callbacks.setButtonStyles\" src=\"https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Aneurysm-Location-Specific-1024x576.png\" alt=\"Diagrams. Title reads Location Specific  Vs. Global Models\nDiagram has three sections. Left has four areas flowing down from the Datasets, through Under Sampling, then through three Location Specific a Global Trained Model, leading down to two rule sets. \nThe middle section starts out with the same datasets, but filters only through an Apriori Algorighm (50% Confidence &amp; 20% Support), and leads down to four rule sets.\nThe third portion shows how the cumulative data and rule sets combine with the 5-year modeling experience of the project and domain expert weights optimization down to one greatly improved rule set.\" class=\"wp-image-2141\" style=\"width:466px;height:auto\" srcset=\"https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Aneurysm-Location-Specific-1024x576.png 1024w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Aneurysm-Location-Specific-300x169.png 300w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Aneurysm-Location-Specific-768x432.png 768w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Aneurysm-Location-Specific-1536x864.png 1536w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Aneurysm-Location-Specific.png 1920w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><button\n\t\t\tclass=\"lightbox-trigger\"\n\t\t\ttype=\"button\"\n\t\t\taria-haspopup=\"dialog\"\n\t\t\taria-label=\"Enlarge\"\n\t\t\tdata-wp-init=\"callbacks.initTriggerButton\"\n\t\t\tdata-wp-on--click=\"actions.showLightbox\"\n\t\t\tdata-wp-style--right=\"state.imageButtonRight\"\n\t\t\tdata-wp-style--top=\"state.imageButtonTop\"\n\t\t>\n\t\t\t<svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"12\" height=\"12\" fill=\"none\" viewBox=\"0 0 12 12\">\n\t\t\t\t<path fill=\"#fff\" d=\"M2 0a2 2 0 0 0-2 2v2h1.5V2a.5.5 0 0 1 .5-.5h2V0H2Zm2 10.5H2a.5.5 0 0 1-.5-.5V8H0v2a2 2 0 0 0 2 2h2v-1.5ZM8 12v-1.5h2a.5.5 0 0 0 .5-.5V8H12v2a2 2 0 0 1-2 2H8Zm2-12a2 2 0 0 1 2 2v2h-1.5V2a.5.5 0 0 0-.5-.5H8V0h2Z\" \/>\n\t\t\t<\/svg>\n\t\t<\/button><\/figure>\n\n\t<\/div>\n\n<\/div>\n\n\n\n<p>On the other hand, delayed intervention when combining factors increases the risk of a stroke, the consequence can be death or permanent disability. When the overall risk is high, it is imperative to perform the correct treatment right away.<\/p>\n\n\n\n<p>Without a dependable clinical risk\/severity score available, neurosurgeons must rely on heuristics compiled from unreliable data and their previous experience.<\/p>\n\n\n<div class=\"wp-bootstrap-blocks-row row\">\n\t\n\n<div class=\"col-12 col-md-6\">\n\t\t\t\n\n<figure data-wp-context=\"{&quot;imageId&quot;:&quot;6a2a1f775dd18&quot;}\" data-wp-interactive=\"core\/image\" data-wp-key=\"6a2a1f775dd18\" class=\"wp-block-image alignleft size-large is-resized inline-image-paragraph-right wp-lightbox-container\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"576\" data-wp-class--hide=\"state.isContentHidden\" data-wp-class--show=\"state.isContentVisible\" data-wp-init=\"callbacks.setButtonStyles\" data-wp-on--click=\"actions.showLightbox\" data-wp-on--load=\"callbacks.setButtonStyles\" data-wp-on-window--resize=\"callbacks.setButtonStyles\" src=\"https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Aneurysm-Knowledge-Infused-1024x576.png\" alt=\"Four diagrams. Title says Knowledge Infused Model for Aneurysm \nDetection &amp; Segmentation\nSMILES logo in top right. \nTop left Pre-processing has various comparisons of aneurysm images. arrows lead down to Knowledge Infused DNN and to Knowledge Extraction top-right. That box shows Medical expert training of the model and feedback back and forth to ROI Extraction and Categorization. Portions of this lead down to the bottom-right box and feed to Infusion Level selection and Equivalent Feature Maps Calculation  there are some black-box illustrations and Adaptive weight Exploitation, Adaptive Layer Infusion sections as well as Level Specific Deep Features Extraction. These circle back across to the Knowledge Infused DNN section in the bottom left and lead to Detection Output and Segmentation Output.\nThe bottom says, &quot;DeepInfusion: A dynamic infusion based-neuro-symbolic AI model for segmentation of intracranial aneurysms.&quot;\u00a0Neurocomputing\u00a0551 (2023): 126510.\" class=\"wp-image-2142\" style=\"width:416px;height:auto\" srcset=\"https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Aneurysm-Knowledge-Infused-1024x576.png 1024w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Aneurysm-Knowledge-Infused-300x169.png 300w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Aneurysm-Knowledge-Infused-768x432.png 768w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Aneurysm-Knowledge-Infused-1536x864.png 1536w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Aneurysm-Knowledge-Infused.png 1920w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><button\n\t\t\tclass=\"lightbox-trigger\"\n\t\t\ttype=\"button\"\n\t\t\taria-haspopup=\"dialog\"\n\t\t\taria-label=\"Enlarge\"\n\t\t\tdata-wp-init=\"callbacks.initTriggerButton\"\n\t\t\tdata-wp-on--click=\"actions.showLightbox\"\n\t\t\tdata-wp-style--right=\"state.imageButtonRight\"\n\t\t\tdata-wp-style--top=\"state.imageButtonTop\"\n\t\t>\n\t\t\t<svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"12\" height=\"12\" fill=\"none\" viewBox=\"0 0 12 12\">\n\t\t\t\t<path fill=\"#fff\" d=\"M2 0a2 2 0 0 0-2 2v2h1.5V2a.5.5 0 0 1 .5-.5h2V0H2Zm2 10.5H2a.5.5 0 0 1-.5-.5V8H0v2a2 2 0 0 0 2 2h2v-1.5ZM8 12v-1.5h2a.5.5 0 0 0 .5-.5V8H12v2a2 2 0 0 1-2 2H8Zm2-12a2 2 0 0 1 2 2v2h-1.5V2a.5.5 0 0 0-.5-.5H8V0h2Z\" \/>\n\t\t\t<\/svg>\n\t\t<\/button><\/figure>\n\n\t<\/div>\n\n\n\n<div class=\"col-12 col-md-6\">\n\t\t\t\n\n<p>Between those two extremes are many cases where the risk warrants monitoring over time, not action. Doctors struggle with the decision of when to treat and when to watch, and every year thousands of unnecessary procedures are performed because they just aren\u2019t. sure. Quantifying the overall stroke risks based on a group of risk factors in similar patients can help make this crucial decision much easier for neurosurgeons.<\/p>\n\n\t<\/div>\n\n<\/div>\n\n\n\n<p>This means the tool needs to be a trusted one that clinicians can use to explain the individual situation. The patient and family are imagining the worst outcomes. They are worried about a devastating stroke and the financial burden of treatment. Being able to clearly explain why the best option is to wait and monitor would be a wonderful benefit to those families.<\/p>\n\n\n<div class=\"wp-bootstrap-blocks-row row\">\n\t\n\n<div class=\"col-12 col-md-6\">\n\t\t\t\n\n<figure data-wp-context=\"{&quot;imageId&quot;:&quot;6a2a1f775e31b&quot;}\" data-wp-interactive=\"core\/image\" data-wp-key=\"6a2a1f775e31b\" class=\"wp-block-image alignleft size-large is-resized inline-image-paragraph-right wp-lightbox-container\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"576\" data-wp-class--hide=\"state.isContentHidden\" data-wp-class--show=\"state.isContentVisible\" data-wp-init=\"callbacks.setButtonStyles\" data-wp-on--click=\"actions.showLightbox\" data-wp-on--load=\"callbacks.setButtonStyles\" data-wp-on-window--resize=\"callbacks.setButtonStyles\" src=\"https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/StrokeNet-1024x576.jpg\" alt=\"Diagram with title, StrokeNet: An Automated Approach for Segmentation \nand Rupture Prediction of Intracranial Aneurysm\nSMILES logo in top right. Left of two boxes reads Step 1: Aneurysm Segmentation. Has a scan image and many representative icons with small print on them. An arrow leads to box two, Step 2: Aneurysm Rupture Prediction. Four images on left lead to four parts, deep features, geometrical features, blood flow pattern, and Fourier Descriptor, they lead into a box showing weighting of those factors, then feature selection, then classifier, then Green, mild, yellow moderate, pink severe, and red critical.\nBottom reads: &quot;StrokeNet: An automated approach for segmentation and rupture risk prediction of intracranial aneurysm.&quot;\u00a0Computerized Medical Imaging and Graphics\u00a0108 (2023): 102271.\" class=\"wp-image-2155\" style=\"width:422px;height:auto\" srcset=\"https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/StrokeNet-1024x576.jpg 1024w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/StrokeNet-300x169.jpg 300w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/StrokeNet-768x432.jpg 768w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/StrokeNet-1536x864.jpg 1536w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/StrokeNet.jpg 1920w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><button\n\t\t\tclass=\"lightbox-trigger\"\n\t\t\ttype=\"button\"\n\t\t\taria-haspopup=\"dialog\"\n\t\t\taria-label=\"Enlarge\"\n\t\t\tdata-wp-init=\"callbacks.initTriggerButton\"\n\t\t\tdata-wp-on--click=\"actions.showLightbox\"\n\t\t\tdata-wp-style--right=\"state.imageButtonRight\"\n\t\t\tdata-wp-style--top=\"state.imageButtonTop\"\n\t\t>\n\t\t\t<svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"12\" height=\"12\" fill=\"none\" viewBox=\"0 0 12 12\">\n\t\t\t\t<path fill=\"#fff\" d=\"M2 0a2 2 0 0 0-2 2v2h1.5V2a.5.5 0 0 1 .5-.5h2V0H2Zm2 10.5H2a.5.5 0 0 1-.5-.5V8H0v2a2 2 0 0 0 2 2h2v-1.5ZM8 12v-1.5h2a.5.5 0 0 0 .5-.5V8H12v2a2 2 0 0 1-2 2H8Zm2-12a2 2 0 0 1 2 2v2h-1.5V2a.5.5 0 0 0-.5-.5H8V0h2Z\" \/>\n\t\t\t<\/svg>\n\t\t<\/button><\/figure>\n\n\t<\/div>\n\n\n\n<div class=\"col-12 col-md-6\">\n\t\t\t\n\n<p>To meet this need, we have developed tools with a decentralized and highly explainable AI-based approach. These tools use a wide array of techniques:&nbsp; Multimodal AI on Digital Subtraction Angiography, Magnetic Resonance Angiography, and Computed Tomography Angiography image modalities along with clinical text, federated learning, RAG-based Neuro-symbolic AI, computational fluid dynamics, and multimodal explainable AI.<\/p>\n\n\t<\/div>\n\n<\/div>\n\n\n\n<p>Ultimately, this project will deliver tools that will reduce fatalities and long-term disabilities, defray high costs for patients and our healthcare system, and alleviate much psychological stress for patients. It will also help to develop and share more robust data with other researchers to advance our understanding of brain aneurysms going forward.<\/p>\n\n\n\n<p>For details, see: <a href=\"https:\/\/www.bafound.org\/blog\/meet-research-grant-recipient-khalid-malik-phd\/\" target=\"_blank\" rel=\"noreferrer noopener\">Brain Aneurysm Foundation: Meet Research Grant Recipient: Khalid Malik, PhD<\/a><\/p>\n\n\n\n<hr class=\"wp-block-separator has-text-color has-secondary-color has-alpha-channel-opacity has-secondary-background-color has-background mt-5 mb-5\"\/>\n\n\n\n<h2 class=\"wp-block-heading has-primary-color has-text-color has-link-color wp-elements-79eb0c97e359bfbe5568aa6a576dae4c\" id=\"WebFiltering\">Neuro-symbolic AI-based Web Filtering<\/h2>\n\n\n\n<h3 class=\"wp-block-heading has-medium-font-size\">Sponsored by <a href=\"https:\/\/incompass.netstar-inc.com\/\" target=\"_blank\" rel=\"noreferrer noopener\">Netstar Inc.<\/a><\/h3>\n\n\n\n<div class=\"wp-block-cover h-auto mt-3 mb-3\"><img loading=\"lazy\" decoding=\"async\" width=\"2560\" height=\"1700\" class=\"wp-block-cover__image-background wp-image-2200\" alt=\"\" src=\"https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/White-BG.jpg\" data-object-fit=\"cover\" srcset=\"https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/White-BG.jpg 2560w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/White-BG-300x199.jpg 300w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/White-BG-1024x680.jpg 1024w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/White-BG-768x510.jpg 768w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/White-BG-1536x1020.jpg 1536w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/White-BG-2048x1360.jpg 2048w\" sizes=\"auto, (max-width: 2560px) 100vw, 2560px\" \/><span aria-hidden=\"true\" class=\"wp-block-cover__background has-background-dim-0 has-background-dim\"><\/span><div class=\"wp-block-cover__inner-container has-global-padding is-layout-constrained wp-block-cover-is-layout-constrained\">\n<p class=\"has-text-align-center has-large-font-size\"><\/p>\n\n\n<div class=\"wp-bootstrap-blocks-row row\">\n\t\n\n<div class=\"col-12 col-md-4\">\n\t\t\t\t<\/div>\n\n\n\n<div class=\"col-12 col-md-4\">\n\t\t\t\n\n<figure class=\"wp-block-image aligncenter size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"246\" height=\"202\" src=\"https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/SMILE-Lab-logo.png\" alt=\"SMILES Lab logo\" class=\"wp-image-2199\" style=\"width:177px;height:auto\"\/><\/figure>\n\n\t<\/div>\n\n\n\n<div class=\"col-12 col-md-4\">\n\t\t\t\t<\/div>\n\n<\/div>\n\n\n\n<div class=\"wp-block-cover h-auto mb-3 mt-3\" style=\"min-height:50px;aspect-ratio:unset;\"><img loading=\"lazy\" decoding=\"async\" width=\"2889\" height=\"244\" class=\"wp-block-cover__image-background wp-image-2197\" alt=\"\" src=\"https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Dk-to-Lt-Blue-Gradient-1.png\" data-object-fit=\"cover\" srcset=\"https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Dk-to-Lt-Blue-Gradient-1.png 2889w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Dk-to-Lt-Blue-Gradient-1-300x25.png 300w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Dk-to-Lt-Blue-Gradient-1-1024x86.png 1024w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Dk-to-Lt-Blue-Gradient-1-768x65.png 768w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Dk-to-Lt-Blue-Gradient-1-1536x130.png 1536w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Dk-to-Lt-Blue-Gradient-1-2048x173.png 2048w\" sizes=\"auto, (max-width: 2889px) 100vw, 2889px\" \/><span aria-hidden=\"true\" class=\"wp-block-cover__background has-background-dim-0 has-background-dim\"><\/span><div class=\"wp-block-cover__inner-container has-global-padding is-layout-constrained wp-block-cover-is-layout-constrained\"><div class=\"wp-bootstrap-blocks-container container mb-2\">\n\t\n<div class=\"wp-bootstrap-blocks-container container mb-2\">\n\t\n\n<h2 class=\"wp-block-heading has-text-align-left has-large-font-size\">Explainable Multimodal Neurosymbolic <br>Edge AI Models for Web Filtering<\/h2>\n\n<\/div>\n\n<\/div>\n<\/div><\/div>\n\n\n<div class=\"wp-bootstrap-blocks-row row\">\n\t\n\n<div class=\"col-12 col-md-2\">\n\t\t\t\t<\/div>\n\n\n\n<div class=\"col-12 col-md-8\">\n\t\t\t\n\n<p class=\"has-text-align-center has-primary-color has-text-color has-link-color wp-elements-f7778893b5aba30e6866f7a8c6cf93bf\"><strong><em>Secure Modeling and Intelligent Learning in Engineering Systems Lab<\/em><\/strong><\/p>\n\n\n\n<hr class=\"wp-block-separator has-text-color has-primary-color has-alpha-channel-opacity has-primary-background-color has-background mt-0\"\/>\n\n\t<\/div>\n\n\n\n<div class=\"col-12 col-md-2\">\n\t\t\t\t<\/div>\n\n<\/div>\n<\/div><\/div>\n\n\n\n<p>Web filtering solutions are a vital component of cybersecurity. They block access to malicious websites, prevent malware from infecting our machines, and protect sensitive data from going out of organizations. They offer a secure, efficient, and controlled online experience across various sectors, addressing concerns related to security, productivity, and content appropriateness. The growing trends in Internet usage for data and knowledge-sharing calls for dynamic classification of web contents, particularly at the edge of the Internet.<\/p>\n\n\n<div class=\"wp-bootstrap-blocks-row row\">\n\t\n\n<div class=\"col-12 col-md-6\">\n\t\t\t\n\n<figure data-wp-context=\"{&quot;imageId&quot;:&quot;6a2a1f775eead&quot;}\" data-wp-interactive=\"core\/image\" data-wp-key=\"6a2a1f775eead\" class=\"wp-block-image alignleft size-large is-resized wp-lightbox-container\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"576\" data-wp-class--hide=\"state.isContentHidden\" data-wp-class--show=\"state.isContentVisible\" data-wp-init=\"callbacks.setButtonStyles\" data-wp-on--click=\"actions.showLightbox\" data-wp-on--load=\"callbacks.setButtonStyles\" data-wp-on-window--resize=\"callbacks.setButtonStyles\" src=\"https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Netstar-Needs-1024x576.png\" alt=\"Title bar: Problem: Industrial Relevance and Novelty\nLeft: List with vertical NetSTAR Needs: and the following extending to the right: 1. Develop accurate trustworthy Multimodal AI URL filtering for dynamic contents\n2. Demand for multimodal representation learning\n3. Multilingual small datasets\n4. Demand for human in loop methods\n5. Data privacy\nRight: SMILES Lab with bubbles sticking out to the left, from top, 1. Neuro-symbolic AI for Diverse Contents\n2. Multimodal Learning\n3. Knowledge Infusion\n4. Multilingual \nRepresentation Learning\n5. Federated Learning\" class=\"wp-image-2146\" style=\"width:454px;height:auto\" srcset=\"https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Netstar-Needs-1024x576.png 1024w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Netstar-Needs-300x169.png 300w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Netstar-Needs-768x432.png 768w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Netstar-Needs-1536x864.png 1536w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Netstar-Needs.png 1920w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><button\n\t\t\tclass=\"lightbox-trigger\"\n\t\t\ttype=\"button\"\n\t\t\taria-haspopup=\"dialog\"\n\t\t\taria-label=\"Enlarge\"\n\t\t\tdata-wp-init=\"callbacks.initTriggerButton\"\n\t\t\tdata-wp-on--click=\"actions.showLightbox\"\n\t\t\tdata-wp-style--right=\"state.imageButtonRight\"\n\t\t\tdata-wp-style--top=\"state.imageButtonTop\"\n\t\t>\n\t\t\t<svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"12\" height=\"12\" fill=\"none\" viewBox=\"0 0 12 12\">\n\t\t\t\t<path fill=\"#fff\" d=\"M2 0a2 2 0 0 0-2 2v2h1.5V2a.5.5 0 0 1 .5-.5h2V0H2Zm2 10.5H2a.5.5 0 0 1-.5-.5V8H0v2a2 2 0 0 0 2 2h2v-1.5ZM8 12v-1.5h2a.5.5 0 0 0 .5-.5V8H12v2a2 2 0 0 1-2 2H8Zm2-12a2 2 0 0 1 2 2v2h-1.5V2a.5.5 0 0 0-.5-.5H8V0h2Z\" \/>\n\t\t\t<\/svg>\n\t\t<\/button><\/figure>\n\n\t<\/div>\n\n\n\n<div class=\"col-12 col-md-6\">\n\t\t\t\n\n<p>Companies today need these solutions to have multilingual capabilities and protect the data privacy of their employees. To meet these challenges requires a reliable solution that can effectively classify the URLs into correct classes.<\/p>\n\n\n\n<p>To meet these needs, UM-Flint has partnered with leading Japanese URL Filtering company, Netstar Inc., to develop a machine learning-based solution. The team consists of multiple PhD and postdoc students of Secure Modeling and Intelligent Learning in Engineering System (SMILES) Lab and employees of Netstar.<\/p>\n\n\t<\/div>\n\n<\/div>\n\n\n\n<p>Students involved in this project will learn advanced techniques of Natural Language Processing, multilingual content processing, and development of knowledge graphs. They will gain experience with neurosymbolic and multimodal AI that is explainable and offers reasoning. They will also have opportunities to gain the many soft skills required for collaboration with a global corporation.<\/p>\n\n\n\n<hr class=\"wp-block-separator has-text-color has-secondary-color has-alpha-channel-opacity has-secondary-background-color has-background mt-5 mb-5\"\/>\n\n\n\n<h2 class=\"wp-block-heading has-primary-color has-text-color has-link-color wp-elements-857f9eff6680d41d8faf0948d7780081\" id=\"KnowledgeGraphs\">Automated Neuro Knowledge Graph Curation<\/h2>\n\n\n\n<p>To develop Neurosymbolic AI systems, it\u2019s essential to have knowledge graphs that represent all the entities of the domains and the relationships between them.<\/p>\n\n\n\n<p>The rapid growth of Knowledge Graphs (KG) in recent years has been indicative of a resurgence in knowledge engineering. The use of KGs in the published literature to distill usable information that neuro-symbolic models and expert-based systems could use is one of the most promising approaches to the data consumption problem; and also, it provides more explanations for AI techniques such as machine learning and deep learning<\/p>\n\n\n\n<p>Most companies today recognize that data is their most valuable asset, but it can come in many different forms and formats. Making that data usable for ML and AI tools is challenging. Currently, knowledge graph creation and curation are mostly manual or somewhat semi-automated, and thus it is a labor-intensive process. In many cases, this manual process takes a person with a high level of expertise away from investing that time in the core product or scientific work they could be doing.<\/p>\n\n\n<div class=\"wp-bootstrap-blocks-row row\">\n\t\n\n<div class=\"col-12 col-md-6\">\n\t\t\t\n\n<p>The automated curation of knowledge graphs from voluminous unstructured data can extract actionable information that is machine-readable and can potentially help knowledge discovery from Big data. To get actionable information, it\u2019s necessary to identify sources and meanings of and relationships between entities of the given domains.<\/p>\n\n\n\n<p>Furthermore, automatically extracting reliable and consistent knowledge particularly from structured and unstructured sources at scale is a formidable challenge. Very few attempts have been made on the automated construction of health knowledge graphs. The ones that have been tried limited their focus to the creation of triplets by having only one type of relationship.<\/p>\n\n\t<\/div>\n\n\n\n<div class=\"col-12 col-md-6\">\n\t\t\t\n\n<figure data-wp-context=\"{&quot;imageId&quot;:&quot;6a2a1f775f5e5&quot;}\" data-wp-interactive=\"core\/image\" data-wp-key=\"6a2a1f775f5e5\" class=\"wp-block-image alignright size-large is-resized wp-lightbox-container\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"576\" data-wp-class--hide=\"state.isContentHidden\" data-wp-class--show=\"state.isContentVisible\" data-wp-init=\"callbacks.setButtonStyles\" data-wp-on--click=\"actions.showLightbox\" data-wp-on--load=\"callbacks.setButtonStyles\" data-wp-on-window--resize=\"callbacks.setButtonStyles\" src=\"https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Knowledge-Graph-Framework-1024x576.png\" alt=\"Title: Automated Knowledge Graph Curation Framework\nConceptual view\nThree bubbles to left, each with arrows pointing to right, leading to a large bubble with three interconnected bubbles inside. \nFrom Left: Blue. Document icon. Text Preprocessing, Tokenization, Normalization, Tagging\nBlue-green, Cluster icon, Categorization, clustering.\nGreen-blue, family tree icon, Classification, PICO.\nLarge, light-green circle labeled Knowledge Modeling.\nThree green circles. Top-left, checklist icon, Concept Extraction, OBIE. arrow to top-right, cluster icon, Relationship Extraction, BioBERT, CNN-BiLSTM. Arrow down to third circle, KG Generation, Extract Triples\nBottom left has Legend of Abbreviations: PICO - Patient\/Population, Intervention, Comparison and Outcomes. OBIE - Ontology Based Information Extraction, BioBERT - Biomedical BERT\" class=\"wp-image-2154\" style=\"width:510px;height:auto\" srcset=\"https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Knowledge-Graph-Framework-1024x576.png 1024w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Knowledge-Graph-Framework-300x169.png 300w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Knowledge-Graph-Framework-768x432.png 768w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Knowledge-Graph-Framework-1536x864.png 1536w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Knowledge-Graph-Framework.png 1920w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><button\n\t\t\tclass=\"lightbox-trigger\"\n\t\t\ttype=\"button\"\n\t\t\taria-haspopup=\"dialog\"\n\t\t\taria-label=\"Enlarge\"\n\t\t\tdata-wp-init=\"callbacks.initTriggerButton\"\n\t\t\tdata-wp-on--click=\"actions.showLightbox\"\n\t\t\tdata-wp-style--right=\"state.imageButtonRight\"\n\t\t\tdata-wp-style--top=\"state.imageButtonTop\"\n\t\t>\n\t\t\t<svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"12\" height=\"12\" fill=\"none\" viewBox=\"0 0 12 12\">\n\t\t\t\t<path fill=\"#fff\" d=\"M2 0a2 2 0 0 0-2 2v2h1.5V2a.5.5 0 0 1 .5-.5h2V0H2Zm2 10.5H2a.5.5 0 0 1-.5-.5V8H0v2a2 2 0 0 0 2 2h2v-1.5ZM8 12v-1.5h2a.5.5 0 0 0 .5-.5V8H12v2a2 2 0 0 1-2 2H8Zm2-12a2 2 0 0 1 2 2v2h-1.5V2a.5.5 0 0 0-.5-.5H8V0h2Z\" \/>\n\t\t\t<\/svg>\n\t\t<\/button><\/figure>\n\n\t<\/div>\n\n<\/div>\n\n\n\n<figure data-wp-context=\"{&quot;imageId&quot;:&quot;6a2a1f775fa04&quot;}\" data-wp-interactive=\"core\/image\" data-wp-key=\"6a2a1f775fa04\" class=\"wp-block-image alignright size-large is-resized wp-lightbox-container\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"576\" data-wp-class--hide=\"state.isContentHidden\" data-wp-class--show=\"state.isContentVisible\" data-wp-init=\"callbacks.setButtonStyles\" data-wp-on--click=\"actions.showLightbox\" data-wp-on--load=\"callbacks.setButtonStyles\" data-wp-on-window--resize=\"callbacks.setButtonStyles\" src=\"https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Knowledge-Graph-Functional-View-1024x576.png\" alt=\"Automated Knowledge Graph Curation Framework.\nFunctional View\nBelow this is the following list:\nData Preprocessing\nClustering - Neuro-Symbolic \nPICO Classification \nRelationship Extractor\nKnowledge Graph Generator\nTo the right is a complex diagram with four boxes on top and one below all of them. Across the top, from left, Data Preprocessing, includes Dataset, Text preprocessing bubble including Sentence Detection, Tokenization, Cleaning, and Lematization. Leads to box two, Neuro Symbolic Clustering, which has tree vertical boxes labelled Generate training data, Cluster Model, and Knowledge Infusion. Each of these has a newspage icon as part of an arrow pointing toward the four boxes in Section three (Cluster model has two coming off)\nBox three is labeled PICO classifier and each of the four boxes within show that each cluster feeds through a P, I, C, and O Classification process.\nThese four boxes have arrows that converge to one large server icon with some classification symbols in it. \nThat server icon is one of three elements in box four, labeled Relationship extractor and it points toward each of the other two elements, One is Tax. RE, which has Concept Mapping to Semantic Groups, Semantic Group Identification, and Relationship Extraction parts in it. The last element in the fourth box is Non-tax. RE, which takes the same clusters and leads them through Pairs Creation, Paired Relationships Detection, then Pair Relationship Identification. These final parts of box four converge with an arrow down to the bottom section of the image, which has four boxes leading from bottom right to the left. the first is labeled Triple Extractions and includes Tax. RE Triples, Concept-Cluster-Concept, Concept-Topic-Concept, Concept-PICO-Concept, and Concept-Relation-Concept. \nAn arrow leads left to a cluster relationship image titled Initial KG Generation. an arrow leads over to KG Completion, which has an additional arrow between the concept and the relationship items, This leads to a final image labeled Ambiguity Removal with fewer arrows between elements. This bottom box is titled KG Fusion.\" class=\"wp-image-2153\" style=\"width:446px;height:auto\" srcset=\"https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Knowledge-Graph-Functional-View-1024x576.png 1024w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Knowledge-Graph-Functional-View-300x169.png 300w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Knowledge-Graph-Functional-View-768x432.png 768w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Knowledge-Graph-Functional-View-1536x864.png 1536w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Knowledge-Graph-Functional-View.png 1920w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><button\n\t\t\tclass=\"lightbox-trigger\"\n\t\t\ttype=\"button\"\n\t\t\taria-haspopup=\"dialog\"\n\t\t\taria-label=\"Enlarge\"\n\t\t\tdata-wp-init=\"callbacks.initTriggerButton\"\n\t\t\tdata-wp-on--click=\"actions.showLightbox\"\n\t\t\tdata-wp-style--right=\"state.imageButtonRight\"\n\t\t\tdata-wp-style--top=\"state.imageButtonTop\"\n\t\t>\n\t\t\t<svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"12\" height=\"12\" fill=\"none\" viewBox=\"0 0 12 12\">\n\t\t\t\t<path fill=\"#fff\" d=\"M2 0a2 2 0 0 0-2 2v2h1.5V2a.5.5 0 0 1 .5-.5h2V0H2Zm2 10.5H2a.5.5 0 0 1-.5-.5V8H0v2a2 2 0 0 0 2 2h2v-1.5ZM8 12v-1.5h2a.5.5 0 0 0 .5-.5V8H12v2a2 2 0 0 1-2 2H8Zm2-12a2 2 0 0 1 2 2v2h-1.5V2a.5.5 0 0 0-.5-.5H8V0h2Z\" \/>\n\t\t\t<\/svg>\n\t\t<\/button><\/figure>\n\n\n\n<p>Traditional models do not consider semantic, correlative, and causal relationships among domain concepts in knowledge graphs. None of the existing approaches have focused on building hierarchical relationships among extracted concepts. Additionally, concept extraction using either word embedding, or ontology-based information extraction does not give reliable accuracy, and this also affects the accuracy of relationship extraction. Lastly, efforts have not been made to develop predictive knowledge that should be interpretable to both machines and humans to enable true symbiotic human-machine and machine-machine interactions.<\/p>\n\n\n\n<p>This project attempts to solve the above-mentioned challenges by proposing an automated domain-specific knowledge graph construction by making use of structured and unstructured data. This process is being repeated across multiple industries in<strong> <\/strong>the <a href=\"#DeepFake\" target=\"_blank\" rel=\"noreferrer noopener\">Deepfake Detector MVP<\/a>, <a href=\"#Aneurysm\" target=\"_blank\" rel=\"noreferrer noopener\">NeuroassistAI<\/a>, and <a href=\"#WebFiltering\" target=\"_blank\" rel=\"noreferrer noopener\">Netstar AI-based web filtering<\/a> projects.<\/p>\n\n\n\n<hr class=\"wp-block-separator has-text-color has-secondary-color has-alpha-channel-opacity has-secondary-background-color has-background mt-5 mb-5\"\/>\n\n\n\n<h2 class=\"wp-block-heading has-primary-color has-text-color has-link-color wp-elements-8da84c84c6dfa328c704bb5a18552163\" id=\"DigitalTwins\">Automotive Cybersecurity Education<\/h2>\n\n\n\n<div class=\"wp-block-cover h-auto mt-3 mb-3\"><img loading=\"lazy\" decoding=\"async\" width=\"2560\" height=\"1700\" class=\"wp-block-cover__image-background wp-image-2200\" alt=\"\" src=\"https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/White-BG.jpg\" data-object-fit=\"cover\" srcset=\"https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/White-BG.jpg 2560w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/White-BG-300x199.jpg 300w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/White-BG-1024x680.jpg 1024w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/White-BG-768x510.jpg 768w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/White-BG-1536x1020.jpg 1536w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/White-BG-2048x1360.jpg 2048w\" sizes=\"auto, (max-width: 2560px) 100vw, 2560px\" \/><span aria-hidden=\"true\" class=\"wp-block-cover__background has-background-dim-0 has-background-dim\"><\/span><div class=\"wp-block-cover__inner-container has-global-padding is-layout-constrained wp-block-cover-is-layout-constrained\">\n<p class=\"has-text-align-center has-large-font-size\"><\/p>\n\n\n<div class=\"wp-bootstrap-blocks-row row\">\n\t\n\n<div class=\"col-12 col-md-4\">\n\t\t\t\t<\/div>\n\n\n\n<div class=\"col-12 col-md-4\">\n\t\t\t\n\n<figure class=\"wp-block-image aligncenter size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"246\" height=\"202\" src=\"https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/SMILE-Lab-logo.png\" alt=\"SMILES Lab logo\" class=\"wp-image-2199\" style=\"width:177px;height:auto\"\/><\/figure>\n\n\t<\/div>\n\n\n\n<div class=\"col-12 col-md-4\">\n\t\t\t\t<\/div>\n\n<\/div>\n\n\n\n<div class=\"wp-block-cover h-auto mb-3 mt-3\" style=\"min-height:50px;aspect-ratio:unset;\"><img loading=\"lazy\" decoding=\"async\" width=\"2889\" height=\"244\" class=\"wp-block-cover__image-background wp-image-2197\" alt=\"\" src=\"https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Dk-to-Lt-Blue-Gradient-1.png\" data-object-fit=\"cover\" srcset=\"https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Dk-to-Lt-Blue-Gradient-1.png 2889w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Dk-to-Lt-Blue-Gradient-1-300x25.png 300w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Dk-to-Lt-Blue-Gradient-1-1024x86.png 1024w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Dk-to-Lt-Blue-Gradient-1-768x65.png 768w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Dk-to-Lt-Blue-Gradient-1-1536x130.png 1536w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/Dk-to-Lt-Blue-Gradient-1-2048x173.png 2048w\" sizes=\"auto, (max-width: 2889px) 100vw, 2889px\" \/><span aria-hidden=\"true\" class=\"wp-block-cover__background has-background-dim-0 has-background-dim\"><\/span><div class=\"wp-block-cover__inner-container has-global-padding is-layout-constrained wp-block-cover-is-layout-constrained\"><div class=\"wp-bootstrap-blocks-container container mb-2\">\n\t\n<div class=\"wp-bootstrap-blocks-container container mb-2\">\n\t\n\n<h2 class=\"wp-block-heading has-text-align-left has-large-font-size\">Integrity Verification of Vehicle&#8217;s sensor <br>using Digital Twin and Multimodal AI<\/h2>\n\n<\/div>\n\n<\/div>\n<\/div><\/div>\n\n\n<div class=\"wp-bootstrap-blocks-row row\">\n\t\n\n<div class=\"col-12 col-md-2\">\n\t\t\t\t<\/div>\n\n\n\n<div class=\"col-12 col-md-8\">\n\t\t\t\n\n<p class=\"has-text-align-center has-primary-color has-text-color has-link-color wp-elements-f7778893b5aba30e6866f7a8c6cf93bf\"><strong><em>Secure Modeling and Intelligent Learning in Engineering Systems Lab<\/em><\/strong><\/p>\n\n\n\n<hr class=\"wp-block-separator has-text-color has-primary-color has-alpha-channel-opacity has-primary-background-color has-background mt-0\"\/>\n\n\t<\/div>\n\n\n\n<div class=\"col-12 col-md-2\">\n\t\t\t\t<\/div>\n\n<\/div>\n<\/div><\/div>\n\n\n<div class=\"wp-bootstrap-blocks-row row\">\n\t\n\n<div class=\"col-12 col-md-6\">\n\t\t\t\n\n<figure data-wp-context=\"{&quot;imageId&quot;:&quot;6a2a1f77605ce&quot;}\" data-wp-interactive=\"core\/image\" data-wp-key=\"6a2a1f77605ce\" class=\"wp-block-image aligncenter size-large is-resized inline-image-paragraph-right wp-lightbox-container\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"590\" data-wp-class--hide=\"state.isContentHidden\" data-wp-class--show=\"state.isContentVisible\" data-wp-init=\"callbacks.setButtonStyles\" data-wp-on--click=\"actions.showLightbox\" data-wp-on--load=\"callbacks.setButtonStyles\" data-wp-on-window--resize=\"callbacks.setButtonStyles\" src=\"https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/DTwins-image_2-1024x590.png\" alt=\"Top Center: Sensing layer and signal icon surrounded by two arrows pointing inward\nChat icon and Feedback layer surrounded by two arrows pointing outward. A real-looking vehicle is on left, a sketched vehicle is on right. They are pointing inward. Above the left vehicle is Physical space and Physical input is to the left with an arrow pointing at the vehicle. Beneath this car is a box. Systems - four icons, labeled In Vehicle Network, Sensors, External Network, and Driving Systems. The car on the right says digital space above and network input to the right with an arrow pointing towards it. The box below says Modules. there iis a computer-with-brain icon labelled Perceptive Cognitive Layer between the two boxes and pointing at this Modules box. All four icons are repeated in this box with the addition of a fifth icon representing two gears and arrows completing a circuit between them. to the right is an icon of a person with an arrow pointing towards the Modules box labeled Cybersecurity SME.\" class=\"wp-image-2220\" style=\"width:448px;height:auto\" srcset=\"https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/DTwins-image_2-1024x590.png 1024w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/DTwins-image_2-300x173.png 300w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/DTwins-image_2-768x443.png 768w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/DTwins-image_2-1536x885.png 1536w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/DTwins-image_2.png 1567w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><button\n\t\t\tclass=\"lightbox-trigger\"\n\t\t\ttype=\"button\"\n\t\t\taria-haspopup=\"dialog\"\n\t\t\taria-label=\"Enlarge\"\n\t\t\tdata-wp-init=\"callbacks.initTriggerButton\"\n\t\t\tdata-wp-on--click=\"actions.showLightbox\"\n\t\t\tdata-wp-style--right=\"state.imageButtonRight\"\n\t\t\tdata-wp-style--top=\"state.imageButtonTop\"\n\t\t>\n\t\t\t<svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"12\" height=\"12\" fill=\"none\" viewBox=\"0 0 12 12\">\n\t\t\t\t<path fill=\"#fff\" d=\"M2 0a2 2 0 0 0-2 2v2h1.5V2a.5.5 0 0 1 .5-.5h2V0H2Zm2 10.5H2a.5.5 0 0 1-.5-.5V8H0v2a2 2 0 0 0 2 2h2v-1.5ZM8 12v-1.5h2a.5.5 0 0 0 .5-.5V8H12v2a2 2 0 0 1-2 2H8Zm2-12a2 2 0 0 1 2 2v2h-1.5V2a.5.5 0 0 0-.5-.5H8V0h2Z\" \/>\n\t\t\t<\/svg>\n\t\t<\/button><\/figure>\n\n\t<\/div>\n\n\n\n<div class=\"col-12 col-md-6\">\n\t\t\t\n\n<p>Training and recruiting cybersecurity is one of the most pressing issues in workforce development today. The global <a href=\"https:\/\/www.theiet.org\/\" target=\"_blank\" rel=\"noreferrer noopener\">Institution of Engineering and Technology<\/a> has released <a href=\"https:\/\/www.theiet.org\/media\/10449\/automotive-cyber-security.pdf\" target=\"_blank\" rel=\"noreferrer noopener\">Automotive Cyber Security<\/a>, a thought leadership review of risk perspectives for connected vehicles, which explains that our trajectory toward more connected vehicles has greatly increased the need for cybersecurity professionals in the automotive industry.<\/p>\n\n\t<\/div>\n\n<\/div>\n\n\n\n<p>Filling those roles has a challenge, though: the learning curve. Cybersecurity education as it\u2019s done today can be a little dry and theoretical, making it seem more inaccessible than it actually is, but it doesn\u2019t have to be that way.<\/p>\n\n\n<div class=\"wp-bootstrap-blocks-row row\">\n\t\n\n<div class=\"col-12 col-md-6\">\n\t\t\t\n\n<figure data-wp-context=\"{&quot;imageId&quot;:&quot;6a2a1f7760ae8&quot;}\" data-wp-interactive=\"core\/image\" data-wp-key=\"6a2a1f7760ae8\" class=\"wp-block-image alignleft size-large is-resized inline-image-paragraph-right wp-lightbox-container\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"576\" data-wp-class--hide=\"state.isContentHidden\" data-wp-class--show=\"state.isContentVisible\" data-wp-init=\"callbacks.setButtonStyles\" data-wp-on--click=\"actions.showLightbox\" data-wp-on--load=\"callbacks.setButtonStyles\" data-wp-on-window--resize=\"callbacks.setButtonStyles\" src=\"https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/DTwins-Map-1024x576.png\" alt=\"Top center, a cloud icon with nodes coming out is labeled Cloud-based Interconnection. Three boxes below. Left: Physical Input, Real car, sensor icon, steering wheel icon, and four wheel drivetrain icon. Image of dash view and Physical Experience label.\nArrow points to middle box: Digital Twins, ghost car, gear-circuit icon, car w\/ nodes icon, and graph icon, image of virtual dashboard labelled twin module.\nArrow to box on right with hacker \/ cybersecurity expert icon below. Box on right is labelled, AR\/VR Gaming Engine - car that looks between real and digital, three icons representing 360 vr, Image shows and is labeled VR User Experience.\" class=\"wp-image-2144\" style=\"width:448px\" srcset=\"https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/DTwins-Map-1024x576.png 1024w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/DTwins-Map-300x169.png 300w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/DTwins-Map-768x432.png 768w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/DTwins-Map-1536x864.png 1536w, https:\/\/www-s3.umflint.edu\/wp\/blogs.dir\/10\/files\/2024\/02\/DTwins-Map.png 1920w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><button\n\t\t\tclass=\"lightbox-trigger\"\n\t\t\ttype=\"button\"\n\t\t\taria-haspopup=\"dialog\"\n\t\t\taria-label=\"Enlarge\"\n\t\t\tdata-wp-init=\"callbacks.initTriggerButton\"\n\t\t\tdata-wp-on--click=\"actions.showLightbox\"\n\t\t\tdata-wp-style--right=\"state.imageButtonRight\"\n\t\t\tdata-wp-style--top=\"state.imageButtonTop\"\n\t\t>\n\t\t\t<svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"12\" height=\"12\" fill=\"none\" viewBox=\"0 0 12 12\">\n\t\t\t\t<path fill=\"#fff\" d=\"M2 0a2 2 0 0 0-2 2v2h1.5V2a.5.5 0 0 1 .5-.5h2V0H2Zm2 10.5H2a.5.5 0 0 1-.5-.5V8H0v2a2 2 0 0 0 2 2h2v-1.5ZM8 12v-1.5h2a.5.5 0 0 0 .5-.5V8H12v2a2 2 0 0 1-2 2H8Zm2-12a2 2 0 0 1 2 2v2h-1.5V2a.5.5 0 0 0-.5-.5H8V0h2Z\" \/>\n\t\t\t<\/svg>\n\t\t<\/button><\/figure>\n\n\t<\/div>\n\n\n\n<div class=\"col-12 col-md-6\">\n\t\t\t\n\n<p>Our research group is developing various tools such as virtual \u2018digital twins\u2019 and a visual question-answer system to teach the complexity of interdisciplinary subjects such as cybersecurity in automobiles. This process will enable students to have a VR experience of the complex ways that IoT sensors, the driving systems, and the networks of systems and software in and out of the vehicle interact in a physical vehicle.<\/p>\n\n\t<\/div>\n\n<\/div>\n\n\n\n<p>In summary, using neuro symbolic logic, AI and the flipped classroom, we\u2019re working to redesign classes from the ground up, starting with a new offering in automotive cybersecurity. The class will feature hands-on exercises on the digital twin of a real car system and will also offer 24\/7 assistance with a chatbot based on a large language model like chatGPT.<\/p>\n\n<\/div>\n<\/div><\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p> [&#8230;]<\/p>\n<p><a class=\"btn btn-secondary understrap-read-more-link\" href=\"https:\/\/www.umflint.edu\/cit\/research\/smiles\/\">Read More&#8230;<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"parent":1198,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_acf_changed":false,"footnotes":""},"class_list":["post-1906","page","type-page","status-publish","hentry"],"acf":[],"_links":{"self":[{"href":"https:\/\/www.umflint.edu\/cit\/wp-json\/wp\/v2\/pages\/1906","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.umflint.edu\/cit\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/www.umflint.edu\/cit\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/www.umflint.edu\/cit\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.umflint.edu\/cit\/wp-json\/wp\/v2\/comments?post=1906"}],"version-history":[{"count":23,"href":"https:\/\/www.umflint.edu\/cit\/wp-json\/wp\/v2\/pages\/1906\/revisions"}],"predecessor-version":[{"id":4093,"href":"https:\/\/www.umflint.edu\/cit\/wp-json\/wp\/v2\/pages\/1906\/revisions\/4093"}],"up":[{"embeddable":true,"href":"https:\/\/www.umflint.edu\/cit\/wp-json\/wp\/v2\/pages\/1198"}],"wp:attachment":[{"href":"https:\/\/www.umflint.edu\/cit\/wp-json\/wp\/v2\/media?parent=1906"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}