3 questions with George Karypis: Making learning from data embedded in graphs easy and scalable

{"value":"\n\nGeorge Karypis is a Distinguished McKnight University Professor at the University of Minnesota Twin Cities, an Amazon Web Services senior principal scientist, and an Amazon Scholar.\n\nThe first [Amazon Web Services (Amazon Web Services) Machine Learning Summit](https://www.amazon.science/latest-news/amazon-web-services-to-hold-machine-learning-summit) on June 2 will bring together customers, developers, and the science community to learn about advances in the practice of machine learning (ML). The event, which is free to attend, will feature four audience-focused tracks, including Science of Machine Learning.\n\nThe science track is focused on the data science and advanced practitioner audience and will highlight the work Amazon Web Services and Amazon scientists are doing to advance machine learning. The track will comprise six sessions, each lasting 30 minutes, and a 45-minute fireside chat.\n\nAmazon Science is [featuring ](https://www.amazon.science/latest-news/3-questions-with-ryan-tibshirani-the-science-behind-covidcast-and-pandemic-tracking)[interviews ](https://www.amazon.science/latest-news/3-questions-with-marzia-polito-performing-computer-vision-tasks-at-scale-with-few-shot-learning)[with ](https://www.amazon.science/latest-news/3-questions-with-michael-kearns-designing-socially-aware-algorithms-and-models)[speakers ](https://www.amazon.science/latest-news/3-questions-with-philip-resnik-analyzing-social-media-to-understand-the-risks-of-suicide)[from ](https://www.amazon.science/latest-news/3-questions-with-kathleen-mckeown-controlling-model-hallucinations-in-natural-language-generation)the Science of Machine Learning track\n\nFor the sixth and final edition of the series, we spoke to [George Karypis](https://www.amazon.science/author/george-karypis). Karypis is a Distinguished McKnight University Professor at the University of Minnesota Twin Cities and an Amazon Web Services senior principal scientist. During the course of his career, Karypis’ research has focused on developing novel algorithms in the fields of data mining, recommender systems, learning analytics, high-performance computing, information retrieval, and bioinformatics. Karypis is also an Amazon Scholar, a group of academics that work on large-scale technical challenges while continuing to teach and conduct research at their universities.\n\n\n#### **Q. What is the subject of your talk going to be at the ML Summit?**\n\n\nI am going to talk about how deep graph neural networks (GNNs) are used to develop machine learning models for solving problems on domains where the underlying data is represented through graphs.\n\n<video src=\"https://dev-media.amazoncloud.cn/d23d8a7cba114595be52c0bfc01909e4_Learning%20Graph%20Neural%20Networks%20with%20Deep%20Graph%20Library%20%EF%BC%8D%20www2020%20tutorial.mp4\" class=\"manvaVedio\" controls=\"controls\" style=\"width:160px;height:160px\"></video>\n\n#### **Learning graph with neural networks - The Web Conference 2020**\n\n\nThe adoption of GNNs has exploded in recent years, as data scientists move from developing deep learning models for two-dimensional signals, such as images, and three-dimensional images, such as video, to learning from structured and related data embedded in graphs.\n\nAt Amazon, my team has been working on the [Deep Graph Library](https://www.amazon.science/videos-webinars/learning-graph-neural-networks-with-deep-graph-library) (DGL), an easy-to-use, high-performance and scalable Python package for deep learning on graphs. DGL is a framework that allows developers to program graph neural networks. DGL supplements existing tensor-based frameworks such as Tensorflow, PyTorch, and MXNet. During my talk, I’m going to talk about how DGL can be used to make the development, training, and use of GNNs easy and scalable.\n\n\n#### **Q. Why is this topic especially relevant within the science community today?**\n\n\n#### **There are a variety of problems for which we can develop accurate machine learning solutions by leveraging the linked data that is inherent to graphs.**\n\n\nGeorge Karypis\n\nGNNs are used in a number of fields today. For example, they play an increasingly important role in social networks, where graphs show connections among related people.\n\nWe have organizations like Marinus Analytics using GNNs to [help victims of human trafficking](https://www.amazon.science/latest-news/how-marinus-analytics-uses-knowledge-graphs-powered-by-aws-neptune-to-combat-human-trafficking). In the medical field, GNNs are playing an increasingly important role in finding [candidate drugs for new diseases](https://www.amazon.science/research-awards/success-stories/michael-bronstein-aims-to-unite-the-deep-learning-community). At Amazon, they are used to develop recommender systems, build mechanisms for fraud and abuse detection, and develop Alexa's conversational capabilities, among other applications.\n\nThere are a variety of problems for which we can develop accurate machine learning solutions by leveraging the linked data that is inherent to graphs.\n\nGNNs are increasingly delivering state-of-the-art results in graph learning on a wide-range of domains. They are now one of the most actively researched areas in deep learning, even as we transition from academic and industrial research to actively powering products and services.\n\n\n#### **Q. What are some breakthroughs in the world of GNN development that are particularly exciting to you?**\n\n\n#### **I’m excited about the development of both new algorithms and infrastructure that will help us scale the training of GNNs.**\n\n\nGeorge Karypis\n\nI’m excited about the development of both new algorithms and infrastructure that will help us scale the training of GNNs.\n\nThis is particularly important for deploying GNNs in real-world applications, where graphs can be very large — to give just one example, a social network can contain millions of nodes (or users) and billions of links.\n\nWhen it comes to being able to tackle large graphs, the development of large-scale benchmarks allows us to zero in on viable architectures and validate approaches that can be scaled for more complex datasets.\n\nIn addition, the development of hardware accelerators for GNN workloads are going to be instrumental in allowing us to harness the power of machine learning to solve problems with graph-structured inputs.\n\n(*You can learn more about George Karypis’s research [here ](http://scholar.google.com/citations?user=ElqwScwAAAAJ&hl=en)and watch his free talk at the virtual Amazon Web Services Machine Learning Summit on June 2 by registering at the link below*).\n\nABOUT THE AUTHOR\n\n#### **Staff writer**","render":"<p><img src=\"1\" alt=\"image.png\" /></p>\n<p>George Karypis is a Distinguished McKnight University Professor at the University of Minnesota Twin Cities, an Amazon Web Services senior principal scientist, and an Amazon Scholar.</p>\n<p>The first <a href=\"https://www.amazon.science/latest-news/amazon-web-services-to-hold-machine-learning-summit\" target=\"_blank\">Amazon Web Services (Amazon Web Services) Machine Learning Summit</a> on June 2 will bring together customers, developers, and the science community to learn about advances in the practice of machine learning (ML). The event, which is free to attend, will feature four audience-focused tracks, including Science of Machine Learning.</p>\n<p>The science track is focused on the data science and advanced practitioner audience and will highlight the work Amazon Web Services and Amazon scientists are doing to advance machine learning. The track will comprise six sessions, each lasting 30 minutes, and a 45-minute fireside chat.</p>\n<p>Amazon Science is <a href=\"https://www.amazon.science/latest-news/3-questions-with-ryan-tibshirani-the-science-behind-covidcast-and-pandemic-tracking\" target=\"_blank\">featuring </a><a href=\"https://www.amazon.science/latest-news/3-questions-with-marzia-polito-performing-computer-vision-tasks-at-scale-with-few-shot-learning\" target=\"_blank\">interviews </a><a href=\"https://www.amazon.science/latest-news/3-questions-with-michael-kearns-designing-socially-aware-algorithms-and-models\" target=\"_blank\">with </a><a href=\"https://www.amazon.science/latest-news/3-questions-with-philip-resnik-analyzing-social-media-to-understand-the-risks-of-suicide\" target=\"_blank\">speakers </a><a href=\"https://www.amazon.science/latest-news/3-questions-with-kathleen-mckeown-controlling-model-hallucinations-in-natural-language-generation\" target=\"_blank\">from </a>the Science of Machine Learning track</p>\n<p>For the sixth and final edition of the series, we spoke to <a href=\"https://www.amazon.science/author/george-karypis\" target=\"_blank\">George Karypis</a>. Karypis is a Distinguished McKnight University Professor at the University of Minnesota Twin Cities and an Amazon Web Services senior principal scientist. During the course of his career, Karypis’ research has focused on developing novel algorithms in the fields of data mining, recommender systems, learning analytics, high-performance computing, information retrieval, and bioinformatics. Karypis is also an Amazon Scholar, a group of academics that work on large-scale technical challenges while continuing to teach and conduct research at their universities.</p>\n<h4><a id=\"Q_What_is_the_subject_of_your_talk_going_to_be_at_the_ML_Summit_13\"></a><strong>Q. What is the subject of your talk going to be at the ML Summit?</strong></h4>\n<p>I am going to talk about how deep graph neural networks (GNNs) are used to develop machine learning models for solving problems on domains where the underlying data is represented through graphs.</p>\n<p><video src=\"https://dev-media.amazoncloud.cn/d23d8a7cba114595be52c0bfc01909e4_Learning%20Graph%20Neural%20Networks%20with%20Deep%20Graph%20Library%20%EF%BC%8D%20www2020%20tutorial.mp4\" controls=\"controls\"></video></p>\n<h4><a id=\"Learning_graph_with_neural_networks__The_Web_Conference_2020_20\"></a><strong>Learning graph with neural networks - The Web Conference 2020</strong></h4>\n<p>The adoption of GNNs has exploded in recent years, as data scientists move from developing deep learning models for two-dimensional signals, such as images, and three-dimensional images, such as video, to learning from structured and related data embedded in graphs.</p>\n<p>At Amazon, my team has been working on the <a href=\"https://www.amazon.science/videos-webinars/learning-graph-neural-networks-with-deep-graph-library\" target=\"_blank\">Deep Graph Library</a> (DGL), an easy-to-use, high-performance and scalable Python package for deep learning on graphs. DGL is a framework that allows developers to program graph neural networks. DGL supplements existing tensor-based frameworks such as Tensorflow, PyTorch, and MXNet. During my talk, I’m going to talk about how DGL can be used to make the development, training, and use of GNNs easy and scalable.</p>\n<h4><a id=\"Q_Why_is_this_topic_especially_relevant_within_the_science_community_today_28\"></a><strong>Q. Why is this topic especially relevant within the science community today?</strong></h4>\n<h4><a id=\"There_are_a_variety_of_problems_for_which_we_can_develop_accurate_machine_learning_solutions_by_leveraging_the_linked_data_that_is_inherent_to_graphs_31\"></a><strong>There are a variety of problems for which we can develop accurate machine learning solutions by leveraging the linked data that is inherent to graphs.</strong></h4>\n<p>George Karypis</p>\n<p>GNNs are used in a number of fields today. For example, they play an increasingly important role in social networks, where graphs show connections among related people.</p>\n<p>We have organizations like Marinus Analytics using GNNs to <a href=\"https://www.amazon.science/latest-news/how-marinus-analytics-uses-knowledge-graphs-powered-by-aws-neptune-to-combat-human-trafficking\" target=\"_blank\">help victims of human trafficking</a>. In the medical field, GNNs are playing an increasingly important role in finding <a href=\"https://www.amazon.science/research-awards/success-stories/michael-bronstein-aims-to-unite-the-deep-learning-community\" target=\"_blank\">candidate drugs for new diseases</a>. At Amazon, they are used to develop recommender systems, build mechanisms for fraud and abuse detection, and develop Alexa’s conversational capabilities, among other applications.</p>\n<p>There are a variety of problems for which we can develop accurate machine learning solutions by leveraging the linked data that is inherent to graphs.</p>\n<p>GNNs are increasingly delivering state-of-the-art results in graph learning on a wide-range of domains. They are now one of the most actively researched areas in deep learning, even as we transition from academic and industrial research to actively powering products and services.</p>\n<h4><a id=\"Q_What_are_some_breakthroughs_in_the_world_of_GNN_development_that_are_particularly_exciting_to_you_45\"></a><strong>Q. What are some breakthroughs in the world of GNN development that are particularly exciting to you?</strong></h4>\n<h4><a id=\"Im_excited_about_the_development_of_both_new_algorithms_and_infrastructure_that_will_help_us_scale_the_training_of_GNNs_48\"></a><strong>I’m excited about the development of both new algorithms and infrastructure that will help us scale the training of GNNs.</strong></h4>\n<p>George Karypis</p>\n<p>I’m excited about the development of both new algorithms and infrastructure that will help us scale the training of GNNs.</p>\n<p>This is particularly important for deploying GNNs in real-world applications, where graphs can be very large — to give just one example, a social network can contain millions of nodes (or users) and billions of links.</p>\n<p>When it comes to being able to tackle large graphs, the development of large-scale benchmarks allows us to zero in on viable architectures and validate approaches that can be scaled for more complex datasets.</p>\n<p>In addition, the development of hardware accelerators for GNN workloads are going to be instrumental in allowing us to harness the power of machine learning to solve problems with graph-structured inputs.</p>\n<p>(<em>You can learn more about George Karypis’s research <a href=\"http://scholar.google.com/citations?user=ElqwScwAAAAJ&amp;hl=en\" target=\"_blank\">here </a>and watch his free talk at the virtual Amazon Web Services Machine Learning Summit on June 2 by registering at the link below</em>).</p>\n<p>ABOUT THE AUTHOR</p>\n<h4><a id=\"Staff_writer_65\"></a><strong>Staff writer</strong></h4>\n"}