MLSys 2021: Bridging the divide between machine learning and systems

{"value":"\n\nAlex Smola, Amazon vice president and distinguished scientist\n\nThe Conference on Machine Learning and Systems (++[MLSys](https://www.amazon.science/conferences-and-events/mlsys-2021)++), which starts next week, is only four years old, but Amazon scientists already have a rich history of involvement with it. Amazon Scholar ++[Michael I. Jordan](https://www.amazon.science/author/michael-i-jordan)++ is on the steering committee; vice president and distinguished scientist ++[Inderjit Dhillon](https://www.amazon.science/author/inderjit-s-dhillon)++ is on the board and was general chair last year; and vice president and distinguished scientist ++[Alex Smola](https://www.amazon.science/author/alex-smola)++, who is also on the steering committee, is this year’s general chair.\n\nAs the deep-learning revolution spread, MLSys was founded to bridge two communities that had much to offer each other but that were often working independently: machine learning researchers and system developers.\n\n“If you look at the big machine learning conferences, they mostly focus on, ‘Okay, here's a cool algorithm, and here are the amazing things that it can do. And by the way, it now recognizes cats even better than before,’” Smola says. “They're conferences where people mostly show an increase in capability. At the same time, there are systems conferences, and they mostly care about file systems, databases, high availability, fault tolerance, and all of that. \n\n\n#### **Conference registration still open**\n\n\nLearn more about Amazon’s involvement with ++[MLSys 2021](https://www.amazon.science/conferences-and-events/mlsys-2021)++, including paper presentations and workshop participation. Registration for the conference is ++[still open](https://mlsys.org/Register/view-registration)++, with the very low fees of \$25 for students and \$100 for academics and professionals.\n\n“Now, why do you need something in-between? Well, because quite often in machine learning, approximate is good enough. You don't necessarily need such good guarantees from your systems. If you lower the requirement, you can do things cheaper, faster, or more scalably.”\n\n\n#### **Sys for ML, ML for sys**\n\n\nAt the same time, as deep learning’s popularity grew, it was natural to ask whether it could help allocate resources in computer systems.\n\n“This is, ultimately, what a lot of systems papers do,” Smola says. “They are along the lines of, Should I start a machine? Should I end one? How many devices should I schedule for a job? When do I decide that a machine has failed? How much redundancy do I need? So you can ask yourself, Well, given that these are a lot of resource decisions, can I use machine learning to predict what an optimal or at least a better strategy will be to handle those resource decisions?”\n\n\n#### **Should I start a machine? Should I end one? How many devices should I schedule for a job? ... Can I use machine learning to predict what an optimal or at least a better strategy will be?**\n\n**Alex Smola**\n\n\nPapers accepted to MLSys, Smola explains, feature research in both directions — machine learning for systems and systems for machine learning. As an example, he pulls up the program listing for the conference session on Communication and Storage, on Tuesday, April 6.\n\n“This is very much a systems session,” Smola says. “But even there, it covers both directions. For instance, the paper ‘In-network aggregation for shared machine learning clusters’ is about how you can do operations cheaply to facilitate more machine learning. But another paper is about how to use machine learning to make those storage systems themselves better.”\n\n\n#### **Cultural fusion**\n\n\nMLSys doesn’t just represent a merger of research programs, Smola says; it also represents a merger of cultures — which can make for some lively discussion.\n\n“In the systems community, essentially, unless you actually have a working system, they won't take you seriously,” Smola says. “That makes the conference a little bit interesting, because you have two different cultures. You have the machine learning culture, where it's more like, ‘Hey, here is an impressionist painting of what could be. Next paper, please.’ And then the systems community, which is a lot more rigorous in terms of, ‘Well, here's something that actually works, and hey, we've demonstrated it. And by the way, maybe there's a product that's actually shipping now with it.’ And that makes the conference interesting, because those two cultures usually don't mix quite that much. And this maybe gives the systems papers a slightly more theoretical bent and the machine learning papers a slightly more empirical one.”\n\nAt this year’s MLSys, one of the additions that Smola oversaw is the introduction of a daylong Chips and Compilers Symposium, which brings the conversation about system design for machine learning down to the metal — the chip level. The symposium was organized by ++[Mu Li](https://www.amazon.science/author/mu-li)++, a senior principal scientist with Amazon Web Services.\n\n“There are events like ++[Hot Chips](https://hotchips.org/#hot-chips-33-virtual-aug-22-24-2021)++ and ++[Cool Chips](https://www.coolchips.org/2021/)++ where NVIDIA, Intel, AMD, ARM, and others show up and demonstrate the latest silicon,” Smola says. “But the silicon is only half the equation. So we figured this would be a good place to bring these two communities much more closely together. This is a community-building exercise.”\n\nLike all computer science conferences in the past year, MLSys has moved online. The advantage of that, Smola says, is that it has drastically reduced the price of registration — \$25 for students and \$100 for academics and professionals.\n\n“It's super affordable for anybody,” Smola says.\n\nABOUT THE AUTHOR\n\n#### **[Larry Hardesty](https://www.amazon.science/author/larry-hardesty)**\n\nLarry Hardesty is the editor of the Amazon Science blog. Previously, he was a senior editor at MIT Technology Review and the computer science writer at the MIT News Office.","render":"<p><img src=\\"https://dev-media.amazoncloud.cn/5918b5f724354b9aa74199023c5f01e7_image.png\\" alt=\\"image.png\\" /></p>\n<p>Alex Smola, Amazon vice president and distinguished scientist</p>\n<p>The Conference on Machine Learning and Systems (<ins><a href=\\"https://www.amazon.science/conferences-and-events/mlsys-2021\\" target=\\"_blank\\">MLSys</a></ins>), which starts next week, is only four years old, but Amazon scientists already have a rich history of involvement with it. Amazon Scholar <ins><a href=\\"https://www.amazon.science/author/michael-i-jordan\\" target=\\"_blank\\">Michael I. Jordan</a></ins> is on the steering committee; vice president and distinguished scientist <ins><a href=\\"https://www.amazon.science/author/inderjit-s-dhillon\\" target=\\"_blank\\">Inderjit Dhillon</a></ins> is on the board and was general chair last year; and vice president and distinguished scientist <ins><a href=\\"https://www.amazon.science/author/alex-smola\\" target=\\"_blank\\">Alex Smola</a></ins>, who is also on the steering committee, is this year’s general chair.</p>\n<p>As the deep-learning revolution spread, MLSys was founded to bridge two communities that had much to offer each other but that were often working independently: machine learning researchers and system developers.</p>\n<p>“If you look at the big machine learning conferences, they mostly focus on, ‘Okay, here’s a cool algorithm, and here are the amazing things that it can do. And by the way, it now recognizes cats even better than before,’” Smola says. “They’re conferences where people mostly show an increase in capability. At the same time, there are systems conferences, and they mostly care about file systems, databases, high availability, fault tolerance, and all of that.</p>\n<h4><a id=\\"Conference_registration_still_open_11\\"></a><strong>Conference registration still open</strong></h4>\\n<p>Learn more about Amazon’s involvement with <ins><a href=\\"https://www.amazon.science/conferences-and-events/mlsys-2021\\" target=\\"_blank\\">MLSys 2021</a></ins>, including paper presentations and workshop participation. Registration for the conference is <ins><a href=\\"https://mlsys.org/Register/view-registration\\" target=\\"_blank\\">still open</a></ins>, with the very low fees of \$25 for students and \$100 for academics and professionals.</p>\n<p>“Now, why do you need something in-between? Well, because quite often in machine learning, approximate is good enough. You don’t necessarily need such good guarantees from your systems. If you lower the requirement, you can do things cheaper, faster, or more scalably.”</p>\n<h4><a id=\\"Sys_for_ML_ML_for_sys_19\\"></a><strong>Sys for ML, ML for sys</strong></h4>\\n<p>At the same time, as deep learning’s popularity grew, it was natural to ask whether it could help allocate resources in computer systems.</p>\n<p>“This is, ultimately, what a lot of systems papers do,” Smola says. “They are along the lines of, Should I start a machine? Should I end one? How many devices should I schedule for a job? When do I decide that a machine has failed? How much redundancy do I need? So you can ask yourself, Well, given that these are a lot of resource decisions, can I use machine learning to predict what an optimal or at least a better strategy will be to handle those resource decisions?”</p>\n<h4><a id=\\"Should_I_start_a_machine_Should_I_end_one_How_many_devices_should_I_schedule_for_a_job__Can_I_use_machine_learning_to_predict_what_an_optimal_or_at_least_a_better_strategy_will_be_27\\"></a><strong>Should I start a machine? Should I end one? How many devices should I schedule for a job? … Can I use machine learning to predict what an optimal or at least a better strategy will be?</strong></h4>\\n<p><strong>Alex Smola</strong></p>\\n<p>Papers accepted to MLSys, Smola explains, feature research in both directions — machine learning for systems and systems for machine learning. As an example, he pulls up the program listing for the conference session on Communication and Storage, on Tuesday, April 6.</p>\n<p>“This is very much a systems session,” Smola says. “But even there, it covers both directions. For instance, the paper ‘In-network aggregation for shared machine learning clusters’ is about how you can do operations cheaply to facilitate more machine learning. But another paper is about how to use machine learning to make those storage systems themselves better.”</p>\n<h4><a id=\\"Cultural_fusion_37\\"></a><strong>Cultural fusion</strong></h4>\\n<p>MLSys doesn’t just represent a merger of research programs, Smola says; it also represents a merger of cultures — which can make for some lively discussion.</p>\n<p>“In the systems community, essentially, unless you actually have a working system, they won’t take you seriously,” Smola says. “That makes the conference a little bit interesting, because you have two different cultures. You have the machine learning culture, where it’s more like, ‘Hey, here is an impressionist painting of what could be. Next paper, please.’ And then the systems community, which is a lot more rigorous in terms of, ‘Well, here’s something that actually works, and hey, we’ve demonstrated it. And by the way, maybe there’s a product that’s actually shipping now with it.’ And that makes the conference interesting, because those two cultures usually don’t mix quite that much. And this maybe gives the systems papers a slightly more theoretical bent and the machine learning papers a slightly more empirical one.”</p>\n<p>At this year’s MLSys, one of the additions that Smola oversaw is the introduction of a daylong Chips and Compilers Symposium, which brings the conversation about system design for machine learning down to the metal — the chip level. The symposium was organized by <ins><a href=\\"https://www.amazon.science/author/mu-li\\" target=\\"_blank\\">Mu Li</a></ins>, a senior principal scientist with Amazon Web Services.</p>\n<p>“There are events like <ins><a href=\\"https://hotchips.org/#hot-chips-33-virtual-aug-22-24-2021\\" target=\\"_blank\\">Hot Chips</a></ins> and <ins><a href=\\"https://www.coolchips.org/2021/\\" target=\\"_blank\\">Cool Chips</a></ins> where NVIDIA, Intel, AMD, ARM, and others show up and demonstrate the latest silicon,” Smola says. “But the silicon is only half the equation. So we figured this would be a good place to bring these two communities much more closely together. This is a community-building exercise.”</p>\n<p>Like all computer science conferences in the past year, MLSys has moved online. The advantage of that, Smola says, is that it has drastically reduced the price of registration — \$25 for students and \$100 for academics and professionals.</p>\n<p>“It’s super affordable for anybody,” Smola says.</p>\n<p>ABOUT THE AUTHOR</p>\n<h4><a id=\\"Larry_Hardestyhttpswwwamazonscienceauthorlarryhardesty_54\\"></a><strong><a href=\\"https://www.amazon.science/author/larry-hardesty\\" target=\\"_blank\\">Larry Hardesty</a></strong></h4>\n<p>Larry Hardesty is the editor of the Amazon Science blog. Previously, he was a senior editor at MIT Technology Review and the computer science writer at the MIT News Office.</p>\n"}