The science behind visual ID

海外精选
海外精选的内容汇集了全球优质的亚马逊云科技相关技术内容。同时,内容中提到的“AWS” 是 “Amazon Web Services” 的缩写,在此网站不作为商标展示。
0
0
{"value":"With every feature and device we build, we challenge ourselves to think about how we can create an immersive, personalized, and proactive experience for our customers. Often, our devices are used by multiple people in our homes, and yet there are times when you want a more personalized experience. That was the inspiration for visual ID. \n\nOn the all-new Echo Show 15, Echo Show 8, and Echo Show 10, you and other members of your household will soon be able to enroll in visual ID, so that at a glance you can see personalized content such as calendars and reminders, recently played music, and notes for you. \n\nAnd with Astro, a new kind of household robot, enrolling in visual ID enables Astro to do things like find you to deliver something, such as a reminder or an item in Astro’s cargo bin.\n\n#### **More coverage of devices and services announcements**\n\n- \"++[Unlocking AI for everyone](https://www.aboutamazon.com/news/devices/unlocking-ai-for-everyone)++\"\n- \"++[Astro’s Intelligent Motion brings state-of-the-art navigation to the home](https://www.amazon.science/blog/astros-intelligent-motion-brings-state-of-the-art-navigation-to-the-home)++\"\n- \"++[A more useful way to measure robotic localization error](https://www.amazon.science/blog/a-more-useful-way-to-measure-robotic-localization-error)++\"\n- \"++[How Amazon is using self-service to democratize AI](https://www.amazon.science/blog/how-amazon-is-using-self-service-to-democratize-ai)++\"\n\n#### **Creating your visual ID**\n\nVisual ID is opt-in, so you must first enroll in the feature, much as you can enroll in voice ID (formerly Alexa voice profile) today. During enrollment, you will use the camera on your supported Echo Show device or Astro to take a series of headshots at different angles. For visual ID to accurately recognize you, we require five different angles of your face. \n\nDuring the enrollment process, the device runs algorithms to ensure that each of the images is of high enough quality. For example, if the room is too dark, you will see on-screen instructions to adjust the lighting and try again. You will also see on-screen notifications as an image of each pose is successfully captured. \n\nThe images are used to create numeric representations of your facial characteristics. Called vectors (one for each angle of your face), these numeric representations are just that: a string of numbers. The images are also used to revise the vectors in the event of periodic updates to the visual ID model — meaning customers are not required to re-enroll in visual ID every time there is a model update. These images and vectors are securely stored on-device, not in Amazon’s cloud.\n\nUp to 10 members of a household per account can enroll on each compatible Echo Show or Astro to enjoy more-personalized experiences for themselves. Customers with more than one visual-ID-compatible device will need to enroll on each device individually.\n\n![image.png](https://dev-media.amazoncloud.cn/98ac20dfa20a4cb29051e295120d4df5_image.png)\n\nA screenshot of the enrollment process, during which the device’s camera takes a series of headshots at different angles.\n\n#### **Identifying an enrolled individual**\n\nOnce you’ve enrolled in visual ID, your device attempts to match people who walk into the camera’s field of view with the visual IDs of enrolled household members. There are two steps to this process, facial detection and facial recognition, and both are done through local processing using machine learning models called convolutional neural networks. \n\nTo recognize a person, the device first uses a convolutional neural network to detect when a face appears in the camera’s field of view. If a person whom the device does not recognize as enrolled in visual ID walks into the camera’s field of view, the device will determine that there are no matches to the stored vectors. The device does not retain images or vectors from unenrolled individuals after processing. All of this happens in fractions of a second and is done securely on-device.\n\nWhen your supported Echo Show device recognizes you, your avatar and a personalized greeting will appear in the upper right of the screen.\n\n![image.png](https://dev-media.amazoncloud.cn/e44cc8fa4ac14fa8aa32f99a2031df8e_image.png)\n\nAn example of what Echo Show 15 might show on its screen once an enrolled individual is recognized.\n\nWhat shows on Astro’s screen will depend on what Astro is doing. For example, if you’ve enrolled in visual ID, and Astro is trying to find you, Astro will display text on its screen — “Looking for [Bob]”, followed by “Found [Bob]” — to acknowledge that it’s recognized you.\n\n\n![image.png](https://dev-media.amazoncloud.cn/759aaa13af6248258cee6fafc5790dc0_image.png)\n\nAstro will display text on its screen — “Looking for [Bob]”, followed by “Found [Bob]” — to acknowledge that it’s recognized you.\n\n#### **Enhancing fairness**\n\nWe set a high bar for equity when it came to designing visual ID. To clear that bar, our scientists and engineers built and refined our visual ID models using millions of images — collected in studies with participants’ consent — explicitly representing a diversity of gender, ethnicity, skin tone, age, ability, and other factors. We then set performance targets to ensure the visual ID feature performed well across groups.\n\nIn addition to consulting with several Amazon Scholars who specialize in computer vision, we also consulted with an external expert in algorithmic bias, Ayanna Howard, dean of the Ohio State University College of Engineering, to review the steps we took to enhance the fairness of the feature. We’ve implemented feedback from our Scholars and Dr. Howard, and we will solicit and listen to customer feedback and make improvements to ensure the feature continues to improve on behalf of our customers.\n\n#### **Privacy by design**\n\nAs with all of our products and services, privacy was foundational to how we built and designed visual ID. As mentioned above, the visual IDs of enrolled household members are securely stored on-device, and both Astro and Echo Show devices use local processing to recognize enrolled customers. You can delete your visual ID from individual devices on which you’ve enrolled through on-device settings and, for Echo Show, through the Alexa app. This will delete the stored enrollment images and associated vectors from your device. We will also automatically delete your visual ID from individual devices if your face is not recognized by that device for 18 months.\n\nIt’s still day one for visual ID, Echo Show, and Astro. We look forward to hearing how our customers use visual ID to personalize their experiences with our devices.\n\nABOUT THE AUTHOR\n\n#### **The Amazon visual ID teams**\n\nThe visual ID teams consist of scientists and engineers working on the visual ID feature for Astro and Echo Show at Amazon.\n\n\n\n\n\n\n\n","render":"<p>With every feature and device we build, we challenge ourselves to think about how we can create an immersive, personalized, and proactive experience for our customers. Often, our devices are used by multiple people in our homes, and yet there are times when you want a more personalized experience. That was the inspiration for visual ID.</p>\n<p>On the all-new Echo Show 15, Echo Show 8, and Echo Show 10, you and other members of your household will soon be able to enroll in visual ID, so that at a glance you can see personalized content such as calendars and reminders, recently played music, and notes for you.</p>\n<p>And with Astro, a new kind of household robot, enrolling in visual ID enables Astro to do things like find you to deliver something, such as a reminder or an item in Astro’s cargo bin.</p>\n<h4><a id=\"More_coverage_of_devices_and_services_announcements_6\"></a><strong>More coverage of devices and services announcements</strong></h4>\n<ul>\n<li>“<ins><a href=\"https://www.aboutamazon.com/news/devices/unlocking-ai-for-everyone\" target=\"_blank\">Unlocking AI for everyone</a></ins>”</li>\n<li>“<ins><a href=\"https://www.amazon.science/blog/astros-intelligent-motion-brings-state-of-the-art-navigation-to-the-home\" target=\"_blank\">Astro’s Intelligent Motion brings state-of-the-art navigation to the home</a></ins>”</li>\n<li>“<ins><a href=\"https://www.amazon.science/blog/a-more-useful-way-to-measure-robotic-localization-error\" target=\"_blank\">A more useful way to measure robotic localization error</a></ins>”</li>\n<li>“<ins><a href=\"https://www.amazon.science/blog/how-amazon-is-using-self-service-to-democratize-ai\" target=\"_blank\">How Amazon is using self-service to democratize AI</a></ins>”</li>\n</ul>\n<h4><a id=\"Creating_your_visual_ID_13\"></a><strong>Creating your visual ID</strong></h4>\n<p>Visual ID is opt-in, so you must first enroll in the feature, much as you can enroll in voice ID (formerly Alexa voice profile) today. During enrollment, you will use the camera on your supported Echo Show device or Astro to take a series of headshots at different angles. For visual ID to accurately recognize you, we require five different angles of your face.</p>\n<p>During the enrollment process, the device runs algorithms to ensure that each of the images is of high enough quality. For example, if the room is too dark, you will see on-screen instructions to adjust the lighting and try again. You will also see on-screen notifications as an image of each pose is successfully captured.</p>\n<p>The images are used to create numeric representations of your facial characteristics. Called vectors (one for each angle of your face), these numeric representations are just that: a string of numbers. The images are also used to revise the vectors in the event of periodic updates to the visual ID model — meaning customers are not required to re-enroll in visual ID every time there is a model update. These images and vectors are securely stored on-device, not in Amazon’s cloud.</p>\n<p>Up to 10 members of a household per account can enroll on each compatible Echo Show or Astro to enjoy more-personalized experiences for themselves. Customers with more than one visual-ID-compatible device will need to enroll on each device individually.</p>\n<p><img src=\"https://dev-media.amazoncloud.cn/98ac20dfa20a4cb29051e295120d4df5_image.png\" alt=\"image.png\" /></p>\n<p>A screenshot of the enrollment process, during which the device’s camera takes a series of headshots at different angles.</p>\n<h4><a id=\"Identifying_an_enrolled_individual_27\"></a><strong>Identifying an enrolled individual</strong></h4>\n<p>Once you’ve enrolled in visual ID, your device attempts to match people who walk into the camera’s field of view with the visual IDs of enrolled household members. There are two steps to this process, facial detection and facial recognition, and both are done through local processing using machine learning models called convolutional neural networks.</p>\n<p>To recognize a person, the device first uses a convolutional neural network to detect when a face appears in the camera’s field of view. If a person whom the device does not recognize as enrolled in visual ID walks into the camera’s field of view, the device will determine that there are no matches to the stored vectors. The device does not retain images or vectors from unenrolled individuals after processing. All of this happens in fractions of a second and is done securely on-device.</p>\n<p>When your supported Echo Show device recognizes you, your avatar and a personalized greeting will appear in the upper right of the screen.</p>\n<p><img src=\"https://dev-media.amazoncloud.cn/e44cc8fa4ac14fa8aa32f99a2031df8e_image.png\" alt=\"image.png\" /></p>\n<p>An example of what Echo Show 15 might show on its screen once an enrolled individual is recognized.</p>\n<p>What shows on Astro’s screen will depend on what Astro is doing. For example, if you’ve enrolled in visual ID, and Astro is trying to find you, Astro will display text on its screen — “Looking for [Bob]”, followed by “Found [Bob]” — to acknowledge that it’s recognized you.</p>\n<p><img src=\"https://dev-media.amazoncloud.cn/759aaa13af6248258cee6fafc5790dc0_image.png\" alt=\"image.png\" /></p>\n<p>Astro will display text on its screen — “Looking for [Bob]”, followed by “Found [Bob]” — to acknowledge that it’s recognized you.</p>\n<h4><a id=\"Enhancing_fairness_46\"></a><strong>Enhancing fairness</strong></h4>\n<p>We set a high bar for equity when it came to designing visual ID. To clear that bar, our scientists and engineers built and refined our visual ID models using millions of images — collected in studies with participants’ consent — explicitly representing a diversity of gender, ethnicity, skin tone, age, ability, and other factors. We then set performance targets to ensure the visual ID feature performed well across groups.</p>\n<p>In addition to consulting with several Amazon Scholars who specialize in computer vision, we also consulted with an external expert in algorithmic bias, Ayanna Howard, dean of the Ohio State University College of Engineering, to review the steps we took to enhance the fairness of the feature. We’ve implemented feedback from our Scholars and Dr. Howard, and we will solicit and listen to customer feedback and make improvements to ensure the feature continues to improve on behalf of our customers.</p>\n<h4><a id=\"Privacy_by_design_52\"></a><strong>Privacy by design</strong></h4>\n<p>As with all of our products and services, privacy was foundational to how we built and designed visual ID. As mentioned above, the visual IDs of enrolled household members are securely stored on-device, and both Astro and Echo Show devices use local processing to recognize enrolled customers. You can delete your visual ID from individual devices on which you’ve enrolled through on-device settings and, for Echo Show, through the Alexa app. This will delete the stored enrollment images and associated vectors from your device. We will also automatically delete your visual ID from individual devices if your face is not recognized by that device for 18 months.</p>\n<p>It’s still day one for visual ID, Echo Show, and Astro. We look forward to hearing how our customers use visual ID to personalize their experiences with our devices.</p>\n<p>ABOUT THE AUTHOR</p>\n<h4><a id=\"The_Amazon_visual_ID_teams_60\"></a><strong>The Amazon visual ID teams</strong></h4>\n<p>The visual ID teams consist of scientists and engineers working on the visual ID feature for Astro and Echo Show at Amazon.</p>\n"}
目录
亚马逊云科技解决方案 基于行业客户应用场景及技术领域的解决方案
联系亚马逊云科技专家
亚马逊云科技解决方案
基于行业客户应用场景及技术领域的解决方案
联系专家
0
目录
关闭
contact-us