{"id":77494,"date":"2021-09-13T09:00:00","date_gmt":"2021-09-13T14:00:00","guid":{"rendered":"https:\/\/eshop.macsales.com\/blog\/?p=77494"},"modified":"2021-09-13T01:13:40","modified_gmt":"2021-09-13T06:13:40","slug":"ipados-15-visual-look-up","status":"publish","type":"post","link":"https:\/\/eshop.macsales.com\/blog\/77494-ipados-15-visual-look-up\/","title":{"rendered":"Get Ready for iPadOS 15: Visual Look Up"},"content":{"rendered":"\n

The time is near for updates to all of Apple\u2019s operating systems, and The Rocket Yard is here to give you the knowledge you need to upgrade with confidence. In the recent Road to macOS 12 Monterey<\/a><\/strong> series, we gave you a look at six of the marquee features of the Mac operating system upgrade. In this Get Ready for iPadOS 15<\/strong> series, we\u2019ll focus on the improvements being made to the iPad’s operating system. Today we\u2019ll look at Visual Look Up<\/strong>, a powerful search tool that is part of iPadOS 15.<\/p>\n\n\n\n

\n\n\n\n
\"An
An example of Visual Look Up at Work on a Vermeer Painting<\/figcaption><\/figure>\n\n\n\n

What Is Visual Look Up?<\/h3>\n\n\n\n

Let\u2019s say that you\u2019re looking at a picture. It doesn\u2019t matter where you\u2019re looking at the image; it could be something sent to you in Mail or Messages, a photo on a web page, or perhaps a picture in your Photo Library. That picture shows an object of some sort, and you want to know what it is.<\/p>\n\n\n\n

Visual Look Up analyzes each photo to \u201csee\u201d what is in it. Through machine learning magic, Visual Look Up identifies what is in the picture, then does a quick search to provide information about the object.<\/p>\n\n\n\n

The feature is new and I’ve found that in the beta versions of iPadOS 15, some objects are either not recognized or they are labeled incorrectly. I have photos of bison, deer, and moose in which the animal is obviously the focus of the picture, yet none of those large mammals was recognized. A photo of a nearby rock formation in the South Denver foothills was identified as Devils Tower in Wyoming. Oddly enough, several photos of Devils Tower were not recognized while others were.<\/p>\n\n\n\n

My guess is that as Visual Look Up is used by more people, the accuracy should increase as the visual “database” is refined.<\/p>\n\n\n\n

\n\n\n\n

Examples of Visual Look Up in action<\/h3>\n\n\n\n

A few examples are in order to show how this new iPadOS 15 tool works. To begin with, I went through my Photo Library and tapped on a picture of a flower:<\/p>\n\n\n\n

\"\"<\/figure><\/div>
\"\"<\/figure><\/div><\/div><\/div><\/div>\n\n\n\n

On the left, you see the image of a peony, and the usual “Info” button ( ℹ\ufe0e ) looks different. There are two small “stars” to acknowledge that Visual Look Up recognizes something in the image. Tapping the Info button on the right highlights it, and two other indicators appear. There’s a tiny leaf icon on the flower, indicating that Visual Look Up recognizes the object as a flower. There’s also a Look Up link (in the red rectangle) to tap for more info. <\/p>\n\n\n\n

When the link is tapped, here’s what Visual Look Up provides courtesy of Siri:<\/p>\n\n\n\n

\"Visual
Visual Look Up and Siri team up to tell us that this flower is a peony, and includes similar images for comparison<\/figcaption><\/figure>\n\n\n\n

It’s quite impressive. Visual Look Up seems to do very well with plants like flowers, shrubs, and trees. <\/p>\n\n\n\n

The feature also works smoothly with many landmarks. It recognized One World Trade Center in New York City, The Space Needle in Seattle, Mount Rushmore in Wyoming, and more. On the other hand, it failed to recognize many natural landmarks. The Grand Tetons, Niagara Falls, and Yellowstone’s Old Faithful Geyser failed the Visual Look Up test. <\/p>\n\n\n\n

It recognizes dogs and cats, probably the most photographed animals in the world. The feature even tries to assign a breed to our feline and canine friends. But birds? Sharp, clear photos of bald eagles, owls, gulls, crows, turkeys, emus, ostriches, hummingbirds, and even chickens failed — although they were identified as birds by a Photo Library search of the keyword “birds”, no more detail was available.<\/p>\n\n\n\n

\n\n\n\n

Visual Look Up in Safari and other iPad apps<\/h3>\n\n\n\n

As mentioned, Visual Look Up works in other apps including Safari. However, there’s no way to tell if it “recognizes” an image other than to tap and hold on it. If the Look Up item shows up in the contextual menu, you can get detailed info with a tap.<\/p>\n\n\n\n

I was able to successfully use Visual Look Up in Safari… sometimes. For example, I could pull up an image of a known landmark, tap and hold, and see the details of the item. The same thing worked with famous paintings. Once again, dog and cat pictures were immediate Visual Look Up hits. Snakes? Nope. Ducks? No. Famous people? Nada. <\/p>\n\n\n\n

\"Visual
Visual Look Up works well in the iPadOS 15 Mail app<\/figcaption><\/figure>\n\n\n\n

In the Mail app, the same tap-and-hold gesture brought up a Look Up menu item, but only on specific types of photos. The same photo embedded in a Note didn’t produce the expected Look Up item. That indicates that the feature isn’t yet “live” in apps other than Photos, Safari, and Mail. Will it be available in all apps that can display images in the future? Who knows…<\/p>\n\n\n\n

\n\n\n\n

Also available in a convenient pocket size<\/h3>\n\n\n\n

Visual Look Up is also available in iOS 15, which should be ready for upgrades around the same time as iPadOS 15. You’ll be able to use the feature with other new abilities coming in macOS 12 Monterey and iOS 15 like Live Text<\/a><\/strong>. <\/p>\n\n\n\n

Stay tuned for more articles about the new features of iPadOS 15 in the upcoming days. <\/p>\n","protected":false},"excerpt":{"rendered":"

Get ready to rev up your iPad with iPadOS 15! Visual Look Up uses Machine Learning to provide info in visual content.<\/p>\n","protected":false},"author":81,"featured_media":77641,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"spay_email":"","footnotes":""},"categories":[90,4],"class_list":["post-77494","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-fresh-from-apple","category-tech-tips"],"yoast_head":"\nGet Ready for iPadOS 15: Visual Look Up<\/title>\n<meta name=\"description\" content=\"Get ready to rev up your iPad with iPadOS 15! Visual Look Up uses Machine Learning to provide info in visual content.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/eshop.macsales.com\/blog\/77494-ipados-15-visual-look-up\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Get Ready for iPadOS 15: Visual Look Up\" \/>\n<meta property=\"og:description\" content=\"Get ready to rev up your iPad with iPadOS 15! Visual Look Up uses Machine Learning to provide info in visual content.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/eshop.macsales.com\/blog\/77494-ipados-15-visual-look-up\/\" \/>\n<meta property=\"og:site_name\" content=\"Rocket Yard\" \/>\n<meta property=\"article:author\" content=\"https:\/\/facebook.com\/stevensande\" \/>\n<meta property=\"article:published_time\" content=\"2021-09-13T14:00:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2021-09-13T06:13:40+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/eshop.macsales.com\/blog\/wp-content\/uploads\/2021\/09\/iPadOS15_visual-lookup.jpeg\" \/>\n\t<meta property=\"og:image:width\" content=\"1400\" \/>\n\t<meta property=\"og:image:height\" content=\"788\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Steve Sande\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Steve Sande\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/eshop.macsales.com\/blog\/77494-ipados-15-visual-look-up\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/eshop.macsales.com\/blog\/77494-ipados-15-visual-look-up\/\"},\"author\":{\"name\":\"Steve Sande\",\"@id\":\"https:\/\/eshop.macsales.com\/blog\/#\/schema\/person\/1152721d0acb70692858d0f3fcb12e7a\"},\"headline\":\"Get Ready for iPadOS 15: Visual Look Up\",\"datePublished\":\"2021-09-13T14:00:00+00:00\",\"dateModified\":\"2021-09-13T06:13:40+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/eshop.macsales.com\/blog\/77494-ipados-15-visual-look-up\/\"},\"wordCount\":887,\"commentCount\":1,\"publisher\":{\"@id\":\"https:\/\/eshop.macsales.com\/blog\/#organization\"},\"articleSection\":[\"Fresh from Apple\",\"Tech Tips\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/eshop.macsales.com\/blog\/77494-ipados-15-visual-look-up\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/eshop.macsales.com\/blog\/77494-ipados-15-visual-look-up\/\",\"url\":\"https:\/\/eshop.macsales.com\/blog\/77494-ipados-15-visual-look-up\/\",\"name\":\"Get Ready for iPadOS 15: Visual Look Up\",\"isPartOf\":{\"@id\":\"https:\/\/eshop.macsales.com\/blog\/#website\"},\"datePublished\":\"2021-09-13T14:00:00+00:00\",\"dateModified\":\"2021-09-13T06:13:40+00:00\",\"description\":\"Get ready to rev up your iPad with iPadOS 15! Visual Look Up uses Machine Learning to provide info in visual content.\",\"breadcrumb\":{\"@id\":\"https:\/\/eshop.macsales.com\/blog\/77494-ipados-15-visual-look-up\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/eshop.macsales.com\/blog\/77494-ipados-15-visual-look-up\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/eshop.macsales.com\/blog\/77494-ipados-15-visual-look-up\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/eshop.macsales.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Get Ready for iPadOS 15: Visual Look Up\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/eshop.macsales.com\/blog\/#website\",\"url\":\"https:\/\/eshop.macsales.com\/blog\/\",\"name\":\"Rocket Yard\",\"description\":\"Your source for expert tips, special deals, commentary, reviews, and the latest tech news.\",\"publisher\":{\"@id\":\"https:\/\/eshop.macsales.com\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/eshop.macsales.com\/blog\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/eshop.macsales.com\/blog\/#organization\",\"name\":\"OWC\",\"url\":\"https:\/\/eshop.macsales.com\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/eshop.macsales.com\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/eshop.macsales.com\/blog\/wp-content\/uploads\/2020\/06\/rocket-yard-logo-round.png\",\"contentUrl\":\"https:\/\/eshop.macsales.com\/blog\/wp-content\/uploads\/2020\/06\/rocket-yard-logo-round.png\",\"width\":1024,\"height\":1024,\"caption\":\"OWC\"},\"image\":{\"@id\":\"https:\/\/eshop.macsales.com\/blog\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/eshop.macsales.com\/blog\/#\/schema\/person\/1152721d0acb70692858d0f3fcb12e7a\",\"name\":\"Steve Sande\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/eshop.macsales.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/1ad8e267ec82e12963d9cfe717c9b8e108e1edbb728f5d91fe50c6e7ecd14b15?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/1ad8e267ec82e12963d9cfe717c9b8e108e1edbb728f5d91fe50c6e7ecd14b15?s=96&d=mm&r=g\",\"caption\":\"Steve Sande\"},\"description\":\"Steve has been writing about Apple products since 1986, starting on a bulletin board system, creating the first of his many Apple-related websites in 1994, joining the staff of The Unofficial Apple Weblog in 2008, and founding Apple World Today in 2015. He\u2019s semi-retired, loves to camp and take photos, and is an FAA-licensed drone pilot.\",\"sameAs\":[\"https:\/\/appleworld.today\",\"https:\/\/facebook.com\/stevensande\",\"https:\/\/www.linkedin.com\/in\/stevensande\/\",\"https:\/\/www.youtube.com\/channel\/UCUnDTuaRnXncKQXfQYVNIJA\/\"],\"url\":\"https:\/\/eshop.macsales.com\/blog\/author\/steve-sande\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Get Ready for iPadOS 15: Visual Look Up","description":"Get ready to rev up your iPad with iPadOS 15! Visual Look Up uses Machine Learning to provide info in visual content.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/eshop.macsales.com\/blog\/77494-ipados-15-visual-look-up\/","og_locale":"en_US","og_type":"article","og_title":"Get Ready for iPadOS 15: Visual Look Up","og_description":"Get ready to rev up your iPad with iPadOS 15! Visual Look Up uses Machine Learning to provide info in visual content.","og_url":"https:\/\/eshop.macsales.com\/blog\/77494-ipados-15-visual-look-up\/","og_site_name":"Rocket Yard","article_author":"https:\/\/facebook.com\/stevensande","article_published_time":"2021-09-13T14:00:00+00:00","article_modified_time":"2021-09-13T06:13:40+00:00","og_image":[{"width":1400,"height":788,"url":"https:\/\/eshop.macsales.com\/blog\/wp-content\/uploads\/2021\/09\/iPadOS15_visual-lookup.jpeg","type":"image\/jpeg"}],"author":"Steve Sande","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Steve Sande","Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/eshop.macsales.com\/blog\/77494-ipados-15-visual-look-up\/#article","isPartOf":{"@id":"https:\/\/eshop.macsales.com\/blog\/77494-ipados-15-visual-look-up\/"},"author":{"name":"Steve Sande","@id":"https:\/\/eshop.macsales.com\/blog\/#\/schema\/person\/1152721d0acb70692858d0f3fcb12e7a"},"headline":"Get Ready for iPadOS 15: Visual Look Up","datePublished":"2021-09-13T14:00:00+00:00","dateModified":"2021-09-13T06:13:40+00:00","mainEntityOfPage":{"@id":"https:\/\/eshop.macsales.com\/blog\/77494-ipados-15-visual-look-up\/"},"wordCount":887,"commentCount":1,"publisher":{"@id":"https:\/\/eshop.macsales.com\/blog\/#organization"},"articleSection":["Fresh from Apple","Tech Tips"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/eshop.macsales.com\/blog\/77494-ipados-15-visual-look-up\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/eshop.macsales.com\/blog\/77494-ipados-15-visual-look-up\/","url":"https:\/\/eshop.macsales.com\/blog\/77494-ipados-15-visual-look-up\/","name":"Get Ready for iPadOS 15: Visual Look Up","isPartOf":{"@id":"https:\/\/eshop.macsales.com\/blog\/#website"},"datePublished":"2021-09-13T14:00:00+00:00","dateModified":"2021-09-13T06:13:40+00:00","description":"Get ready to rev up your iPad with iPadOS 15! Visual Look Up uses Machine Learning to provide info in visual content.","breadcrumb":{"@id":"https:\/\/eshop.macsales.com\/blog\/77494-ipados-15-visual-look-up\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/eshop.macsales.com\/blog\/77494-ipados-15-visual-look-up\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/eshop.macsales.com\/blog\/77494-ipados-15-visual-look-up\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/eshop.macsales.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Get Ready for iPadOS 15: Visual Look Up"}]},{"@type":"WebSite","@id":"https:\/\/eshop.macsales.com\/blog\/#website","url":"https:\/\/eshop.macsales.com\/blog\/","name":"Rocket Yard","description":"Your source for expert tips, special deals, commentary, reviews, and the latest tech news.","publisher":{"@id":"https:\/\/eshop.macsales.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/eshop.macsales.com\/blog\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/eshop.macsales.com\/blog\/#organization","name":"OWC","url":"https:\/\/eshop.macsales.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/eshop.macsales.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/eshop.macsales.com\/blog\/wp-content\/uploads\/2020\/06\/rocket-yard-logo-round.png","contentUrl":"https:\/\/eshop.macsales.com\/blog\/wp-content\/uploads\/2020\/06\/rocket-yard-logo-round.png","width":1024,"height":1024,"caption":"OWC"},"image":{"@id":"https:\/\/eshop.macsales.com\/blog\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/eshop.macsales.com\/blog\/#\/schema\/person\/1152721d0acb70692858d0f3fcb12e7a","name":"Steve Sande","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/eshop.macsales.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/1ad8e267ec82e12963d9cfe717c9b8e108e1edbb728f5d91fe50c6e7ecd14b15?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/1ad8e267ec82e12963d9cfe717c9b8e108e1edbb728f5d91fe50c6e7ecd14b15?s=96&d=mm&r=g","caption":"Steve Sande"},"description":"Steve has been writing about Apple products since 1986, starting on a bulletin board system, creating the first of his many Apple-related websites in 1994, joining the staff of The Unofficial Apple Weblog in 2008, and founding Apple World Today in 2015. He\u2019s semi-retired, loves to camp and take photos, and is an FAA-licensed drone pilot.","sameAs":["https:\/\/appleworld.today","https:\/\/facebook.com\/stevensande","https:\/\/www.linkedin.com\/in\/stevensande\/","https:\/\/www.youtube.com\/channel\/UCUnDTuaRnXncKQXfQYVNIJA\/"],"url":"https:\/\/eshop.macsales.com\/blog\/author\/steve-sande\/"}]}},"jetpack_featured_media_url":"https:\/\/eshop.macsales.com\/blog\/wp-content\/uploads\/2021\/09\/iPadOS15_visual-lookup.jpeg","jetpack_shortlink":"https:\/\/wp.me\/pmPaT-k9U","_links":{"self":[{"href":"https:\/\/eshop.macsales.com\/blog\/wp-json\/wp\/v2\/posts\/77494","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/eshop.macsales.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/eshop.macsales.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/eshop.macsales.com\/blog\/wp-json\/wp\/v2\/users\/81"}],"replies":[{"embeddable":true,"href":"https:\/\/eshop.macsales.com\/blog\/wp-json\/wp\/v2\/comments?post=77494"}],"version-history":[{"count":7,"href":"https:\/\/eshop.macsales.com\/blog\/wp-json\/wp\/v2\/posts\/77494\/revisions"}],"predecessor-version":[{"id":77640,"href":"https:\/\/eshop.macsales.com\/blog\/wp-json\/wp\/v2\/posts\/77494\/revisions\/77640"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/eshop.macsales.com\/blog\/wp-json\/wp\/v2\/media\/77641"}],"wp:attachment":[{"href":"https:\/\/eshop.macsales.com\/blog\/wp-json\/wp\/v2\/media?parent=77494"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/eshop.macsales.com\/blog\/wp-json\/wp\/v2\/categories?post=77494"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}