Apps Use Click to Do in Recall in Windows 11


Recall.webp

This tutorial will show you how to use Click to Do in Recall for your account in Windows 11.

Starting with Windows 11 build 26120.2415 (Dev) on Snapdragon-powered Copilot+ PCs, you can try out the Recall (Preview) feature.

Starting with Windows 11 build 26120.2510 (Dev), Microsoft is expanding the preview of Recall to Windows Insiders on AMD and Intel-powered Copilot+ PCs. This includes Click to Do in Recall as well. You can now engage with Click to Do by simply pressing WIN key + mouse-click, WIN + Q, through the Snipping Tool menu and print screen, or searching “Click to Do” through the search box on the Windows taskbar. These methods will make it easier than ever to take immediate action on whatever catches your eye on-screen.

Recall was introduced earlier this year, with the ability to enable you to quickly find and jump back into what you have seen before on your PC. You can use an explorable timeline to find the content you remember seeing before. You can also use semantic powered search and just describe how you remember something and Recall will retrieve the moment you saw it. Any photo, link, or message can be a fresh point to continue from.

To use Recall you need to opt in to saving snapshots, which are screenshots of your activity. Snapshots and the contextual information derived from them are saved and encrypted to your local hard drive. Recall does not share snapshots or associated data with Microsoft or third parties, nor is it shared between different Windows users on the same device. Windows will ask for your permission before saving snapshots. You are always in control, and you can delete snapshots, pause or turn them off at any time. Any future options for the user to share data will require fully informed explicit action by the user.

You're always in control of what's saved as a snapshot. You can disable saving snapshots, pause temporarily, filter apps and websites, and delete your snapshots at any time.

Click to Do (preview) is an AI-enhanced Windows experience designed to simplify your workflow. By making text and images selectable, Click to Do provides relevant action suggestions that integrate seamlessly into people’s workflows. For example, for an image, Click to Do might suggest actions like visual search with Bing, erasing objects, or removing the background. You can then choose which action you would like to take. Click to Do (preview) runs on top of your snapshots in Recall (preview). Click to Do helps you get things done faster by connecting you to actions for content, either images or text, that you see on screen. Click to Do analyzes what's in the snapshot and then you can choose the individual pieces of info you want to take action on. The analysis of your snapshot is always performed locally on your device. Content is only shared out of the app if you choose to complete an action. Click to Do is active automatically as you browse through your snapshots.

For snapshots that have already been saved, info from filtered apps and websites along with private browsing activity from supported browsers is removed. Click to Do can't access info that was removed by filters when it's analyzing saved snapshots.

When you choose to send info from Click to Do to an app, like Paint, Click to Do will temporarily save this info in order to complete the transfer. Click to Do creates a temporary file in the following location:
  • C:\Users\{username}\AppData\Local\Temp
Temporary files may also be saved when you choose send feedback. These temporary files aren’t saved long term. Click to Do doesn’t keep any content from your screen after completing the requested action, but some basic telemetry is gathered to keep Click to Do secure, up to date, and working.

In keeping with Microsoft’s commitment to data privacy and security, all saved images and processed data are kept on the device and processed locally. However, Click to Do allows you to choose if you want to get more information about your selected content online. When you choose one of the following Click to Do actions, the selected content is sent to the online provider from your local device to complete your request:
  • Search the web: Sends the selected content to the default search engine of your default browser
  • Open website: Opens the selected website in your default browser
  • Visual search with Bing: Sends the selected content to Bing visual search using your default browser
Click to Do uses optical character recognition (OCR) on your PC to analyze snapshots and improve search.

You can choose to turn Click to Do off from the bottom of Recall. You’ll notice that when Click to Do is active, your cursor is blue and white. The cursor also changes shape depending on the type of info beneath it. What you can do with the info changes based on what kind of content Click to Do detects.

Starting with Windows 11 build 26120.2992 (Dev), you’ll see a new text action for Click to Do available on Copilot+ PCs called Refine. When you open the menu, the new action will be under Rewrite > Refine.

References:


Here's How:

1 Open Recall (Win+J).

2 While browsing through your snapshots in Recall, you can perform the following Click to Do options:


 Click to Do with Text

A) Click/tap on text in the snapshot to select it. (see screenshots below)

B) Right click on the selected text to get the following options:
  • Copy: Copies the selected text to the clipboard.
  • Open with: Opens the selected text in a text editor like Notepad.
  • Search the web: Does a search for the selected text using your default browser and search engine.
  • Summarize: Briefly outlines the main points of the selected text
  • Rewrite (Casual): Revises the selected text using a casual tone
  • Rewrite (Formal): Revises the selected text using a formal tone
  • Refine: Revises the selected text, making grammatical improvements
When the highlighted text is an email address, you can either copy the text or Send email.
  • Send email: Uses your default email app to open a new email to the selected email address
When the highlighted text is a website URL, you can either copy the text or Open website.
  • Open website: Opens the selected website in your default browser
Click_to_Do_in_Recall-text.webp
Click_to_Do_in_Recall-website.webp

Summarize_and_Rewrite.webp



 Click to Do with Images

A) Click/tap on an image in the snapshot to select it. (see screenshot below)

B) Right click on the selected image to get the following options:
  • Copy: Copies the image to the clipboard
  • Save as: Save the image to a specified location
  • Share: Opens the share files option for the image file
  • Open with: Open the image with an app such as Photos, Snipping Tool, or Paint
  • Visual search with Bing: Does a visual search using Bing using your default web browser
  • Blur background with Photos: Blur the background with the Photos app
  • Erase objects with Photos: Erase unwanted objects in the image with the Photos app
  • Remove background with Paint: Remove the background of the image with Paint
Click_to_Do_in_Recall-image.webp




 Click to Do Now

When you select the Now option in Recall, a snapshot is taken that filters your private browsing windows, filtered apps, and filtered websites. These snapshots are only saved if you’ve enabled saving snapshots. Even if you aren’t allowing snapshots to be saved, or have temporarily paused saving snapshots, you can still use the Now option to take advantage of Click to Do. A notification appears at the bottom of the Recall window to let you know that the snapshot won’t be saved.

When you use Click to Do in Recall and select the Now option, a snapshot is taken without your private browsing windows, filtered apps, and filtered websites. These snapshots are displayed and locally analyzed but only saved if you have saving snapshots enabled. When using the Now option, Click to Do analyzes only what's active on your screen. It doesn't analyze content that's inside minimized apps that aren't on your screen. If you don’t want content analyzed, make sure the window isn’t open or visible when using the Now option.

Click_to_Do_Now_in_Recall.webp



That's it,
Shawn Brink


 
Last edited:

Latest Support Threads

Back
Top Bottom