Explainer

Can AI see my screen on Windows? How it works, and what it can see

Updated · By the Lida team

Short answer

Yes. An AI assistant that can see your screen reads the app and controls in front of you, so you can ask for help without describing your setup or pasting screenshots. On Windows they come in three kinds: chat tools you share a screenshot or window with, assistants that talk you through the screen and highlight where to click, and agents that click and type for you. What matters most is when the assistant looks, what it keeps, and what it is never allowed to do; this guide covers those questions, and our best-of list compares the products.

Why an assistant that sees your screen is different

Most help asks you to leave what you are doing. You search, open a video, or type a question into a chat window, and then you translate the answer back into the app you were using. Half the work is describing where you are: which version, which menu, what the error says.

A screen-aware assistant skips that step. It reads the window, the controls and the text in front of you, so a question as short as “how do I export this?” has enough context to answer. The better ones answer on the screen itself, pointing at the control instead of describing it.

The three kinds of screen-aware assistant

The label “sees your screen” covers very different products. It helps to sort them by what they do with what they see.

KindWhat it does with your screenGood forWatch out for
Chat with a screenshotAnswers questions about an image or window you attachOne-off questions, reading an errorYou still follow the steps yourself, from text
Live voice guideWatches a shared app or desktop, talks you through it, may highlight where to clickLearning an app, getting unstuckUsually does not click or type for you
AgentClicks, types and scrolls to finish a taskRepetitive or tedious stepsWhat it may do without asking, and how you stop it

Some products sit in one column. Lida covers all three in the same session: you can ask it to guide you (it moves its cursor to the exact control, puts a ring on it, and waits while you do the step), to teach you (it draws the idea on a board beside your work, narrated and captioned), or to do it (it clicks and types while you watch and asks before anything risky). You can switch part-way through by saying so.

What to look for before you install one

An assistant that sees your screen sees everything on it, so the limits matter as much as the features. These are the questions worth asking of any product, with how Lida answers each.

  • When does it look? Prefer tools that only see your screen during a session you start. Lida looks only while a session is running, and at no other time.
  • Does it keep screenshots? Lida sends pictures of the screen to the AI model during a session so it can answer, and never saves them. Personal details are scrubbed from the text it stores.
  • Can you hide sensitive apps? Lida's view is blanked while a password manager, a banking app, or any app you list is in front.
  • How do you stop it? Lida stops on Ctrl + Alt + Space, and while it is acting for you, touching the mouse or keyboard stops it at once.
  • What will it never do? Lida never types into password fields, never enters card numbers, never transfers money, and never changes security settings.
  • Does it admit when it is unsure? Lida points only at controls it can name on screen and says so when it can only guess.

The full list of what Lida can and cannot see and do is on the security page.

Why it needs a desktop app, not a browser tab

Browsers keep each tab away from the rest of your computer on purpose, so no website can see your desktop. An assistant that helps across Excel, Photoshop, Settings and everything else has to run as an installed app. That is why Lida is a Windows desktop app, and why the website is only for your account, early access, pricing and help.

Which one should you pick?

This page explains how screen-aware AI works and what to check before you trust one with your screen. For a ranked comparison of the products themselves (Lida, Copilot Vision, ChatGPT, Gemini Live and Claude computer use), read the best AI that sees your screen on Windows. If you mainly want an assistant that does the clicking for you, read how to let an AI control your computer safely, and for the plain facts about Lida itself (platform, price, status), see Lida's official facts.

Trying Lida

Lida is in private preview on Windows, and invites go out in waves. Request early access, install the app when your invite arrives, and sign in with the same account you use on the website. You need a microphone, because you talk to Lida. Sessions use credits; one credit is about one minute, and the plans are on the pricing page.

Questions

Can AI see my screen on Windows?
Yes. Several assistants can look at your screen on Windows. Some answer questions about a screenshot, some talk you through a shared window, and some act for you. Lida is a Windows desktop companion that sees your screen during a session you start and can guide you, teach you, or do the task while you watch.
Does a screen-reading AI record everything I do?
It depends on the product, so check before installing. Lida only looks at your screen while a session you started is running. Pictures of the screen go to the AI model so it can answer, and Lida never saves them.
Can it work in my browser instead of an app?
Not for your whole desktop. Browsers keep tabs isolated from the rest of the computer, so an assistant that helps in any Windows app has to be installed. Lida runs as a Windows desktop app.
Can I keep it away from my banking or password apps?
With Lida, yes. Its view is blanked while a password manager, a banking app, or any app you add to the list is in front, and it never types into password fields or enters card numbers.
How do I get Lida?
Lida is in private preview on Windows. Request early access on trylida.com and you will get an email when your invite is ready.

Lida is a Windows desktop companion that sees your screen and talks with you. It is in private preview, and invites go out in waves.