How he does things
His mind runs on our servers. His hands are a small program on your computer. Between them is Lingo, a language we made to be small enough to check.
w=win.wait({title:"Untitled - Notepad"})
ui.fill(ui.find(w,{role:"document"})[0],"Shopping: milk, eggs")
return "written"
One step
When you ask for something, he writes a short program like the one above, using only what your computer said it can do. Our side checks it. Your computer runs it and sends back what happened, and he decides what to do next.
Why a language
A program is something we can read, check and show you. Every step under his replies is the program he ran and what it gave back, word for word.
What it can reach
Windows and their controls, the screen and its words, the mouse and keys, files, the clipboard, commands and the web, each behind its permission. Nothing else exists to call.