Observe - Axilio

observe captures one screen and returns its recognized text, icons, dimensions, hash, and capture time.

CLI
Python SDK
Go SDK

axilio phone observe -o json | jq '.texts | length'

Add --ocr-engine premium when the screen needs the premium OCR engine.

screen = driver.observe()
print(len(screen.texts), "pieces of text")

screen, err := driver.Observe()
if err != nil {
    log.Fatal(err)
}
fmt.Println(len(screen.Texts), "pieces of text")

Search the snapshot locally

Searching an observed snapshot does not capture the screen again.

CLI
Python SDK
Go SDK

axilio phone observe -o json > screen.json
jq '.texts[] | select(.text | test("\\$[0-9]+\\.[0-9]{2}"))' screen.json
jq '.texts[] | select(.text | contains("Total"))' screen.json

screen = driver.observe()
prices = screen.find_all_text(pattern=r"\$\d+\.\d{2}")
total = screen.find_text("Total")

screen, err := driver.Observe()
if err != nil {
    log.Fatal(err)
}
prices, err := screen.FindAllText("", `\$\d+\.\d{2}`)
if err != nil {
    log.Fatal(err)
}
total := screen.FindText("Total", false)
fmt.Println(len(prices), total)

See Screen for the snapshot fields and local query rules. observe maps to DCP Screen.observe; it is not a REST operation.

A picture instead?

observe gives you structured text and icons. Use Screenshot when you need PNG bytes.

Next steps

Find

Search the live screen for one target.

Screenshot

Save the current screen as an image.