Grok Computer Use

Grok Computer Use allows Grok 4.5 to directly interact with a browser to perform tasks much like a human. This capability lets Grok move the cursor, click buttons, type text, and navigate the web, automating complex, multi-step workflows. Hyperbrowser makes it simple to run Grok Computer Use tasks in managed cloud browsers. Start a task with a single API call, then poll for results or use our SDK’s blocking methods that handle everything automatically. You can view your Grok Computer Use tasks in the dashboard.

How It Works

You can use Grok Computer Use in two ways:

Start and Wait: SDKs provide a startAndWait() method that blocks until the task completes and returns the result
Async Pattern: Start a task, get a job ID, then poll for status and results—useful for long-running tasks or when you want more control

Installation

npm install @hyperbrowser/sdk dotenv

yarn add @hyperbrowser/sdk dotenv

pip install hyperbrowser python-dotenv

uv add hyperbrowser python-dotenv

Quick Start

The simplest way to run a Grok Computer Use task is with the startAndWait() method, which handles everything for you:

import { Hyperbrowser } from "@hyperbrowser/sdk";
import { config } from "dotenv";

config();

const client = new Hyperbrowser({
  apiKey: process.env.HYPERBROWSER_API_KEY,
});

async function main() {
  const result = await client.agents.grokComputerUse.startAndWait({
    task: "Go to Hacker News and tell me the title of the top post",
    maxSteps: 20,
  });

  console.log(`Output:\n${result.data?.finalResult}`);
}

main().catch((err) => {
  console.error(`Error: ${err.message}`);
});

from hyperbrowser import Hyperbrowser
from hyperbrowser.models import StartGrokComputerUseTaskParams
import os
from dotenv import load_dotenv

load_dotenv()

client = Hyperbrowser(api_key=os.getenv("HYPERBROWSER_API_KEY"))

result = client.agents.grok_computer_use.start_and_wait(
    params=StartGrokComputerUseTaskParams(
        task="Go to Hacker News and tell me the title of the top post",
        max_steps=20
    )
)

print(f"Output:\n{result.data.final_result}")

# Start the task
curl -X POST https://api.hyperbrowser.ai/api/task/grok-computer-use \
  -H "Content-Type: application/json" \
  -H "x-api-key: YOUR_API_KEY" \
  -d '{
    "task": "Go to Hacker News and tell me the title of the top post",
    "maxSteps": 20
  }'

# Response: {"jobId": "abc123", "liveUrl": "https://..."}

# Check status
curl https://api.hyperbrowser.ai/api/task/grok-computer-use/abc123/status \
  -H "x-api-key: YOUR_API_KEY"

# Get full results
curl https://api.hyperbrowser.ai/api/task/grok-computer-use/abc123 \
  -H "x-api-key: YOUR_API_KEY"

Async Pattern

When you need more control, use the async pattern to start a task and poll for results:

import { Hyperbrowser } from "@hyperbrowser/sdk";
import { config } from "dotenv";

config();

const client = new Hyperbrowser({
  apiKey: process.env.HYPERBROWSER_API_KEY,
});

async function main() {
  try {
    // Start the task
    const task = await client.agents.grokComputerUse.start({
      task: "What is the title of the first post on Hacker News today?",
      maxSteps: 20,
    });

    console.log(`Task started: ${task.jobId}`);
    console.log(`Watch live: ${task.liveUrl}`);

    // Poll for completion
    let result;
    while (true) {
      result = await client.agents.grokComputerUse.getStatus(task.jobId);
      console.log(`Status: ${result.status}`);

      if (result.status === "completed" || result.status === "failed") {
        break;
      }

      await new Promise((resolve) => setTimeout(resolve, 5000)); // Wait 5s
    }

    const fullResult = await client.agents.grokComputerUse.get(task.jobId);

    if (fullResult.status === "completed") {
      console.log("Result:", fullResult.data?.finalResult);
      console.log("Steps taken:", fullResult.data?.steps?.length);
    } else {
      console.error("Task failed:", fullResult.error);
    }
  } catch (err) {
    console.error(`Error: ${err.message}`);
  }
}

main();

import asyncio
from hyperbrowser import AsyncHyperbrowser
from hyperbrowser.models import StartGrokComputerUseTaskParams
from dotenv import load_dotenv
import os

load_dotenv()

client = AsyncHyperbrowser(api_key=os.getenv("HYPERBROWSER_API_KEY"))


async def main():
    try:
        # Start the task
        task = await client.agents.grok_computer_use.start(
            params=StartGrokComputerUseTaskParams(
                task="What is the title of the first post on Hacker News today?",
                max_steps=20,
            )
        )

        print(f"Task started: {task.job_id}")
        print(f"Watch live: {task.live_url}")

        # Poll for completion
        while True:
            result = await client.agents.grok_computer_use.get_status(task.job_id)
            print(f"Status: {result.status}")

            if result.status in ["completed", "failed"]:
                break

            await asyncio.sleep(5)  # Wait 5s

        full_result = await client.agents.grok_computer_use.get(task.job_id)

        if full_result.status == "completed":
            print("Result:", full_result.data.final_result)
            print(
                "Steps taken:",
                len(full_result.data.steps) if full_result.data.steps else 0,
            )
        else:
            print("Task failed:", full_result.error)
    except Exception as e:
        print(f"Error: {e}")


if __name__ == "__main__":
    asyncio.run(main())

Stop a Running Task

Stop a task before it completes:

await client.agents.grokComputerUse.stop("job-id");

client.agents.grok_computer_use.stop("job-id")

curl -X PUT https://api.hyperbrowser.ai/api/task/grok-computer-use/job-id/stop \
  -H "x-api-key: YOUR_API_KEY"

Parameters

string

required

Natural language description of what you want Grok to accomplish. Be specific for best results.

string

default:"grok-4.5"

Grok model to use. The only supported option is "grok-4.5".

string

default:"medium"

Reasoning effort for Grok. Available options:

"low"
"medium"
"high"

number

default:"50"

Maximum number of actions Grok can take (clicks, typing, navigation, etc.). Increase for complex tasks.

number

default:"3"

Maximum consecutive failures before the task is aborted.

string

ID of an existing browser session to reuse. Useful for multi-step workflows that need to maintain the same browser session.

boolean

default:"false"

Keep the browser session alive after task completion.

boolean

default:"true"

Allow the agent to interact by executing actions on the actual computer, not just within the page. Allows the agent to see the entire screen instead of just the page contents.

object

Session configuration (proxy, stealth, captcha solving, etc.). Only applies when creating a new session. If you provide an existing sessionId, these options are ignored.

boolean

default:"false"

Use your own xAI API key instead of consuming Hyperbrowser credits for LLM calls. You will only be charged for browser usage.

object

API key for xai. Required when useCustomApiKeys is true.

{
  xai: "..."
}

The agent may not complete the task within the specified maxSteps. If that happens, try increasing the maxSteps parameter.Additionally, the browser session used by the AI Agent will time out based on your team’s default Session Timeout settings or the session’s timeoutMinutes parameter if provided. You can adjust the default Session Timeout in the Settings page.

useComputerAction can often be better for completing tasks but may require more steps. It is especially useful when the agent needs to interact with elements on the page that might not be accessible by or visible to Playwright. Since it allows the agent to see and interact with the entire screen, it is much more powerful. Instead of executing actions with Playwright which can only interact with the page via CDP, computer actions allow the agent to interact directly with computer primitives (direct clicks, typing, scroll, etc.).

Reuse Browser Sessions

You can pass in an existing sessionId to the Grok Computer Use task so that it can execute the task on an existing session. Also, if you want to keep the session open after executing the task, you can supply the keepBrowserOpen parameter.

import { Hyperbrowser } from "@hyperbrowser/sdk";
import { config } from "dotenv";

config();

const client = new Hyperbrowser({
  apiKey: process.env.HYPERBROWSER_API_KEY,
});

const main = async () => {
  const session = await client.sessions.create();

  try {
    const result = await client.agents.grokComputerUse.startAndWait({
      task: "What is the title of the first post on Hacker News today?",
      sessionId: session.id,
      keepBrowserOpen: true,
    });

    console.log(`Output:\n${result.data?.finalResult}`);

    const result2 = await client.agents.grokComputerUse.startAndWait({
      task: "Tell me how many upvotes the first post has.",
      sessionId: session.id,
    });

    console.log(`\nOutput:\n${result2.data?.finalResult}`);
  } catch (err) {
    console.error(`Error: ${err}`);
  } finally {
    await client.sessions.stop(session.id);
  }
};

main().catch((err) => {
  console.error(`Error: ${err.message}`);
});

import os
from hyperbrowser import Hyperbrowser
from hyperbrowser.models import StartGrokComputerUseTaskParams
from dotenv import load_dotenv

load_dotenv()

client = Hyperbrowser(api_key=os.getenv("HYPERBROWSER_API_KEY"))


def main():
    session = client.sessions.create()

    try:
        resp = client.agents.grok_computer_use.start_and_wait(
            StartGrokComputerUseTaskParams(
                task="What is the title of the first post on Hacker News today?",
                session_id=session.id,
                keep_browser_open=True,
            )
        )

        print(f"Output:\n{resp.data.final_result}")

        resp2 = client.agents.grok_computer_use.start_and_wait(
            StartGrokComputerUseTaskParams(
                task="Tell me how many upvotes the first post has.",
                session_id=session.id,
            )
        )

        print(f"\nOutput:\n{resp2.data.final_result}")
    except Exception as e:
        print(f"Error: {e}")
    finally:
        client.sessions.stop(session.id)


if __name__ == "__main__":
    try:
        main()
    except Exception as e:
        print(f"Error: {e}")

Always set keepBrowserOpen: true on tasks that you want to reuse the session from. Otherwise, the session will be automatically closed when the task completes.

Using Your Own API Keys

Bring your own xAI API key to avoid consuming Hyperbrowser credits for LLM calls. You’ll still be charged for browser session usage, but save on token costs.

import { Hyperbrowser } from "@hyperbrowser/sdk";
import { config } from "dotenv";

config();

const client = new Hyperbrowser({
  apiKey: process.env.HYPERBROWSER_API_KEY,
});

const main = async () => {
  const result = await client.agents.grokComputerUse.startAndWait({
    task: "What is the title of the first post on Hacker News today?",
    useCustomApiKeys: true,
    apiKeys: {
      xai: "<XAI_API_KEY>",
    },
  });

  console.log(`Output:\n\n${result.data?.finalResult}`);
};

main().catch((err) => {
  console.error(`Error: ${err.message}`);
});

import os
from hyperbrowser import Hyperbrowser
from hyperbrowser.models import StartGrokComputerUseTaskParams, GrokComputerUseApiKeys
from dotenv import load_dotenv

load_dotenv()

client = Hyperbrowser(api_key=os.getenv("HYPERBROWSER_API_KEY"))


def main():
    resp = client.agents.grok_computer_use.start_and_wait(
        StartGrokComputerUseTaskParams(
            task="What is the title of the first post on HackerNews today?",
            use_custom_api_keys=True,
            api_keys=GrokComputerUseApiKeys(
                xai="<XAI_API_KEY>",
            )
        )
    )

    print(f"Output:\n\n{resp.data.final_result}")


if __name__ == "__main__":
    try:
        main()
    except Exception as e:
        print(f"Error: {e}")

curl -X POST https://api.hyperbrowser.ai/api/task/grok-computer-use \
  -H "Content-Type: application/json" \
  -H "x-api-key: YOUR_HYPERBROWSER_API_KEY" \
  -d '{
    "task": "What is the title of the first post on Hacker News today?",
    "useCustomApiKeys": true,
    "apiKeys": {
      "xai": "YOUR_XAI_API_KEY"
    }
  }'

Session Configuration

Customize the browser session used by Grok Computer Use with session options.

import { Hyperbrowser } from "@hyperbrowser/sdk";
import { config } from "dotenv";

config();

const client = new Hyperbrowser({
  apiKey: process.env.HYPERBROWSER_API_KEY,
});

const main = async () => {
  const result = await client.agents.grokComputerUse.startAndWait({
    task: "What is the title of the first post on Hacker News today?",
    sessionOptions: {
      acceptCookies: true,
    }
  });

  console.log(`Output:\n\n${result.data?.finalResult}`);
};

main().catch((err) => {
  console.error(`Error: ${err.message}`);
});

import os
from hyperbrowser import Hyperbrowser
from hyperbrowser.models import StartGrokComputerUseTaskParams, CreateSessionParams
from dotenv import load_dotenv

load_dotenv()

client = Hyperbrowser(api_key=os.getenv("HYPERBROWSER_API_KEY"))


def main():
    resp = client.agents.grok_computer_use.start_and_wait(
        StartGrokComputerUseTaskParams(
            task="What is the title of the first post on Hacker News today?",
            session_options=CreateSessionParams(
                accept_cookies=True,
            ),
        )
    )

    print(f"Output:\n\n{resp.data.final_result}")


if __name__ == "__main__":
    try:
        main()
    except Exception as e:
        print(f"Error: {e}")

curl -X POST https://api.hyperbrowser.ai/api/task/grok-computer-use \
  -H 'Content-Type: application/json' \
  -H 'x-api-key: <YOUR_API_KEY>' \
  -d '{
      "task": "What is the title of the first post on Hacker News today?",
      "sessionOptions": {
          "acceptCookies": true
      }
  }'

sessionOptions only applies when creating a new session. If you provide a sessionId, these options are ignored.

Proxies and CAPTCHA solving add latency to page navigation. Only enable them when necessary for your use case.

Best Practices

Write clear, specific task descriptions

Be explicit about what you want Grok to do. Instead of “check the website”, say “go to example.com, find the pricing page, and extract the cost of the Enterprise plan”.

Set appropriate maxSteps

Simple tasks need 10-20 steps. Complex multi-page workflows might need 50+ steps. Monitor failed tasks and adjust accordingly.

Reuse sessions for multi-step workflows

It is usually better to split up complex tasks into smaller, more manageable ones and execute them as separate agent calls on the same session.

Get Started

Browser Sessions

Session Configuration

Web API

Agents

HyperAgent Usage

Scraping

Integrations

How It Works

Installation

Quick Start

Async Pattern

Stop a Running Task

Parameters

Reuse Browser Sessions

Using Your Own API Keys

Session Configuration

Best Practices

​How It Works

​Installation

​Quick Start

​Async Pattern

​Stop a Running Task

​Parameters

​Reuse Browser Sessions

​Using Your Own API Keys

​Session Configuration

​Best Practices

How It Works

Installation

Quick Start

Async Pattern

Stop a Running Task

Parameters

Reuse Browser Sessions

Using Your Own API Keys

Session Configuration

Best Practices