> ## Documentation Index
> Fetch the complete documentation index at: https://docs.xpander.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# Apify

> Learn how to integrate AI agents with Apify using xpander.ai. Create intelligent agents that can gather information from websites, monitor online content, and automate repetitive web tasks.

## About Apify

**Apify** is a cloud-based web scraping and automation platform built for developers, AI agents, and data-driven applications. Apify enables software and autonomous agents to extract structured data from websites, run browser automation workflows, and operate large-scale crawling jobs without managing infrastructure.

Unlike basic scraping scripts or manual crawlers, Apify provides a scalable execution environment with managed proxy rotation, distributed task processing, scheduling, and persistent storage. Developers can deploy reusable Actors (serverless automation units), orchestrate multi-step data-collection workflows, and programmatically access datasets via a robust API.

## Authentication Options

Below are possible authentication options you can choose:

<Tabs>
  <Tab title="API Access">
    ### Generate an Apify API Key

    1. Log in to your [Apify account](https://console.apify.com/).

    2. Select **Settings**, then click **API & Integrations**.

           <img src="https://mintcdn.com/xpanderai-099931d1/VsRpda9_0y4b_abK/images/connectors/apify/img_1.png?fit=max&auto=format&n=VsRpda9_0y4b_abK&q=85&s=5fd5cf8f13f5a95dddab5f82edf18c4f" alt="Img 1" width="2880" height="1558" data-path="images/connectors/apify/img_1.png" />

    3. Click **+ Create a new token** to create a new API key.

    4. Click **Create** in the dialog that appears to create your new API key..

           <img src="https://mintcdn.com/xpanderai-099931d1/VsRpda9_0y4b_abK/images/connectors/apify/img_2.png?fit=max&auto=format&n=VsRpda9_0y4b_abK&q=85&s=17fd7b9c8f78132865cded0e5226d5b0" alt="Img 2" width="2124" height="1534" data-path="images/connectors/apify/img_2.png" />

    5. The new API key will appear on the page. Click the copy icon next to the API key to copy the generated key, then store it in a safe place..

           <img src="https://mintcdn.com/xpanderai-099931d1/VsRpda9_0y4b_abK/images/connectors/apify/img_3.png?fit=max&auto=format&n=VsRpda9_0y4b_abK&q=85&s=0538e2008dd4c823774b52309b5be8c3" alt="Img 3" width="2880" height="1550" data-path="images/connectors/apify/img_3.png" />

    ### Integrate Apify into xpander.ai

    1. Go to the **Connectors** section in the sidebar of your xpander.ai dashboard.
    2. Select **Apify** from the available integrations.
    3. Click **+ Create new connection**.
    4. Enter a **connector name** as desired, e.g., "xpander-apify".
    5. Choose **API Key** as the authentication method.
    6. Paste your Apify access token into the provided field.
    7. Choose **Bearer** as the **Auth Type**.
    8. Save the configuration.

           <img src="https://mintcdn.com/xpanderai-099931d1/VsRpda9_0y4b_abK/images/connectors/apify/img_4.png?fit=max&auto=format&n=VsRpda9_0y4b_abK&q=85&s=18ab562e5abcc9be4389e8d7fc745bba" alt="Img 4" width="2120" height="1356" data-path="images/connectors/apify/img_4.png" />
  </Tab>
</Tabs>

## Integration of Apify into an AI Agent

Once you’ve configured your Apify connector with the authentication option described above, you can integrate it into your AI agent with xpander.ai:

1. In your xpander.ai dashboard, navigate to the **Agents** page, then click an agent to open the **Agent Configuration** tab.

2. Select **Tools**, then click **Add Tools**.

3. Select **Connectors**.

4. Choose **Apify** with the same **connector name** you configured in the previous section (e.g., xpander-apify).

5. Select the available Apify operations that suit your use case.

   To grant your agent web scraping capabilities, enable the following operations.

   * **Start Actor Run**
   * **List Actor Runs (By Actor)**
   * **Get Actor Last Run**
   * **Create Actor**
   * **List Actors**

6. Click **Deploy** to update your agent.

<img src="https://mintcdn.com/xpanderai-099931d1/VsRpda9_0y4b_abK/images/connectors/apify/img_5.png?fit=max&auto=format&n=VsRpda9_0y4b_abK&q=85&s=aa4e3a01254fc3452fb095decb647e65" alt="Img 3" width="2880" height="1556" data-path="images/connectors/apify/img_5.png" />

## AI Agent Apify Prompt Library

Below are possible prompts or use cases you can try after integrating Apify into your xpander.ai AI agent:

```
Run a web scraping task to extract the top 10 results for “wireless noise cancelling headphones” from Amazon, including price and rating.
```

```
Check our competitor’s pricing page and report any changes in pricing or plans compared to the last saved dataset.
```

```
Collect the first 20 LinkedIn job listings for “Head of Engineering” in Berlin and return the company names.
```

```
Monitor <website_url> daily and notify me if new content is published.
```

<img src="https://mintcdn.com/xpanderai-099931d1/VsRpda9_0y4b_abK/images/connectors/apify/gif_1.gif?s=137967bacfa15bda95a70ce43ea75632" alt="Gif 1" width="800" height="641" data-path="images/connectors/apify/gif_1.gif" />

## Related Resources

* [Using Tools & Connectors in the xpander.ai platform](/guides/agents/tools-connectors)
* [Apify Documentation](https://docs.apify.com/)
