OpenAI

Configuration > API Access > AI > OpenAI

To connect to OpenAI you will need a funded OpenAI account and an OpenAI API key. This is different to a ChatGPT subscription.

You can sign up to an OpenAI account, select your use as ‘API’, and then head over to the billing section to fund the account.

If you don’t fund the account, it will not work. You’re able to select to add a fixed amount of credit to the account, as well as adjust spending limits. Please carefully review their API pricing and token costs.

When you have an API key, copy and paste it into the ‘API Key’ field in the OpenAI Account Information tab.

Click ‘Connect’ when you wish to use the set up for a crawl.

Navigate to the ‘Prompt Configuration’ tab, to set up up to 100 prompts against crawl data.

Select the category of model (ChatGPT, Moderation or Embeddings), the OpenAI model used (for example, ‘gpt-4o’), content type and data to be used for the prompt, such as body text, HTML, or a custom extraction, as well as write your custom prompt.

Please note: To use ‘Page Text’ or ‘HTML’ for the prompt, you will need to enable ‘Store HTML‘ via ‘Config > Spider > Extraction’.

To test a prompt, use the ‘play’ icon to the right of the prompt field.

In the OpenAI prompt tester, input the URL to test and click the ‘Test’ button to display both the extraction, and response.

Data from the prompt will appear in the AI tab (and Internal tab, against your usual crawl data).

The ‘Add from Library’ function includes half a dozen prompts for inspiration.

You’re able to add and customise your own using the ‘Add from Library’ button, clicking ‘User’ and the ‘+’ button.

Custom prompts can be shared using the export and import buttons at the top.

Read our full tutorial on How To Crawl With AI Prompts.