Content: Low Relevance Content

Pages that are potentially less relevant or off-topic compared to the overall content theme of the website based upon the configured low relevance threshold.

Low semantic similarity to the overall site focus might indicate irrelevant pages or those that do not fit the general content theme.

How to Analyse in the SEO Spider

View URLs with this issue in the ‘Content’ tab and ‘Low Relevance Content’ filter.

To populate this filter an embeddings prompt must be set up from an AI provider as outlined in the embeddings configuration. The ‘Enable Low Relevance’ configuration must be selected in ‘Config > Content > Embeddings’, and post ‘Crawl Analysis’ must be performed.

The low relevance threshold can be adjusted under ‘Config > Content > Embeddings’ and defaults to 0.4.

The ‘Semantic Relevance Score’ column displays the similarity to the Centroid. The Centroid is derived by averaging the embeddings of all crawled pages to understand the site focus.

The algorithm is run against text on the page, rather than the full HTML. The content used for this analysis can be configured under ‘Config > Content > Area’.

Please read our tutorial How to Identify Semantically Similar Pages & Outliers.

What Triggers This Issue

This issue is triggered when pages are semantically low in relevance compared to the main content theme of the website based upon the configured low relevance threshold (defauted to 0.4).

The main content theme or ‘site focus’ is derived by averaging the embeddings of crawled pages to calculate a centroid. Outlier and low relevance pages are those further away from the centroid.

How To Fix

Review pages to ensure they are relevant, appropriate and the content is as expected considering the core theme of the website.

Consider removing or adjusting irrelevant and off-topic content where appropriate.

Pages such as privacy and terms and conditions might have low relevance compared to the main content theme, but should obviously be retained.