Sitemap & URLs
Find answers to all frequently asked questions (FAQs) about the “Sitemap & URLs” screen. This tag covers managing your knowledge base , including adding new pages , recrawling updated content , and managing your links.
Find answers to all frequently asked questions (FAQs) about the “Sitemap & URLs” screen. This tag covers managing your knowledge base , including adding new pages , recrawling updated content , and managing your links.
Understanding how Sideconvo works is the first step to answering this question.
Sideconvo indexes all your website URLs and any additional knowledge you upload and stores it in a vector database. Additionally, your site description and special instructions are used as foundational instructions. When you have a conversation with Sideconvo, the answer is constructed exclusively from this knowledge, your site description and any special instructions you provide.
Experiment in the Playground with conversations and observe the related links that are presented with the Sideconvo response. If you do not find what you expect:
If the above does not work for you, the problem could be that other content is ranking higher in the results. If you think this is the case, consider the content on that page:
Finally, the process for Knowledge & PDFs is mostly the same.
The most reliable way to ensure 100% coverage of your website is to have a valid sitemap.xml accessible. Without a sitemap acting as a roadmap, our crawler discovers content by simply following links starting from your homepage, which may not reach every page on larger or complex websites. If adding a sitemap isn’t possible, you can also use our “Bulk Add” feature to manually upload a list of specific URLs you want the system to learn from.
First, try opening the link in a new tab to see if it works. If it does, you can use the “Recrawl” function to try again. If the link is permanently broken, you can “Delete” it to remove it from the list.
These are URLs that the system tried to crawl but could not access. This is often due to the page being temporarily down, a broken link (404 error), or a server issue. The reason for the failure is usually displayed with the link.
Excluding a URL is like archiving it; it’s removed from the knowledge base but can be brought back later. Deleting a URL (from “My Links” or “Failed Links”) is a permanent removal from the system.
You only have direct delete permissions over URLs you have explicitly curated. To delete a discovered link, you must first “Save to My Links”, and then you can delete it from there.
Yes. Recrawling a page will always replace any manual edits with the fresh content from the live web page.
You need to trigger a “Recrawl”. Find the URL in the list and click the circular arrow icon. This tells the system to visit the page again and fetch the latest content.
Excluding a link removes it from your Sideconvo’s active knowledge base, meaning its content won’t be used to answer questions. However, the system still remembers the URL, and you can see it by selecting the “Excluded Links” filter.
The search function is tied to your current filter. If you’re searching for a URL that’s in “Discovered Links” but you have the “My Links” filter active, it won’t appear. Try clearing the filter to “Show All Active” and search again.