Find answers to all frequently asked questions (FAQs) about the “Sitemap & URLs” screen. This tag covers managing your knowledge base , including adding new pages , recrawling updated content , and managing your links.
Understanding how Sideconvo works is the first step to answering this question. Sideconvo indexes all your website URLs and any additional knowledge you upload and stores it in a vector database. Additionally, your site description and special instructions are used as foundational instructions. When you have a conversation with Sideconvo, the answer is constructed exclusively […]
The most reliable way to ensure 100% coverage of your website is to have a valid sitemap.xml accessible. Without a sitemap acting as a roadmap, our crawler discovers content by simply following links starting from your homepage, which may not reach every page on larger or complex websites. If adding a sitemap isn’t possible, you […]
First, try opening the link in a new tab to see if it works. If it does, you can use the “Recrawl” function to try again. If the link is permanently broken, you can “Delete” it to remove it from the list.
These are URLs that the system tried to crawl but could not access. This is often due to the page being temporarily down, a broken link (404 error), or a server issue. The reason for the failure is usually displayed with the link.
Excluding a URL is like archiving it; it’s removed from the knowledge base but can be brought back later. Deleting a URL (from “My Links” or “Failed Links”) is a permanent removal from the system.
You only have direct delete permissions over URLs you have explicitly curated. To delete a discovered link, you must first “Save to My Links”, and then you can delete it from there.
Yes. Recrawling a page will always replace any manual edits with the fresh content from the live web page.
You need to trigger a “Recrawl”. Find the URL in the list and click the circular arrow icon. This tells the system to visit the page again and fetch the latest content.
Excluding a link removes it from your Sideconvo’s active knowledge base, meaning its content won’t be used to answer questions. However, the system still remembers the URL, and you can see it by selecting the “Excluded Links” filter.
The search function is tied to your current filter. If you’re searching for a URL that’s in “Discovered Links” but you have the “My Links” filter active, it won’t appear. Try clearing the filter to “Show All Active” and search again.
“Discovered Links” are pages found automatically by the system. “My Links” is a curated list that you manage directly. Saving a URL to “My Links” gives you more control, such as the ability to delete it. All URLs you add are in ‘My Links’.
The Details View is disabled during the crawling process because the content is actively being updated. The view will become available as soon as the crawl is successful and complete.
Crawling is the process where the system visits a web page, reads its content, and formats it into a structured document (markdown) that Sideconvo can use.
Yes. In the “+ New URL” screen, you can paste a list of URLs. Just make sure each URL is on a new line.
Click the “+ New URL” button, paste the full URL (or a list of URLs), and click “Add URLs”. The system will then crawl the page to extract its content.
The system automatically discovers pages by crawling your website’s sitemaps. These initial pages appear under the “Discovered Links” filter.
This screen is the control center for all the web page content your assistant uses to answer questions. You can add new pages, update existing ones, and manage the overall knowledge base.
Empower visitors to ask questions and get instant, helpful answers