Documentation indexing isn't easy to debug from the logs.

[MattiJarvinen]

Validations

• I believe this is a way to improve. I'll try to join the Continue Discord for questions
• I'm not able to find an open issue that requests the same enhancement

Problem

When I add new documentation like https://Angular.dev I only get one page indexed. VS Code developer tools aren't outputting any errors or anything to get to the bottom of the problem.

Solution

Add logging around the lines where articles are crawled.

Preferably log:

• crawled / found pages (url)
• pages without article
• articles added from url

If possible some logging level to adjust noisyness.

https://github.com/continuedev/continue/blob/5f4ac7ae50eff225992b91557d8bd56bad3c79ec/core/indexing/docs/DocsService.ts#L444C8-L448C32

[sestinj]

Definitely agreed that indexing isn't ideal right now. The first thing we're going to focus on is just making it actually work by default so that ideally nobody needs to debug. If we find this for some reason impossible then will look to add more logs! Otherwise want to avoid making things too noisy

[github-actions]

This issue hasn't been updated in 90 days and will be closed after an additional 10 days without activity. If it's still important, please leave a comment and share any new information that would help us address the issue.

[github-actions]

This issue was closed because it wasn't updated for 10 days after being marked stale. If it's still important, please reopen + comment and we'll gladly take another look!