Task: Investigate why the website is poorly indexed
Investigate why the website is poorly indexed
Need to double-check Google and Yandex Webmaster in more detail. Most likely, the queue is simply clogged with old pages that have long been lost from the site. That is, we need to let them know that these pages don't need to be searched for, and that new pages need to be indexed.
Ворклоги
But in Google the situation is better, it caught the latest changes faster and started indexing new pages.
For now, the situation in Yandex is as follows:
By the way, there will be more pages. Google devoured the sitemap and sees 90+ pages for tasks alone.
Now it's important to work on the task page to make it more informative (which project it belongs to, what logs there were, more detailed worklogs (to make it more content-rich and useful, etc.)). Without this, there is a risk of getting penalized (pessimization). That is, if there are many boilerplate pages with a small amount of content, neither Google nor Yandex likes that.
Yandex, judging by everything, is still more focused on old pages, although it has already seen the new ones via the sitemap too.
Here, all these many thousands are old pages that have been on another resource for many years, and I set up redirects here a week ago.
But right now it is re-crawling about one and a half to two thousand pages a day, specifically the old ones, without looking at the new ones.
I added the new sections to it manually, maybe it will index them faster.
Just in case, I also added a disallow rule for the old sections in robots.txt.
Disallow: /comments
Disallow: /profile
Disallow: /templates