We have a custom Sitemap Provider that includes users profile to the sitemap,  This was working properly until we reach 60K+ profiles, now are having "Thread was being aborted." error.

Would like to ask whats the best way of adding large datasets to the Search Engine sitemap?  Is it possible to load data per page then just incrementally add it to the sitemap?

Thanks