During the configuration of the Zendesk crawler, we are encountering issues with the validation of sitemaps generated by e-commerce platforms such as Bigcommerce and Shopify.
The validation policies seem to be too restrictive, preventing the proper indexing of content.
Specific examples:
-
Bigcommerce: The main sitemap is available at the URL
example.org/xmlsitemap.php. This URL is rejected because it does not have the .xml extension, even though it is a valid XML file. Even when specifying more granular URLs likeexample.org/xmlsitemap.php?type=products&page=1to index only products, the system continues to reject the URL both for the .php extension and the presence of URL parameters. - Shopify: The main sitemap is available at example.org/sitemap.xml, which is a sitemap index. When trying to index only the products via URLs like example.org/sitemap_products_1.xml?from=7417528942729&to=14935079453047 , the system rejects it due to the presence of URL parameters, even though the .xml extension is correct.
These restrictions prevent us from fully leveraging the crawler's features to effectively index our content.
We kindly ask that you review the sitemap validation policies to allow the use of URLs without the .xml extension (when the content is actually XML) and to properly handle URL parameters, especially when they are used to filter specific content within a sitemap file.
Thank you for your attention.
Thank you for taking the time to provide us with your feedback. This has been logged for our PM team to review. For others who may be interested in this feature request, please add your support by upvoting this post and/or adding your use case to the comments below. Thank you again!