“”

TYPO3 sitemap crawler TYPO3 sitemap crawler

sitecrawler / stable

This extension provides a Symfony command to crawl any sitemap including all sub sitemaps. It gathers all available urls and then calls each url. This way you can warm up the TYPO3 page cache. Any standard sitemap can be crawled: TYPO3, Shopware, ...

This version supports TYPO3

Older versions also support TYPO3

Composer support

composer req schliesser/sitecrawler

Tags

#sitemap #crawl #fetch #cache #cachewarumup

Last upload comment

Major release v3.0.0

Version 3.0.0 supports now gzipped sub sitemaps and TYPO3 v13.
Dropped support for TYPO3 v11 and older.

Downloads by month

Download 3.0.0 External Manual Found an Issue? Code Insights Packagist.org
Author
André Buchmann
Last update
15. May 2024
First upload
26. Feb 2020
Downloads
23,191
Category
Backend
Dependencies
  • TYPO3 (12.4.0 - 13.4.99)

Installation

  1. Download ZIP file
  2. Log into your TYPO3 backend
  3. Go to Extension Manager module
  4. Press the upload button on the top bar
  5. Select the ZIP file and upload it. If you want to overwrite an existing extension installation, activate the checkbox.
  1. Go to your folder where the root composer.json file is located
  2. Type: composer req schliesser/sitecrawler to get the latest version that runs on your TYPO3 version.
  1. Download T3X file
  2. Log into your TYPO3 backend
  3. Go to Extension Manager module
  4. Press the upload button on the top bar
  5. Select the T3X file and upload it. If you want to overwrite an existing extension installation, activate the checkbox.

Other extensions by this user (1)

Credits: Image copyright listing Credits: Image copyright listing
(credits)

Give credits: Automatically list all used images with their copyright. Multisite support.

Supported TYPO3 versions:
Last upload: 10. Jun 2024

Version history

Version Upload comment Works with TYPO3 Download
3.0.0 / stable
May 15, 2024 		Major release v3.0.0

Version 3.0.0 supports now gzipped sub sitemaps and TYPO3 v13.
Dropped support for TYPO3 v11 and older.
12.4.0 - 13.4.99 Download
2.0.1 / stable
April 25, 2023 		Maintenance release v2.0.1

Supports TYPO3 12 now!
10.4.0 - 12.4.99 Download
2.0.0 / stable
August 05, 2022 		Major Release v2.0.0

New option '--list=json' to export the gathered url list as json or txt.
Refactored the command and dropped support for TYPO3 9.5.
10.4.0 - 11.5.99 Download
1.1.2 / stable
July 08, 2022 		Maintenance release v1.1.2

- Readme and description updated
- License changed to GPL-2.0-or-later
9.5.0 - 11.5.99 Download
1.1.1 / stable
April 26, 2022 		Bugfix release v1.1.1

Robots.txt resolver checks for query part on root level path. A single sitemap (e.g. for news) can be crawled again.
9.5.0 - 11.5.99 Download
1.1.0 / stable
October 03, 2021 		[TASK] Update readme

Closes #8
9.5.0 - 11.5.99 Download
1.0.1 / stable
August 12, 2020 		Merge pull request #6 from schliesser/feature/testing-and-ci-integration

Feature/testing and ci integration
9.5.0 - 10.4.99 Download
1.0.0 / stable
February 26, 2020 		First release of TYPO3 sitemap crawler

This extension provides a Symfony command to crawl the sitemap including all sub sitemaps. It gathers all available urls and than calls each url to warm up the TYPO3 page cache.
9.5.0 - 10.4.99 Download