diff options
| author | Alex Pott <alex.a.pott@googlemail.com> | 2022-10-05 12:58:39 +0100 |
|---|---|---|
| committer | Alex Pott <alex.a.pott@googlemail.com> | 2022-10-05 12:58:39 +0100 |
| commit | 198b03a0e59e5cab35b69bf224c5a2bb40d7f717 (patch) | |
| tree | 67650379ef3135478b6ade4aa27e1a7c5e23594f /robots.txt | |
| parent | f4b955cfe0ce525490fc32d43f6120898b8cd49d (diff) | |
| download | drupal-198b03a0e59e5cab35b69bf224c5a2bb40d7f717.tar.gz drupal-198b03a0e59e5cab35b69bf224c5a2bb40d7f717.zip | |
Issue #3271222 by Rajab Natshah, yogeshmpawar, BramDriesen: Include Disallow Oembed media links in the robots.txt file for better Drupal SEO
Diffstat (limited to 'robots.txt')
| -rw-r--r-- | robots.txt | 4 |
1 files changed, 4 insertions, 0 deletions
diff --git a/robots.txt b/robots.txt index 18f8df8e693..ebcd04b96ca 100644 --- a/robots.txt +++ b/robots.txt @@ -49,6 +49,8 @@ Disallow: /user/register Disallow: /user/password Disallow: /user/login Disallow: /user/logout +Disallow: /media/oembed +Disallow: /*/media/oembed # Paths (no clean URLs) Disallow: /index.php/admin/ Disallow: /index.php/comment/reply/ @@ -59,3 +61,5 @@ Disallow: /index.php/user/password Disallow: /index.php/user/register Disallow: /index.php/user/login Disallow: /index.php/user/logout +Disallow: /index.php/media/oembed +Disallow: /index.php/*/media/oembed |