Infrastructure/ghost
0
Fork 0
mirror of https://github.com/TryGhost/Ghost.git synced 2025-01-06 22:40:14 -05:00
Code Issues Activity

🐛 Fixed /p/ redirects not being indexed by search engines (#19864)

Browse source 
ref
[ENG-741](https://linear.app/tryghost/issue/ENG-741/🐛-our-robotstxt-config-causes-indexing-issues-for-customers-who-have)

`/p/` has been dropped from the `robots.txt` file so that search engines
can index the pages at these locations. In the event that the page at
the location is a preview page, the existing robots meta tag on the page
will prevent indexing.
This commit is contained in:
Michael Barrett 2024-03-14 14:44:54 +00:00 committed by GitHub
parent 39da5a1f88
commit 60d81b2003
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
2 changed files with 0 additions and 4 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

1
ghost/core/core/frontend/public/robots.txt
View file

@ -1,7 +1,6 @@
User-agent: * User-agent: *
Sitemap: {{blog-url}}/sitemap.xml Sitemap: {{blog-url}}/sitemap.xml
Disallow: /ghost/ Disallow: /ghost/
Disallow: /p/
Disallow: /email/ Disallow: /email/
Disallow: /r/ Disallow: /r/
Disallow: /webmentions/receive/ Disallow: /webmentions/receive/

3
ghost/core/test/e2e-frontend/default_routes.test.js
View file

@ -319,12 +319,9 @@ describe('Default Frontend routing', function () {
.expect(200) .expect(200)
.expect(assertCorrectFrontendHeaders); .expect(assertCorrectFrontendHeaders);
// The response here is a publicly documented format users rely on
// In case it's changed remember to update the docs at https://ghost.org/help/modifying-robots-txt/
res.text.should.equal( res.text.should.equal(
'User-agent: *\n' + 'User-agent: *\n' +
'Sitemap: http://127.0.0.1:2369/sitemap.xml\nDisallow: /ghost/\n' + 'Sitemap: http://127.0.0.1:2369/sitemap.xml\nDisallow: /ghost/\n' +
'Disallow: /p/\n' +
'Disallow: /email/\n' + 'Disallow: /email/\n' +
'Disallow: /r/\n' + 'Disallow: /r/\n' +
'Disallow: /webmentions/receive/\n' 'Disallow: /webmentions/receive/\n'