Create these Web Special Files in the root folder
.htaccess
Contains the permanent 301 redirect to unify your website with and without “www” + Names the Error page + Redirects pages
| RewriteEngine On | |
| RewriteCond %{HTTP_HOST} ^domain.com | : Unify URLs |
| RewriteRule (.*) http://www.domain.com/$1 [R=301,L] | : Unify URLs |
| ErrorDocument 404 /error-page.html | : Error page Name |
| redirect permanent /old.html http://www.domain.com/new.html | : Redirect pages |
| … | : (repeat for more redirects) |
sitemap.xml
File that lists the URLs for your website
| <?xml version=”1.0″ encoding=”UTF-8″ ?> | |
| <urlset xmlns=”http://www.google.com/schemas/sitemap/0.84″> | |
| <url> | |
| <loc>http://www.domain.com/page.html</loc> | : Existing page |
| <priority>0.9</priority> | : Page Priority 0 to 1 |
| <lastmod>2013-12-31</lastmod> | |
| <changefreq>weekly</changefreq> | |
| </url> | |
| … | : (repeat for more pages) |
| </urlset> |
robots.txt
File that lists files and folders that Google Spider should not crawl + Names the Sitemap
| User-Agent: * | : Applies to all Robots |
| Disallow: /folder/ | : Folder |
| Disallow: /file | : File |
| … | : (repeat for more foldres/files) |
| sitemap: http://www.domain.com/sitemap.xml | : Sitemap Name |
error-page.html
File containing the 404 error page message