seo,sitemap,robots.txt , Use `robots.txt` in a multilingual site

Use `robots.txt` in a multilingual site


Tag: seo,sitemap,robots.txt

Having to manage a multilingual site, where users are redirected to a local version of site, like // for users from US, UK, etc.. // for users from France, Swiss, etc...

How should be organized the robots.txt file in pair with the sitemap? // with - Sitemap:
OR  // with - Sitemap:  // with - Sitemap:

kwnowing that en and fr sites are in fact independent entities not sharing common content, even if similar appearance.


You need to put one robots.txt at the top level.

The robots.txt file must be in the top-level directory of the host, accessible though the appropriate protocol and port number.


Multiple modals with galleries vs. a single dynamic one

Lets say we have a long list of posts on a single page. Each of those posts has a hidden div with multiple img tags inside it. When a user clicks on the post, the images inside the hidden div should be showcased in a modal gallery. Which approach is...

Wordpress - customized pages with blocks - prohibit google seo index of blocks

I'm using Wordpress and WooCommerce for my online shop. With the theme I'm using you can customize the product-category pages by adding "blocks". So if I want to have a text on the top of a product category page I simply create a block page, lets say its called "category-info"....

TYPO3 Extbase build own Sitemap

There are a lot of sitemap Generators for TYPO3 in the TER available. But none of them can handle Sites created by Extbase, which are not shown in the TYPO3 page tree. Edit Thanks to biesior, detailed informations: Unconventional I switch in TypoScript the GET Parameter for my Extbase extension[globalVar...

Change the unique generated title names of friendly-id using attribute of another table

I have a Company Model, and i am using friendly_id like this friendly_id :name, use: :slugged But since there can be many Company with the same name (different branches). I am trying to handle that case by using city attribute from the address of the Company. But the Company address...

proper use link hreflang

I use below link tag for multiple language, have two question should I add <link href="" rel="canonical"> in url or should I add <html lang='en'> in url and <html lang='es'> in <head> <!-- … --> <link href="" hreflang="x-default" rel="alternate"> <link href="" hreflang="en" rel="alternate"> <link href=""...

How Google “distinguishes” website articles from news? [closed]

When I search keywords from Google, it shows all articles related to these words and It has separate tab called "News", where Google shows related news. How Goolge "Knows" that article from site is about News? I have opened source codes of multiple news websites and they has "itemprops" in...

Slidershow jquery and convert to css

I downloaded script for slider show and it work without problems but after implemented this slide show i have problems with seo optimalization in HTML5. Because this code using this <div u=""> or <img u=""> and its still write me that i cant use this combination div with tag "u"....

Removing the number of first page in Yii2 Pagination from the URL

For SEO purposes I need to remove the first page number from the URL. i.e I have the following: and the two URLs points to the same contents of the view action. I want to make the pagination free from 1 in the URL. i.e first Page link... mandatory fields and the time needed until Google shows changes

I have implemented (using Microdata) inside my product pages and when I check Google Webmaster Tools it is crawled by Googlebot and interpreted successfully. The point is I have not implemented some properties inside Product type like brand. I need to know whether there is some subset of all...

Best JSON-LD practices: using multiple