FAQ Database Discussion Community


Is it necesary to generate sitemaps for old indexed urls?

seo,search-engine,sitemap
I have a web site with content from 2001 and I need to remake the sitemap. Question arises: if the old urls have already been indexed do I need to add them again (the same urls) to the sitemap even if not haven't changed? for example: the sitemap have this...

how google crawls dynamic pages? [closed]

php,seo,search-engine,googlebot
I am about to create an Online Shopping site for my one of the client. I have to make this site SEO Friendly and therefore I must have to understand few things before I proceed to make a custom CMS Based website. As I said I am going to make...

Automatic Search Using WWW::Mechanize

perl,file,search-engine,webpage,www-mechanize
I am trying to write a Perl script which will automatically key in search variables on this LexisNexis search page and retrieve the search results. I am using the WWW::Mechanize module but I am not sure how to figure out the field name of the search bar itself. This is...

How does trec_eval calculates Mean Average Precision (MAP)?

search-engine,information-retrieval,data-retrieval
I'm using TREC_EVAL to evaluate a search engine. I'd like to know how it calculates the Mean Average Precision (MAP). I'm sure it doesn't calculate a simple average of the average precisions (AP). It seems a weighted arithmetic but I can't understand which weights are used.

Replacing .html files with .php files while maintaining search engine rankings

php,html,.htaccess,search-engine
I maintain a website that contains a dozen or so .html documents which I have just rewritten to include php code. As search engines currently index the .html documents, I would rather not break those links and I certainly don't want to do anything that will affect my search rankings....

Natural Language Search (user intent search)

nlp,search-engine,keyword,voice-recognition,naturallyspeaking
I'm trying to build a search engine that allows my users to search with natural language commands, just like Google Now. Except, my search engine is slightly more constrained, in that it is mainly going to be used within an e-commerce site, and allow the users to search for certain...

Umbraco Omitting Media files from search results

c#,razor,umbraco,search-engine
As my title suggests, I am wanting my search code to omit anything in my media folder. Right now, if I search for "test" it will bring back any page with the word test in it as well as any document or image which has test on it as well....

Fulltext Search engine, multiple columns, boolean mode

php,android,full-text-search,search-engine,boolean-search
I am making a search engine for an android app that does fulltext search and match against multiple columns against '+word1 +word2' in boolean mode. However, I can't get any search result. E.g. search field type- "open sea" then, Sql will search Match...Against ('+open +sea' IN BOOLEAN MODE) and display...

Where can I find a corpus of search engine queries?

nlp,search-engine,google-search,bing
I'm interested in training a question-answering system on top of user-generated search queries but so far it looks like such data is not made available. Are there some research centers or industry labs that have compiled corpora of search-engine queries?

Disallow specific folders in robots.txt with wildcards

seo,search-engine,robots.txt,google-crawlers
Can i hide specific folders from crawlers with wildcards like: User-agent: * Disallow: /system/ Disallow: /v* I want to hide all folders starts with "v" character. It will work this way?...

Can anyone help me make the search bar work as I now have the JS prompt? [on hold]

javascript,html5,search,youtube-api,search-engine
I have created a small program that pulls from the YouTube API which allows you to search for a random video for whatever title you enter when prompted. My goal is to have this work like a search engine. I would like to make my search bar the input instead...

Search functionality outputting as 'array'

php,html,mysql,arrays,search-engine
I followed a tutorial on how to make a search bar functional and I am not seeing what I'm doing wrong. I am trying to give users the option to search for products. The end result is everything is being out-putted as 'Array'. The correct amount of search results show...

Elasticsearch two sets of terms against two fields

elasticsearch,search-engine
I'm trying to use Elasticsearch to return docs that have different terms in two fields. Not knowing how to write this it would be something like this: query: field1: "term set #1" field2: "very different term set #2" Ideally the term sets would be arrays of strings. I'd like all...

How to make the most match item to the top in ElasticSearch query result

search,elasticsearch,search-engine
I'm using ElasticSearch to build a e-commerce search engine like nexttag.com or thefind.com. There are some item like: iPhone 6 Case - iPhone 6 Wallet Case , iPhone 6 Leather Case ,Flip Wallet Leather Case Cover with Credit Card Holder For Apple iPhone 6 4.7'' Black iPhone 6 / 6...

Search SharePoint Foundation 2013 Picture Library by terms defined in Keywords field

metadata,sharepoint-2013,search-engine,picturegallery
Since Term Store functionality (and probably most of metadata functionality) isn't available in SharePoint Foundation 2013, I couldn't find a way to search through the pictures using some sort of tagging. Thus I decided to employ something what is available already in Foundation version. When you edit the picture, you...

Using Google Custom Search engine with a little privacy

javascript,html,search-engine,google-search
I would like to use a Google Custom Search Engine on my website. With Google's default implementation, you have to put Javascript on each page that has the search box. For privacy reasons, I would like to load that Javascript only for those users who actually use the search engine....

robots.txt allow all except few sub-directories

seo,search-engine,cpanel,robots.txt,shared-hosting
I want my site to be indexed in search engines except few sub-directories. Following are my robots.txt settings: robots.txt in the root directory User-agent: * Allow: / Separate robots.txt in the sub-directory (to be excluded) User-agent: * Disallow: / Is it the correct way or the root directory rule will...

How do I create search like excel in DataGridView?

c#,excel,datagridview,find,search-engine
I used this code to search in DataGridView to find and select a row (no filter)! But, when DataGridView has repetitive values in rows it won't get the next row! How do I go to the next row with every click to Btn_find (Find similar to Excel)? private void button1_Click(object...

Multiple Aggregate Ratings of Schema.org

seo,search-engine,schema.org,serp
I have multiple aggregate ratings snippets in one page. Is there a way to make one of them the default one? The one that will be displayed in the results of Search Engines? Thanks all! Update: That webpage is, essentially, the page of a Brand. It contains the aggregate ratings...

ERROR: index 'products': too many string attributes (current index format allows up to 4 GB)

database,indexing,full-text-search,search-engine,sphinx
Got this when tried to index table in database with 25GB of data. Sphinx contains index declaration with following fields: sql_field_string = field_indexer #some keywords sql_field_string = product_name sql_field_string = description sql_attr_float = price sql_field_string = product_url sql_field_string = image_url sql_field_string = sku sql_attr_uint = merchant_id sql_attr_uint = network_id All...

Questions about CACM collection

search-engine,information-retrieval,data-retrieval
I'm using CACM document collection. I tried to search more information on this collection online but unfortunately I didn't find what I was looking for. If I've understood correctly, this collection contains documents from a paper journal. As far as this is concerned, I don't understand why every document always...

Search box/field design with multiple search locations

python,search,design,search-engine,pyramid
Not sure if this question is better suited for a different StackExchange site but, here goes: I have a search page that searches a number of different type of things. All (at the moment) requiring a different input field for each type of search. For example, one might search for...

PHP mySQL search not working

php,html,mysql,search,search-engine
<?php $username = "root"; $password = ""; $hostname = "localhost"; $db_handle = mysql_connect($hostname, $username, $password) or die ("Could not connect to database"); $selected= mysql_select_db("login", $db_handle); $output=''; if(isset($_POST['search'])){ $searchq = $_POST['search']; $query= "SELECT * FROM PHP_Item WHERE Name LIKE '%searchq%' OR Description LIKE '%serachq%'" or die ("could not search"); $result= mysql_query($query);...