FAQ Database Discussion Community


Which stoplist am I using?

sql-server,full-text-search
How do I determine which stoplist was associated with my full text index?

Why isn't my single-character full text search working?

sql-server,full-text-search,sql-server-2014
Given this code, I'm getting back no results: SELECT TOP 10 * FROM MyTable WHERE CONTAINS(TextColumn, '"W"') Things I've checked: Longer words return a result There are no stop LIST associated with this index There is definitely text such as "James W Brown" in the column The full text index...

How to escape string for SQLite FTS query

sqlite,full-text-search,fts4
I'm trying to perform a SQLite FTS query with untrusted user input. I do not want to give the user access to the query syntax, that is they will not be able to perform a match query like foo OR bar AND cats. If they tried to query with that...

How to query an external content FTS4 table but return additional columns from the original content table

android,sqlite,full-text-search,fts4
I am creating an FTS4 external content table in SQLite like this: CREATE TABLE t2(id INTEGER PRIMARY KEY, col_a, col_b, col_text); CREATE VIRTUAL TABLE fts_table USING fts4(content="t2", col_text); I'm using an external content table so that I don't need to store duplicate values of col_text in fts_table. I'm only indexing...

Why is exec sp_executesql much slower than inline sql?

c#,sql-server,ado.net,full-text-search,sp-executesql
I have test this query in management studio and this execute very fast(less than a second) declare @p_Message_0 varchar(3) = 'whh' declare @p_CreatedTime_0 datetime = '2015-06-01' SELECT count(1) FROM (SELECT * FROM [Logs](nolock) WHERE CONTAINS([Message], @p_Message_0) AND [CreatedTime]<@p_CreatedTime_0) t SELECT t2.* FROM (SELECT t.*,ROW_NUMBER() OVER (ORDER BY Id DESC) as...

Not able to search two fields simultaneously each using its own solr.StopFilterFactory filter

solr,full-text-search,sunspot-solr
I have defined two dynamic fields solr 5 schema: <dynamicField name="*_texts_en" stored="true" type="text_en" multiValued="true" indexed="true"/> <dynamicField name="*_texts_pt" stored="true" type="text_pt" multiValued="true" indexed="true"/> for documents in English and in Portuguese, with the following index and query analyzers: <fieldType name="text_en" class="solr.TextField" positionIncrementGap="100"> <analyzer type="index"> <charFilter class="solr.HTMLStripCharFilterFactory"/> <tokenizer...

'Find All' in Android Studio

android-studio,full-text-search
New to Android Studio and I wanted to find all instances of something across all java files. I read that shift+shift would bring up a 'Search Everywhere' box but it doesn't work. You can see from the image below that the text is in the open class and it says...

How to use COLLATE Latin1_General_CI_AI with Full text search column

sql-server-2008-r2,full-text-search
How to use 'COLLATE Latin1_General_CI_AI' with Full text search column in SQL Server 2008 R2. Select query should show all employees with first name Andres.It should also include names with accent. Accent Sensitivity option is ON for full text catalogs, it works if i use like operator but doesn't work...

Unable to set full-text index to 'active' in table-designer

sql-server,sql-server-2008-r2,full-text-search
In SQL Server 2008 R2 Management Studio, I have set my database to be full-text indexed and ran the command EXEC sp_fulltext_database 'enable' along with creating a catalog. When I open the table design mode, and right click the Primary Key, then click Full-Text Indexes in the context menu, I...

How to realize a context search based on synomyns?

mysql,sql,search,full-text-search
Lets say an internet user searches for "trouble with gmail". How can I return entries with "problem|problems|issues|issue|trouble|troubles with gmail|googlemail|google mail"? I don't like to manually add these linkings between different keywords so the links between "issue <> problem <> trouble" and "gmail <> googlemail <> google mail" are completly unknown....

Ignore leading zeros with Elasticsearch

elasticsearch,full-text-search
I am trying to create a search bar where the most common query will be for a "serviceOrderNo". "serviceOrderNo" is not a number field in the database, it is a string field. Examples: 000000007 000000002 WO0000042 123456789 AllTextss 000000054 000000065 000000874 The most common format is just an integer proceeded...

Common words not showing up in FULLTEXT search results

mysql,sql,full-text-search
I am using Full Text searching for a website I am making to order a users search query by relevance. This is working great with one problem. When a search term is populated in my table more than 50% of the time, that query is ignored. I am looking for...

Intersect search:search result set with cts:search result set that used cts:polygon geospatial search

full-text-search,xquery,intersection,marklogic,cts-search
I had to add geo-spatial search capability to an already existing app which uses search:search API and has full text search and faceted search. I've read about Extending the Search API, but I just don't have the time right now. So, I thought I will adapt my code in order...

Showing previous searches in PyCharm

eclipse,full-text-search,pycharm
Eclipse allows viewing one's previous searches in one's search history even going so far as to show the exact state in which one left a previous search. For example, if one removed (i.e. excluded) a search result from a previous search, that previous search is shown without that search result...

MariaDB 10.0 with SphinxSE

mysql,node.js,full-text-search,sphinx,mariadb
I have a question about integrating Sphinx with MariaDB 10.0. The db comes packaged with the SphinxSE storage engine, but I'm having trouble finding detailed information about how to set this up. Consider the following scenario: I have a book-selling app using a database with the following tables: "Book", "Listing",...

Favorite tool for word/phrase counting

full-text-search,text-mining,data-analysis,word-count,text-analysis
I am looking for a tool that performs counting of words and, more importantly, phrases, in large amounts of open-ended text responses. I need the ability to exclude certain words (a, the, and, etc.) as well. I am aware of a few tools that do this: - http://www.mywritertools.com/default.asp - http://www.hermetic.ch/wfca/wfca.htm...

Lucene vs Solr, indexning speed for sampe data

java,indexing,solr,lucene,full-text-search
I have worked upon Lucene before and now moving towards Solr. The problem is that I am not able to do Indexing on Solr as fast as Lucene can do. My Lucene Code: public class LuceneIndexer { public static void main(String[] args) { String indexDir = "/home/demo/indexes/index1/"; IndexWriterConfig indexWriterConfig =...

MongoDB Can't canonicalize query: BadValue Too many text expressions

mongodb,full-text-search,mongodb-query
I am attempting to build a query for MongoDB in Java and I am running into this error, "Can't canonicalize query: BadValue Too many text expressions" whenever I run the query. The database is full of documents with a text property that is indexed for full text searching. I am...

SQL FTS3 Doesn't Seem To Add Content FTS4 Does

android,sqlite,full-text-search
I'm trying to use FTS in my existing SQLite database, so I'm using an external source for the virtual table- but I'm getting confusing results for an FTS3 table, which I'll end up having to use if I plan on supporting < 11 Android API In this static function from...

Why doesn't my Full text search yields results?

sql-server,sql-server-2008-r2,full-text-search
I have a simple View: Let's select top 5 rows : (the view doesn't have top 5 - it's just for clarity here) SELECT TOP 5 [CustomerId] ,[EngLastFirst] ,[EngFirstLast] ,[LocalLastFirst] ,[LocalFirstLast] FROM [WebERP].[dbo].[View_CustomersNames] Result : Let's create a Full Text Index (Right click on the view): OK. so now we...

Get random rows if full text result is less than N rows

mysql,sql,mysqli,full-text-search
I am using below code to find something SELECT * FROM table WHERE MATCH(title) AGAINST('php tutorial') LIMIT 25 If there are titles that match my query, It returns 25 rows. If the row is empty or if less than 25 rows I want to get random 25 rows from table....

MySQL full text search, joining and ordering both by relevancy and an integer, using PHP and PDO

php,mysql,pdo,full-text-search
I have two tables: Meta has all information about an ID. Posters has a many-to-one relationship to Meta by movie_id (many posters to one movie, sometimes) Now I want to create a full text search using PHP and PDO to prepare the statement and return results first by relevancy, then...

extending model in comfortable_mexican_matress

ruby-on-rails,ruby,full-text-search,sunspot-rails,comfortable-mexican-sofa
I'm trying to implement full-text search in my rails application. The application is based on comfortable_mexican_sofa. For the full-text I am using the sunspot gem. I need to add add the searchable attribute to the Pages class. I created a new file under models with the same class but it...

Search substring with Rails Solr

ruby-on-rails,ruby,solr,full-text-search
I use gem sunspot_solr for full-text searching but I need search substring, example: "teststring", I need searched this typing 'est', 'tr', 'ing'... What I need do for this?...

Mysql Fulltext search returns empty result while there are 100+ rows

mysql,search,full-text-search
The query I use to get rows: SELECT * FROM `sentence` WHERE MATCH(text) AGAINST('hello') Mysql returns empty result when I run this query. However if I use LIKE keyword to get rows SELECT * FROM `sentence` WHERE text LIKE '%hello%' Then, Mysql returns 144 rows. And lets come to a...

Can't find FULLTEXT index while using IN BOOLEAN MODE

mysql,sql,full-text-search,mariadb,match-against
I'm trying to filter some data with an MATCH ... AGAINST WHERE clause. But I get the following error: Can't find FULLTEXT index matching the column list This is an query I execute: SELECT PAR.idPartij, PAR.Partijnaam, PRO.Productnaam, PER.Perceel, R.Ras, PAR.TagNR FROM Partij AS PAR LEFT OUTER JOIN Product AS PRO...

MySql Fulltext search using 2 character word

mysql,full-text-search,full-text-indexing
I've set ft_min_word_len = 1 and running show variables like 'ft%'; also shows the same. Also have already updated the Fulltext indexes by dropping and re-creating them. But when I run SELECT OriginalProductName FROM products WHERE MATCH (ProductName) AGAINST ('+samsung +tv' IN BOOLEAN MODE); against a row which is having...

Use of 'CONTAINS(Foo, “A”) OR CONTAINS(Foo, “B”) vs CONTAINS(Foo, '“A” OR “B”') in SQL Server FullText

sql,sql-server,full-text-search
I need to find some texts in a pretty huge database full text indexed, and i dont know what is better to use in my variations of the terms in the query. I have saw some examples using SELECT Foo.Bar FROM Foo WHERE CONTAINS(Foo.Bar, "A") OR CONTAINS(Foo.Bar, "B") And some...

SQL Server 2012 : full-text query has results for compound word but not for compounds (separate terms)

sql,tsql,sql-server-2012,full-text-search
In my Microsoft SQL Server 2012 table I have a full-text indexed column, which contains the word 'bittersweet' many times. Now when I execute my search query with input 'bittersweet' I get the following query and results: SELECT * FROM MyTable WHERE CONTAINS((FTString),'"*bittersweet*"') Gives me many results. Which is okay....

Postgres full text search: how to search multiple words in multiple fields?

sql,postgresql,search,indexing,full-text-search
i'm using for the first time Postgresql and i'm trying to create a search engine in my website. i have this table: CREATE TABLE shop ( id SERIAL PRIMARY KEY, name TEXT NOT NULL, description TEXT, address TEXT NOT NULL, city TEXT NOT NULL ); Then i created an index...

Client-side full-text search on array of objects

javascript,jquery,arrays,full-text-search
I have the following example JavaScript array of objects and need to enable users to search on it using words/phrases, returning the objects: var items = []; var obj = { index: 1, content: "This is a sample text to search." }; items.push(obj); obj = { index: 2, content: "Here's...

Exporting MySQL database with FTS index

mysql,indexing,full-text-search
I was recently doing migration of a MySQL database and found an issue with regards to FTS indexing. Here are the steps that produced the issue: I exported the database with the following command: mysqldump -p -u username database_name > export.sql and imported it with: mysql -p -u username database_name...

Force Solr not to use _version_ field during search

java,solr,lucene,full-text-search
I have a default declaration for _version_ field in my schema.xml: <field name="_version_" type="long" indexed="true" stored="true" multiValued="false"/> I've read that this field is only internally managed by Solr for concurrency management, however when I search for "002219" in return I get: "docs": [ { "person_street_t": [ "<streetName>", ], "id": "123",...

Apache solr + mysql connection

mysql,solr,full-text-search
I work on a project. I want to use mysql for storage all data and solr for search only a string in database. Is it possible ?

Database column based record filtering not working using auto-complete search PHP

php,mysql,search,full-text-search,full-text-indexing
I have integrated auto-complete search in my site where user enter keyword and view the records based on it. Suppose, if I write zip code it only filter data from zip field. Next, if user types address like 121 North West, so script automatically pick records matches 121 North West....

SQLite FTS4: A query containing a single unary not expression?

sql,sqlite,sqlite3,full-text-search
The SQLite3 FTS4 documentation regarding the standard query unary - operator states: An FTS query may not consist entirely of terms or term-prefix queries with unary "-" operators attached to them. Is there any way around this? Specifically, I want to retrieve all the rows in my table that do...

Are fulltext (match against) queries with Propel2 possible?

php,mysql,full-text-search,propel
With Propel2 and MySQL/InnoDB, I want to execute a fulltext query on the VARCHAR columns title and director of a table movies. In plain SQL this would read SELECT * FROM movies WHERE MATCH(title, director) AGAINST("big lebowski" IN NATURAL LANGUAGE MODE); How can this query be constructed with the Propel2...

Search with SELF JOIN

mysql,sql,full-text-search,self-join
Please help to figure it out the right SQL statement for the search. I use SELF JOIN and I get the right results, but I can't get CONCAT_WS to work the right way. DATA: id base_id name type 2 0 Alien Isolation Base 5 0 Aliens vs. Predator Base 4...

Matching similar lists in mysql+php

php,mysql,search,solr,full-text-search
I have 2 tables, first one is playlists which includes title, author and date info. other table is for tracks with artist, song name, album (etc.), playlistid, popularity columns. I would like to show similar playlists for a specific playlist with similarity percentage. Desired results are like; playlist #4 %70...

How to parse user search string for Postgresql query?

php,postgresql,parsing,full-text-search,logical-operators
i created a search engine on my site using full text search in Postegresql. i added a searchbox in my PHP page in which users can write strings like these: word1 +word2 word1+word2 word1 -word2 word1-word2 word1 word2 word1 word2 how to convert them to the following strings? word1&word2 word1&word2...

IRavenQueryable for both space-splitted search-terms and complete search-string as whole

c#,search,full-text-search,ravendb,iqueryable
In our own RavenQueryableExtensions class we have the following method: public static IRavenQueryable<T> SearchMultiple<T>(this IRavenQueryable<T> self, Expression<Func<T, object>> fieldSelector, string queries, decimal boost = 1, SearchOptions options = SearchOptions.Or) { if (String.IsNullOrEmpty(queries)) throw new ArgumentNullException("queries"); // All gabs of more than a single space (like tabs, two spaces, etc.) //...

MongoDB - Logical OR when searching for words and phrases using full text search

mongodb,search,full-text-search,mongodb-query,full-text-indexing
I asked a related question previously, and as suggested by the poster there have created this new question as a follow up: MongoDB full text search - matching words and exact phrases I was having some problems with unexpected results when using the full text search functionality in MongoDB, specifically...

Fulltext search in mysql doesn't retrieve all rows

mysql,sql,full-text-search
i've a problem with a query in mysql. This is what i done: CREATE TABLE `dar`.`MyTable` ( `MyCol` VARCHAR(100) NOT NULL, FULLTEXT INDEX `Index_1`(`MyCol`) ) ENGINE = MyISAM; INSERT INTO MyTable (MyCol) VALUES ('6002.C3'), ('6002'), ('6002R1'), ('6003.C4'), ('AA6002.X'), ('BB 6002.X'); This is not necessary, but i've done anyway: REPAIR TABLE...

Difference between GiST and GIN index

postgresql,indexing,full-text-search
I am implementing a table that has a column with a data type of tsvector and I am trying to understand what index would be better to use? GIN or GiST? In looking through the postgres documentation here I seem to get that: GiST is faster to update and build...

Fulltext Search engine, multiple columns, boolean mode

php,android,full-text-search,search-engine,boolean-search
I am making a search engine for an android app that does fulltext search and match against multiple columns against '+word1 +word2' in boolean mode. However, I can't get any search result. E.g. search field type- "open sea" then, Sql will search Match...Against ('+open +sea' IN BOOLEAN MODE) and display...

Drupal Search API Solr - Long strings

string,search,drupal,solr,full-text-search
I am using Search API Solr (Solr v4.9.0) for my Drupal Search. A customer just informed us that they found out that Solr does not show search results for strings that are longer then 15 characters. The weired thing is, that we also use Search API Autocomplete in this project...

Text search on many-to-many relationship

mysql,full-text-search,subquery,many-to-many
I have three tables: cars, colours, and cars_has_colours, the first two of which have a many-to-many relationship. I'd like to search cars, ideally using MATCH and AGAINST. This is very simple to achieve if I wanted to search cars.name. I'd like to search colours with MATCH and AGAINST, if possible....

Will installing full text search on live SQL server 2008r2 database server cause downtime?

sql-server,sql-server-2008-r2,full-text-search
Will adding the SQL full text component an existing live SQL Server 2008R2 Database Server cause the server to be restarted/reset?

Write script to search the solution

visual-studio,powershell,batch-file,visual-studio-2013,full-text-search
I'm working on removing a large number of old and unused images from our website. We run ASP.NET with C# code behind, and do our work out of Visual Studio (2013). Right now I'm just going through our images directory and searching the solution for the image file name. While...

Predefined Term Mapping

mongodb,elasticsearch,full-text-search,elastic
I have not yet used Elasticsearch so please excuse the bad description. I would like to know if it is possible to configure Elasticsearch to do the following - I had some issues in MongoDB with this as the full text search functionalities seem to be a little limiting. Here's...

Convert from innodb to MyISAM for fulltext

mysql,sql,full-text-search,innodb,myisam
I want to use fulltext in a big table, and I can't update mysql for support fulltext in innodb or use external search engine. So I think I have 2 option here. 1.Using innodb and search database with LIKE 2.Convert my table to MyISAM I don't know what is the...

mysql subquery as if condition ( only if needed )

mysql,if-statement,full-text-search,case
I want to perform a textsearch on a table containing posts belonging to topics within groups. Depending on the privacysettings for these groups I need to run a subquery to check if the requesting user is a member of the groups containg search matches. Databasescheme: Table: posts Columns: id, group_id,...

Postgres tsearch performance on first query

performance,postgresql,indexing,full-text-search,ispell
We are using a custom text search configuration for searching in german texts for a proper support of compound words. The dictionary can be found here: http://www.sai.msu.su/~megera/postgres/gist/tsearch/V2/ (ispell-german-compound.tar.gz). The dicts got converted to UTF8 and I used the following script to add the configuration to the database: DROP TEXT SEARCH...

full text search with multiple text input

sql,laravel,input,full-text-search,laravel-5
I'm trying to do a full text search with two text input fields. public function searchmatch() { $hex = Input::get('HEX'); $rgb = Input::get('RGB') $products = DB::table('products')->whereRaw( "MATCH(HEX,RGB) AGAINST(? IN BOOLEAN MODE)", array($hex,$rgb) )->get(); return view('search')->with('products', $products); } However it does not work. I tried storing both inputs into an array...

Limiting Data With Lucene.NET

full-text-search,sql-azure,lucene.net
We are using Sql Server 2012 Full-Text indexing, however we would like to move our database to Sql Azure. Using the migration tool it is telling us that Full-Text indexing is not compatible with Sql Azure (even v12 which is in preview does not support it so it doesn't look...

Can we get the column which contains the search result in SQL server FTS search

sql-server,full-text-search
I am new to FTS of SQL Server. So this might be an obvious question but i am not able to find any answer. I want to perform a search on 3 columns of a table. I can fire a query like : SELECT docid from TBLFTS where CONTAINS(* ,...

python fuzzy text search

python,elasticsearch,full-text-search,fuzzy-search,whoosh
I am wondering if there has any Python library can conduct fuzzy text search. For example: I have three key words "letter", "stamp", and "mail". I would like to have a function to check if those three words are within the same paragraph (or certain distances, one page). In addition,...

SQL Server Full Text search for numeric string with commas

sql-server,sql-server-2012,full-text-search
I have a full-text indexed nvarchar(max) column on a SQL Server 2012 install. If one row of the column has 'blah blah $1,234,567 blah blah' as data. When I run the following queries, the ones that return the row are shown: SELECT ftext FROM dbo.Test WHERE Contains([ftext], '"1,234,567*"') --true SELECT...

How do you extract all the tokens in a SQLite FTS table?

sqlite,full-text-search
For debugging purposes I want to see all the tokens that exist in a Full Text Search virtual table in SQLite. When I look at the database structure for my FTS table (named fts_table) I see the following: But browsing the data in these tables doesn't show the the list...

How does ReversedWildcardFilterFactory speed up wildcard searches?

solr,full-text-search
The Solr docs say: solr.ReversedWildcardFilterFactory A filter that reverses tokens to provide faster leading wildcard and prefix queries. Add this filter to the index analyzer, but not the query analyzer. The standard Solr query parser will use this to reverse wildcard and prefix queries to improve performance... How does it...

How can we treat groups of digits as strings in mongodb fulltext searches?

string,mongodb,full-text-search,metacharacters
In a certain ID field we are indexing on a document looks like this: 1234 45676 We want to be able to do fulltext searches on each of the 2 groups of numbers, just as if they are strings. I escape the number groups in quotes, which the mongo documentation...

PostgreSQL accent + case insensitive search

postgresql,database-design,indexing,full-text-search,case-insensitive
I'm looking for a way to support with good performances case insensitive + accent insensitive search. Till now we had no issue on this using MSSql server, on Oracle we had to use OracleText, and now we need it on PostgreSQL. I've found this post about accent insensitive: Does PostgreSQL...

Amazon Cloudsearch not searching with partial string

full-text-search,amazon-cloudsearch
I'm testing Amazon Cloudsearch for my web application and i'm running into some strange issues. I have the following domain indexes: name, email, id. For example, I have data such as: John Doe, [email protected], 1 When I search for jo I get nothing. If I search for joh I still...

Automatic OR queries using SQLite FTS4

c,sqlite,full-text-search
I have a SQLite FTS4 database, and I would like to be able to perform OR queries on it from user-input, e.g. if the user enters "hello there" I would like to do SELECT * FROM fts_table WHERE text MATCHES 'hello OR there'. However, if I pass simply pass in...

mysql fulltext search failure

mysql,full-text-search
This is what I tested. mysql> select * from product; +------------+---------+---------------+ | Id | Product | ProductIdType | +------------+---------+---------------+ | B00005N5PF | one pen | ASIN | | B000J5XS3C | | ASIN | +------------+---------+---------------+ 2 rows in set (0.00 sec) mysql> select * from product p where match (p.Product) against...

Google App Engine conditional Field Expressions

python,google-app-engine,full-text-search
Is it possible to have a search api FieldExpression with a condition? something like -> search.FieldExpression(name='adjusted_x','Not (x = someValue) x / 2)' Thus, only dividing those values for x that do not equal someValue......

Correct Postgres full text search indexes

ruby-on-rails,postgresql,heroku,full-text-search,prefix
I'm creating a multi-column full text search index and currently I have this running CREATE INDEX products_search_document ON products USING gin(to_tsvector('english', style_number || ' ' || brand || ' ' || style_description || ' ' || color)); This works great for queries that I'm using like this SELECT * FROM...

Should I use NDB or Search API for storing User model?

python,google-app-engine,full-text-search,gae-datastore,gae-search
Suppose I have basic User model in ndb with following properties: ``` name = ndb.StringProperty(default='') username = ndb.StringProperty(required=True) email = ndb.StringProperty(default='') active = ndb.BooleanProperty(default=True) admin = ndb.BooleanProperty(default=False) permissions = ndb.StringProperty(repeated=True) verified = ndb.BooleanProperty(default=False) token = ndb.StringProperty(default='') password_hash = ndb.StringProperty(default='') bio = ndb.StringProperty(default='') location = ndb.StringProperty(default='') facebook...

MySQL using OR with MATCH AGAINST slows query drastically

mysql,performance,full-text-search,sql-like,full-text-indexing
Columns are indexed and fulltext. Why does the "OR" add 5-8 seconds? SELECT * FROM exampleTable WHERE MATCH(someColumn) AGAINST('+testing123*' IN BOOLEAN MODE) // returns in .05 seconds SELECT * FROM exampleTable WHERE someColumn LIKE 'testing123%' // returns in .003 seconds SELECT * FROM exampleTable WHERE (MATCH(someColumn) AGAINST('+testing123*' IN BOOLEAN MODE)...

How can I know when SQL Server Full Text Search has indexed a record?

sql-server,full-text-search
My question is similar to this one: How can I know when SQL Full Text Index Population is finished? only instead of population status of the whole index I need to know if SQL Server Full Text Search (FTS) has already indexed certain record in the table. In other words,...

Sphinx indexer «No error» error

mysql,search,indexing,full-text-search,sphinx
I have 25GB TSV file and trying to import it with command: D:\sphinx\bin>indexer.exe -c D:\sphinx\sphinx.conf products --rotate It works some time, but then shows error ERROR: index 'products': source 'products_tsv': read error 'No error' (line=4595827, pos=908, docid=4595827). But record at line 4595827 have no problems. I have two questions: What's...

How to support full text search using entity framwork and UnitOfWork and Repository pattern

c#,linq,entity-framework,full-text-search
We are using entity framework 6, UnitOfWork and Repository pattern. We have huge table which requires full text support from SQL. So, there is any simple way which allows us to query the database using linq and entity framework? For example to search list of products: var itemInformation = UnitOfWork.ProductGs1Repository.RunFullTextContainsQuery(x...

ElasticSearch: Count Frequency of Occurrence of a Set of Words in a Set of Documents

elasticsearch,full-text-search,data-mining,word-frequency
I have the following ElasticSearch query: { "from": 0, "sort": [ "_score" ], "fields": [ "id", "title", "text" ], "query": { "query_string": { "fields": [ "title", "text" ], "query": "(\"green socks\" OR \"red socks\") AND NOT (\"yellow\" OR \"blue\")" } }, "size": 100 } This works fine, and returns a...

Limit SQLServer Full text search to top 3 releavent answer

sql,sql-server,full-text-search
I am a SQL newbie sorry if this is a simple thing My data in sql is like this My DATA: Content sl.no KTUU Alaskas News Source Alaskas Top News Storm Watch Weather Politics Sports Health Business Headlines 16419 Lawn Care Business Service Providers Lawn Care Business Information Lawn Mowing...

MySQL Fulltext Boolean Mode search returns too many results

php,mysql,full-text-search
I'm having an issue with my fulltext search query and I've pretty much gone through all the forums and threads I could find but I'm still having this issue. I am using the MySQL Fulltext Boolean Mode search to return matching rows based on two columns (artist name and track...

Python text search library

python,parsing,full-text-search,negate
I am looking for a library that would let me do something like the following: matches( user_input="hello world how are you what are you doing", keywords='+world -tigers "how are" -"bye bye"' ) Basically I want it to match strings based on presence of words, absence of words and sequences of...

Neo4j automatic index doesn't work first time

lucene,neo4j,full-text-search,cypher,spring-data-neo4j
I have a following test: @Test public void testAutoIndexingAndFuzzySearch() { GraphDatabaseService graphDb = template.getGraphDatabaseService(); Index<Node> autoIndex = graphDb.index().forNodes("node_auto_index"); graphDb.index().setConfiguration(autoIndex, "type", "fulltext"); graphDb.index().setConfiguration(autoIndex, "to_lower_case", "true"); graphDb.index().setConfiguration(autoIndex, "analyzer", StandardAnalyzerV36.class.getName()); sampleDataGenerator.generateSampleDataJava(); List<Product> products = //...

Fulltext search in PHP

php,full-text-search
I want to perform fulltext search for a given phrase in a given string using PHP. I want this search to be: case insensitive diacritics insensitive, so for example "Žluťoučký kůň" should be matched as "Zlutoucky kun" as fast as possible independent on any third party libraries (if it is...

Full text Search in SQL Server not finding my entries

sql,sql-server,full-text-search,ssms
My requirement is to be able to search imran in Simran, Simrankaur e.t.c I am using following query: select Name, Len(Name) from Demo where Contains(Name, '"*imran*"') My Demo table has Name column with following entries Simran, Simrankaur, SimranKaurKhurana but the query returns nil. Where am I doing it wrong?...

Understanding Apache Lucene's scoring algorithm

search,solr,lucene,full-text-search,hibernate-search
I'm working with Hibernate Search for months now, but still I'm not able to digest the relevance it brings. I'm overall satisfied with the results it returns, but even simplest test does not satisfy my expectation. First test was using the term frequency(tf). Data: word word word word word word...

ERROR: index 'products': too many string attributes (current index format allows up to 4 GB)

database,indexing,full-text-search,search-engine,sphinx
Got this when tried to index table in database with 25GB of data. Sphinx contains index declaration with following fields: sql_field_string = field_indexer #some keywords sql_field_string = product_name sql_field_string = description sql_attr_float = price sql_field_string = product_url sql_field_string = image_url sql_field_string = sku sql_attr_uint = merchant_id sql_attr_uint = network_id All...

MongoDB+Doctrine: How to sort the query by text search score

php,mongodb,doctrine,full-text-search
I have a code like this that searches by the text index: $expr = $queryBuilder->expr()->operator('$text', ['$search' => $this->value]); $result = $queryBuilder->equals($expr)->getQuery()->execute(); But the result is not sorted by the relevance, which I want. I found some info here but could not figure out how to add field score to search...

IS it faster to use Levenstein while querying rows or on PHP?

php,mysql,full-text-search,levenshtein-distance
Currently I'm using the following query: (I'm using the following implmenetation of levenshtein() SELECT title FROM db_full WHERE MATCH (`Title`) AGAINST ('Harry Potter and the Deathly Hallows' IN BOOLEAN MODE) AND levenshtein('Harry Potter and the Deathly Hallows', `Title`) BETWEEN 0 AND 15 I was wondering if it was faster to...