FAQ Database Discussion Community


ElasticSearch: Install elasticsearch-mapper-attachments on a mock ES cluster locally

elasticsearch,elasticsearch-plugin
I am using mock instance of ElasticSearch where I create it "locally" so that I won't be dependent on a running ES cluster during my unit test process or when I am off network. For example: Settings defaultSettings = ImmutableSettings .settingsBuilder() .put(ElasticSearchReservedWords.CLUSTER_NAME.getText(), "test-cluster-" + NetworkUtils.getLocalAddress().getHostName()) .put(ElasticSearchReservedWords.PATH_DATA.getText(), new File("C:/Temp/mock_elasticsearch_cluster/data").getAbsolutePath())...

How to use custom analyzer in ElasticSearch?

elasticsearch,elasticsearch-plugin
I wanted to try Elasticsearch with Polish language support, but I have some problems with it. I installed Stempel Analysis Plugin, I'm trying to create an index that uses Polish analyzer: curl -XPUT localhost:9200/polisz -d '{ "mappings" : { "_default_" : { "properties" : { "text_entry" : { "type": "string",...

filter json in logstash

json,logstash,kibana,elasticsearch-plugin
I have a json file with records like this one {"id":1,"first_name":"Frank","last_name":"Mills","date":"5/31/2014","email":"[email protected]","country":"France","city":"La Rochelle","latitude":"46.1667","longitude":"-1.15" and I'm trying to filter the fields in logstash, unsuccessfully so far. I tried the grok debugger and the grokconstructor but cannot make it work. My last attempt is input { file{ path => ["C:/logstash-1.4.2/mock_data.json"] type => "json"...

Kibana 4,maps not showing specific areas

elasticsearch,elasticsearch-plugin,kibana-4
In Kibana 3, I was able to use three types of maps US,Europe and the World Map. But in the Kibana 4,I can only see a wolrd map version. For my data purposes I need to have only the US one. Can anybody help me on this?.

How to display “ALL” the nested documents in an object in separate rows from elasticsearch?

elasticsearch,nested,elasticsearch-plugin
I have a nested object in the following form: { "name": "Multi G. Enre", "books": [ { "name": "Guns and lasers", "genre": "scifi", "publisher": "orbit" }, { "name": "Dead in the night", "genre": "thriller", "publisher": "penguin" } ] } I tried the following JSON query for the above document: {...

Elasticsearch head plugin not working through nginx reverse proxy

nginx,elasticsearch,reverse-proxy,elasticsearch-plugin
I have elasticsearch with the head plugin installed running on a different server. I also set up an nginx reverse proxy for my ES instance. The configuration looks like below: http { include mime.types; default_type application/octet-stream; sendfile on; keepalive_timeout 65; server { listen 80; server_name es.mydomain.net; location / { proxy_set_header...

Elasticsearch Aggregation by Day of Week and Hour of Day

elasticsearch,nosql,elasticsearch-plugin,spring-data-elasticsearch,pyelasticsearch
I have documents of type: [{"msg":"hello", date: "some-date"},{"msg":"hi!", date: "some-date"}, ... I want to have the count of documents by day of week. For example x messages were sent on Monday and y were sent on Tuesday and so on. I have used date_histogram with aggregation but it returns me...

What is the purpose of “analysed” button in Kibana 4?

elasticsearch,kibana,elasticsearch-plugin,kibana-4
Description: ​I have set up Kibana 4 and also configured an index for analytics. So in the discover page,of Kibana,I can see my index name and the corresponding fields in the index there. To the right side of the fields panel,there is a settings icon. When I click that,four options...

Elasticsearch and MongoGB: no river _meta document found after 5 attempts

mongodb,elasticsearch,elasticsearch-plugin
I have a MongoDB database named news to which I tried to index with ES. Using these plugins: richardwilly98.elasticsearch/elasticsearch-river-mongodb/2.0.9 and elasticsearch/elasticsearch-mapper-attachments/2.5.0 This is what happening when I tried to create the index. I have tried to delete the index and recreating it, without that helping. $ curl -XPUT 'http://localhost:9200/_river/news/_meta' -d...

Custom Analyzer not working Elasticsearch

elasticsearch,elasticsearch-plugin
{ "_source": { "enabled": false }, "analysis": { "analyzer": { "default": { "type": "custom", "tokenizer": "uax_url_email", "filter": "lowercase,standard,stop" } } }, "mappings": { "table": { "properties": { "field1": { "type": "string", "include_in_all": false, "index": "no" }, "field2": { "type": "long", "include_in_all": false, "index": "no" }, "field3": { "type": "string", "index":...

Elastic Search JDBC River Plugin SQL Server Integrated Security

jdbc,elasticsearch,elasticsearch-plugin,elasticsearch-jdbc-river,elastic
So I've been working on implementing elastic search using the JDBC River plugin to get data from our SQL Server DB into elastic search. I've got it working fine using the SQL Server credentials, but trying to use integrated security doesn't work. It will create the index, but it doesn't...

elasticsearch can't install head plugin

java,elasticsearch,elasticsearch-plugin,elastic,elasticsearch-head
I am planing to install head pluging for elasticsearch. in both these two official documentation, http://mobz.github.io/elasticsearch-head/ and http://docs.couchbase.com/admin/elastic/install-plugin.html they said to use this: bin/plugin -install mobz/elasticsearch-head I did, but i got the following error: PS C:\elasticsearch-1.3.9\elasticsearch-1.3.9> bin/plugin -install mobz/elasticsearch-head Exception in thread "main" org.elasticsearch.common.settings.SettingsException: Failed to load settings from [file:/C:/...

Active Directory AuthorizationException in elastic search

elasticsearch,nest,elasticsearch-plugin,elastic,elasticsearch-shield
I am trying to use AD authentication. I am able to login successfully but i am not authorized to perform any query in marvel. Everytime i execute query in marvel, i get the following error.Below are the details { "error": "AuthorizationException[action [indices:data/read/search] is unauthorized for user [shivang.Mittal]]", "status": 403 }...

How to use Elasticsearch bulk index with single JSON file in Python

python,json,elasticsearch,elasticsearch-plugin,elastic
I have a single JSON file formatted like: {"index":{"_type": "summary", "_id": "0001-1200-2015-12-31-0007", "_index": "transaction"}} {"data_load_user_id": "nathan", "tender_time": 5, "ring_time": 8, "operator_id": "0111"} for about 12,000 rows. As far as I know, this is the correct way to format a JSON file for the bulk API in elasticsearch. I'm still confused...

Kibana4 not showing any results

elasticsearch,elasticsearch-plugin,kibana-4
I have created a Kibana 4 dashboard a few days earlier and named it as "test dashboard".But when I load it now , it is empty as shown in the screenshot below. It was perfectly working and was showing various analytics when I created. Any clues?....

Get document on some condition in elastic search java API

java,elasticsearch,elasticsearch-plugin
As I know we can parse document in elastic search, And when we search for a keyword, It will return the document using this code of java API:- org.elasticsearch.action.search.SearchResponse searchHits = node.client() .prepareSearch() .setIndices("indices") .setQuery(qb) .setFrom(0).setSize(1000) .addHighlightedField("file.filename") .addHighlightedField("content") .addHighlightedField("meta.title") .setHighlighterPreTags("<span class='badge badge-info'>") .setHighlighterPostTags("</span>") .addFields("*", "_source")...

Logstash not writing to Elasticsearch with Shield

elasticsearch,logstash,elasticsearch-plugin,logstash-configuration
I have been trying to make logstash write to elasticseach with shield without success. My setup was working nromally before installing the shield plugin to elasticsearch. I've followed this guide from elastic.co and created a new user for the logstash user role using: esusers useradd logstashadmin -r logstash I've also...

Move docs from one index to another

python,elasticsearch,elasticsearch-plugin
I'm trying to move docs from one index to a different index, without maintaining the source docs. I'm using scroll to do this now, but, so far, I'm reindexing and it's keeping the source documents on the source index. I don't want this to happen, I want a move not...

NEST elasticsearch.NET search query not returning results (part 2)

elasticsearch,nest,elasticsearch-plugin
I'm using the object initializer syntax with NEST to form a search query. When I include the second pdfQuery with the logical OR operator, I get no results. If I exclude it, I get results. QueryContainer titleQuery = new MatchQuery { Field = Property.Path<ElasticBook>(p => p.Title), Query = query, Boost...