FAQ Database Discussion Community


Not able to access Kibana running in a Docker container on port 5601

elasticsearch,docker,dockerfile,kibana-4
I have built a docker image with the following Docker file. # gunicorn-flask FROM devdb/kibana MAINTAINER John Doe <[email protected]> ENV DEBIAN_FRONTEND noninteractive RUN apt-get update RUN apt-get install -y python python-pip python-virtualenv gunicorn # Setup flask application RUN mkdir -p /deploy/app COPY gunicorn_config.py /deploy/gunicorn_config.py COPY app /deploy/app RUN pip install...

ElasticSearch + Kibana - Unique count using pre-computed hashes

elasticsearch,kibana-4
update: Added I want to perform unique count on my ElasticSearch cluster. The cluster contains about 50 millions of records. I've tried the following methods: First method Mentioned in this section: Pre-computing hashes is usually only useful on very large and/or high-cardinality fields as it saves CPU and memory. Second...

How to do a time range search in Kibana

elasticsearch,logstash,kibana,kibana-4
We are using the ELK for log aggregation. Is it possible to search for events that occured during a particular time range. Lets say I want to see all exceptions that occurred between 10am and 11am in last month. Is it possible to extract the time part from @timestamp and...

Can Kibana 3 and Kibana 4 Be Used Side-By-Side?

kibana,kibana-4
I'm currently using Kibana 3, and would like to upgrade to Kibana 4. However, I would like to keep Kibana 3 around until I have my dashboards in Kibana 4 configured. Can the two be run side-by-side without interfering with one another? I know that Kibana stores its settings in...

Geo location from mongodb to elasticsearch

mongodb,elasticsearch,kibana-4
mongo-connector is used to push the data from server which have geo location as "location":{ "coordinates" : { "lon":-77.03653, "lat": 38.897676 } } changed the properties of location as "properties" :{ "location" :{ "type": "object", "properties" :{ "coordinates": { "type" : "geo_point", "geohash": "true", "geohash_prefix": "true" } } } }...

Kibana 4 : How to remove saved discover request

kibana-4
A trivial question but I can't figure how to remove or clean some saved requests in the Discover tab. Thank's for any help....

Kibana 4,maps not showing specific areas

elasticsearch,elasticsearch-plugin,kibana-4
In Kibana 3, I was able to use three types of maps US,Europe and the World Map. But in the Kibana 4,I can only see a wolrd map version. For my data purposes I need to have only the US one. Can anybody help me on this?.

Is it possible to access elasticsearch's internal stats via Kibana

kibana,kibana-4
I can see from querying our elasticsearch nodes that they contains internal statistics that for example show disk, memory and CPU usage (for example via GET _nodes/stats API). Is there anyway to access these in Kibana-4?...

Passing Elasticsearch and Kibana config file to docker containers

elasticsearch,docker,kibana,kibana-4
I have found a docker image devdb/kibana which runs Elasticsearch 1.5.2 and Kibana 4.0.2. However I would like to pass into this docker container the configuration files for both Elasticsearch (i.e elasticsearch.yml) and Kibana (i.e config.js) Can I do that with this image itself? Or for that would I have...

Using an aggregation on data with forward slash in elasticsearch

elasticsearch,kibana-4,elastic
I have data, that has an attribute like this apiUrl:/REST/endpoint/123 Now I would like to show all the urls and I am trying to use an aggregate function (apiUrl.raw is not_analyzed part of the multifield): POST /index/type/_search { "aggregations": { "application": { "terms": { "field": "apiUrl.raw" } } } }...

Courier Fetch: shards failed

elasticsearch,kibana,kibana-4
Why do I get these warnings after adding more data to my elasticsearch? And the warnings are different every time I browse the dashboard. "Courier Fetch: 30 of 60 shards failed." More details: It's a sole node on a CentOS 7.1 /etc/elasticsearch/elasticsearch.yml index.number_of_shards: 3 index.number_of_replicas: 1 bootstrap.mlockall: true threadpool.bulk.queue_size: 1000...

How can you set the colors in a chart with Kibana 4?

kibana-4
I have a stacked bar chart in Kibana 4, and I would like the error bar to be red, the warning bar to be orange and the info bar to be green. This used to be simple to accomplish in Kibana 3, but I cannot figure out how to do...

Elastic Search Index in python

python,elasticsearch,kibana,kibana-4,pyelasticsearch
I want to push my data from a dictionary to Elasticsearch. How can I create an index for the same? I tried using the Curl commands as well on Linux server curl -XPUT 'http://localhost:9200/osint/' -d ' index: number_of_shards: 5 number_of_replicas: 2 ' but this also didnt help out I wrote...

Elasticsearch scan and scroll - add to new index

bash,http,elasticsearch,kibana-4
Elasticsearch and command line programming noobie question. I have elasticsearch set up locally on my computer and want to pull documents from a server that uses a different version of es using the scan and scroll api and add them into my index. I am having trouble figuring out how...

Kibana and fixed time spans

elasticsearch,kibana,kibana-4
Is it possible to set a fixed timespan for a saved visualization or a saved search in Kibana 4? Scenario: I want to create one dashboard with 2 visualizations with different time spans. A metric counting unique users within 10 min (last 10 minutes) A metric counting todays unique users...

How to write search queries in kibana using Query DSL for Elasticsearch aggregation

elasticsearch,querydsl,kibana-4
I am working on ELK stack to process Apache access logs. Spent a lot of time understanding Query DSL format so that more complex queries can be written. Currently am facing issues with running the queries in kibana interface but the same queries work just fine when posted using curl...

Kibana 4 configuration for production

node.js,azure-web-sites,kibana,kibana-4
I'm trying to deploy Kibana 4 to Azure Websites. I can't use bin/kibanta.bat file since Azure Websites uses start script in package.json to bootstrap application. I tried to update package.json start script to run bin\kibana.js file and environment variables in it. After that Azure starts running Kibana server but I'm...

Logstash unable to start when I add grep filter

elasticsearch,logstash,kibana-4
I have a logstash instance deployed on my local and I am trying to get head wrapped around it. I added a simple grep filter to the logstash.conf file, but when I restart the service, it fails. And when I remove the grep statement it works fine. Here is my...

How to set authentication in kibana

kibana,kibana-4
Is it possible to enable authentication in Kibana in order to restrict access to a dashboard to only be accessible to particular users?

Kibana 4 Color Scheme

kibana,kibana-4
I tend towards darker color schemes when building GUIs, and some of the nicer screenshots that I've seen of Kibana support this. Now that we are kicking the tires on Kibana 4, the vizualizations and dashboards seem to be light background only. Is there a button staring me in the...

Scripted Fields for if/else condition in Kibana 4

elasticsearch,lucene,kibana,kibana-4
I have some numeric fields in elasticsearch, I have to implement some logic for which I need to create some scripted fields. I am new to kibana 4's scripted fields feature, so I need some help regarding a basic format that could be used for writing a basic if else...

Kibana Dashboard multiple time periods and search terms

kibana-4
Is it possible to give different time periods or different search terms to each Visualization in a Kibana Dashboard?

Kibana 4 start as service in ubuntu 12.04

elasticsearch,logstash,kibana-4
Im trying to start kibana 4 as a service in ubuntu 12.04. Please any one help on how to set as service . I referred these links to write the script , but it wont work. https://github.com/akabdog/scripts/blob/master/kibana4_init https://github.com/chovy/node-startup/blob/master/init.d/node-app...

How to configure Kibana 4 and elasticsearch behind nginx?

linux,nginx,kibana-4
I have kibana 4 and eladticsearch running on the same server. I need to access kibana through a domain but when i tried i keep getting file not found. I just create location /kibana in nginx and the proxy_pass is the ip:port of kibana. Anyone had this.?...

Kibana4 not showing any results

elasticsearch,elasticsearch-plugin,kibana-4
I have created a Kibana 4 dashboard a few days earlier and named it as "test dashboard".But when I load it now , it is empty as shown in the screenshot below. It was perfectly working and was showing various analytics when I created. Any clues?....

Search for parse errors in logstash/grok

logstash,kibana,grok,kibana-4
I´m using the elk stack to analyze log data and have to handle large volumes of log data. It looks like all the logs can be parsed with logstash/grok. Is there a way to search with kibana for loglines that couldn´t be parsed?...

Elasctic Search is working at port 9200 but Kibana is not working

elasticsearch,kibana,kibana-4
Hello I am starting work with kibana and elasticsearch. I am being able to run elasticsearch at port 9200 but kibana is not running at port 5601. The following two images are given for clarification Kibana is not running and showing the page is not available...

How to remove date from LogStash event

log4j,logstash,kibana,kibana-4,logstash-grok
I have the following message in my log file... 2015-05-08 12:00:00,648064070: INFO : [pool-4-thread-1] com.jobs.AutomatedJob: Found 0 suggested order events This is what I see in Logstash/Kibana (with the Date and Message selected)... May 8th 2015, 12:16:19.691 2015-05-08 12:00:00,648064070: INFO : [pool-4-thread-1] com.pcmsgroup.v21.star2.application.maintenance.jobs.AutomatedSuggestedOrderingScheduledJob: Found 0 suggested order events The date...

Visualizing a percentage of current view

elasticsearch,kibana,kibana-4
I am trying to display a users chat messages as a percentage of the current view/query. I can get a visualization of the counts per user easily but is there a way to turn this into a percent of the all the selected users?...

How to make Kibana 4 visualizer on dashboard not resizable?

kibana-4
Recently started using Kibana 4. I am not getting how to make Kibana 4 visualizer on dashboard not resizable? and in visualizer there is option to see table,request,response how to hide it?...

Unable to show location in tile map of kibana

elasticsearch,logstash,kibana,kibana-4
I am using Elasticsearch-1.5.1, Kibana-4.0.2-linux-x86, Logstash-1.4.2. My logstash conf is like this input{ redis{ data_type=>'list' key=>'pace' password=>'bhushan' type=>pace } }filter { geoip { source => "mdc.ip" target => "geoip" database => "/opt/logstash-1.4.2/vendor/geoip/GeoLiteCity.dat" add_field => [ "[geoip][coordinates]", "%{[geoip][longitude]}" ] add_field => [ "[geoip][coordinates]", "%{[geoip][latitude]}" ] } } output{ if[type]=="pace"{ elasticsearch{ template_overwrite...

Kibana 4 Metric visualization show latest value

elasticsearch,kibana,kibana-4
I'm new to Kibana and Elastic Search and i have run into this problem: My ES contains (among other stuff) also data containing the current value of one custom performance counter and i would like my dashboard to show this value, e.g., as a big number - therefore i tried...

Elastic Search analyzing fields and Kibana Graphs Legends

elasticsearch,kibana-4
I'm using elasticsearch 1.5.2 and Kibana 4.0.3. I'm having a problem with the analyzers, using the default one the legends in the kibana graphs split the field by &, / and -. Which is the default behavior. I've tried setting the fields to not_analyzed and then the kibana legends display...

Setting default index in Kibana 4

elasticsearch,kibana,kibana-4
I can't define default index in Kibana 4.0.2, as you can see on the image below. It doesn't saves if I enter it manually in "Advanced" tab, it only glitches when I click on "Set as default index" button but it doesn't make needed changes. I'm using Couchbase 3.0.3, transport-couchbase...

Need to create value over time chart using Kibana 4

logstash,kibana-4
Am using logstash to store logfile containing the read time of a cable (specific to my application) I would like to plot the graph of Cable Read Time (Y-Axis) over Elapsed Time (X-Axis) using Kibana. Logstash config file looks as below input { file { path => "/opt/performanceMetrics.csv" type =>...

FIELDDATA Data is too large

elasticsearch,kibana-4
I open kibana and do a search and i get the error where shards failed. I looked in the elasticsearch.log file and I saw this error: org.elasticsearch.common.breaker.CircuitBreakingException: [FIELDDATA] Data too large, data for [@timestamp] would be larger than limit of [622775500/593.9mb] Is there any way to increase that limit of...

How to display data without aggregation in Kibana?

elasticsearch,kibana-4
I have data that is in the following format: file_name file_size time_stamp A 100 2014-05-12 12:00 B 200 2014-05-12 12:00 C 300 2014-05-12 12:00 A 50 2014-05-12 12:15 B 45 2014-05-12 12:15 C 600 2014-05-12 12:15 How to display data Y-Axis with file size without aggregation (eg A-100,B-200,C3-300 for first...

What is the purpose of “analysed” button in Kibana 4?

elasticsearch,kibana,elasticsearch-plugin,kibana-4
Description: ​I have set up Kibana 4 and also configured an index for analytics. So in the discover page,of Kibana,I can see my index name and the corresponding fields in the index there. To the right side of the fields panel,there is a settings icon. When I click that,four options...

Nested Object in Kibana visualize

elasticsearch,kibana,kibana-4
I have uploaded the JSON file in elasticsearch and my mapping contains of some nested objects. The problem is that, in Kibana, in visualize I can not see them This is my mapping: "comments":{"type": "nested", "properties":{ "count":{ "type": "integer" }, "data": { "type": "nested", "properties": { "created_time": { "type": "integer"...

Kibana 4 “rehash”: false

elasticsearch,kibana-4
I'm using Kibana 4 to query unique count on ElasticSearch. I would like to prevent rehash on field, since the field is already hashed. How can I make Kibana to perform the aggregation using "rehash": false? Thanks...