FAQ Database Discussion Community


How can I monitor a python scrypt and restart it in the event of a crash? (Windows)

python,windows,monitoring
I have a simple python script to send data from a Windows 7 box to a remote computer via SFTP. The script is set to continuously send a single file every 5 minutes. This all works fine but I'm worried about the off chance that the process stops or fails...

How to get raw hadoop metrics

hadoop,monitoring
sorry if this question is a duplicate, so far I haven't been able to find a satisfactory answer. Is it possible to get the raw data of hadoop2 metrics? (e.g. in text file/json format) According to https://wiki.apache.org/hadoop/GangliaMetrics, I know that I can use ganglia (or maybe nagios) to get the...

Bluemix Monitoring and Analytics service - where did the message column go?

logging,monitoring,bluemix
In the Bluemix Monitoring and Analytics service, on the Log Analysis tab, in the grid view of results, there used to be a message column which contained just the text of the logged messages. Now that column is gone and has been replaced with a logRecord column which also contains...

spark streaming throughput monitoring

performance,apache-spark,monitoring,spark-streaming,amazon-cloudwatch
Is there a way to monitor the input and output throughput of a Spark cluster, to make sure the cluster is not flooded and overflowed by incoming data? In my case, I set up Spark cluster on AWS EC2, so I'm thinking of using AWS CloudWatch to monitor the NetworkIn...

Real-time monitoring of intermittent binary data

linux,terminal,binary,buffer,monitoring
Context: monitor a low-volume, intermittent stream from a program When debugging some program, one sometimes have to monitor some output. When output is ascii, no problem, just run in terminal (the program itself, or nc if it uses a TCP or UDP interface, or cat /dev/somedevice, or socat ..., whatever)....

Hypothetical Memory Usage Monitoring Program

c++,c,memory,monitoring
Would it be at all possible (I don't care about practicality or usefulness) to write a C or C++ program that monitored memory usage in the following, very basic way? Given that declaring a variable without assigning it a value results in it having the value of whatever is already...

How does the proc/diskstats work to present that values? And for proc/stat and meminfo?

linux,unix,statistics,monitoring,proc
I am trying to get the diskstats data by same way that the file does. Is there any way to reach that values without reading that file? How the values are placed there? Is there any ".c" file that processes the data to place on diskstats? And for proc/stat and...

Tool to find cause of dead lock in Java application [closed]

java,locking,profiling,monitoring,deadlock
We can reproduce a situation where part of your system freezes. We suspect that this might be due to a locking problem. How can we find out where every thread of our application is currently at? Which tool can we use to find the spot where the deadlock occurs?...

Distinguish Windows services with the same ProcessName

powershell,memory,windows-services,monitoring,powershell-v3.0
I am adjusting a monitoring system which checks if a service is running or not. It does that by checking the process name and it's memory consumption. Once it drops below 1 MB an alert is triggered. Also I use the memory usage value to display it in a graph....

Diagnosing slow running app

process,exe,monitoring
I have a complicated .NET app that does text processing and it runs very slow. I want to capture all the processes it envokes so I could figure out what is causing it to run so slow. How can I determine which processes are running once I run this app?

How to skip reading the timestamp in zabbix?

logging,monitoring,zabbix
I have created a zabbix alert to return log messages whenever there is any ERROR or WARNING in the file : Item : Type : Zabbix agent (active) key : log[/usr/local/panorama/acs/standalone/log/server.log,WARN\s*\[|ERROR\s*\[,,,,\0] Type of information : Log Log Time Format : yyyy-MM-ddThh:mm:ss,SSS And an alert : Name : Error/Warning log at...

Java monitoring tool which will allow to see the stacktrace at “real time”

java,monitoring,stack-trace,visualvm,thread-dump
I work on very large web project which is written in java. when I click some button or do other actions it is hard to me to understand what methods called in application code(because I am new in project and application is really really big). So I would like to...

how to enable audit framework in arch linux 3.12 kernel?

linux,linux-kernel,monitoring,audit,archlinux
I want to use audit framework on my latest arch linux, but running sudo auditctl -w /home/ in console gives me Error - audit support not in kernel Cannot open netlink audit socket I tried to enable of course audit via kernel boot params setting audit flag: GRUB_CMDLINE_LINUX_DEFAULT="quiet audit=1" but...

Ambari Monitoring raw data

api,data,monitoring,ambari
For my masters project, I'm looking for a convenient way to grasp the monitoring data Ambari collects. To be precise, I'm interested in the raw data (can be csv, xml, json, you name it) of the charts Ambari shows in the dashboard, i.e., Cluster CPU, Disk Usage, network usage and...

Can't verify by visiting the external URL of the server using browser when installing apache Ranger

hadoop,bigdata,monitoring
I am installing Apache Ranger in centos by following their instructions: https://cwiki.apache.org/confluence/display/RANGER/Ranger+Installation+Guide. But after installing and run the command: service ranger-admin start, Ranger starts but I can't verify by visiting the external URL of the server using browser, for example: http://:6080/. I followed every instruction step by step as they...

Aggregating distributed logfiles into one logfile on real-time

monitoring,distributed,logfile
I got in legacy a system which save its logfiles on 15 different servers during 1 job run. Now, there is a need to aggregate all of them into 1 file, and just as important- on real-time. I started by ssh through python, but its not answering the real-time need....

How to log EC2 operations on AWS?

amazon-web-services,amazon-ec2,monitoring
We are operating a large amount of instances and ELB on AWS. Recently we experienced strange behaviors. We don't know whether our boto scripts are responsible or AWS has malfunction. It might also be a human mistake. We are not able to know who did what on EC2 instances, that's an issue....

How can I send application health data to nagios from a spring application?

java,spring,monitoring,nagios
I would like to send the following health information to Nagios for monitoring: Various connection pool statistics and connections statuses RabbitMQ connection status Business logic metrics like, "Number of transactions processed" I am aware of the spring-actuator project and that works great for active monitoring. However, this app resides on...

hawtio - predefined list of remote agents

java,monitoring,hawtio,jolokia
I'm working on an application which is comprised of many web containers with WAR-s installed on these containers. Currently I have a farm of ~ 10 servers like this. I'm about to start the integration of jolokia/hawtio to track the JMX mbeans exposed on each of these servers. For this...

Staying up to date with software releases of dependencies

dependencies,monitoring,updates,dependency-management,software-release
I think everybody uses some third party software (dependencies) in his projects. Often you drop in one version at a time and never update it, cause you don't know there is a new version and if there is you may have some migration work. Most of these 3rd party projects...

Remote monitoring with visualvm and JMX

java,spring-boot,monitoring,jmx
I would like to monitor a remotely running java (spring boot) application with jvisualvm (or jconsole). When running locally, I can see the managed beans in both jvisualvm and jconsole. When running remotely I cannot connect. I tried it with several different java processes (e.g. with spring xd). Looking for...

monitoring the backup

backup,monitoring,nagios,health-monitoring
Does anyone know any related work about: 1- Monitoring the backup done by HP Data Protector using Nagios or Icinga 2- Monitoring the backup done by HP Data Protector by any other monitoring tool 3- Monitoring the backup in general

Tool to monitor & log system metrics during automated Java performance tests

java,performance,automation,monitoring
We have an application using Spring Integration in its core, and have created performance tests to see what is the processing speed (msgs/sec) for different generated input types. This process is automated, so whenever such test is run, a separate instance is created in cloud, and disposed after done &...

How to detect and prevent (valid) malicious web requests? e.g. corporate espionage

c#,security,logging,iis-7,monitoring
Without trying to sound like I am creating a movie plot - here is a scenario: Website creates quotes for clients using a intricate classified quoting system. Someone with malicious intent decides to create a bot and by using a wide range of parameters, spam the quotes and essentially copy...

How to get file access information on linux (debian)

linux,logging,web-crawler,monitoring,server
Recently i have been having some issues with the robots.txt file on my webserver according to google webmasters tools. More precisely i get a "Crawl postponed because robots.txt was inaccessible." message. This is weird, because if you try to access it: http://www.newsflow24.com/robots.txt it looks just fine, even the google crawl...

How to log/monitor selected WM_USER+n Windows messages?

delphi,delphi-xe2,monitoring,message-queue
Some dialogs and data modules in my code need to delay execution and do this by calling PostMessage(). This is not across modules, i.e. the datamodule will have the handler for the PostMessage issued there, so will a dialog. There is (of course?) interaction between code in the different modules....

Monit daemon - error connecting to the monit daemon

linux,ubuntu,debian,monitoring,monit
I installed monit and tried to check the status using below command. monit status But end up with below error. monit: error connecting to the monit daemon How can I fix this?...

What is a good language to use for monitoring a web page? [closed]

web,monitoring
There's a website that updates with new postings periodically, but I don't want to have to sign on to the website in order to see the changes. I wanted to write a program to constantly monitor the web page and send me an email whenever it changes. Preferably, it would...

Ganglia fails to communicate with Apache HBase

hadoop,hbase,monitoring,ganglia
I installed Ganglia to monitor the HBase cluster. I'm using ganglia-3.3.0. Hadoop version: hadoop-1.1.2 HBase version : hbase-0.94.8 My Hadoop cluster comprises of 1 master node and 2 slave nodes. Ganglia gmetad_server is configured on the master node I changed the hbase/conf/hadoop-metrics.properties file. hbase.class=org.apache.hadoop.metrics.ganglia.GangliaContext31 hbase.period=10 hbase.servers=hostname_of_ganglia_server:8649 I started the service...