Kibana
Apache access and error logs in Fluentd
To parse and add Apache2 access and error logs add this section to your /etc/td-agent/td-agent.conf Fluend config file Restart td-agent Now, access apache web pages and you will see logs going into elastic database. In Kibana management, create new index pattern like apache-* to visualize apache logs in kibana
EFK stack – versatile and very capable analytics platform
So far I was happily using ELK stack to feed syslog messages into Elasticsearch. In ELK stack I had used Logstash to aggregate syslogs and feed them into elasticsearch. Recently, I came across fluentd and found it quite interesting and flexible. Using fluentd with Elasticsearch and Kibana I have now build a EFK stack. EFK […]
Delete old data in Elasticsearch
ELK platform provides great solution aggregating and indexing various log, events within a organization. But you may not want to keep old data in Elasticsearch forever. Also see ELK installation and configuration To delete old data you can use “elasticsearch-curator” tool You can simply install it as $pip install elasticsearch-curator Followed by some basic configuration. […]
Syslog and snmp traps in ELK – Taming ELK
ELK stack is quite capable solution for event, logs, data aggregation and parsing. It offers a very shiny yet highly flexible web frontend. You can extend it to limits you can think off. It is a perfect open source tool for end to end data analytics.So what is ELK exactly ? ELK is composed of […]