CERN centralized Elasticsearch service¶
This document contains all information needed to manage the ES. The ES is provided by CERN IT. General info can be found in this documentation.
Communication channels:¶
CERN IT ES homepage
- Tickets: open a snow ticket.
- Mattermost channel: LHCb specific channel or IT general channel.
Elasticsearch instances¶
We are using three production instances:
- es-lhcb-monitoring for monitoring WMS and ComponentMonitoring
- es-lhcb-dirac-logs for centralized Monitoring
- es-lhcb-mcstats for MC statistics
and one for certification:
- es-lhcb-dev for everything
The above are all ES6 instances.
Elasticsearch performance monitoring¶
IT/ES provides monitoring tool for monitoring ES instances. You can access in the following link (accessible from inside the CERN network).
Kibana¶
Kibana is used for visualize the data. IT/ES provides a Kibana end point for each ES instance. You can access using https://instance/kibana for example: https://es-lhcb-monitoring.cern.ch/kibana
All kibana interfaces are CERN internal web pages. If you are outside of the CERN network you need to follow these instructions.
Note: You can access to kibana, if you are in one of the group: lhcb-dirac, lhcb-geoc, lhcb-gridshifters
Managing ES templates¶
Each ES instance has a dedicated template, what you can found in the repository by searching lhcb. For example for the logs.
Curator¶
Curator can be used for easily manage ES data. It can be used in different purpose. We are using it for deleting indexes that are older a certain date. To setup Curator you need to use the ES template repository (see Managing ES templates section.) and create curator4.actions file. For example: deleting indexes older a certain period.
Re-indexing existing index¶
You may need to re-index indexes from one cluster to another. You can use the following script to reindex.