======================================
CERN centralized Elasticsearch service
======================================
This document contains all information needed to manage the ES. The ES is provided by CERN IT.
General info can be found in this `documentation `_.
-----------------------
Communication channels:
-----------------------
CERN IT ES `homepage `_
1. Tickets: open a `snow ticket `_.
2. Mattermost channel: LHCb `specific channel `_ or `IT general channel `_.
-----------------------
Elasticsearch instances
-----------------------
We are using three production instances:
1. es-lhcb-monitoring for monitoring WMS and ComponentMonitoring
2. es-lhcb-dirac-logs for centralized Monitoring
3. es-lhcb-mcstats for MC statistics
and one for certification:
1. es-lhcb-dev for everything
The above are all ES6 instances.
------------------------------------
Elasticsearch performance monitoring
------------------------------------
IT/ES provides monitoring tool for monitoring ES instances. You can access `in the following link `_
(accessible from inside the CERN network).
------
Kibana
------
Kibana is used for visualize the data. IT/ES provides a Kibana end point for each ES instance.
You can access using https://instance/kibana for example: https://es-lhcb-monitoring.cern.ch/kibana
All kibana interfaces are CERN internal web pages. If you are outside of the CERN network you need to follow
`these instructions `_.
Note: You can access to kibana, if you are in one of the group: lhcb-dirac, lhcb-geoc, lhcb-gridshifters
---------------------
Managing ES templates
---------------------
Each ES instance has a dedicated template, what you can found in the `repository `_ by
searching lhcb. For example for the `logs `_.
-------
Curator
-------
Curator can be used for easily manage ES data. It can be used in different purpose.
We are using it for deleting indexes that are older a certain date. To setup Curator you need to
use the ES template repository (see Managing ES templates section.) and create `curator4.actions` file.
For example: `deleting indexes older a certain period `_.
--------------------------
Re-indexing existing index
--------------------------
You may need to re-index indexes from one cluster to another. You can
use the `following script to reindex `_.