Difference between revisions of "Monitoring System"

From Gcube Wiki
Jump to: navigation, search
(Configuring Advanced Monitoring)
 
(24 intermediate revisions by 4 users not shown)
Line 1: Line 1:
{{UnderUpdate}}
+
[[Category:Administrator's Guide]]
 
+
A gCube infrastructure manages various types of resources, such as:
A D4Science infrastructure manages various types of resources, such as:
+
  
 
* Hardware
 
* Hardware
Line 7: Line 6:
 
* Collections and Auxiliary Resources
 
* Collections and Auxiliary Resources
  
Hardware resources include gLite storage elements and computing nodes as well as gCube hosting nodes (containers), while gCube services and external software fall into the second category type. Collections and auxiliary resources can be data, metadata, indices, schemas or transformation utilities, among others.
+
Hardware resources include gCube hosting nodes (containers) as well as gLite storage elements, computing and Cloud nodes, while gCube services and external software fall into the second category type. Collections and auxiliary resources can be data, metadata, indices, schemas or transformation utilities, among others.
 
+
All these resource information are put into gCube Information System (IS) which plays the role of the infrastructure's registry and supports the publishing, discovery and monitoring of all the parts that form the infrastructure. D4Science provides two monitoring tools, namely Fast Monitoring and Infrastructure Viewer, in order to provide quick organization and visualization of the resources and how they are related to each other. The tools are accessible at the [http://monitor.d4science.research-infrastructures.eu/ Monitoring Webtool].
+
 
+
==Monitor Portal Installation==
+
Once a tomcat instance as been installed the monitor portlet wars have to be putted into the ''$CATALINA_HOME/webbaps/''.
+
 
+
This is the list of monitor portlets war containing the two applications below can be downloaded from here:
+
[[http://monitor.d4science.research-infrastructures.eu/training/WARS.tar.gz | monitoring application WAR(s)]]
+
 
+
* Infrastructure Viewer
+
* Advanced Monitoring
+
 
+
 
+
 
+
=== Configuration ===
+
Each portlet have a configuration file where the Infrastructures VO are specified.
+
 
+
==== Configuring Infrastructure Viewer ====
+
The configuration file path is ''{applicationFolder}/XML/scopedata.xml''.
+
 
+
The scopedata file have this structure:
+
<source lang="xml">
+
<?xml version="1.0" encoding="UTF-8"?>
+
<infrastructures>
+
  <infrastructure>
+
    <name>d4science</name>
+
    <vos>
+
      <vo>
+
        <name>d4science</name>
+
        <src>ServiceMap_d4science.research-infrastructures.eu.xml</src>
+
        <scope>/d4science.research-infrastructures.eu</scope>
+
      </vo>
+
    </vos>
+
  </infrastructure>
+
<infrastructures>
+
</source>
+
 
+
Tags:
+
* '''infrastructures''': the infrastructures list.
+
** '''infrastructure''': a single infrastructure.
+
*** '''name''': the infrastructure name (like gcube or d4science)
+
*** '''vos''': the vo list.
+
**** '''vo''': a single vo.
+
***** '''name''': the vo name.
+
***** '''src''': the vo ServiceMap file (located in ''$GLOBUS_LOCATION/config'' dir).
+
***** '''scope''': the vo scope.
+
 
+
[[Media:scopedata.xml|Here]] a complete sample.
+
 
+
When a new VO is added, a new vo tag is needed.
+
The VRE are discovered automatically.
+
 
+
==== Configuring Advanced Monitoring ====
+
 
+
You can refer to the Infrastructure Viewer guide for the setting of the Infrastructure / VO(s).
+
You should also edit another configuration file which is located ''{applicationFolder}/config/config.properties''.
+
 
+
'''ONLY the default scope property MUST be changed.'''
+
 
+
== Guide ==
+
=== Infrastructure Viewer ===
+
The interface is provided at [http://monitor.d4science.research-infrastructures.eu/iv/ Infrastructure Viewer] and a screenshot is shown below.
+
 
+
[[Image:Iv-mon.jpeg|frame|center|The Infrastructure Viewer monitoring tool.]]
+
 
+
This webtool has been designed to provide different views for various purposes. Views can be for
+
 
+
* '''gHN''' (Sites, gCube Hosting Nodes, and Running Instances)
+
* '''Package''' (Service Archives, and Software Packages, and gHNs)
+
* '''Service''' (Service Classes, Service Names, and Running Instances)
+
* '''Data''' (Collections, Metadata Collections, and Indices)
+
* '''Package Dependencies'''
+
* '''Service Dependencies'''
+
 
+
Each view can be applied on a specific scope identified by:
+
 
+
* the '''Infrastructure''',
+
* the '''Virtual Organization''', and
+
* the '''Virtual Research Environment'''.
+
 
+
Additionally, each view provides specific metrics like CPU or disk space for gHNs, indices and meta-data collections for data, e.t.c.
+
 
+
The above figure depicts a spacial view for packages in d4science infrastructure for the FCPPS/FCPPS VO/VRE according to some metrics selected under the Advanced Options drop-down list.
+
  
Living the cursor of the mouse above a resource, additional information is provided through a caption area. Additionally, for gHN and Services views, right-clicking on a resource, results in a pop-up window, that organizes full and detailed information, as it is depicted bellow.
+
All these resource information are collected by the [[gCore Based Information System]] (IS) which plays the role of the infrastructure's registry and supports the publishing, discovery and monitoring of all the resources belonging the infrastructure. A working instance of the Infrastructure Monitor is available in the [https://services.d4science.org/infrastructure-monitor D4Science Services Gateway].
  
[[Image:Iv-mon-details.jpeg|frame|center|Pop-up window providing full information about a gHN]]
+
For further information please see [https://wiki.gcube-system.org/gcube/Resource_Management this page].

Latest revision as of 13:59, 19 October 2016

A gCube infrastructure manages various types of resources, such as:

  • Hardware
  • Services and Applications
  • Collections and Auxiliary Resources

Hardware resources include gCube hosting nodes (containers) as well as gLite storage elements, computing and Cloud nodes, while gCube services and external software fall into the second category type. Collections and auxiliary resources can be data, metadata, indices, schemas or transformation utilities, among others.

All these resource information are collected by the gCore Based Information System (IS) which plays the role of the infrastructure's registry and supports the publishing, discovery and monitoring of all the resources belonging the infrastructure. A working instance of the Infrastructure Monitor is available in the D4Science Services Gateway.

For further information please see this page.