Difference between revisions of "DJRA2.1 Report on Scenario Specific Technology Development"

From Gcube Wiki
Jump to: navigation, search
m (AquaMaps Scenario)
 
(29 intermediate revisions by 3 users not shown)
Line 1: Line 1:
=Introduction=
+
[[Category:TO BE REMOVED]]
 +
 
 +
{|align=right
 +
||__TOC__
 +
|}
 +
 
 
The content of this report captures the development status of all software components that are direct or indirect consequence of the work performed by the Joint Research Activity 2 (JRA2) work package of the D4ScienceII project.
 
The content of this report captures the development status of all software components that are direct or indirect consequence of the work performed by the Joint Research Activity 2 (JRA2) work package of the D4ScienceII project.
  
 
The objective of this work package is to cover the design and implementation case-specific needs for each particular interoperable infrastructure. Each case is analyzed and the system to implement it, on the side of the interoperating infrastructure, is designed in detail. Following the initial design, each case implements the specific components required so that it can exploit the facilities offered by the evolving ecosystem core and it can export the identified interoperable features to the rest of the ecosystem cases.
 
The objective of this work package is to cover the design and implementation case-specific needs for each particular interoperable infrastructure. Each case is analyzed and the system to implement it, on the side of the interoperating infrastructure, is designed in detail. Following the initial design, each case implements the specific components required so that it can exploit the facilities offered by the evolving ecosystem core and it can export the identified interoperable features to the rest of the ecosystem cases.
  
The cases involved in these scenarios are the ones defined by the high level needs and requirements exposed by the one of the following infrastructures and have been specialized through the NA4 and NA5 process. These interoperability cases through this process evolved to specific implementation requirements whose definitions and status of implementation is reported in this document. The implementation is performed in the context of the following tasks:
+
The cases involved in these scenarios are the ones defined by the high level needs and requirements exposed by the one of the following infrastructures and have been specified through the NA4 and NA5 processes. The interoperability cases through this process evolved to specific implementation requirements whose definition and status of implementation is reported here. The implementation is performed in the context of the following tasks:
  
*INSPIRE specific implementation
+
* [[#INSPIRE|INSPIRE specific implementation]]
*DRIVER specific implementation
+
* [[#DRIVER|DRIVER specific implementation]]
*AquaMaps specific implementation
+
* [[#AquaMaps|AquaMaps specific implementation]]
*FCPPS specific implementation
+
* [[#FCPPS|FCPPS specific implementation]]
*ICIS specific implementation
+
* [[#ICIS|ICIS specific implementation]]
  
This document reports on the implementation progress made in the context of these tasks. Progress is reported both in the context of each individual task as well as in the direction of ecosystem interoperability. The report groups related functionalities (from an implementation point of view), with respect to their impact in components that are involved for their provision. Thus, the status of development is presented by functional group, whereas this can be the result of the combined status of various elements involved in a particular functional scope. Furthermore, as a single component might expose more than a single functional facet, it might be implicitly or explicitly involved in several functional groups.
+
The progress is reported both in the context of each individual task as well as in the direction of ecosystem interoperability. The report groups related functionalities (from an implementation point of view), with respect to their impact on components that are involved. Thus, the status of development is presented by functional group. This status can be the result of the combined statuses of the various elements involved in a particular functional scope. Furthermore, as a single component might expose more than a single functional facet, it might be implicitly or explicitly involved in several functional groups.
  
As a result of a requirement (or an entire requirement group), development can be aiming to:
+
As a result of one or more requirements, development can aim for:
*An entirely new software suite (Service including libraries and user interface elements if applicable) for extending gCube potential in a new domain.
+
* An entirely new software suite (Service including libraries and user interface elements if applicable) for extending gCube to cover new domains.
*A minor new component (of any of the aforementioned types) that plugs into the infrastructure (or to a particular existing component) in well defined areas, adding to its behavior.
+
* A minor new component (of any of the aforementioned types) that plugs into the infrastructure (or to a particular existing component) in well defined areas, adding to its behavior.
* Modification/extension of existing components, for provision of new functionality or modification/improvement of the existing one.  
+
* Modification/extension of existing components, for provision of new functionality or modification/improvement of the existing one.
  
In this stage of D4ScienceII project, the status of a component can be any of the following:
+
Requirements characterizing each case are documented in the dedicated wiki pages of '''[https://networking.wiki.d4science-ii.research-infrastructures.eu/networking/index.php/NA5_Home NA5]'''. The guidelines governing the activities performed in this context can be found at the respective '''[https://networking.wiki.d4science-ii.research-infrastructures.eu/networking/index.php/Communities_Practices_and_Requirements:_Guidelines_and_Template guidelines page]'''. The study of the documentation and requirements produced through these pages are the subject of analysis of dedicated system analysts producing a complete report documented under the '''[https://service.wiki.d4science-ii.research-infrastructures.eu/service/index.php/Virtual_Organisations_and_Virtual_Research_Environments_Planning SA2 wiki]'''. This product is the basis upon which TRAC tickets are created to further link and monitor development activities.
* Canceled (components that their design and implementation has been canceled due to shift of interest)
+
* Design (components that are in the stage of design and the best implementation approach is yet to be decided)
+
* Prototypes (components that are already designed and implemented as prototypes but have not been delivered yet as stable versions).
+
* Delivered (components that have been completely delivered, i.e. are deployable on the infrastructure, but further refinements are performed)
+
* Completed (delivered components that their formal development cycle is finished and no updates are planned for next versions)
+
A further clarification is given with respect to development so as to make evident which is the degree to which a component can be included in a production infrastructure in its current state.
+
  
It is important to note that a component can be a product of joint community requirements, and as such it is co-referenced in the respective sections. In this report, a clear reference to the request originator is made wherever suited, with a potential clarification on whether this is a “diffusion” adoption or an original request. In the former case a reference is made in the respective section to detail the role of the component in the collaboration among ecosystems.
+
== Status ==
  
=Functionality Status Sum-up =
+
=== INSPIRE ===
  
''This section contains definition and reporting information on the functionalities implemented in the context of JRA2 as well as the involved components, be it existing, modified or new. If the list becomes to big to be hosted in a single page, each one of the sub sections can be moved to a new page.''
+
The '''requirements''' characterizing the INSPIRE scenario are documented in a dedicated wiki page ('''[https://networking.wiki.d4science-ii.research-infrastructures.eu/networking/index.php/INSPIRE_Scenario INSPIRE Scenario]''') as part of the project deliverable DNA5.1 Communities Practices and Requirements. The production of these requirements is led by scenario representatives. The set of requirements is expected to evolve during the project lifetime. During the project lifetime, requirements can be revised and reinforced after evaluation of implementation of the requested facilities. In addition, new requirements may emerge.  
  
==INSPIRE==
+
The so produced requirements are analyzed by a multidisciplinary team involving NA, SA and JRA representatives with the goal (i) to reach a common understanding of the community desiderata and (ii) to identify the '''actions''' needed to satisfy them. This activity is ''continuous'', i.e. the team will discuss the existing requirements, agree on approaches and solutions to satisfy the faced issues and plan the activities (namely technology development and deployment) to resolve them. This activity is documented in a dedicated wiki page ('''[https://service.wiki.d4science-ii.research-infrastructures.eu/service/index.php/INSPIRE_Scenario_Analysis INSPIRE Scenario Analysis]''').
{| align="center" width="100%" border="1" cellpadding="4" cellspacing="0"
+
|- style="font-style:bold;"
+
|bgcolor="yellow"| Functionality
+
|bgcolor="yellow"| Related TRACked Requirements
+
|bgcolor="yellow"| Support
+
|bgcolor="yellow"| Diffusion
+
|bgcolor="yellow"| Status
+
|bgcolor="yellow"| Stage Completion (%)
+
|bgcolor="yellow"| Completion Date
+
|bgcolor="yellow"| Production Release Date
+
|-
+
|''In-document reference to detailed description''
+
|''Track URI''
+
|''List of partners involved''
+
|''List of in-document references to related functionalities where this component is diffused''
+
|''The current status of the component''
+
|''Percentage completed''
+
|''The envisaged or actual completion date''
+
|''The envisaged or actual release date''
+
|-
+
|[[#DAG-JDL_Job_Execution_on_gCube_nodes | DAG-JDL Job Execution on gCube nodes]]
+
|''Track URI''
+
|NKUA
+
|''List of in-document references to related functionalities where this component is diffused''
+
|Prototype
+
|50%
+
|N/A
+
|N/A
+
|-
+
|[[#Grid_Job_Execution_on_gLite Grid | Grid Job Execution on gLite Grid]]
+
|''Track URI''
+
|NKUA
+
|''List of in-document references to related functionalities where this component is diffused''
+
|Prototype
+
|50%
+
|N/A
+
|N/A
+
|-
+
|[[#Map-Reduce_modeled_execution | Map-Reduce modeled execution]]
+
|''Track URI''
+
|NKUA
+
|''List of in-document references to related functionalities where this component is diffused''
+
|Prototype
+
|50%
+
|N/A
+
|N/A
+
|-
+
|[[#Access_OpenSearch_Inspire | Access of OpenSearch interface on INSPIRE content]]
+
|''Track URI''
+
|NKUA
+
|''List of in-document references to related functionalities where this component is diffused''
+
|Prototype
+
|20%
+
|N/A
+
|N/A
+
|-
+
|}
+
  
===Functionality details===
+
The planned actions are recorded through TRAC tickets and organized into a '''living report''' ('''[https://issue.d4science-ii.research-infrastructures.eu/report/30 Report #30]''') that provide its users with an ever updated account on the '''scenario specific technology development activities''', including their state (e.g. if the activity is complete, the percentage of completion), a detailed description of the specific activity, the planned and actual completion date.
====Requirements====
+
''The requirements that raised the need for this functionality''
+
====Functionalities====
+
''The functionalities that are expected to be provided''
+
====Status====
+
''The current status of the the overall functionality''
+
====Main Components Involved====
+
''The main components that either pre-exist, are extended or are completly new and are implemented in this context''
+
====More Information====
+
''Links to more information''
+
  
===DAG-JDL Job Execution on gCube nodes===
+
Other development activities results from defects discovered after the release of the artifacts (e.g. known bugs). These are captured by two specific live reports, '''current defects''' ([https://issue.d4science-ii.research-infrastructures.eu/report/39 Report #39]) and '''resolved defects''' ([https://issue.d4science-ii.research-infrastructures.eu/report/40 Report #40]).
====Requirements====
+
The requirement raised to necessitate the development of this component was the need of execution arbitrary, validated, of various technologies in the gCube infrastructure
+
====Functionalities====
+
This adaptor as part of the adaptors offered by the WorkflowEngine constructs an Execution Plan based on the description of a job defined in JDL syntax. This description can be of a single job or it can include a Directed Acyclic Graph (DAG) of jobs. This adaptor parses a Job Description Language (JDL) definition block and translates the described job or DAG of jobs into an  Execution Plan which can be submitted to the ExecutionEngine for execution.
+
====Status====
+
Prototype
+
====Main Components Involved====
+
[[WorkflowJDLAdaptor | Workflow JDL Adaptor]]
+
====More Information====
+
* [[WorkflowJDLAdaptor | Workflow JDL Adaptor]]
+
* [[WorkflowEngine | Workflow Engine]]
+
* [[ExecutionEngine | Execution Engine]]
+
  
===Grid Job Execution on gLite Grid===
+
In addition to the development activities captured by the reports above, other stems from incidents and malfunctions discovered while exploiting the technology in the production infrastructure. They are captured by two specific living reports, '''current incidents''' ([https://support.d4science-ii.research-infrastructures.eu/report/1 '''Report #1''']) and '''resolved incidents''' ([https://support.d4science-ii.research-infrastructures.eu/report/2 '''Report #2'''] and [https://issue.d4science-ii.research-infrastructures.eu/report/11 '''Report #11''']).
====Requirements====
+
The requirement raised to necessitate the development of this component was the need of forwarding execution of resource intensive jobs to the gLite grid
+
====Functionalities====
+
This adaptor as part of the adaptors offered by the WorkflowEngine constructs an  Execution Plan that can mediate to submit a job described through a JDL file using a gLite Grid UI node. After its submission the job is monitored for its status and the final output of the job is retrieved.
+
====Status====
+
Prototype
+
====Main Components Involved====
+
[[WorkflowGridAdaptor | Workflow Grid Adaptor]]
+
====More Information====
+
* [[WorkflowGridAdaptor | Workflow Grid Adaptor]]
+
* [[WorkflowEngine | Workflow Engine]]
+
* [[ExecutionEngine | Execution Engine]]
+
  
===Map-Reduce modeled execution===
+
=== DRIVER ===
====Requirements====
+
The requirement raised to necessitate the development of this component was the need of supporting the Map Reduce paradigm and offer an effective environment for the jobs to operate on
+
====Functionalities====
+
This adaptor as part of the adaptors offered by the WorkflowEngine constructs an  Execution Plan that can mediate to submit a job writen under the Map Reduce design pattern and written against the utilities offered by the Hadoop infrastructure. This adaptor constructs an  Execution Plan that can contact a Hadoop UI node, submit, monitor and retrieve the output of a Map Reduce job. The Hadoop infrastructure utilized resides in a cloud infrastructure with which the ExecutionEngine negotiates the resource availability.
+
====Status====
+
Prototype
+
====Main Components Involved====
+
[[WorkflowHadoopAdaptor | Workflow Hadoop Adaptor]]
+
====More Information====
+
* [[WorkflowHadoopAdaptor | Workflow Hadoop Adaptor]]
+
* [[WorkflowEngine | Workflow Engine]]
+
* [[ExecutionEngine | Execution Engine]]
+
  
===Access OpenSearch Inspire===
+
The '''requirements''' characterizing the DRIVER scenario are documented in a dedicated wiki page ('''[https://networking.wiki.d4science-ii.research-infrastructures.eu/networking/index.php/DRIVER_Scenario DRIVER Scenario]''') as part of the project deliverable DNA5.1 Communities Practices and Requirements. The production of these requirements is led by scenario representatives. The set of requirements is expected to evolve during the project lifetime. During the project lifetime, requirements can be revised and reinforced after evaluation of implementation of the requested facilities. In addition, new requirements may emerge.
====Requirements====
+
The requirement raised to necessitate the development of this component was the need of integrating content provided from INSPIRE platform though OpenSearch interface
+
====Functionalities====
+
This Operator will provide core functionality to searching INpsire content through an OpenSearch interface provided from the INSPIRE platform
+
====Status====
+
Prototype
+
====Main Components Involved====
+
Page not Available
+
====More Information====
+
* Page not Available
+
  
==DRIVER==
+
The so produced requirements are analyzed by a multidisciplinary team involving NA, SA and JRA representatives with the goal (i) to reach a common understanding of the community desiderata and (ii) to identify the '''actions''' needed to satisfy them. This activity is ''continuous'', i.e. the team will discuss the existing requirements, agree on approaches and solutions to satisfy the faced issues and plan the activities (namely technology development and deployment) to resolve them. This activity is documented in a dedicated wiki page ('''[https://service.wiki.d4science-ii.research-infrastructures.eu/service/index.php/DRIVER_Scenario_Analysis DRIVER Scenario Analysis]''').
{| align="center" width="100%" border="1" cellpadding="4" cellspacing="0"
+
|- style="font-style:bold;"
+
|bgcolor="yellow"| Functionality
+
|bgcolor="yellow"| Related TRACked Requirements
+
|bgcolor="yellow"| Support
+
|bgcolor="yellow"| Diffusion
+
|bgcolor="yellow"| Status
+
|bgcolor="yellow"| Stage Completion (%)
+
|bgcolor="yellow"| Completion Date
+
|bgcolor="yellow"| Production Release Date
+
|-
+
|''In-document reference to detailed description''
+
|''Track URI''
+
|''List of partners involved''
+
|''List of in-document references to related functionalities where this component is diffused''
+
|''The current status of the component''
+
|''Percentage completed''
+
|''The envisaged or actual completion date''
+
|''The envisaged or actual release date''
+
|-
+
|[[#Access_OpenSearch_Driver | Access of OpenSearch interface on DRIVER content]]
+
|''Track URI''
+
|NKUA
+
|''List of in-document references to related functionalities where this component is diffused''
+
|Prototype
+
|20%
+
|N/A
+
|N/A
+
|-
+
|[[#Image Data Transformation | Image Data Transformation]]
+
|''Track URI''
+
|DRIVER
+
|''List of in-document references to related functionalities where this component is diffused''
+
|Prototype
+
|20%
+
|N/A
+
|N/A
+
|-
+
|}
+
===Functionality details===
+
====Requirements====
+
''The requirements that raised the need for this functionality''
+
====Functionalities====
+
''The functionalities that are expected to be provided''
+
====Status====
+
''The current status of the the overall functionality''
+
====Main Components Involved====
+
''The main components that either pre-exist, are extended or are completly new and are implemented in this context''
+
====More Information====
+
''Links to more information''
+
  
===Access OpenSearch Driver===
+
The planned actions are recorded through TRAC tickets and organized into a '''living report''' ('''[https://issue.d4science-ii.research-infrastructures.eu/report/31 Report #31]''') that provide its users with an ever updated account on the '''scenario specific technology development activities''', including their state (e.g. if the activity is complete, the percentage of completion), a detailed description of the specific activity, the planned and actual completion date.
====Requirements====
+
The requirement raised to necessitate the development of this component was the need of integrating content provided from DRIVER platform though OpenSearch interface
+
====Functionalities====
+
This Operator will provide core functionality to searching DRIVER content through an OpenSearch interface provided from the DRIVER platform
+
====Status====
+
Prototype
+
====Main Components Involved====
+
Page not Available
+
====More Information====
+
* Page not Available
+
  
===Image Data Transformation===
+
Other development activities results from defects discovered after the release of the artifacts (e.g. known bugs). These are captured by two specific live reports, '''current defects''' ([https://issue.d4science-ii.research-infrastructures.eu/report/39 Report #39]) and '''resolved defects''' ([https://issue.d4science-ii.research-infrastructures.eu/report/40 Report #40]).
====Requirements====
+
The requirement raised to necessitate the development of this component was the need to process large number of images to create thumbnails
+
====Functionalities====
+
This component implemented by the DRIVER community makes use of the gDTS gCube service to process large numbers of images to create thumbnails
+
====Status====
+
Prototype
+
====Main Components Involved====
+
Page not Available
+
====More Information====
+
* Page not Available
+
  
== AquaMaps Scenario ==
+
In addition to the development activities captured by the reports above, other stems from incidents and malfunctions discovered while exploiting the technology in the production infrastructure. They are captured by two specific living reports, '''current incidents''' ([https://support.d4science-ii.research-infrastructures.eu/report/1 '''Report #1''']) and '''resolved incidents''' ([https://support.d4science-ii.research-infrastructures.eu/report/2 '''Report #2'''] and [https://issue.d4science-ii.research-infrastructures.eu/report/11 '''Report #11''']).
  
The '''requirements''' characterizing the AquaMaps scenario are documented in a dedicated wiki page ('''[https://networking.wiki.d4science-ii.research-infrastructures.eu/networking/index.php/AquaMaps_Scenario AquaMaps Scenario]''') as part of the project deliverable DNA5.1 Communities Practices and Requirements. The production of these requirements is lead by scenario representatives. The set of requirements is expected to evolve during the project lifetime, e.g. previously posed requirements will be revised and reinforced thanks to the availability of early implementation of the requested facilities as well as new requirements will be posed.
+
=== AquaMaps ===
  
The so produced requirements are analyzed by analysts having multidisciplinary knowledge and involving NA, SA and JRA representatives with the goal (i) to reach a common understanding of the community desiderata and (ii) to identify the '''actions''' needed to satisfy them. This activity is ''continuous'', i.e. the team will discuss the existing requirements, agree on approaches and solutions to satisfy the faced issues and plan the activities (namely technology development and deployment) to resolve them. This activity is documented in a dedicated wiki page ('''[https://service.wiki.d4science-ii.research-infrastructures.eu/service/index.php/AquaMaps_Scenario_Analysis AquaMaps Scenario Analysis]''').
+
The '''requirements''' characterizing the AquaMaps scenario are documented in a dedicated wiki page ('''[https://networking.wiki.d4science-ii.research-infrastructures.eu/networking/index.php/AquaMaps_Scenario AquaMaps Scenario]''') as part of the project deliverable DNA5.1 Communities Practices and Requirements. The production of these requirements is led by scenario representatives. The set of requirements is expected to evolve during the project lifetime. During the project lifetime, requirements can be revised and reinforced after evaluation of implementation of the requested facilities. In addition, new requirements may emerge.  
  
The planned actions are recorded through TRAC tickets and organized into a '''living report''' (<font color=red>'''LINK TO TRAC REPORT TO BE CREATED'''</font>) that provide its users with an ever updated account on the '''scenario specific technology development activities''', including their state (e.g. if the activity is complete, the percentage of completion), a detailed description of the specific activity, the planned and actual completion date.
+
The so produced requirements are analyzed by a multidisciplinary team involving NA, SA and JRA representatives with the goal (i) to reach a common understanding of the community desiderata and (ii) to identify the '''actions''' needed to satisfy them. This activity is ''continuous'', i.e. the team will discuss the existing requirements, agree on approaches and solutions to satisfy the faced issues and plan the activities (namely technology development and deployment) to resolve them. This activity is documented in a dedicated wiki page ('''[https://service.wiki.d4science-ii.research-infrastructures.eu/service/index.php/AquaMaps_Scenario_Analysis AquaMaps Scenario Analysis]''').
  
In addition to the development activities captured by the reports above, other stems from incidents and malfunctions discovered while exploiting the technology in the production infrastructure. They are captured by two specific living reports, '''current incidents''' ([https://issue.d4science-ii.research-infrastructures.eu/report/9 Report #9]) and '''resolved incidents''' ([https://issue.d4science-ii.research-infrastructures.eu/report/11 Report #11]).
+
The planned actions are recorded through TRAC tickets and organized into a '''living report''' ('''[https://issue.d4science-ii.research-infrastructures.eu/report/32 Report #32]''') that provide its users with an ever updated account on the '''scenario specific technology development activities''', including their state (e.g. if the activity is complete, the percentage of completion), a detailed description of the specific activity, the planned and actual completion date.
  
==FCPPS==
+
Other development activities results from defects discovered after the release of the artifacts (e.g. known bugs). These are captured by two specific live reports, '''current defects''' ([https://issue.d4science-ii.research-infrastructures.eu/report/39 Report #39]) and '''resolved defects''' ([https://issue.d4science-ii.research-infrastructures.eu/report/40 Report #40]).
{| align="center" width="100%" border="1" cellpadding="4" cellspacing="0"
+
|- style="font-style:bold;"
+
|bgcolor="yellow"| Functionality
+
|bgcolor="yellow"| Related TRACked Requirements
+
|bgcolor="yellow"| Support
+
|bgcolor="yellow"| Diffusion
+
|bgcolor="yellow"| Status
+
|bgcolor="yellow"| Stage Completion (%)
+
|bgcolor="yellow"| Completion Date
+
|bgcolor="yellow"| Production Release Date
+
|-
+
|''In-document reference to detailed description''
+
|''Track URI''
+
|''List of partners involved''
+
|''List of in-document references to related functionalities where this component is diffused''
+
|''The current status of the component''
+
|''Percentage completed''
+
|''The envisaged or actual completion date''
+
|''The envisaged or actual release date''
+
|-
+
|}
+
===Functionality details===
+
====Requirements====
+
''The requirements that raised the need for this functionality''
+
====Functionalities====
+
''The functionalities that are expected to be provided''
+
====Status====
+
''The current status of the the overall functionality''
+
====Main Components Involved====
+
''The main components that either pre-exist, are extended or are completly new and are implemented in this context''
+
====More Information====
+
''Links to more information''
+
  
==ICIS==
+
In addition to the development activities captured by the reports above, other stems from incidents and malfunctions discovered while exploiting the technology in the production infrastructure. They are captured by two specific living reports, '''current incidents''' ([https://support.d4science-ii.research-infrastructures.eu/report/1 '''Report #1''']) and '''resolved incidents''' ([https://support.d4science-ii.research-infrastructures.eu/report/2 '''Report #2'''] and [https://issue.d4science-ii.research-infrastructures.eu/report/11 '''Report #11''']).
{| align="center" width="100%" border="1" cellpadding="4" cellspacing="0"
+
|- style="font-style:bold;"
+
|bgcolor="yellow"| Functionality
+
|bgcolor="yellow"| Related TRACked Requirements
+
|bgcolor="yellow"| Support
+
|bgcolor="yellow"| Diffusion
+
|bgcolor="yellow"| Status
+
|bgcolor="yellow"| Stage Completion (%)
+
|bgcolor="yellow"| Completion Date
+
|bgcolor="yellow"| Production Release Date
+
|-
+
|''In-document reference to detailed description''
+
|''Track URI''
+
|''List of partners involved''
+
|''List of in-document references to related functionalities where this component is diffused''
+
|''The current status of the component''
+
|''Percentage completed''
+
|''The envisaged or actual completion date''
+
|''The envisaged or actual release date''
+
|-
+
|}
+
===Functionality details===
+
====Requirements====
+
''The requirements that raised the need for this functionality''
+
====Functionalities====
+
''The functionalities that are expected to be provided''
+
====Status====
+
''The current status of the the overall functionality''
+
====Main Components Involved====
+
''The main components that either pre-exist, are extended or are completly new and are implemented in this context''
+
====More Information====
+
''Links to more information''
+
  
=Diffusion=
+
=== FCPPS ===
  
''This section summarizes the interoperability resolving implementation by coupling the described functionality requirements. Although this section introduces a level of repetition, since some of the information detailed in previous section of the document, it serves also as a validation index for the implemented work and its deadlines. Additionally, the status and completion percentage reported in this section is targeting the integration of functionalities which may differ from the ones described in the above sections. This is mainly due to the fact that a functionality requirement may need in order to be satisfied not only integration with other ecosystem modules, but also with platform components as well as external ones.''
+
The '''requirements''' characterizing the FCPPS scenario are documented in a dedicated wiki page ('''[https://networking.wiki.d4science-ii.research-infrastructures.eu/networking/index.php/FCPPS_Scenario FCPPS Scenario]''') as part of the project deliverable DNA5.1 Communities Practices and Requirements. The production of these requirements is led by scenario representatives. The set of requirements is expected to evolve during the project lifetime. During the project lifetime, requirements can be revised and reinforced after evaluation of implementation of the requested facilities. In addition, new requirements may emerge.  
  
{| align="center" width="100%" border="1" cellpadding="4" cellspacing="0"
+
The so produced requirements are analyzed by a multidisciplinary team involving NA, SA and JRA representatives with the goal (i) to reach a common understanding of the community desiderata and (ii) to identify the '''actions''' needed to satisfy them. This activity is ''continuous'', i.e. the team will discuss the existing requirements, agree on approaches and solutions to satisfy the faced issues and plan the activities (namely technology development and deployment) to resolve them. This activity is documented in a dedicated wiki page ('''[https://service.wiki.d4science-ii.research-infrastructures.eu/service/index.php/FCPPS_Scenario_Analysis FCPPS Scenario Analysis]''').
|- style="font-style:bold;"
+
 
|bgcolor="yellow"| Required Functionality
+
The planned actions are recorded through TRAC tickets and organized into a '''living report''' ('''[https://issue.d4science-ii.research-infrastructures.eu/report/33 Report #33]''') that provide its users with an ever updated account on the '''scenario specific technology development activities''', including their state (e.g. if the activity is complete, the percentage of completion), a detailed description of the specific activity, the planned and actual completion date.
|bgcolor="yellow"| Provided Functionality
+
 
|bgcolor="yellow"| Integration Status
+
Other development activities results from defects discovered after the release of the artifacts (e.g. known bugs). These are captured by two specific live reports, '''current defects''' ([https://issue.d4science-ii.research-infrastructures.eu/report/39 Report #39]) and '''resolved defects''' ([https://issue.d4science-ii.research-infrastructures.eu/report/40 Report #40]).
|bgcolor="yellow"| Integration Completion (%)
+
 
|bgcolor="yellow"| Integration Completion Date
+
In addition to the development activities captured by the reports above, other stems from incidents and malfunctions discovered while exploiting the technology in the production infrastructure. They are captured by two specific living reports, '''current incidents''' ([https://support.d4science-ii.research-infrastructures.eu/report/1 '''Report #1''']) and '''resolved incidents''' ([https://support.d4science-ii.research-infrastructures.eu/report/2 '''Report #2'''] and [https://issue.d4science-ii.research-infrastructures.eu/report/11 '''Report #11''']).
|-
+
 
|In-document reference to detailed description of the required functionality and the partner requesting it
+
=== ICIS ===
|List of in-document references to detailed description of the provided functionalities and the partners providing it
+
 
|The current status of the integration procedure
+
The '''requirements''' characterizing the ICIS scenario are documented in a dedicated wiki page ('''[https://networking.wiki.d4science-ii.research-infrastructures.eu/networking/index.php/ICIS_Scenario ICIS Scenario]''') as part of the project deliverable DNA5.1 Communities Practices and Requirements. The production of these requirements is led by scenario representatives. The set of requirements is expected to evolve during the project lifetime. During the project lifetime, requirements can be revised and reinforced after evaluation of implementation of the requested facilities. In addition, new requirements may emerge.
|Integration procedure percentage completed
+
 
|The envisaged or actual integration procedure completion date
+
The so produced requirements are analyzed by a multidisciplinary team involving NA, SA and JRA representatives with the goal (i) to reach a common understanding of the community desiderata and (ii) to identify the '''actions''' needed to satisfy them. This activity is ''continuous'', i.e. the team will discuss the existing requirements, agree on approaches and solutions to satisfy the faced issues and plan the activities (namely technology development and deployment) to resolve them. This activity is documented in a dedicated wiki page ('''[https://service.wiki.d4science-ii.research-infrastructures.eu/service/index.php/ICIS_Scenario_Analysis ICIS Scenario Analysis]''').
|-
+
 
|}
+
The planned actions are recorded through TRAC tickets and organized into a '''living report''' ('''[https://issue.d4science-ii.research-infrastructures.eu/report/34 Report #34]''') that provide its users with an ever updated account on the '''scenario specific technology development activities''', including their state (e.g. if the activity is complete, the percentage of completion), a detailed description of the specific activity, the planned and actual completion date.
 +
 
 +
Other development activities results from defects discovered after the release of the artifacts (e.g. known bugs). These are captured by two specific live reports, '''current defects''' ([https://issue.d4science-ii.research-infrastructures.eu/report/39 Report #39]) and '''resolved defects''' ([https://issue.d4science-ii.research-infrastructures.eu/report/40 Report #40]).
 +
 
 +
In addition to the development activities captured by the reports above, other stems from incidents and malfunctions discovered while exploiting the technology in the production infrastructure. They are captured by two specific living reports, '''current incidents''' ([https://support.d4science-ii.research-infrastructures.eu/report/1 '''Report #1''']) and '''resolved incidents''' ([https://support.d4science-ii.research-infrastructures.eu/report/2 '''Report #2'''] and [https://issue.d4science-ii.research-infrastructures.eu/report/11 '''Report #11''']).

Latest revision as of 20:01, 6 July 2016


The content of this report captures the development status of all software components that are direct or indirect consequence of the work performed by the Joint Research Activity 2 (JRA2) work package of the D4ScienceII project.

The objective of this work package is to cover the design and implementation case-specific needs for each particular interoperable infrastructure. Each case is analyzed and the system to implement it, on the side of the interoperating infrastructure, is designed in detail. Following the initial design, each case implements the specific components required so that it can exploit the facilities offered by the evolving ecosystem core and it can export the identified interoperable features to the rest of the ecosystem cases.

The cases involved in these scenarios are the ones defined by the high level needs and requirements exposed by the one of the following infrastructures and have been specified through the NA4 and NA5 processes. The interoperability cases through this process evolved to specific implementation requirements whose definition and status of implementation is reported here. The implementation is performed in the context of the following tasks:

The progress is reported both in the context of each individual task as well as in the direction of ecosystem interoperability. The report groups related functionalities (from an implementation point of view), with respect to their impact on components that are involved. Thus, the status of development is presented by functional group. This status can be the result of the combined statuses of the various elements involved in a particular functional scope. Furthermore, as a single component might expose more than a single functional facet, it might be implicitly or explicitly involved in several functional groups.

As a result of one or more requirements, development can aim for:

  • An entirely new software suite (Service including libraries and user interface elements if applicable) for extending gCube to cover new domains.
  • A minor new component (of any of the aforementioned types) that plugs into the infrastructure (or to a particular existing component) in well defined areas, adding to its behavior.
  • Modification/extension of existing components, for provision of new functionality or modification/improvement of the existing one.

Requirements characterizing each case are documented in the dedicated wiki pages of NA5. The guidelines governing the activities performed in this context can be found at the respective guidelines page. The study of the documentation and requirements produced through these pages are the subject of analysis of dedicated system analysts producing a complete report documented under the SA2 wiki. This product is the basis upon which TRAC tickets are created to further link and monitor development activities.

Status

INSPIRE

The requirements characterizing the INSPIRE scenario are documented in a dedicated wiki page (INSPIRE Scenario) as part of the project deliverable DNA5.1 Communities Practices and Requirements. The production of these requirements is led by scenario representatives. The set of requirements is expected to evolve during the project lifetime. During the project lifetime, requirements can be revised and reinforced after evaluation of implementation of the requested facilities. In addition, new requirements may emerge.

The so produced requirements are analyzed by a multidisciplinary team involving NA, SA and JRA representatives with the goal (i) to reach a common understanding of the community desiderata and (ii) to identify the actions needed to satisfy them. This activity is continuous, i.e. the team will discuss the existing requirements, agree on approaches and solutions to satisfy the faced issues and plan the activities (namely technology development and deployment) to resolve them. This activity is documented in a dedicated wiki page (INSPIRE Scenario Analysis).

The planned actions are recorded through TRAC tickets and organized into a living report (Report #30) that provide its users with an ever updated account on the scenario specific technology development activities, including their state (e.g. if the activity is complete, the percentage of completion), a detailed description of the specific activity, the planned and actual completion date.

Other development activities results from defects discovered after the release of the artifacts (e.g. known bugs). These are captured by two specific live reports, current defects (Report #39) and resolved defects (Report #40).

In addition to the development activities captured by the reports above, other stems from incidents and malfunctions discovered while exploiting the technology in the production infrastructure. They are captured by two specific living reports, current incidents (Report #1) and resolved incidents (Report #2 and Report #11).

DRIVER

The requirements characterizing the DRIVER scenario are documented in a dedicated wiki page (DRIVER Scenario) as part of the project deliverable DNA5.1 Communities Practices and Requirements. The production of these requirements is led by scenario representatives. The set of requirements is expected to evolve during the project lifetime. During the project lifetime, requirements can be revised and reinforced after evaluation of implementation of the requested facilities. In addition, new requirements may emerge.

The so produced requirements are analyzed by a multidisciplinary team involving NA, SA and JRA representatives with the goal (i) to reach a common understanding of the community desiderata and (ii) to identify the actions needed to satisfy them. This activity is continuous, i.e. the team will discuss the existing requirements, agree on approaches and solutions to satisfy the faced issues and plan the activities (namely technology development and deployment) to resolve them. This activity is documented in a dedicated wiki page (DRIVER Scenario Analysis).

The planned actions are recorded through TRAC tickets and organized into a living report (Report #31) that provide its users with an ever updated account on the scenario specific technology development activities, including their state (e.g. if the activity is complete, the percentage of completion), a detailed description of the specific activity, the planned and actual completion date.

Other development activities results from defects discovered after the release of the artifacts (e.g. known bugs). These are captured by two specific live reports, current defects (Report #39) and resolved defects (Report #40).

In addition to the development activities captured by the reports above, other stems from incidents and malfunctions discovered while exploiting the technology in the production infrastructure. They are captured by two specific living reports, current incidents (Report #1) and resolved incidents (Report #2 and Report #11).

AquaMaps

The requirements characterizing the AquaMaps scenario are documented in a dedicated wiki page (AquaMaps Scenario) as part of the project deliverable DNA5.1 Communities Practices and Requirements. The production of these requirements is led by scenario representatives. The set of requirements is expected to evolve during the project lifetime. During the project lifetime, requirements can be revised and reinforced after evaluation of implementation of the requested facilities. In addition, new requirements may emerge.

The so produced requirements are analyzed by a multidisciplinary team involving NA, SA and JRA representatives with the goal (i) to reach a common understanding of the community desiderata and (ii) to identify the actions needed to satisfy them. This activity is continuous, i.e. the team will discuss the existing requirements, agree on approaches and solutions to satisfy the faced issues and plan the activities (namely technology development and deployment) to resolve them. This activity is documented in a dedicated wiki page (AquaMaps Scenario Analysis).

The planned actions are recorded through TRAC tickets and organized into a living report (Report #32) that provide its users with an ever updated account on the scenario specific technology development activities, including their state (e.g. if the activity is complete, the percentage of completion), a detailed description of the specific activity, the planned and actual completion date.

Other development activities results from defects discovered after the release of the artifacts (e.g. known bugs). These are captured by two specific live reports, current defects (Report #39) and resolved defects (Report #40).

In addition to the development activities captured by the reports above, other stems from incidents and malfunctions discovered while exploiting the technology in the production infrastructure. They are captured by two specific living reports, current incidents (Report #1) and resolved incidents (Report #2 and Report #11).

FCPPS

The requirements characterizing the FCPPS scenario are documented in a dedicated wiki page (FCPPS Scenario) as part of the project deliverable DNA5.1 Communities Practices and Requirements. The production of these requirements is led by scenario representatives. The set of requirements is expected to evolve during the project lifetime. During the project lifetime, requirements can be revised and reinforced after evaluation of implementation of the requested facilities. In addition, new requirements may emerge.

The so produced requirements are analyzed by a multidisciplinary team involving NA, SA and JRA representatives with the goal (i) to reach a common understanding of the community desiderata and (ii) to identify the actions needed to satisfy them. This activity is continuous, i.e. the team will discuss the existing requirements, agree on approaches and solutions to satisfy the faced issues and plan the activities (namely technology development and deployment) to resolve them. This activity is documented in a dedicated wiki page (FCPPS Scenario Analysis).

The planned actions are recorded through TRAC tickets and organized into a living report (Report #33) that provide its users with an ever updated account on the scenario specific technology development activities, including their state (e.g. if the activity is complete, the percentage of completion), a detailed description of the specific activity, the planned and actual completion date.

Other development activities results from defects discovered after the release of the artifacts (e.g. known bugs). These are captured by two specific live reports, current defects (Report #39) and resolved defects (Report #40).

In addition to the development activities captured by the reports above, other stems from incidents and malfunctions discovered while exploiting the technology in the production infrastructure. They are captured by two specific living reports, current incidents (Report #1) and resolved incidents (Report #2 and Report #11).

ICIS

The requirements characterizing the ICIS scenario are documented in a dedicated wiki page (ICIS Scenario) as part of the project deliverable DNA5.1 Communities Practices and Requirements. The production of these requirements is led by scenario representatives. The set of requirements is expected to evolve during the project lifetime. During the project lifetime, requirements can be revised and reinforced after evaluation of implementation of the requested facilities. In addition, new requirements may emerge.

The so produced requirements are analyzed by a multidisciplinary team involving NA, SA and JRA representatives with the goal (i) to reach a common understanding of the community desiderata and (ii) to identify the actions needed to satisfy them. This activity is continuous, i.e. the team will discuss the existing requirements, agree on approaches and solutions to satisfy the faced issues and plan the activities (namely technology development and deployment) to resolve them. This activity is documented in a dedicated wiki page (ICIS Scenario Analysis).

The planned actions are recorded through TRAC tickets and organized into a living report (Report #34) that provide its users with an ever updated account on the scenario specific technology development activities, including their state (e.g. if the activity is complete, the percentage of completion), a detailed description of the specific activity, the planned and actual completion date.

Other development activities results from defects discovered after the release of the artifacts (e.g. known bugs). These are captured by two specific live reports, current defects (Report #39) and resolved defects (Report #40).

In addition to the development activities captured by the reports above, other stems from incidents and malfunctions discovered while exploiting the technology in the production infrastructure. They are captured by two specific living reports, current incidents (Report #1) and resolved incidents (Report #2 and Report #11).