Difference between revisions of "Data Transfer Scheduler & Agent components"
From Gcube Wiki
Andrea.manzi (Talk | contribs) (→Overview) |
Andrea.manzi (Talk | contribs) (→Overview) |
||
Line 3: | Line 3: | ||
== Overview == | == Overview == | ||
− | This class of components manages transfer capabilities among gCube infrastructure nodes, in particular it can handles data transfer between Data Sources and Data Storages exploiting the interfaces and the services implemented under the [[Data Access and Storage Facilities]] subsystem. | + | This class of components manages transfer capabilities among gCube infrastructure nodes, in particular but not only it can handles data transfer between Data Sources and Data Storages exploiting the interfaces and the services implemented under the [[Data Access and Storage Facilities]] subsystem. |
This document outlines the design rationale, key features, and high-level architecture, the options for their deployment and as well some use cases. | This document outlines the design rationale, key features, and high-level architecture, the options for their deployment and as well some use cases. | ||
=== Key features === | === Key features === | ||
+ | |||
+ | The components belonging to this class are responsible for: | ||
+ | |||
+ | ;reliable data transfer between Data Source and Data Storages | ||
+ | |||
+ | ;structured and unstructured Data Transfer | ||
+ | |||
+ | ;transfers to local nodes | ||
+ | |||
+ | ;advanced transfer schedules and transfer optimization | ||
== Design == | == Design == |
Revision as of 15:51, 18 April 2012
Intro
Contents
Overview
This class of components manages transfer capabilities among gCube infrastructure nodes, in particular but not only it can handles data transfer between Data Sources and Data Storages exploiting the interfaces and the services implemented under the Data Access and Storage Facilities subsystem.
This document outlines the design rationale, key features, and high-level architecture, the options for their deployment and as well some use cases.
Key features
The components belonging to this class are responsible for:
- reliable data transfer between Data Source and Data Storages
- structured and unstructured Data Transfer
- transfers to local nodes
- advanced transfer schedules and transfer optimization
Design
Philosophy
Architecture
fugyre
Deployment
Large Deployment
figure
Small Deployment
figure