Difference between revisions of "Data Transfer APIs"

From Gcube Wiki
Jump to: navigation, search
(Data Transfer Agent Service)
(Data Transfer Agent Service)
Line 37: Line 37:
 
* '''Key Features''':
 
* '''Key Features''':
 
:* ''transfer of local files from an external/internal client to a remote GHN''
 
:* ''transfer of local files from an external/internal client to a remote GHN''
:* "file transfer from a remote Data Source to a remote GHN using standard protocol ( HTTP, FTP, BitTorrent)''
+
:* ''file transfer from a remote Data Source to a remote GHN using standard protocol ( HTTP, FTP, BitTorrent)''
:* ''file transfer from a remote Data Source to the gCube Storage Manager ( MongoDB) using standard protocol ( HTTP, FTP, BitTorrent)''
+
:* ''file transfer from a remote Data Source to the gCube Storage Manager ( MongoDB) using standard protocols ( HTTP, FTP, BitTorrent)''
 
:* ''tree based data transfer from a remote Data Source to a remote tree-based data storage''
 
:* ''tree based data transfer from a remote Data Source to a remote tree-based data storage''
 
:* ''transfer statistics available trough messaging''
 
:* ''transfer statistics available trough messaging''

Revision as of 10:59, 2 July 2012

Data Transfer APIs provide access to transfer mechanisms for large sets of multi-type datasets distributed across the system. The document outlines the design reational for those APIs.

Overview

APIs

Name Description Type Protocol Framework
Data Transfer Agent Library The CL for the Data Transfer Agent operations Java Local CL
Data Transfer Agent Service Structured/Unstructured transfer operations among data Source/Storages gCube Web Service SOAP gCore
gRS2 Broker This component exposes the gCube Resultset as an http endpoint Java Servlet REST HTTP Front End

Data Transfer Agent Library

  • Description: The CL for the Data Transfer Agent operations
  • Type: Java
  • Protocol: Local
  • Framework: CL
  • Key Features:
  • implements synchronous transfers over service asynchronous requests
  • implements transfer monitoring
  • provides transfer outcomes to clients

Data Transfer Agent Service

  • Description: Structured/Unstructured transfer operations among data Source/Storages
  • Type: gCube Web Service
  • Protocol: SOAP
  • Framework: gCore
  • Key Features:
  • transfer of local files from an external/internal client to a remote GHN
  • file transfer from a remote Data Source to a remote GHN using standard protocol ( HTTP, FTP, BitTorrent)
  • file transfer from a remote Data Source to the gCube Storage Manager ( MongoDB) using standard protocols ( HTTP, FTP, BitTorrent)
  • tree based data transfer from a remote Data Source to a remote tree-based data storage
  • transfer statistics available trough messaging

gRS2 Broker

  • Description: This component exposes the gCube Resultset as an http endpoint
  • Type: Java Servlet
  • Protocol: REST
  • Framework: HTTP Front End
  • Key Features:
  • Wiki Doc: