Data Transfer APIs

Data Transfer APIs provide access to transfer mechanisms for large sets of multi-type datasets distributed across the system. The document outlines the design reational for those APIs.

Overview

APIs

Name	Description	Type	Protocol	Framework
Data Transfer Agent Library	The CL for the Data Transfer Agent operations	Java	Local	CL
Data Transfer Agent Service	Structured/Unstructured transfer operations among data Source/Storages	gCube Web Service	SOAP	gCore
gRS2 Broker	This component exposes the gCube Resultset as an http endpoint	Java Servlet	REST	HTTP Front End

Data Transfer Agent Library

• Description: The CL for the Data Transfer Agent operations
• Type: Java
• Protocol: Local
• Framework: CL
• Key Features:

• synchronous transfers over service asynchronous requests
• transfer monitoring
• transfer outcomes to clients

• Documentation

Data Transfer Agent Service

• Description: Structured/Unstructured transfer operations among data Source/Storages
• Type: gCube Web Service
• Protocol: SOAP
• Framework: gCore
• Key Features:

• transfer of local files from an external/internal client to a remote GHN
• file transfer from a remote Data Source to a remote GHN using standard protocol ( HTTP, FTP, BitTorrent)
• file transfer from a remote Data Source to the gCube Storage Manager ( MongoDB) using standard protocols ( HTTP, FTP, BitTorrent)
• tree based data transfer from a remote Data Source to a remote tree-based data storage
• transfer statistics available trough messaging

• Documentation

gRS2 Broker

• Description: This component exposes the gCube Resultset as an http endpoint
• Type: Java Servlet
• Protocol: REST
• Framework: HTTP Front End
• Key Features:
• Wiki Doc: