Data Transfer Agent

Data Transfer Agent Service

The Data Transfer Agent Service has been implemented with the aim of facilitating the transfer of data ( both structured and unstructured ) for the following use cases:

• Transfer of Local files from an external/internal client to a remote GHN
• File Transfer from a remote Data Source to a remote GHN using standard protocol ( HTTP, FTP, BitTorrent) thanks to the integration with the URLResolution Library.
• File Transfer from a remote Data Source to the gCube Storage Manager ( MongoDB) using standard protocol ( HTTP, FTP, BitTorrent) thanks to the integration with the URLResolution Library.
• Tree based data transfer from a remote Data Source to a remote Tree-Based Storage.

The service make use of gRS to implement Local Transfer, Tree based Data Transfer and delivery of Transfer Outcomes to clients. The service make use of Messaging infrastructure as well in order to publish transfer statistics, that can be consumed by:

• Accounting statistics consumers
• the Data Transfer Scheduler Service, which use messaging in order to consume Agent transfer results.

In order to get more information about the whole Data Transfer Architecture please check ..