Routinely collecting data from remote offshore locations, PGS often had to migrate large data sets to its offices in London, England, Houston, USA, or Cyberjaya, Malaysia for further processing, analysis, and quality checking. PGS used the FTP protocol and a free UDP transfer application to deliver these large files, but these methods created issues when sending and receiving large files. The main challenge PGS faced was slow transfer speeds on their underutilized 10 Gbps link between London and Houston.
Furthermore, both the FTP system and the UDP application lacked the management capabilities PGS required, leaving all control of the transfer with end users. With no coordination, this lack of management frequently caused problems on the lower bandwidth, last mile links. “We might have 100 FTP transfers executing simultaneously, causing all transfers to go at a crawl,” said James Watson, Lead Engineer at PGS. Having no control over the file transfer processes, our IT team constantly had to address the same file transfer related issues.