<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>FileCatalyst &#187; Fast File Transfer by FileCatalyst | </title>
	<atom:link href="http://www.filecatalyst.com/feed/" rel="self" type="application/rss+xml" />
	<link>http://www.filecatalyst.com</link>
	<description>Reinventing File Transfer</description>
	<lastBuildDate>Wed, 01 Feb 2012 22:35:57 +0000</lastBuildDate>
	<language>en</language>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.org/?v=3.3.1</generator>
		<item>
		<title>FileCatalyst JavaScript API: In-Browser File Transfer</title>
		<link>http://www.filecatalyst.com/filecatalyst-javascript-api-in-browser-file-transfer/</link>
		<comments>http://www.filecatalyst.com/filecatalyst-javascript-api-in-browser-file-transfer/#comments</comments>
		<pubDate>Tue, 31 Jan 2012 19:32:04 +0000</pubDate>
		<dc:creator>Greg</dc:creator>
				<category><![CDATA[Acceleration]]></category>
		<category><![CDATA[Applets]]></category>
		<category><![CDATA[javascript]]></category>

		<guid isPermaLink="false">http://www.filecatalyst.com/?p=2763</guid>
		<description><![CDATA[Introduction The FileCatalyst JavaScript API offers the ability to implement an accelerated file transfer application from within a web browser. Using the API, you are able to customize the end-user's file transfer experience, integrating the file transfer into your site (in terms of both functionality and UI) in a way not necessarily possible with the [...]]]></description>
			<content:encoded><![CDATA[<h3>Introduction</h3>
<p>The FileCatalyst JavaScript API offers the ability to implement an accelerated file transfer application from within a web browser. Using the API, you are able to customize the end-user's file transfer experience, integrating the file transfer into your site (in terms of both functionality and UI) in a way not necessarily possible with the default configuration alone.</p>

<h4>The Quick Version</h4>
<p>If you just want to see how the API can be called, here's an example using jQuery:</p>
<pre class="crayon-plain-tag"><code>$('#uploadButton').click(function() {
  document.FileCatalyst.uploadLive();
});</code></pre>
<p>It's that easy. The API documentation gives a rundown of each of the methods available via JavaScript. Here, we have bound a click listener to some element with the ID "uploadButton". When that element is clicked, the JavaScript
  triggers the upload function of the applet.</p>

<h4>Requirements</h4>
<p><strong>End user:</strong> JavaScript enabled on their browsers, Java installed on their machines (for the desktop environment, this is the vast majority of users)</p>
<p><strong>Developer:</strong> 2 files that come with FileCatalyst; plus 2 custom components:</p>
<ol>
  <li>Included: The applet script (ex. <code>fcupload.js</code>)</li>
  <li>Included: The applet JAR file (referenced by the applet script) (ex. <code>FileCatalystApplets.jar</code>)</li>
  <li>Custom: A webpage that will load the applet and provide controls (applets ship with sample pages to use as a starting point)</li>
  <li>Custom: Additional script(s)</li>
</ol>

<h3>Our Longer Example: Uploader with buttons</h3>
<p>In this simple example, we have decided that we want to reduce the full-blown UI down to three key buttons: &ldquo;Add to Queue&rdquo;, &ldquo;Upload&rdquo;, and &ldquo;Cancel&rdquo;. In the following code samples,
  three important tasks are accomplished: 1. the applet is added to the page; 2. the applet's default UI is hidden; 3. our three buttons are hooked up using the FileCatalyst API and the jQuery JavaScript library.</p>

<h4>The Webpage</h4>
<p>Let's have a look at the webpage. In this case we're just using static HTML.</p>
<pre class="crayon-plain-tag"><code>&lt;html&gt;
  &lt;head&gt;
    &lt;title&gt;FileCatalyst Upload with JavaScript API&lt;/title&gt;
    &lt;script src=&quot;http://code.jquery.com/jquery-1.7.1.min.js&quot;&gt;&lt;/script&gt; &lt;!-- load jQuery from wherever you prefer --&gt;
    &lt;script src=&quot;uploadApp.js&quot;&gt;&lt;/script&gt; &lt;!-- our custom script that handles button events etc. --&gt;
  &lt;/head&gt;
  &lt;body&gt;
    &lt;div class=&quot;wrapper&quot;&gt;
      &lt;h1&gt;Upload Sample&lt;/h1&gt;
      &lt;input id=&quot;browseButton&quot; type=button class=&quot;fcbutton&quot; value=&quot;Add to Queue&quot; disabled=&quot;disabled&quot;/&gt;
      &lt;input id=&quot;uploadButton&quot; type=button class=&quot;fcbutton&quot; value=&quot;Upload&quot; disabled=&quot;disabled&quot;/&gt;
      &lt;input id=&quot;cancelButton&quot; type=button class=&quot;fcbutton&quot; value=&quot;Cancel&quot; disabled=&quot;disabled&quot;/&gt;
      &lt;div id=&quot;fc_upload&quot;&gt;
        &lt;script src=&quot;fcupload.js&quot;&gt;&lt;/script&gt; &lt;!-- The upload applet will load here --&gt;
      &lt;/div&gt;
    &lt;/div&gt;
  &lt;/body&gt;
&lt;/html&gt;</code></pre>

<p>In the <code>&lt;head&gt;</code> section, we have included jQuery (which we will use for event binding) and then our custom script (which will contain the event binding and any other JS functionality we may wish for). jQuery is
  possibly overkill if your page is literally as simple as this example; however, many people are already using jQuery on their site.</p>
<p>Buttons are simply <code>&lt;input&gt;</code> elements with type "button". The buttons also have the class "fcbutton" for convenience in styling and scripting. They are disabled by default, and will be enabled upon applet load. This
  has the added benefit of keeping the buttons disabled for users without JavaScript enabled on their browsers.</p>
<p>Adding the applet to any webpage couldn't be easier. Below the buttons we simply load the applet's JavaScript file with a <code>&lt;script&gt;</code> or <code>&lt;embed&gt;</code> element (depending on browser). Once loaded, the applet appears in the DOM inside an <code>&lt;applet&gt;</code> node.</p>

<h4>Hiding the applet</h4>
<p>Next, we need to hide the applet's default UI. You can do this with pure CSS using <code>visibility: hidden</code>, but NOT with <code>display: none</code> (which will not allow the applet to load). A safer bet is to use
  the <code>height</code> and <code>width</code> parameters inside <code>fcupload.js</code>, however. Setting these to zero will work in some but not all browsers. The safest bet is to make the applet tiny (1X1) and stick it somewhere on the page
  that's out of the way.</p>

Inside <code>fcupload.js</code>, find these lines and modify as shown:
<pre class="crayon-plain-tag"><code>// GUI Behaviours and Presentation
var width                       = &quot;1&quot;;
var height                      = &quot;1&quot;;
var background                  = &quot;255,255,255&quot;; //RGB value for white. You can make it the same color as the element it sits inside

// (later in file)
var callurlonload               = &quot;javascript:appletLoaded()&quot;; // this will trigger the JS &quot;appletloaded&quot; function</code></pre>

<p>For additional insurance, you might have some CSS that hides the applet or takes it out of the document flow:</p>
<pre class="crayon-plain-tag"><code>#fc_upload {
  position: absolute; /* remove from flow */
  visibility: hidden; /* optionally make it completely invisible */
}</code></pre>

<h4>Hooking Up the Buttons / Custom Scripts</h4>
<p>This is the meat of the whole exercise. We are using jQuery for its simple syntax, but you can use whatever event-binding method you prefer (even inline <code>onclick</code> attributes). All we do in the script is
  bind a listener to each button. When the button is clicked, a JavaScript function from the FileCatalyst API (now available through the included applet) is fired.</p>
<p>Inside <code>uploadApp.js</code> (or whatever you have named your file):</p>
<pre class="crayon-plain-tag"><code>function appletLoaded() {
  $('.fcbutton').removeAttr('disabled'); // the applet has loaded, so enable the buttons
}

/* bind the click events when the DOM is ready for scripting */

$(document).ready(function() {

  $('#browseButton').click(function() {
    document.FileCatalyst.browseLive(true);
  });

  $('#uploadButton').click(function() {
    document.FileCatalyst.uploadLive();
  });

  $('#cancelButton').click(function() {
    document.FileCatalyst.setCancelled();
  });
});</code></pre>
<p>The appletLoaded function (referenced in <code>fcupload.js</code> modifications) removes the <code>"disabled"</code> attribute, enabling the buttons. The event handler listens for clicks
on the buttons, and fires off a method call to the applet, using the available JavaScript functions.</p>

<h3>Conclusion</h3>
<p>Using a Java applet puts FileCatalyst right in the browser, with no installation required. Full acceleration and security options, without the end-user needing to configure anything is a big win for any
organization that uses the web (and what organizations don't?). Our own API sits under our powerful <a href="/products/filecatalyst-workflow">Workflow</a> and <a href="/products/filecatalyst-webmail">Webmail</a>
applications, but if you do not need a fully realized web portal out of the box, or are integrating FileCatalyst within your existing portal, the JavaScript API offers virtually every option you might need.</p>
<p>Transfer hook functions such as <code>getTimeRemaining()</code>, and <code>getFilesSoFar()</code>
  (along with a whopping 42 other useful hooks) allow you to capture information from an ongoing session. For the upload applet, functions such as the ones used in this post's example (along with another 20) allow you to invoke
  applet methods through JavaScript.</p>
<p>The potential is huge. Included in the FileCatalyst Upload Applet package is a sample of a web application that uses AJAX to fetch page content; the applet is never unloaded/destroyed (the way it would be
  when navigating to an entirely separate page), so you can have a transfer persisting while the user continues to explore the site. The sample uses a number of transfer hooks and upload applet methods, so look to it
  as a more sophisticated sample than the one provided in this exercise.</p>]]></content:encoded>
			<wfw:commentRss>http://www.filecatalyst.com/filecatalyst-javascript-api-in-browser-file-transfer/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Analysis On Improving Throughput Part 1: Disk IO</title>
		<link>http://www.filecatalyst.com/analysis-on-improving-throughput-part-1-disk-io/</link>
		<comments>http://www.filecatalyst.com/analysis-on-improving-throughput-part-1-disk-io/#comments</comments>
		<pubDate>Tue, 17 Jan 2012 21:34:54 +0000</pubDate>
		<dc:creator>Christian</dc:creator>
				<category><![CDATA[Acceleration]]></category>
		<category><![CDATA[FileCatalyst Direct]]></category>
		<category><![CDATA[10gbps]]></category>
		<category><![CDATA[Fast File Transfer]]></category>
		<category><![CDATA[tuning]]></category>

		<guid isPermaLink="false">http://www.filecatalyst.com/?p=2750</guid>
		<description><![CDATA[In light of the release of FileCatalyst Direct v3.0, I thought I'd write a few articles about the road to achieving 10Gbps speeds. It seems to me the best place to start is with the endpoint of the transfer: the storage media. Why? Before we even think about the file transfer protocol, we have to [...]]]></description>
			<content:encoded><![CDATA[<p>In light of the release of FileCatalyst Direct v3.0,  I thought I'd write a few articles about the road to achieving 10Gbps speeds.  It seems to me the best place to start is with the endpoint of the transfer: the storage media. Why? Before we even think about the file transfer protocol, we have to be sure that our disks can keep up. It's very easy for people to forget how much of a bottleneck disk read &#038; write IO can be.</p>

<h2>Disk IO Tests</h2>

<p>10Gbps (1250MB/s ) is fast.  Especially for a single file stream. By comparison:</p>

<ul>
<li>Your average enterprise HDD SATA drive will read/write between 50-100MB/s (or 800Mbps)</li>
<li>Your average SSD SATA drive will read data at 300MB/s, and write at 200MB/s  (1.6 Gbps-2.4 Gbps)</li>
<li>FiberChannel SAN arrays normally connect between 500MB/s to 1000MB/s (4Gbps or 8Gbps)</li>
</ul>

<p>Getting FileCatalyst to run 10Gbps speeds (1250 MB/s) requires testing your hardware infrastructure. Having a fiber SAN may not be enough.</p>

<p>For our internal test environment, this meant adding a few RAID 0 arrays (8 SSD drives or 16 HDD drives) in order to achieve the desired speeds. Certainly not mentioning this as a recommendation for a production solution, but it was the simplest way to achieve the speeds we needed for testing.</p>

<p>To determine what your system is capable of providing, FileCatalyst includes tools within FileCatalyst Server, HotFolder, and Command Line Client. The tools are command-line scripts designed to emulate how the FileCatalyst software manages Disk IO, and can give you a good approximation of your system's potential before a single byte has transferred over the network.</p>

<h3>Running Enhanced Disk IO Tests</h3>
<p>ReadIO and Write IO tests have a similar syntax to run them. ReadIO is executed by the executing the application switch "-testReadIO", while the write io uses the switch "-testIO". Since most issues are found with write speeds (which tend to be slower than read), let's focus on write IO.</p>

<p>The Write IO test creates a file on your file system,  and reports back how quickly the file was created by the application. How it creates that file is determined by the parameters you must fill in before it runs:</p>

<pre class="crayon-plain-tag"><code>&lt;code&gt;C:\Users\ccharette\Desktop\applettests\CL&gt;java -jar FileCatalystCL.jar -testIO
Entering Write TestIO. This will run a series of tests on the file system to 
attempt to discover the optimal values for # of writer threads and write block 
size for your system.The test is both IO intensive and CPU intensive. Please 
give the test adequate time to complete.

Please enter the drive/path you wish to test (ie:  C:/ or /mnt/data/ ):  c:\temp
  File to be written:  c:\temp/test.io

Please enter the size of file you wish write (in MB, default 500):  10000
  File size:  10000MB.

Please enter the timeout length (secs) per run (default 60 secs): 180
  Timeout:  180 seconds.

Please enter the number of runs to perform for each settings (default 5): 3
  Number of runs per iteration:  3

Test if buffer size used in writes to disk affect performance.
Please enter a buffer array to attempt (default:  '64,128,256,512,1024,2048,4096')
Size in KB, comma delimited: 4,16,64,256,1024,4096,16384
  4 Buffer Size values (KB):  4,16,64,256,1024,4096,16384.

Test if multiple writters offer performance benefit when saving a block to disk.
Please enter a writer thread array to attempt (default:  '1,2,4,6,8'): 1,2
  2 Thread values:  1,2.

How many files would you like to create concurrently for IO test (default 1)?
Note:  number of files will never exceed number of writer threads during tests.
  1 files will be created in test:  1.

Test using Direct IO when allocating buffer space by Java (default true):  true
  Use DirectIO = true.

Mode used to open up files (rw/rws/rwd -- default rw):  rw
  Mode used = rw.&lt;/code&gt;</code></pre>

<h3>Things to note:</h3>
<ul>
<li>It is better to create a file large enough that it represents your total data set expected for the transfer (ie:  9GB DVD ISO), or larger than the amount of memory the OS can utilize for file system buffers (see results below).</li>
<li>Timeout should represent a valid length of time you expect can easily be reached when writing a single copy of the file.</li>
<li>Specify # of runs with the average posted.</li>
<li>Buffer size represents an optional switch on the Server &#038; Clients which dictates how large each read/write IO should be from the JAVA code down to the file system. You should experiment with a few values here, as different disk configurations sometimes yield vastly different optimal results.</li>
<li>The Server and Clients support multiple read and write threads per file.</li>
<li>Keep the # of files to create concurrently to 1 if you are testing only a single file tranfer speed (single client to server endpoint). This is actually one of the hardest test cases to manage, as there are OS level locks which often task the CPU, limiting throughput you can get when writing to a single file.  If you are looking to test 10 clients each utilizing 1Gbps connection, select multiple files (much higher file IO possible when multiple files are being saved at a time).</li>
<li>Always select Direct IO, since this is what the FileCatalyst application uses.</li>
<li>Select default "rw" mode, which takes advantage of OS level memory buffers if available.</li>
</ul>

<h2>Results</h2>
<table style="font-size:12px">
<tr style="font-weight:bold">
<td style="border: 1px dotted gray; background-color: #eee">Machine 1a:  Windows 7, single SSD drive</td>
<td style="border: 1px dotted gray; background-color: #eee">Machine 1b:  Windows 7, single HDD drive</td>
</tr>
<tr>
<td style="font-family: monospace; border: 1px dotted gray""><pre class="crayon-plain-tag"><code>Tests run with the following parameters:
        file:  c:/temp/test.io
        size:  10000000000
        timeout:  180000
        directIO:  true
        file mode:  rw
        Max # files to use:  1
  # of THREADS  |1      |2
Buffer size     +=======+=======+
4               |240    |150
16              |237    |150
64              |238    |150
256             |236    |152
1024            |237    |152
4096            |236    |149
16384           |236    |196</code></pre>
</td>
<td style="font-family: monospace; border: 1px dotted gray""><pre class="crayon-plain-tag"><code>Tests run with the following parameters:
        file:  E:/tmp/test.io
        size:  10000000000
        timeout:  300000
        directIO:  true
        file mode:  rw
        Max # files to use:  1
  # of THREADS  |1      |2
Buffer size     +=======+=======+
4               |89     |52
16              |92     |53
64              |92     |53
256             |92     |53
1024            |95     |54
4096            |100    |55
16384           |104    |79</code></pre>
</td>
</tr>
<tr style="font-weight:bold">
<td style="border: 1px dotted gray; background-color: #eee">Machine 2a:  Ubuntu RAID 0, 8 x SSD, 10GB file</td>
<td style="border: 1px dotted gray; background-color: #eee">Machine 2b:  Ubuntu RAID 0, 8 x SSD, 60GB file</td>
</tr>
<tr>
<td style="font-family: monospace; border: 1px dotted gray""><pre class="crayon-plain-tag"><code>Tests run with the following parameters:
        file:  /opt/tmp//test.io
        size:  10000000000
        timeout:  60000
        directIO:  true
        file mode:  rw
        Max # files to use:  1
  # of THREADS  |1      |2
Buffer size     +=======+=======+
4               |1431   |1282
16              |1722   |1614
64              |2059   |1748
256             |2239   |1933
1024            |2095   |2050
4096            |2078   |2048
16384           |1841   |1720</code></pre>
</td>
<td style="font-family: monospace; border: 1px dotted gray""><pre class="crayon-plain-tag"><code>Tests run with the following parameters:
        file:  /opt/tmp//test.io
        size:  60000000000
        timeout:  180000
        directIO:  true
        file mode:  rw
        Max # files to use:  1
  # of THREADS  |1      |2
Buffer size     +=======+=======+
4               |1093   |893
16              |1177   |1131
64              |1400   |1184
256             |1387   |1324
1024            |1402   |1303
4096            |1293   |1294
16384           |1140   |1271</code></pre>
</td>
</tr>
</table>

<p><strong>Observations:</strong>  Note that neither of these machines benefitted from multiple writer threads, and that performance was higher when a single writer was involved.</p>

<p><strong>Machine 1a:</strong>  When writing to SSD, we can get 230+ MB/s (>1.8Gbps) of write speed when using 1 thread. Block sizes do not affect throughput.</p>

<p><strong>Machine 1b:</strong>  Same machine, but utilizing slower secondary HDD drive. When using slower disks, the software can only get a fraction of the bandwidth (in this case < 1Gbps). We do see marginal improvements the larger the block size used, so limiting the block size is not a good idea. By default, the FileCatalyst application will use the largest block size it can (determined by UDP block size).</p>

<p><strong>Machine 2a: </strong> Can read/write at 2000+MB/s (>16Gbps) for 10GB files. We can also see a sweet spot of ~256KB write block, where smaller writes adversely affect performance (as to larger blocks). This system however has 48GB of RAM on it, so the numbers it provides me are actually above what I would expect the system to give me.</p>

<p><strong>Machine 2b: </strong> Same test, but with 60GB file. Now we have realistic numbers which match the disk IO, giving us a system capable of sustaining 1350MB/s (10.5Gbps) write speed.</p>

<h2>Configuration Values</h2>
<p>On the Server &#038; Client side, the following configuration options are therefore available to set (CLI arguments shown):</p>
<ul>
<li>numBlockWriters  [#]</li>
<li>writeBufferSizeKB [# KB]</li>
<li>writeFileMode [rw/rwd/rws]</li>
<li>numBlockReaders [#]</li>
<li>readBufferSizeKB [# KB]</li>
</ul>

<p>This are machine specific settings. To maximize performance, you need to run tests on both endpoints (client + server). On the server (if client connections are going to do both upload and downloads), you should run both read and write tests.</p>

<p>For both the FileCatalyst Server and HotFolder, these settings are configuration file changes that must be manually set (fcconf.conf for server, fchf.conf on HotFolder). For the CLI, these may be passed in as run-time arguments.</p>

<h2>Conclusion</h2>
<p>Knowing the limits of your system IO is the first required step in achieving high speed transfers. FileCatalyst v3.0 provides several tools to help both benchmarks those limits and tune the application to best take advantage of your system.</p>

]]></content:encoded>
			<wfw:commentRss>http://www.filecatalyst.com/analysis-on-improving-throughput-part-1-disk-io/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>What Problems are we solving?</title>
		<link>http://www.filecatalyst.com/what-problems-are-we-solving/</link>
		<comments>http://www.filecatalyst.com/what-problems-are-we-solving/#comments</comments>
		<pubDate>Fri, 23 Dec 2011 20:16:22 +0000</pubDate>
		<dc:creator>Greg</dc:creator>
				<category><![CDATA[Acceleration]]></category>
		<category><![CDATA[FileCatalyst]]></category>

		<guid isPermaLink="false">http://www.filecatalyst.com/?p=2728</guid>
		<description><![CDATA[This blog post is in response to a Google+ topic presented here by Jay Cuthrell (@qthrul) The question was: I'm catching up on Aspera, Digital Rapids, FileCatalyst, Kencast, RepliWeb, RocketStream (TIBCO), Signiant, SmartJog, etc... What problems are each of these companies solving today? Tomorrow? Any other suggestions? My response was an impromptu stream... written on [...]]]></description>
			<content:encoded><![CDATA[<p>This blog post is in response to a Google+ topic presented <a href="https://plus.google.com/110357001884194145645/posts/9vyaH1zL1TH" title="Google+ question">here</a> by Jay Cuthrell (<a href="http://twitter.com/qthrul" title="Jay Cuthrell's Twitter">@qthrul</a>)</p>

<p>The question was: </p>

<blockquote><p>I'm catching up on Aspera, Digital Rapids, FileCatalyst, Kencast, RepliWeb, RocketStream (TIBCO), Signiant, SmartJog, etc...

What problems are each of these companies solving today? Tomorrow?

Any other suggestions?</p></blockquote>

My response was an impromptu stream... written on the fly... and since Google+ wouldn't actually let me post it from my account (too long? thread locked?) I thought I would reproduce it here in this blog instead:

<hr />

<p>Hi Jay, good question. Some of the companies you mention (including the one I work for, FileCatalyst) are definitely interested in seeing businesses replace FTP for their file transfer needs. Some of our marketing materials even say, "FTP was born in the 70's... and you're still using it? Seriously?" I believe a few others are using FTP for transport, but adding a layer of management.</p>

<p>So my own short answer to the question is: FileCatalyst is trying to solve the problem of (primarily large, primarily high-speed) file transfer on WAN.</p>

<p>The broader answer would be an essay. And those who know me will say that I'm just the man to ramble a subject into the ground. But I'll try to keep it brief. My first disclaimer: I'm not an engineer for the company; if any of the information I present is in dispute, I can get clarification from smarter folks than me. </p>

<p>The RFC for the FTP spec didn't anticipate the huge files and fast speeds we face today. Being based on TCP, it had reliability as job #1 rather than efficiency (though its reliability model hasn't really held up either). And it performs well enough up to about 10Mbps without tuning. Until recently, that described most residential and even many business connections, so people were (and still are) more or less satisfied and didn't see the need to replace this absolutely ubiquitous technology (FTP). Sure there were other problems (reliability, ease-of-use, auditing/tracking) but people seemed more or less content to stick to FTP or at least FTP-based Managed File Transfer.</p>

<p>Larger enterprises and other businesses that have file transfer as a daily mission-critical task knew better, and were the first businesses to notice that even with shiny new 45Mbps connections (of course since then we've seen 100Mbps, then 1Gbps, and now 10Gbps connections becoming the 'shiny new' links) they weren't getting the speeds they expected and started looking for alternatives.</p>

<p>There were only a few of us at the time who had independently of one-another seen the possibilities UDP had to offer. UDP is only about a decade newer than TCP, truth be told. But it wasn't meant for file transfer because it had NO reliability built into it... it was meant for streaming and broadcasting. Adding the layer of reliability on top of UDP is what makes the file transfer protocols of FileCatalyst, Aspera, Signiant, and other peers unique. It's also what makes each of our solutions proprietary.</p>

<p>I'm still not answering the question directly, though, so I'll move on. I would like to add my second disclaimer which is that I'm trying to answer the question "what do we solve" and therefore answers will inherently look like marketing pieces. This is not my intention!</p>

<ol>
<li>For the enterprise, FileCatalyst is definitely solving the problem of large file transfer on high-speed networks. We're constantly pushing and testing the limits of FTP (as a 'competitor', we need to give it benefit of the doubt! And our technology can also "speak" TCP when needed) as well as the FileCatalyst protocol. TCP is inherently bottlenecked. It will never reach 10Gbps for transferring a large file. We are reaching those speeds on relatively modest single-space units, with encryption.</li>

<li>FileCatalyst also solves reliability problems present in FTP. TCP's checksum model is archaic and unreliable, as anyone who has had a failed transfer can attest to. And most of us who transfer large files have also seen that it does not always reliably resume the transfer (and that's assuming resume is even enabled, which is not always the case). By contrast, we have a whole set of retry/resume facilities that ensure delivery of any size of file through any network conditions.</li>

<li>Speaking of network conditions, this is the main thing that our technology (and other UDP-based technologies) solve. We're immune to latency and packet loss, adjust to network conditions, and recover any missing packets in a highly efficient manner (I can't speak for all of the UDP-based competitors, but we do not just blast packets willy-nilly and collect lost ones later-- the protocol tries to lose as few as possible in the first place).</li>

<li>What differentiates each of the competitors is the feature set on top of the protocol. In other words, we also solve client-option and "management" problems in different ways. FileCatalyst offers too many management features to list here, but suffice it to say that you can adjust file transfers on the fly, collect and record transactional information and logs, be aware of when files are sent and to whom, and access an entire deployment via a central console on the web. There isn't much that you can't monitor and manage remotely, and since it may all be secured with SSL (and AES for data), you are able to meet security and compliance mandates.</li>

<li>Another problem with FTP is the end-user experience. Those of us who are a bit more technical don't mind installing and configuring an FTP client, but remember that there are many people out there for whom using an FTP client feels like engaging in mysterious and forbidden arts. For those people we have a number of options that will get them transferring files in moments, some of which require zero installation or configuration while still allowing UDP-based transfers.</li>
</ul>

<p><deep breath></p>

<p>I've lost most of your readers already, especially once the "marketing sounding" parts kicked in... but in short: every problem you can think of that FTP offers in terms of either technical problems or usability problems... we have solved or are trying our best to solve.</p>

<p>Should I mention that people use email for file transfer, too? A whole other problem to be solved....</p>

<p>What problems are we solving for tomorrow? In terms of the technology, we're always pushing for efficiency. We're going to turn the corner and 10Gbps won't be the top dog, it'll be 20Gbps... then 100.... and as long as our protocol remains efficient, we'll have a strategy for scaling. In terms of usability, there's always room for improvement or lateral thinking. How can we break down the barriers of adoption? How can people easily move from FTP to an alternative? As mobile devices become a primary mode of computing, how can we ensure a seamless experience in that space? I certainly have more questions on this one than answers. I wonder what other people see as being the file transfer problems of tomorrow?</p>

<p>There's a lot of talk in the media right now about storage SPACE. And of course as a file transfer software company, we always read articles and think, "OK, you need space... but you also need to get your files there in a timely fashion!" A lot of companies are going to be faced with shipping physical media to their cloud storage provider. We have solutions already, but people are still shipping discs or using FTP/HTTP. This is one of the problems of today that we'll also be solving for tomorrow.</p>]]></content:encoded>
			<wfw:commentRss>http://www.filecatalyst.com/what-problems-are-we-solving/feed/</wfw:commentRss>
		<slash:comments>1</slash:comments>
		</item>
		<item>
		<title>The World is Getting Faster &#8211; FTP is not</title>
		<link>http://www.filecatalyst.com/the-world-is-getting-faster-ftp-is-not/</link>
		<comments>http://www.filecatalyst.com/the-world-is-getting-faster-ftp-is-not/#comments</comments>
		<pubDate>Thu, 03 Nov 2011 20:20:52 +0000</pubDate>
		<dc:creator>Greg</dc:creator>
				<category><![CDATA[Acceleration]]></category>

		<guid isPermaLink="false">http://www.filecatalyst.com/?p=2676</guid>
		<description><![CDATA[Just finished reading a post at GigaOm regarding gigabit fibre in the UK. Of course, being in the business that we're in, I immediately thought: if businesses of all sizes, and even homes end up with 300Mbps connections (or faster), what are all these people going to be doing to transfer their large files? Home [...]]]></description>
			<content:encoded><![CDATA[<p>Just finished reading a post at GigaOm regarding <a href="http://gigaom.com/broadband/londons-cityfibre-to-build-a-800-million-gigabit-network/" title="Gigabit Fibre in the UK on GigaOm">gigabit fibre in the UK</a>.</p>
<p>Of course, being in the business that we're in, I immediately thought: if businesses of all sizes, and even <em>homes</em> end up with 300Mbps connections (or faster), what are all these people going to be doing to transfer their large files? Home users and those who don't know there are options are still going to be using FTP, and wondering why their file is taking so long to send. Typically, even with a good connection, FTP (or any transfer based on TCP) is going to start performing poorly at a measly 10Mbps. Under near-perfect conditions, a single-threaded FTP transfer is likely to reach 70Mbps tops. And when you're transferring from one part of the world to another, you do not have near-perfect conditions.</p>
<span id="more-2676"></span>

<p>Multi-threaded TCP (a technique FileCatalyst itself uses for certain scenarios) can help, but at the cost of resources. It doesn't take long for multiple TCP threads to slow down even a modern machine.</p>

<p>Even if we forget about reliability (FTP having a poor track record is already a good reason to switch to something else) and other file transfer must-haves for a second, and we're right on the cusp of every file transfer process in the world needing something better. UDP-based file transfer like that offered by FileCatalyst and a handful of other companies will be the best alternative.</p>

<p>At Gbps+ speeds, there's another bottleneck: I/O (how fast your network and storage can read or write), but that's a conversation for another day.</p>
<p>Suffice it to say, when it becomes apparent to the world at large (people other than enterprises that have already switched) that FTP is just not working or is highly ineffecient, well-engineered UDP-based file transfer has already been created and is just waiting for the call.</p>]]></content:encoded>
			<wfw:commentRss>http://www.filecatalyst.com/the-world-is-getting-faster-ftp-is-not/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>FileCatalyst at GTEC 2011</title>
		<link>http://www.filecatalyst.com/filecatalyst-at-gtec-2011/</link>
		<comments>http://www.filecatalyst.com/filecatalyst-at-gtec-2011/#comments</comments>
		<pubDate>Tue, 11 Oct 2011 14:58:37 +0000</pubDate>
		<dc:creator>Greg</dc:creator>
				<category><![CDATA[Events]]></category>

		<guid isPermaLink="false">http://www.filecatalyst.com/?p=2661</guid>
		<description><![CDATA[GTEC is Canada's government technology event. Thousands of visitors from both the public and private sectors will be at GTEC to learn about the technologies at play within the government, as well as emerging technologies which may soon become a part of the government's technology landscape. FileCatalyst has been deployed in a number of government [...]]]></description>
			<content:encoded><![CDATA[<p>GTEC is Canada's government technology event. Thousands of visitors from both the public and private sectors will be at GTEC to learn about the technologies at play within the government, as well as emerging technologies which may soon become a part of the government's technology landscape. FileCatalyst has been deployed in a number of government scenarios in Canada and abroad. GTEC presents the perfect opportunity to showcase what we are already doing, and what our technology can do for any governmental agency.</p>

<p>From <strong>October 17 to 20</strong>, we will be at GTEC in <strong>Ottawa, Canada</strong>, on the 3rd floor of the Ottawa Convention Centre. We look forward to seeing you there!</p>

<p>From the GTEC website:</p>

<blockquote>
For 18 years GTEC (Government Technology Exhibition and Conference) has been inspiring public sector IT professionals with thought provoking demonstrations of advanced technology and a powerful line-up of speakers that features the best and brightest industry leaders. GTEC is Canada's Government Technology Event, and one which attracts over 7000 participants, renowned speakers, and exhibitors from across Canada and around the world annually. The event offers something for everyone: from CIOs and ADMs to Program Managers and IT personnel. All come to meet and network with peers, celebrate technology accomplishments, learn from a "who's who" of key note speakers, and see demonstrations of the most advanced technologies that are driving public sector IT initiatives at all levels of government in Canada and other countries.
</blockquote>]]></content:encoded>
			<wfw:commentRss>http://www.filecatalyst.com/filecatalyst-at-gtec-2011/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>FileCatalyst at InterOp NY 2011</title>
		<link>http://www.filecatalyst.com/interop-ny-2011/</link>
		<comments>http://www.filecatalyst.com/interop-ny-2011/#comments</comments>
		<pubDate>Fri, 23 Sep 2011 19:20:18 +0000</pubDate>
		<dc:creator>Greg</dc:creator>
				<category><![CDATA[Events]]></category>

		<guid isPermaLink="false">http://www.filecatalyst.com/?p=2642</guid>
		<description><![CDATA[FileCatalyst will be in New York at the Javits Centre from Oct 3&#8211;7, showcasing the lastest advances in our technology. Come visit us at booth 603 and we'll be happy to answer all your questions or provide a demonstration. While showing our technology, we will be focusing specifically on: 10 Gbps transfers in the Enterprise. [...]]]></description>
			<content:encoded><![CDATA[<p>FileCatalyst will be in New York at the Javits Centre from Oct 3&ndash;7, showcasing the lastest advances in our technology. Come visit us at booth 603 and we'll be happy to answer all your questions or provide a demonstration.</p>

<p>While showing our technology, we will be focusing specifically on:</p>
<ul>
<li>10 Gbps transfers in the Enterprise. FileCatalyst is the first acceleration solution to reach these speeds.</li>
<li>The impending release of FileCatalyst Direct 3.0, with better performance than ever, and a new web-based management console.</li>
<li>The latest versions of our FileCatalyst web-based products, Webmail and Workflow</li>
<li>Monitoring and Management for mobile devices</li>
</ul>

<p>We hope to see you there!</p>]]></content:encoded>
			<wfw:commentRss>http://www.filecatalyst.com/interop-ny-2011/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>FileCatalyst 3.0 announced</title>
		<link>http://www.filecatalyst.com/filecatalyst-3-0-announced/</link>
		<comments>http://www.filecatalyst.com/filecatalyst-3-0-announced/#comments</comments>
		<pubDate>Fri, 23 Sep 2011 15:48:42 +0000</pubDate>
		<dc:creator>John</dc:creator>
				<category><![CDATA[Blog]]></category>
		<category><![CDATA[Fast File Transfer]]></category>
		<category><![CDATA[FileCatalyst Direct]]></category>
		<category><![CDATA[Managed File Transfer]]></category>
		<category><![CDATA[10]]></category>
		<category><![CDATA[10gbps]]></category>
		<category><![CDATA[console]]></category>
		<category><![CDATA[gbps]]></category>
		<category><![CDATA[press]]></category>

		<guid isPermaLink="false">http://www.filecatalyst.com/?p=2621</guid>
		<description><![CDATA[Earlier this month at IBC in Amsterdam, we announced the soon to be released FileCatalyst 3.0. The new version can transfer files really really fast... up-to 10Gbps (1,250 MB/sec) with AES encryption! It also includes a global monitoring console to watch your entire file transfer Eco-system from a single browser window. You can read more [...]]]></description>
			<content:encoded><![CDATA[Earlier this month at IBC in Amsterdam, we announced the soon to be released FileCatalyst 3.0.<br /><r>
The new version can transfer files really really fast... up-to <strong>10Gbps (1,250 MB/sec)</strong> with AES encryption! It also includes a global monitoring console to watch your entire file transfer Eco-system from a single browser window.
<br />
<br />You can read more about FileCatalyst 3.0 from: <a href="http://www.prweb.com/releases/fast-file-transfer/10gbps-transfer/prweb8781826.htm">PR WEB</a>
<br />
<br />Also you can watch this great YouTube video illustrating 10Gbps file transfer:<br /><br />
<iframe width="560" height="315" src="http://www.youtube.com/embed/yvjnWjUwOdo" frameborder="0" allowfullscreen></iframe>
<br /><br />]]></content:encoded>
			<wfw:commentRss>http://www.filecatalyst.com/filecatalyst-3-0-announced/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>The Road To Banff leads through the Cloud</title>
		<link>http://www.filecatalyst.com/the-road-to-banff-leads-through-the-cloud/</link>
		<comments>http://www.filecatalyst.com/the-road-to-banff-leads-through-the-cloud/#comments</comments>
		<pubDate>Tue, 13 Sep 2011 18:41:17 +0000</pubDate>
		<dc:creator>Greg</dc:creator>
				<category><![CDATA[Blog]]></category>
		<category><![CDATA[FileCatalyst]]></category>

		<guid isPermaLink="false">http://www.filecatalyst.com/?p=2599</guid>
		<description><![CDATA[Recently, FileCatalyst had a great opportunity to be a part of Canada 3.0, a digital media forum with over 2,000 participants discussing and shaping Canada's digital landscape. One of the events was a &#8220;pitch off&#8221; that saw participants exchanging large digital media assets. FileCatalyst provided the transport technology, which was deployed to a cloud solution [...]]]></description>
			<content:encoded><![CDATA[<p>Recently, FileCatalyst had a great opportunity to be a part of <a href="http://www.canada30.com/" title="Canada 3.0 Website" target="_blank">Canada 3.0</a>, a digital media forum with over 2,000 participants discussing and shaping Canada's digital landscape.</p>

<p>One of the events was a &ldquo;pitch off&rdquo; that saw participants exchanging large digital media assets. FileCatalyst provided the transport technology, which was deployed to a cloud solution provided by <a href="http://canadiancloud.com">Canadian Cloud Computing</a>. Deployment was quick, and the results exceeded all expectations.</p>

<p>Read the case study <a href="http://www.canadiancloud.com/wp-content/uploads/2011/09/Case-Study-Road-to-Banff.pdf">&ldquo;The Road to Banff leads through the Cloud&ldquo;</a> in its original form at CCC's website.</p>

]]></content:encoded>
			<wfw:commentRss>http://www.filecatalyst.com/the-road-to-banff-leads-through-the-cloud/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>FileCatalyst at GTEC this October</title>
		<link>http://www.filecatalyst.com/filecatalyst-at-gtec-this-october/</link>
		<comments>http://www.filecatalyst.com/filecatalyst-at-gtec-this-october/#comments</comments>
		<pubDate>Thu, 25 Aug 2011 15:04:51 +0000</pubDate>
		<dc:creator>John</dc:creator>
				<category><![CDATA[Featured]]></category>
		<category><![CDATA[News]]></category>

		<guid isPermaLink="false">http://www.filecatalyst.com/?p=2568</guid>
		<description><![CDATA[GTEC is Canada's biggest &#8220;technology in the government&#8221; expo. With a number of government and military deployments under our belt at both Canadian and International level, we felt the time was right to show our leading fast file transfer technology to a broader public service audience, and GTEC was the obvious choice. Come and visit [...]]]></description>
			<content:encoded><![CDATA[<a href="http://www.gtec.ca/">GTEC</a> is Canada's biggest &ldquo;technology in the government&rdquo; expo. With a number of government and military deployments <a href="../customers/military-government/">under our belt</a> at both Canadian and International level, we felt the time was right to show our leading fast file transfer technology to a broader public service audience, and GTEC was the obvious choice. Come and visit booth 301 on Oct 18th and 19th 9:30&ndash;4:30pm. The FileCatalyst booth will be located on the 3rd Level at Ottawa Convention Center in Ottawa, Canada.]]></content:encoded>
			<wfw:commentRss>http://www.filecatalyst.com/filecatalyst-at-gtec-this-october/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>FileCatalyst at IBC</title>
		<link>http://www.filecatalyst.com/filecatalyst-at-ibc/</link>
		<comments>http://www.filecatalyst.com/filecatalyst-at-ibc/#comments</comments>
		<pubDate>Fri, 22 Jul 2011 15:12:55 +0000</pubDate>
		<dc:creator>Greg</dc:creator>
				<category><![CDATA[FileCatalyst]]></category>
		<category><![CDATA[News]]></category>

		<guid isPermaLink="false">http://www.filecatalyst.com/?p=2536</guid>
		<description><![CDATA[At the time of this post, IBC is still a number of weeks away. However, preparations have been underway for several months already, and the date will be upon us before we know it! Since the last show, there have been major iterations of all our software, including the well-anticipated release of FileCatalyst Direct 3.0 [...]]]></description>
			<content:encoded><![CDATA[<p>At the time of this post, IBC is still a number of weeks away. However, preparations have been underway for several months already, and the date will be upon us before we know it!</p>
<p>Since the last show, there have been major iterations of all our software, including the well-anticipated release of <a href="http://filecatalyst.com/products/filecatalyst-direct">FileCatalyst Direct 3.0</a> and <a href="http://filecatalyst.com/products/filecatalyst-workflow">FileCatalyst Workflow 4.6.1</a>. As our user base can tell you, we are continually improving our software; at IBC we will be demonstrating the latest versions of our current offerings, along with a few new surprises.</p>
<p>The conference portion of <a href="http://www.ibc.org/">IBC </a>(International Broadcasting Convention) runs from September 8&ndash;13, with the Exhibition running from September 9&ndash;13.</p>]]></content:encoded>
			<wfw:commentRss>http://www.filecatalyst.com/filecatalyst-at-ibc/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
	</channel>
</rss>
<!-- This Quick Cache file was built for (  www.filecatalyst.com/feed/ ) in 1.14980 seconds, on Feb 4th, 2012 at 8:29 pm UTC. -->
<!-- This Quick Cache file will automatically expire ( and be re-built automatically ) on Feb 4th, 2012 at 9:29 pm UTC -->
<!-- +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ -->
<!-- Quick Cache Is Fully Functional :-) ... A Quick Cache file was just served for (  www.filecatalyst.com/feed/ ) in 0.00105 seconds, on Feb 4th, 2012 at 8:37 pm UTC. -->
