Rackspace Cloud Files Now Supporting Extremely Large File Sizes

The Rackspace Cloud Files team is pleased to announce that we now support extremely large file sizes by allowing customers to use multipart uploads.  I really do mean extremely large files.

In very simple terms, we accomplish this by having users segment their large files and upload a manifest file that maps their segments.  The best part is that users have access to their segments just like they would any other file and large files will be downloaded as a single file.

Companies who are looking to store videos, HD movies, very large backup files, etc. need this type of functionality.  Check out our knowledge base article here for best practices and limitations.  At this time, Rackspace has not yet implemented this functionality into the Rackspace Cloud Control Panel.

If you’re a developer and want to implement large file support into your application, you need to follow the following steps:

First, Upload The Segments:
curl -X PUT -H 'X-Auth-Token: <token>'
http://<storage_url>/container/myobject/1 --data-binary '1'

curl -X PUT -H 'X-Auth-Token: <token>'
http://<storage_url>/container/myobject/2 --data-binary '2'

curl -X PUT -H 'X-Auth-Token: <token>'
http://<storage_url>/container/myobject/3 --data-binary '3' 

Next, Create The Manifest File:
curl -X PUT -H 'X-Auth-Token: <token>'
-H 'X-Object-Manifest: container/myobject/'
http://<storage_url>/container/myobject --data-binary ''

To Download The Segments As A Single Object:
curl -H 'X-Auth-Token: <token>'

Not looking to develop against this code?  You might find it convenient to use ST (Swift Tool), which will split your file for you, let you specify the size of the segments you want, and create your manifest file for you.  You can get information about the Swift Tool here and download it here.  Once you have it, the process is very simple.

For an example using the Swift Tool, please check out the KB article here.

If you have any questions about this feature, just let us know.  We are happy to help!

Rack Blogger is our catchall blog byline, subbed in when a Racker author moves on, or used when we publish a guest post. You can email Rack Blogger at blog@rackspace.com.



Please enter your comment!
Please enter your name here