#Expedat droplet software license#
#Expedat droplet install#
#Expedat droplet software#

Note: You won’t be charged software fees for 21 days, but the usual AWS infrastructure fees apply.

Go to the AWS Marketplace page for the ExpeDat Gateway for Amazon S3 trial.

Launch the ExpeDat Gateway for Amazon S3 (server) For convenience, we’ve placed a copy of the data in an Amazon S3 bucket in ap-northeast-1: s3://accel-file-tx-demo-tokyo. We’ ll move this 650GB compressed dataset over the Internet from an Amazon EC2 instance in the AWS Tokyo Region (ap-northeast-1) to an ExpeDat S3 Gateway “free trial” Amazon EC2 instance launched from the AWS Marketplace into the AWS N. The ExpeDat S3 Gateway runs on an Amazon EC2 instance, which can be set up in a couple of minutes.įor this example, we’ll use the same dataset that we used in the earlier blog post: the Wikipedia Traffic Statistics V2 from AWS Public Data Sets. This product can transmit ~300GB per hour and is available as a monthly subscription.

#Expedat droplet install#

One of the easiest ways to get started with ExpeDat is to install the ExpeDat Gateway for Amazon S3 via the AWS Marketplace. The ExpeDat S3 Gateway product can also automatically stream data into Amazon S3 – data never touches Amazon Elastic Block Store (Amazon EBS) or ephemeral storage, but instead lives only in memory as it’s transmitted via the ExpeDat gateway on Amazon EC2 to the bucket of your choice in Amazon S3. If lower-level integration is required, SDKs are available. ExpeDat also has Object Handlers that let you integrate with any external script or program, making automation easy to set up. Unlike Tsunami UDP, ExpeDat is an actively maintained and fully supported product that employs AES encryption and has lightweight, cross-platform clients with GUIs. It also provides features that make moving large amounts of data into Amazon S3 from on-premises or Amazon EC2 instances in other regions a seamless experience. And Tsunami UDP doesn’t support native Amazon S3 integration, so transfers must first be terminated on an Amazon Elastic Cloud Compute (Amazon EC2) instance and then re-transmitted to Amazon S3 manually using tools like the AWS CLI.ĮxpeDat, by Data Expedition Inc., addresses these shortfalls.

In addition, due to the lack of an SDK or plugins, Tsunami UDP can be hard to automate for tasks like creating watch folders with complex rules. It’s also a single-threaded application that hasn’t been updated since 2009 and commercial support is not available. It doesn’t support native encryption-important to know if you’re working with sensitive data.

#Expedat droplet software license#

Tsunami UDP has no software license fees and is easy to set up, but it has drawbacks. From there, using the multipart upload functionality built into the AWS CLI, we moved the data into Amazon Simple Storage Service (Amazon S3). Specifically, we showed how you can use it to move data quickly into Amazon EC2 from another instance in a distant AWS Region. Matt Yanchyshyn is a Principal Solutions Architect with Amazon Web Services IntroductionĪ previous blog post ( Moving Big Data Into the Cloud with Tsunami UDP) discussed how Tsunami UDP is a fast and easy way to move large amounts of data to and from AWS.