Twas the night before re:Invent 2018 and there were many great releases from AWS to tease the first day of the AWS’ annual conference. The annual Midnight Madness provides a sneak peak to re:Invent where AWS executives give their take on what’s coming to AWS. While there were many announcements made, we’re here to share the most exciting highlights from the night.
S3 Batch Operations
S3 Batch Operations is a new set of S3 API features allowing AWS customers to manage very large amounts of objects in S3 with a single S3 API call. Some of those actions included are copying objects (in very high amounts) between buckets, replacing tag sets, modifying access controls, and restoring archived objects from Amazon S3 Glacier in bulk.
Until now these type of actions required clients to write their own custom software or scripts to execute those desired yet complex operations which could take several months.
Customers can now save this time to focus on developing their application code to leverage this API to be natively integrated with S3 service and manage data in high-scale in a simpler and optimized manner.
Click here to learn more about S3 Batch Operations and Sign-Up for the Preview.
AWS Transfer for SFTP
AWS Transfer for SFTP (Secure File Transfer Protocol) allows for the transfer of files and other data over a connection using the Secure Shell (SSH) protocol. As opposed to FTP, traffic to the SFTP remains encrypted in transit since it uses asymmetric cryptology with SSH public key to encrypt the data. This means many organizations can benefit from this service to securely upload/download files to servers using SFTP to follow security best practices.
Previously, SFTP required deployment on an EC2 instance, configuration building, and maintaining the server to ensure it followed required compliances (such as patching, data access for specific users and groups etc.. ). With AWS Transfer for SFTP, you can now deploy an highly available SFTP service, integrated with S3 for data storage and scalability without managing any servers or modifying your applications to reduce significant operational overhead.
With AWS Transfer for SFTP you can now store your data on AWS S3 natively using SFTP protocol without modifying your application code or use other custom solution that does not support AWS API.
You can read more about AWS Transfer for SFTP here.
AWS DataSync
AWS DataSync was designed to simplify and automate online data transfer. An agent based data transfer service that automates the management and movement of data between on-premises storage to AWS Amazon S3 and Amazon Elastic File System (Amazon EFS) endpoints.
This service not only allows the movement of data to AWS easily, but it’s up to ten times faster than any common open source tooling. For secure data transfer, data is encrypted at transit using TLS cryptographic protocol between the on-premise and AWS endpoints.
A common use case for customers required to implement a custom solution for replicating large amount of data or utilize 3rd party solutions that may require the use of an EC2 server as a broker to run NFS server .
With AWS DataSync you can directly replicate your on-premise data to AWS and much faster.
In addition, upon completion of the data transfer process, the service performs data checks in transit and in-rest to ensure data integrity. For file protection for large amounts of objects, once the data replicated to S3 it can potentially be archived to Amazon Glacier by setting the accordance Lifecycle Management Policy or by sending the data to Amazon EFS for a standby file system. Performing these actions could also reduce operational costs as well.
To learn more about AWS DataSync, you can click here.
AWS RoboMaker
With the rapid evolvement of robotics and Artificial Intelligence (AI) technologies the need for cloud native solution to manage a variety sets of tools in automated manner is larger than ever before.
AWS RoboMaker enables the orchestration of your AI development environment by automatically provisioning an highly available and scalable compute resources, configuring the development software (Gazebo) while leveraging the widely-used open-source ROS (Robot Operating System).
RoboMaker provide developers a built-in sets of tools to test, simulate and configure multiple AI environments without the need of worrying about other dependencies that are required for its operation.
These new solutions will allow organizations to significantly improve operational processes and efficiency for data transfer and management. And this is just the start; there’s much more to come out of re:Invent in the coming days!
To follow these updates and gain insights on how they can impact your business, subscribe to our blog! You can also check out all of AWS’ original announcements here.
Ready to revolutionize your business with AWS? Get in touch!
