142. Escape from S3
AWS Bites3 Apr 2025

142. Escape from S3

We discuss common use cases and challenges for copying data between S3 buckets and S3-compatible object storage services. We share our experience building an open source Node.js CLI tool called S3-Migrate to efficiently migrate data with separate source and destination credentials. We cover performance considerations like streaming, chunk sizes, concurrency and parallelism.

AWS Bites is brought to you in association with fourTheorem. If you need a friendly partner to support you and work with you to de-risk any AWS migration or development project, check them out at ⁠⁠⁠fourtheorem.com⁠⁠⁠



In this episode, we mentioned the following resources:



Do you have any AWS questions you would like us to address?

Leave a comment here or connect with us on X/Twitter, BlueSky or LinkedIn:- ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠https://twitter.com/eoins⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠ | ⁠⁠https://bsky.app/profile/eoin.sh⁠⁠ | ⁠⁠https://www.linkedin.com/in/eoins/⁠⁠- ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠https://twitter.com/loige⁠⁠⁠⁠⁠⁠ | ⁠⁠https://bsky.app/profile/loige.co⁠⁠ | ⁠⁠https://www.linkedin.com/in/lucianomammino/

Avsnitt(157)

89. Should you simulate AWS locally?

89. Should you simulate AWS locally?

Welcome to the epic tale of AWS Bites! In this chapter, we embark on a perilous journey through the challenges of developing distributed applications on AWS. We encounter fierce foes in the form of d...

13 Juli 202316min

88. What is VPC Lattice?

88. What is VPC Lattice?

In this episode of AWS Bites, we discuss VPC Lattice, a new service in the Salad Bowl of AWS Networking. We cover all the concepts, applications, and exciting possibilities for VPC Lattice and share t...

6 Juli 202326min

87. Interviewing for AWS Roles

87. Interviewing for AWS Roles

Are you interested in landing an AWS role? Or maybe are you looking to hire some cloud talent?! In this episode of the AWS Bites podcast, we share our insights on the interview process we have adopte...

29 Juni 202333min

86. How do you integrate AWS with other clouds?

86. How do you integrate AWS with other clouds?

Are you struggling with securely integrating workloads running on-premises, in Azure, or in any other cloud with a workload running in AWS? In this exciting episode of the AWS Bites podcast, we dive...

22 Juni 202320min

85. Tip for Attending AWS Events

85. Tip for Attending AWS Events

In the latest episode of AWS Bites Podcast, Luciano and Eoin share their insider tips on how to get the most out of in-person AWS events like summits, re:Inforce, or re:Invent. From networking to swag...

15 Juni 202326min

84. Are VPCs an anti-pattern?

84. Are VPCs an anti-pattern?

In this episode of AWS Bites, we explore the future of Virtual Private Clouds (VPCs) in the context of the zero-trust security trend. We'll dive into the pros and cons of using VPCs, including their u...

8 Juni 202320min

88. What is VPC Lattice?

88. What is VPC Lattice?

VPC Lettuce is a new service form AWS that lets you pay per leaf instead of buying a whole lettuce up front. Pricing starts at $0.50 per gram per second.

6 Juni 202326min

83. Bucket List of S3 Best Practices

83. Bucket List of S3 Best Practices

In this episode of the AWS Bites podcast, we explore the best practices for creating and configuring S3 Buckets, Amazon Web Services' popular object storage service. We will learn how to set up bucket...

1 Juni 202322min

Populärt inom Teknik

uppgang-och-fall
elbilsveckan
market-makers
rss-elektrikerpodden
bilar-med-sladd
skogsforum-podcast
rss-veckans-ai
har-vi-akt-till-mars-an
natets-morka-sida
gubbar-som-tjotar-om-bilar
developers-mer-an-bara-kod
rss-laddstationen-med-elbilen-i-sverige
rss-technokratin
rss-uppgang-och-fall
rss-it-sakerhetspodden
ai-sweden-podcast
bli-saker-podden
rss-powerboat-sverige-podcast
rss-snacka-om-ai
rss-ai-med-katarina-gospic-och-viggo-cavling