142. Escape from S3
AWS Bites3 Huhti 2025

142. Escape from S3

We discuss common use cases and challenges for copying data between S3 buckets and S3-compatible object storage services. We share our experience building an open source Node.js CLI tool called S3-Migrate to efficiently migrate data with separate source and destination credentials. We cover performance considerations like streaming, chunk sizes, concurrency and parallelism.

AWS Bites is brought to you in association with fourTheorem. If you need a friendly partner to support you and work with you to de-risk any AWS migration or development project, check them out at ⁠⁠⁠fourtheorem.com⁠⁠⁠



In this episode, we mentioned the following resources:



Do you have any AWS questions you would like us to address?

Leave a comment here or connect with us on X/Twitter, BlueSky or LinkedIn:- ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠https://twitter.com/eoins⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠ | ⁠⁠https://bsky.app/profile/eoin.sh⁠⁠ | ⁠⁠https://www.linkedin.com/in/eoins/⁠⁠- ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠https://twitter.com/loige⁠⁠⁠⁠⁠⁠ | ⁠⁠https://bsky.app/profile/loige.co⁠⁠ | ⁠⁠https://www.linkedin.com/in/lucianomammino/

Jaksot(156)

112. What is a Service Control Policy (SCP)?

112. What is a Service Control Policy (SCP)?

In this episode, we provide a friendly introduction to Service Control Policies (SCPs) in AWS Organizations. We explain what SCPs are, how they work, common use cases, and tips for troubleshooting acc...

2 Helmi 202418min

111. How we run a Cloud Consulting business

111. How we run a Cloud Consulting business

In this episode, we discuss how we work as a cloud consulting company, including our principles, engagement process, sprint methodology, and focus on agile development to deliver successful projects. ...

26 Tammi 202445min

110. Why should you use Lambda for Machine Learning?

110. Why should you use Lambda for Machine Learning?

In this episode, we discuss using AWS Lambda for machine learning inference. We cover the tradeoffs between GPUs and CPUs for ML, tools like ggml and llama.cpp for running models on CPUs, and share ex...

19 Tammi 202424min

109. What is the AWS Project Development Kit (PDK)?

109. What is the AWS Project Development Kit (PDK)?

This episode of the AWS Bites Podcast provides an overview of the AWS Project Development Kit (PDK), an open-source tool to help bootstrap and maintain cloud projects. We discuss what PDK is, how it c...

12 Tammi 202428min

108. How to Solve Lambda Python Cold Starts

108. How to Solve Lambda Python Cold Starts

In this episode, we discuss how you can use Python for data science workloads on AWS Lambda. We cover the pros and cons of using Lambda for these workloads compared to other AWS services. We benchmark...

15 Joulu 202320min

107. Expert opinions from re:Invent 2023

107. Expert opinions from re:Invent 2023

In this episode, we share expert opinions from AWS community leaders on their favorite announcements from re:Invent 2023, advice for those starting their cloud journey, predictions for the future of s...

8 Joulu 202320min

106. Luciano at re:Invent

106. Luciano at re:Invent

Luciano and Eoin chat about Luciano's experience attending AWS re:Invent 2023 in Las Vegas for the first time. They talk about the massive scale of the event, logistical challenges getting around betw...

1 Joulu 202318min

105. Integration Testing on AWS

105. Integration Testing on AWS

In this episode, we discuss integration testing event-driven systems and explore AWS's new Integration Application Test Kit (IATK). We cover the challenges of testing events and common approaches like...

24 Marras 202328min