109. What is the AWS Project Development Kit (PDK)?
This episode of the AWS Bites Podcast provides an overview of the AWS Project Development Kit (PDK), an open-source tool to help bootstrap and maintain cloud projects. We discuss what PDK is, how it can help generate boilerplate code and infrastructure, keep configuration consistent across projects, and some pros and cons of using a tool like this versus doing it manually. Is PDK something you should use for your cloud projects? Let's find out! 💰 SPONSORS 💰 AWS Bites is brought to you by fourTheorem, an Advanced AWS Partner. If you are moving to AWS or need a partner to help you go faster, check us out at fourtheorem.com ! In this episode, we mentioned the following resources. The official PDK website (and documentation): https://aws.github.io/aws-pdk/ Our previous episode "16. What are the pros and cons of CDK?": https://awsbites.com/16-what-are-the-pros-and-cons-of-cdk/ Our previous episode "93. CDK Patterns - The Good, The Bad and The Ugly": https://awsbites.com/93-cdk-patterns-the-good-the-bad-and-the-ugly/ Projen's official website: https://projen.io/ Introduction talk to Projen at CDK Day 2020: https://www.youtube.com/watch?v=SOWMPzXtTCw Our previous episode "70. How do you create good AWS diagrams?": https://awsbites.com/70-how-do-you-create-good-aws-diagrams/ Building a shopping list app with PDK (tutorial): https://aws.github.io/aws-pdk/getting_started/shopping_list_app.html PDK in-depth developer guides: https://aws.github.io/aws-pdk/developer_guides/index.html Opinion by Vlad Ionescu on X: https://twitter.com/iamvlaaaaaaad/status/1743608823896592640 Yeoman: https://yeoman.io/ CookieCutter: https://github.com/cookiecutter/cookiecutter Terraform project generation example: https://github.com/conzy/terraform-demo Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on X, formerly Twitter: - https://twitter.com/eoins - https://twitter.com/loige
12 Jan 202428min
108. How to Solve Lambda Python Cold Starts
In this episode, we discuss how you can use Python for data science workloads on AWS Lambda. We cover the pros and cons of using Lambda for these workloads compared to other AWS services. We benchmark cold start times and performance for different Lambda deployment options like zip packages, layers, and container images. The results show container images can provide faster cold starts than zip packages once the caches are warmed up. We summarize the optimizations AWS has made to enable performant container image deployments. Overall, Lambda can be a good fit for certain data science workloads, especially those that are bursty and need high concurrency. 💰 SPONSORS 💰 AWS Bites is brought to you by fourTheorem, an Advanced AWS Partner. If you are moving to AWS or need a partner to help you go faster, check us out at fourtheorem.com ! In this episode, we mentioned the following resources. Our blog post detailing our research on how to optimise Python Data Science in AWS Lambda: https://fourtheorem.com/optimise-python-data-science-aws-lambda/ The repository with our benchmarks and related visualizations: https://github.com/fourTheorem/lambda-datasci-perf On-demand Container Loading on AWS Lambda (AWS Paper): https://arxiv.org/abs/2305.13162 Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on X, formerly Twitter: - https://twitter.com/eoins - https://twitter.com/loige
15 Dec 202320min
107. Expert opinions from re:Invent 2023
In this episode, we share expert opinions from AWS community leaders on their favorite announcements from re:Invent 2023, advice for those starting their cloud journey, predictions for the future of serverless, whether to go multi-cloud or not, and how AI will impact developers. Our guests provide insightful perspectives on getting hands-on experience, leveraging the AWS community, thinking through architectural decisions, and more. AWS Bites is brought to you by fourTheorem, an Advanced AWS Partner. If you are moving to AWS or need a partner to help you go faster, check us out at fourtheorem.com ! In this episode, we mentioned the following resources. Alex Kearns on Linkedin: https://www.linkedin.com/in/alexjameskearns/ AWS Console-to-Code (Preview) to generate code for console actions: https://aws.amazon.com/about-aws/whats-new/2023/11/aws-console-to-code-preview-generate-console-actions/ Emily Shea on Linkedin: https://www.linkedin.com/in/emshea/ Emily's talk: Getting started building serverless event-driven applications (SVS205): https://www.youtube.com/watch?v=1aTQI-Kqs2U Ran Isenberg on Linkedin: https://www.linkedin.com/in/ranisenberg/ Ran's blog: https://www.ranthebuilder.cloud/ Maxime David on Linkedin: https://www.linkedin.com/in/maxday/ Danielle Heberling on Linkedin: https://www.linkedin.com/in/deeheber/ Jones Zachariah Noel N on Linkedin: https://www.linkedin.com/in/jones-zachariah-noel-n/ Sam Williams on Linkedin: https://www.linkedin.com/in/sam-complete-coding/ AJ Stuyvenberg on Linkedin: https://www.linkedin.com/in/aaron-stuyvenberg/ Faizal Khan on Linkedin: https://www.linkedin.com/in/faizal-khan/ Heitor Lessa on Linkedin: https://www.linkedin.com/in/heitorlessa/ Chris Williams on Linkedin: https://www.linkedin.com/in/chrisfwilliams/ Praneeta Prakash on Linkedin: https://www.linkedin.com/in/praneetaprakash/ Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on X, formerly Twitter: - https://twitter.com/eoins - https://twitter.com/loige #aws #reinvent2023 #reinvent #networkingevents
8 Dec 202320min
106. Luciano at re:Invent
Luciano and Eoin chat about Luciano's experience attending AWS re:Invent 2023 in Las Vegas for the first time. They talk about the massive scale of the event, logistical challenges getting around between venues, highlights from the keynotes and announcements, and tips for networking and getting the most out of re:Invent. Luciano shares his perspective on the AI focus, meeting people in real life after connecting online, rookie mistakes to avoid, and why re:Invent is worth the investment for anyone working in the AWS space. AWS Bites is brought to you by fourTheorem, an Advanced AWS Partner. If you are moving to AWS or need a partner to help you go faster, check us out at fourtheorem.com ! In this episode, we mentioned the following resources. - Amazon Q: https://aws.amazon.com/blogs/aws/introducing-amazon-q-a-new-generative-ai-powered-assistant-preview/ - Efi Merdler-Kravitz's talk on "Rustifying serverless" with AWS Lambda (YouTube): https://www.youtube.com/watch?v=Mdh_2PXe9i8 - ElastiCache Serverless for Redis and Memcached: https://aws.amazon.com/blogs/aws/amazon-elasticache-serverless-for-redis-and-memcached-now-generally-available/ - Throughput increase and dead letter queue redrive for SQS FIFO: https://aws.amazon.com/blogs/aws/announcing-throughput-increase-and-dead-letter-queue-redrive-support-for-amazon-sqs-fifo-queues/ - Step Functions Workflow Studio in AWS Application Composer: https://aws.amazon.com/blogs/aws/aws-step-functions-workflow-studio-is-now-available-in-aws-application-composer/ - Lambda scales 12x faster: https://aws.amazon.com/blogs/aws/aws-lambda-functions-now-scale-12-times-faster-when-handling-high-volume-requests/ - Step Function redrive from a failed state: https://aws.amazon.com/blogs/compute/introducing-aws-step-functions-redrive-a-new-way-to-restart-workflows/ Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on X, formerly Twitter: - https://twitter.com/eoins - https://twitter.com/loige #aws #reinvent2023 #reinvent #networkingevents
1 Dec 202318min
105. Integration Testing on AWS
In this episode, we discuss integration testing event-driven systems and explore AWS's new Integration Application Test Kit (IATK). We cover the challenges of testing events and common approaches like logging, end-to-end testing, and using temporary queues. We then introduce IATK, walk through how to use it for EventBridge testing, and share our experience trying out the X-Ray trace validation. We found IATK promising but still rough around the edges, though overall a useful addition to help test complex event flows. 💰 SPONSORS 💰 AWS Bites is brought to you by fourTheorem, an Advanced AWS Partner. If you are moving to AWS or need a partner to help you go faster, check us out at fourtheorem.com! In this episode, we mentioned the following resources: sls-test-tools on GitHub: https://github.com/aleios-cloud/sls-test-tools Sarah Hamilton’s article on Integration testing and how to use sls-test-tool: https://medium.com/serverless-transformation/bridge-integrity-integration-testing-strategy-for-eventbridge-based-serverless-architectures-b73529397251 Our previous episode on building a cross-account Event Bridge deployment: https://awsbites.com/39-how-do-you-build-a-cross-account-event-backbone-with-eventbridge/ Our IATK tests for the cross-account Event Bridge project: https://github.com/fourTheorem/cross-account-eventbridge/blob/main/test/integration/test_events.py IATK tutorial: https://awslabs.github.io/aws-iatk/tutorial/ IATK examples: https://awslabs.github.io/aws-iatk/tutorial/examples/retrieve_cfn_info/ You can listen to AWS Bites wherever you get your podcasts: Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== Breaker: https://www.breaker.audio/aws-bites RSS: https://anchor.fm/s/6a3312a0/podcast/rss
24 Nov 202328min
104. Explaining Lambda Runtimes
In this episode, we celebrate AWS Lambda's 9th birthday by taking a deep dive into Lambda runtimes. We discuss how Lambda works, compare official runtimes vs. custom runtimes, and explain when and why building a custom runtime might be worth the effort. We talk through how custom runtimes work, options for deploying them, and potential use cases where they could be beneficial over standard runtimes. 💰 SPONSORS 💰 AWS Bites is brought to you by fourTheorem, an Advanced AWS Partner. If you are moving to AWS or need a partner to help you go faster, check us out at fourtheorem.com! In this episode, we mentioned the following resources: The original announcement launching AWS Lambda in 2014: https://aws.amazon.com/about-aws/whats-new/2014/11/13/introducing-aws-lambda/ List of official Lambda runtimes: https://docs.aws.amazon.com/lambda/latest/dg/lambda-runtimes.html Library implementing the Rust runtime: https://github.com/awslabs/aws-lambda-rust-runtime Library implementing the Go runtime: https://github.com/aws/aws-lambda-go/ Library implementing the C++ runtime: https://github.com/awslabs/aws-lambda-cpp Third-party PHP runtime (Bref): https://bref.sh/ Third-party Swift runtime: https://github.com/swift-server/swift-aws-lambda-runtime Official documentation on how to build a custom runtime: https://docs.aws.amazon.com/lambda/latest/dg/runtimes-custom.html An official tutorial on how to build a custom runtime: https://docs.aws.amazon.com/lambda/latest/dg/runtimes-walkthrough.html List of all the environment variables available to a runtime: https://docs.aws.amazon.com/lambda/latest/dg/configuration-envvars.html#configuration-envvars-runtime Lambda Response Streaming official docs: https://docs.aws.amazon.com/lambda/latest/dg/runtimes-custom.html#runtimes-custom-response-streaming Our previous episode on Lambda Response Streaming: https://awsbites.com/77-how-do-you-use-lambda-response-streaming/ On-demand Container Loading in AWS Lambda (paper): https://arxiv.org/abs/2305.13162 Deep dive on container support for AWS Lambda (Eoin's article): https://dev.to/eoinsha/container-image-support-in-aws-lambda-deep-dive-2keh When is the Lambda Init Phase Free, and when is it Billed? (article by Luc van Donkersgoed): https://lucvandonkersgoed.com/2022/04/09/when-is-the-lambda-init-phase-free-and-when-is-it-billed/ You can listen to AWS Bites wherever you get your podcasts: Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== Breaker: https://www.breaker.audio/aws-bites RSS: https://anchor.fm/s/6a3312a0/podcast/rss
17 Nov 202325min
103. Building GetAI Features with Bedrock
In this episode, we discuss how we automated generating YouTube descriptions, chapters and tags for our podcast using Amazon's new GenAI tool: Bedrock. We provide an overview of Bedrock's features and how we built an integration to summarize podcast transcripts and extract relevant metadata using the Anthropic Claude model. We share the prompt engineering required to instruct the AI, and details on our serverless architecture using Step Functions, Lambda, and EventBridge. We also discussed Bedrock pricing models and how we built a real-time cost-monitoring dashboard. Overall, this automation saves us substantial manual effort while keeping costs low. We hope this episode inspires others to explore building their AI workflows with Bedrock. 💰 SPONSORS 💰 AWS Bites is brought to you by fourTheorem, an Advanced AWS Partner. If you are moving to AWS or need a partner to help you go faster, check us out at fourtheorem.com! In this episode, we mentioned the following resources: The GitHub repository with the code for the AWS Bites website: https://github.com/awsbites/aws-bites-site Episoder: the open source project we created to handle this Bedrock-based automation: https://github.com/fourTheorem/episoder Podwhisperer: out other open source automation that creates accurate transcripts for our podcast: https://github.com/fourTheorem/podwhisperer/ Amazon Bedrock Workshop: https://catalog.us-east-1.prod.workshops.aws/workshops/a4bdb007-5600-4368-81c5-ff5b4154f518/en-US Using generative AI on AWS for diverse content types (workshop): https://catalog.workshops.aws/genai-on-aws/en-US/01-introduction Deploying a Multi-Model and Multi-RAG Powered Chatbot Using AWS CDK on AWS: https://github.com/aws-samples/aws-genai-llm-chatbot/tree/main You can listen to AWS Bites wherever you get your podcasts: Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== Breaker: https://www.breaker.audio/aws-bites RSS: https://anchor.fm/s/6a3312a0/podcast/rss
10 Nov 202320min
102. Getting Ampt with Jeremy Daly
In this episode, we have the pleasure of speaking with Jeremy Daly, CEO of Ampt and a leader in the AWS and serverless community. We discuss Jeremy's journey into AWS and serverless, the prolific open source work and content he creates, the evolution of serverless over the years, common myths about serverless, and, finally, the story behind building Ampt to improve the developer experience. Jeremy provides his perspective on the state of serverless and predictions for the future and it also gives some fantastic pieces of advice for wannabe tech-entrepreneurs! 💰 SPONSORS 💰 AWS Bites is brought to you by fourTheorem, an Advanced AWS Partner. If you are moving to AWS or need a partner to help you go faster, check us out at fourtheorem.com! In this episode, we mentioned the following resources: Serverless Microservice patterns for AWS (article by Jeremy): https://www.jeremydaly.com/serverless-microservice-patterns-for-aws/ Datadog research: The state of Serverless: https://www.datadoghq.com/state-of-serverless/ Bref: serverless runtime for PHP: https://bref.sh/ Ampt original announcement blog post: https://www.serverless.com/blog/serverless-cloud-spins-off-as-ampt Our previous episode on Ampt: https://awsbites.com/100-exploring-ampt-a-new-way-to-build-cloud-apps-on-aws/ Long-running tasks and smart compute with Ampt: https://getampt.com/blog/introducing-long-running-tasks/ Ampt official website: https://getampt.com/ Jeremy's official website: https://www.jeremydaly.com/ Jeremy on X (ergo Twitter): https://twitter.com/jeremy_daly Jeremy's newsletter "Off-by-none": https://offbynone.io/ You can listen to AWS Bites wherever you get your podcasts: Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== Breaker: https://www.breaker.audio/aws-bites RSS: https://anchor.fm/s/6a3312a0/podcast/rss
3 Nov 20231h 10min
