Sid Anand on Building Agari’s Cloud-native Data Pipelines with AWS Kinesis and Serverless

Sid Anand on Building Agari’s Cloud-native Data Pipelines with AWS Kinesis and Serverless

Wesley Reisz talks to Sid Anand, a data architect at cybersecurity company Agari, about building cloud-native data pipelines. The focus of their discussion is around a solution Agari uses that is built from Amazon Kinesis Streams, serverless functions, and auto scaling groups. Sid Anand is an architect at Agari, and a former technical architect at eBay, Netflix, and LinkedIn. He has 15 years of data infrastructure experience at scale, is a PMC for Apache Airflow, and is also a program committee chair for QCon San Francisco and QCon London. Why listen to this podcast - Real-time data pipeline processing is very latency sensitive - Micro-batching allows much smaller amounts of data to be processed - Use the appropriate data store (or stores) to support the use of the dataIngesting data quickly into a clean database with minimal indexes can be fast - Communicate using a messaging system that supports schema evolution More on this: Quick scan our curated show notes on InfoQ http://bit.ly/2rJU9nB You can also subscribe to the InfoQ newsletter to receive weekly updates on the hottest topics from professional software development. bit.ly/24x3IVq Subscribe: www.youtube.com/infoq Like InfoQ on Facebook: bit.ly/2jmlyG8 Follow on Twitter: twitter.com/InfoQ Follow on LinkedIn: www.linkedin.com/company/infoq Want to see extented shownotes? Check the landing page on InfoQ: http://bit.ly/2rJU9nB

Det här avsnittet är hämtat från ett öppet RSS-flöde och publiceras inte av Podme. Det kan innehålla reklam.

Avsnitt(385)

Cloud and DevOps InfoQ Trends Report 2026: AI, Resilience, Platforms, FinOps, and Sovereignty

Cloud and DevOps InfoQ Trends Report 2026: AI, Resilience, Platforms, FinOps, and Sovereignty

In this episode of the podcast, members of the InfoQ editorial staff and friends of InfoQ will discuss current trends in the cloud and DevOps domains as part of our annual trends report. These reports...

12 Aug 50min

WebAssembly on the JVM: Feature Evolution, Performance, and the Transition to Endive

WebAssembly on the JVM: Feature Evolution, Performance, and the Transition to Endive

Andrea Peruffo discusses the evolution of WebAssembly beyond the browser and its growing role on the server-side JVM. He covers performance advancements in Wasm runtimes, moving from interpreters to e...

3 Aug 34min

Rethinking Data: Moving From the Traditional Three-Tier Web Stack to Client-Side Event Sourcing

Rethinking Data: Moving From the Traditional Three-Tier Web Stack to Client-Side Event Sourcing

Johannes Schickling explores how he moved beyond the traditional three-tier web stack to a local-first approach. He shares his experience transitioning from Prisma to developing Overtone—a music curat...

27 Juli 43min

Strands Agents with Clare Liguori

Strands Agents with Clare Liguori

In this episode, Thomas Betts talks with Clare Liguori, the technical lead on the open source Strands Agents SDK. The conversation covers how Strands Agents has grown from a Python SDK to a full agent...

20 Juli 38min

Governance in the Age of AI: A Conversation with Sarah Wells

Governance in the Age of AI: A Conversation with Sarah Wells

In this podcast Michael Stiefel spoke to Sarah Wells about the relationship of governance to software architecture. Governance enables teams to work effectively by establishing procedures that minimiz...

13 Juli 48min

Spite-Driven Engineering: A New Blueprint for Cloud Security in the AI Native Era

Spite-Driven Engineering: A New Blueprint for Cloud Security in the AI Native Era

In this episode, Alex Zenla (CTO/Co-founder, Edera) challenges the "laissez-faire" attitude toward modern infrastructure. She promotes "spite-driven development", building software to solve genuine te...

6 Juli 40min

Architectural Patterns: Moving Beyond Cloud-Native to Local-First - Insights from Adam Wiggins

Architectural Patterns: Moving Beyond Cloud-Native to Local-First - Insights from Adam Wiggins

In this episode, Heroku co-founder and Ink & Switch founder Adam Wiggins argues for a 'local-first' architecture that reconciles cloud-based collaboration with the performance and data ownership of lo...

29 Juni 38min

How eBPF Empowers Developers to Observe Inside the Linux Kernel in a Safe and Unintrusive Way

How eBPF Empowers Developers to Observe Inside the Linux Kernel in a Safe and Unintrusive Way

Daniel Finneran explores how eBPF has evolved far beyond its roots in packet filtering into a robust, safe way to extend the Linux kernel. He explains how the eBPF "verifier", the security guardrail, ...

22 Juni 43min

Populärt inom Teknik

uppgang-och-fall
market-makers
rss-uppgang-och-fall
skogsforum-podcast
 och-bilen-gar-bra
rss-laddstationen-med-elbilen-i-sverige
rss-elektrikerpodden
elbilsveckan
developers-mer-an-bara-kod
bosse-bildoktorn-och-hasse-p
rss-en-ai-till-kaffet
bli-saker-podden
rss-veckans-ai
rss-fabriken-2
natets-morka-sida
rss-milpodden
rss-jonas-jaani-podcast
rss-upplyst-entreprenordirektor
hej-bruksbil
rss-teknikstrul-podcast