Apache Beam Founder Tyler Akidau Discusses Streaming System and Their Complexities

Apache Beam Founder Tyler Akidau Discusses Streaming System and Their Complexities

In this podcast, we are talking to Tyler Akidau, a senior engineer at Google, who leads the technical infrastructure and data processing teams in Seattle, and a founding member of the Apache Beam PMC and a passionate voice in the streaming space. This podcast will cover data streaming and the 2015 DataFlow Model streaming paper [http://www.vldb.org/pvldb/vol8/p1792-Akidau.pdf] and much of the concepts covered, such as why dealing with out-of-order data is important, event time versus processing time, windowing approaches, and finally preview the track he is hosting at QConf SF next week. Why listen to this podcast: - Batch processing and streaming aren’t two incompatible things; they are a function of different windowing options. - Event time and processing time are two different concepts, and may be out of step with each other. - Completeness is knowing that you have processed all the events for a particular window. - Windowing choice can be answered from the what, when, where, how questions. - Unbounded versus bounded data is a better dimension than stream or batch processing. More on this: Quick scan our curated show notes on InfoQ http://bit.ly/2AyBTAb You can also subscribe to the InfoQ newsletter to receive weekly updates on the hottest topics from professional software development. bit.ly/24x3IVq Subscribe: www.youtube.com/infoq Like InfoQ on Facebook: bit.ly/2jmlyG8 Follow on Twitter: twitter.com/InfoQ Follow on LinkedIn: www.linkedin.com/company/infoq Want to see extented shownotes? Check the landing page on InfoQ: http://bit.ly/2AyBTAb

Denne episoden er hentet fra en åpen RSS-feed og er ikke publisert av Podme. Den kan derfor inneholde annonser.

Episoder(396)

AI, ML, and Data Engineering InfoQ Trends Report 2026

AI, ML, and Data Engineering InfoQ Trends Report 2026

In this episode of the podcast, members of the InfoQ AI and MIL editorial staff and friends of InfoQ discuss the current trends in the domain of AI, ML and Data Engineering. One of the regular featur...

30 Okt 1h 11min

The Future of Web Apps: Will AI Agents Generate UIs on the Fly?

The Future of Web Apps: Will AI Agents Generate UIs on the Fly?

Rachel Lee Nabors, former React core team member, dives into the architecture and philosophy behind local-first applications, exploring how small language models (SLMs) running directly on-device can ...

19 Okt 47min

What Does It Really Mean To Program With AI: A Conversation with Joy Ebertz

What Does It Really Mean To Program With AI: A Conversation with Joy Ebertz

In this podcast, Michael Stiefel spoke to Joy Ebertz about how the use of artificial intelligence is changing the way architects and developers do their jobs. Focusing on the long term success of the ...

12 Okt 44min

Future Cybersecurity: Hardware Memory Safety, Automated Governance and Post-Quantum Cryptography

Future Cybersecurity: Hardware Memory Safety, Automated Governance and Post-Quantum Cryptography

In this episode, Chris Swan, engineer at Atsign and security track host at QCon London, reflects on the ideas shared during QCon London 2026 and teases topics of the future edition. The discussion exp...

5 Okt 34min

The AI Revolution Fails Without Psychological Safety For Developers: A Conversation with Erin Doyle

The AI Revolution Fails Without Psychological Safety For Developers: A Conversation with Erin Doyle

In this podcast, Michael Stiefel spoke to Erin Doyle about how artificial intelligence tools are transforming the software development process, and how they are affecting software engineers. Architect...

28 Sep 54min

The Future of AI: From Enterprise Adoption to Open Source Sovereignty

The Future of AI: From Enterprise Adoption to Open Source Sovereignty

In this episode, a panel of AI experts, Meryem Arik (DoubleWord), Clara Higuera Cabañes (BBVA), and Jeff Smith (C Proof), demystify the current state of AI in the enterprise. The discussion navigates ...

25 Sep 52min

Securing AI Agents: Identity, Authorisation, and the DPACT Framework

Securing AI Agents: Identity, Authorisation, and the DPACT Framework

In this episode, Sahil Agarwal talks about the critical challenges of identity, authorisation, and security in the age of AI agents. Sahil introduces the DPACT framework (Delegation, Policy, Auditabil...

21 Sep 41min

How Will We Train Developers If AI Does the Routine Work: A Conversation with Scott Hanselman

How Will We Train Developers If AI Does the Routine Work: A Conversation with Scott Hanselman

In this podcast Michael Stiefel spoke to Scott Hanselman about developing new software engineers when artificial intelligence agents are doing most of the work on which junior developers were trained....

14 Sep 36min

Populært innen Teknologi

teknisk-sett
energi-og-klima
rss-kunstig-intelligens-med-elisabeth-maren-og-morten
pedagogisk-intelligens
rss-ai-forklart
shifter
elektropodden
fornybaren
lydartikler-fra-aftenposten
rss-snakk-om-sikkerhet
nasjonal-sikkerhetsmyndighet-nsm
tomprat-med-gunnar-tjomlid
rss-alt-som-gar-pa-strom
rss-larervarelset
rss-digitaliseringspodden
smart-forklart
rss-teknologioptimistene-en-podkast-om-teknologi-og-mennesker
rss-fish-ships
rss-ki-praten
rss-heis