Data Science #3 - "A Mathematical Theory of Communication" (1948), Shannon, C. E. Part - 1
Data Science Decoded16 Heinä 2024

Data Science #3 - "A Mathematical Theory of Communication" (1948), Shannon, C. E. Part - 1

Shannon, Claude Elwood. "A mathematical theory of communication." The Bell system technical journal 27.3 (1948): 379-423. Part 1/3. The paper fundamentally reshapes how we understand communication. The paper introduces a formal framework for analyzing communication systems, addressing the transmission of information with and without noise. Key concepts include the definition of information entropy, the logarithmic measure of information, and the capacity of communication channels. Shannon demonstrates that information can be efficiently encoded and decoded to maximize the transmission rate while minimizing errors introduced by noise. This work is pivotal today as it underpins digital communication technologies, from data compression to error correction in modern telecommunication systems. Full breakdown of the paper with math and python code is at our website: https://datasciencedecodedpodcast.com... This is the first part out of 3, as the paper is quite long!

Tämä jakso on lisätty Podme-palveluun avoimen RSS-syötteen kautta eikä se ole Podmen omaa tuotantoa. Siksi jakso saattaa sisältää mainontaa.

Jaksot(33)

 Data Science #34 - The deep learning original paper review, Hinton, Rumelhard & Williams (1985)

Data Science #34 - The deep learning original paper review, Hinton, Rumelhard & Williams (1985)

On the 34th episode, we review the 1986 paper, "Learning representations by back-propagating errors" , which was pivotal because it provided a clear, generalized framework for training neural networks...

23 Marras 202546min

Data Science #33 - The Backpropagation method, Paul Werbos (1980)

Data Science #33 - The Backpropagation method, Paul Werbos (1980)

On the 33rd episdoe we review Paul Werbos’s “Applications of Advances in Nonlinear Sensitivity Analysis” which presents efficient methods for computing derivatives in nonlinear systems, drastically re...

3 Marras 202557min

 Data Science #32 - A Markovian Decision Process, Richard Bellman (1957)

Data Science #32 - A Markovian Decision Process, Richard Bellman (1957)

We reviewed Richard Bellman’s “A Markovian Decision Process” (1957), which introduced a mathematical framework for sequential decision-making under uncertainty. By connecting recurrence relations to M...

19 Syys 202546min

 Data Science #31 - Correlation and causation (1921), Wright Sewall

Data Science #31 - Correlation and causation (1921), Wright Sewall

On the 31st episode of the podcast, we add Liron to the team, we review a gem from 1921, where Sewall Wright introduced path analysis, mapping hypothesized causal arrows into simple diagrams and provi...

26 Heinä 202548min

Data Science #30 - The Bootstrap Method (1977)

Data Science #30 - The Bootstrap Method (1977)

In the 30th episode we review the the bootstrap, method which was introduced by Bradley Efron in 1979, is a non-parametric resampling technique that approximates a statistic’s sampling distribution by...

30 Touko 202541min

Data Science #29 - The Chi-square automatic interaction detection(CHAID) algorithm (1979)

Data Science #29 - The Chi-square automatic interaction detection(CHAID) algorithm (1979)

In the 29th episode, we go over the 1979 paper by Gordon Vivian Kass that introduced the CHAID algorithm.CHAID (Chi-squared Automatic Interaction Detection) is a tree-based partitioning method introdu...

23 Touko 202541min

Data Science #28 - The Bloom filter algorithm

Data Science #28 - The Bloom filter algorithm

In the 28th episode, we go over Burton Bloom's Bloom filter from 1970, a groundbreaking data structure that enables fast, space-efficient set membership checks by allowing a small, controllable rate o...

23 Touko 202539min

Data Science #27 - The History of Least Squares (1877)

Data Science #27 - The History of Least Squares (1877)

Mansfield Merriman's 1877 paper traces the historical development of the Method of Least Squares, crediting Legendre (1805) for introducing the method, Adrain (1808) for the first formal probabilistic...

2 Huhti 202532min

Suosittua kategoriassa Tiede

rss-poliisin-mieli
tiedekulma-podcast
rss-mita-tulisi-tietaa
docemilia
rss-hereilla
rss-bios-podcast
utelias-mieli
hippokrateen-vastaanotolla
rss-metsanomistaja-podcast
rss-lapsuuden-rakentajat-podcast
rss-sosiopodi
filocast-filosofian-perusteet
rss-tiedetta-vai-tarinaa
rss-duodecim-lehti
radio-antro
rss-totuuden-liepeilla