#9 DoK community: Geospatial Sensor Networks and Partitioning Data // Alex Miłowski

#9 DoK community: Geospatial Sensor Networks and Partitioning Data // Alex Miłowski

For our 9th installation of the Dokc data on k8s meetup, we will be talking with Alex Milowski from Redis Labs.

// Key takeaways:
How are data collection and consumption workloads fundamentally different?
What are the main challenges for sensor networks? How are those challenges address within the context of K8s?

// Abstract:
We use resources like weather reports or air quality measurements to navigate the world. These resources become especially important when faced by extreme events like the current wildfires in the Western USA. The data for the reports, predictions, and maps all start as realtime sensor networks.

In this talk, Alex will present some of his research into scientific data representation on the Web and how the key mechanism is the partitioning, annotation, and naming of data representations. We’ll take a look at a few examples, including some recent work on air quality data relating to the current wildfires in the western USA. We’ll explore the central question of how geospatial sensor network data can be collected and consumed within K8s deployments.


// Alex Bio
Dr. Milowski is a researcher, developer, entrepreneur, mathematician, and computer scientist. He has been involved in the development of Web and Semantics technologies since the early 1990's, primarily focusing on data representation, algorithms, and processing data at scale; also, an experienced developer skilled in a variety of functional and imperative languages.

He received his PhD in Informatics (Computer Science) from the renowned University of Edinburgh School of Informatics (Scotland) on large-scale computation over scientific data on the Web in 2014.

Various experience in scientific computing - geospatial and genome data pipelines - and big data platforms.

Recently, he has been working in telecommunications on various mobile financial applications and researching how to improve the productivity of machine learning systems and data scientists by utilizing Kubernetes as a platform. He has experience teaching, mentoring, and developing within various data science/ML domains including topics such as cloud computing, Kubernetes, Spark, Hadoop, text processing/NLP, deep learning, data acquisition, and a whole lot of Python.

▬▬▬▬▬▬ Connect with us 👋 ▬▬▬▬▬▬

Join our slack:
https://join.slack.com/t/dokcommunity/shared_invite/zt-g3ui5r0g-jDKz5dhh2W1ayElqwKYYAg
Follow us on Twitter: @dokcommunity

Connect with Demetrios on LinkedIn:
https://www.linkedin.com/in/dpbrinkm/

Connect with Alex on Linkedin:
https://www.linkedin.com/in/alexmilowski/

▬▬▬▬▬▬ Supporters of the DoKc ▬▬▬▬▬▬

This meetup is sponsored by MayaData, which helped start the DOK.community and remains an active supporter. MayaData sponsors two Cloud Native Computing Foundation (CNCF) projects, OpenEBS (http://www.openEBS.io) - the leading open-source container attached storage solution - and Litmus (https://litmuschaos.io/) - the leading Kubernetes native chaos engineering project, which was recently donated to the CNCF as a Sandbox project. As of August 2020, MayaData is the fifth-largest contributor to CNCF projects. Well-known users of MayaData software include the CNCF itself, Bloomberg, Comcast, Arista, Orange, Intuit, and others. Check out more info at https://mayadata.io/

Jaksot(243)

Tech with project RapGOD (DoK Day EU 2022) // Abhijith Ganesh

Tech with project RapGOD (DoK Day EU 2022) // Abhijith Ganesh

https://go.dok.community/slack https://dok.community/ From the DoK Day EU 2022 (https://youtu.be/Xi-h4XNd5tE) The Rap God project acts as a great entry point to many incoming open-source enthusiasts ...

27 Touko 20228min

Serverless Event Streaming Applications as Functions on K8 (DoK Day EU 2022) // Timothy Spann

Serverless Event Streaming Applications as Functions on K8 (DoK Day EU 2022) // Timothy Spann

https://go.dok.community/slack https://dok.community/ From the DoK Day EU 2022 (https://youtu.be/Xi-h4XNd5tE) We will walk through how to build serverless event streaming applications as functions ru...

27 Touko 20228min

Running Kafka on Kubernetes, across three clouds at Adobe (DoK Day EU 2022) // Adi Muraru

Running Kafka on Kubernetes, across three clouds at Adobe (DoK Day EU 2022) // Adi Muraru

https://go.dok.community/slack https://dok.community/ From the DoK Day EU 2022 (https://youtu.be/Xi-h4XNd5tE) Adobe runs dozens of Kafka clusters spread across both public (AWS and Azure) and private...

27 Touko 202216min

Running a database on local NVMes on Kubernetes (DoK Day EU 2022) // Tomáš Nožička & Maciej Zimnoch

Running a database on local NVMes on Kubernetes (DoK Day EU 2022) // Tomáš Nožička & Maciej Zimnoch

https://go.dok.community/slack https://dok.community/ From the DoK Day EU 2022 (https://youtu.be/Xi-h4XNd5tE) Running a database on Kubernetes with persistent storage is relatively easy but when it c...

27 Touko 20229min

Resilient Redis (DoK Day EU 2022) // Hrittik Roy & Ryan Gray

Resilient Redis (DoK Day EU 2022) // Hrittik Roy & Ryan Gray

https://go.dok.community/slack https://dok.community/ From the DoK Day EU 2022 (https://youtu.be/Xi-h4XNd5tE) Redis is a widely used open-source in-memory data store and cache that has become a key c...

27 Touko 20227min

PV TrashCan - Protection against accidental deletion of PVs or Namespaces (DoK Day EU 2022) // Veda Talakad, Aditya Kulkarni & Aditya Dani

PV TrashCan - Protection against accidental deletion of PVs or Namespaces (DoK Day EU 2022) // Veda Talakad, Aditya Kulkarni & Aditya Dani

https://go.dok.community/slack https://dok.community/ From the DoK Day EU 2022 (https://youtu.be/Xi-h4XNd5tE) Accidental PVC delete or namespace delete can cause the Persistent Volume to get deleted....

27 Touko 202211min

Protecting data with CSI Volume Snapshots on Kubernetes (DoK Day EU 2022) // Grant Griffiths

Protecting data with CSI Volume Snapshots on Kubernetes (DoK Day EU 2022) // Grant Griffiths

https://go.dok.community/slack https://dok.community/ From the DoK Day EU 2022 (https://youtu.be/Xi-h4XNd5tE) The container storage interface (CSI) is a contract between different container orchestra...

27 Touko 202211min

Operator Lifecycle Management (DoK Day EU 2022) // Julian Fischer

Operator Lifecycle Management (DoK Day EU 2022) // Julian Fischer

https://go.dok.community/slack https://dok.community/ From the DoK Day EU 2022 (https://youtu.be/Xi-h4XNd5tE) The ability to extend Kubernetes with Custom Resource Definitions and respective controll...

27 Touko 202215min