Damian Brady on DevOps for Data Science and Machine Learning - Episode 008

Damian Brady on DevOps for Data Science and Machine Learning - Episode 008

This week, your host, Jeffrey Palermo, interviews Damian Brady. Damian is a Senior Cloud DevOps Developer Advocate at Microsoft, helping customers implement DevOps methods on the Microsoft platform. He’s been with Microsoft for just over a year now and formerly served as a developer for Octopus Deploy.

In this episode, Damian and Jeffrey talk all things data science and machine learning. Damian answers key questions such as: what has been the biggest change in the area of data science since the Azure DevOps release? What does source control look like for data science projects in DevOps? And more. He also explains some of the interesting architectures he has put together for machine learning and walks Jeffrey through the process of his machine learning model from source control, building, packaging, and finally, to deploying. He also gives his recommendations for those who want to go even further with data science after listening to this week’s episode.

Topics of Discussion:

[:52] About today’s guest, Damian Brady.

[1:06] Damian introduces himself and explains his role at Microsoft.

[1:46] Which group Damian is presently on at Microsoft.

[4:14] With the Azure DevOps release, what’s the big change in the area of data science? What is going to be different for people building or running models?

[6:47] For data science projects what does the source control look like?

[8:49] For the Microsoft ML, is there a particular format that the data is stored in, in source control?

[9:09] If the data is large and needs to be versioned, what are the current methods people are using?

[11:06] A word from Azure DevOps sponsor: Clear Measure.

[11:39] Some of the interesting architectures Damian has put together for machine learning.

[16:10] Damian walks Jeffrey through his machine learning model from source control to building, to packaging up the release, to deploying.

[19:20] For this type of model, where would be the physical environment where it’s measuring information?

[20:24] Damian talks firewall rules, permissions, and security.

[23:16] The advantages of using Azure’s IoT Hub.

[24:46] Damian talks about the new open source features that were added with the release.

[28:20] Does Damian still encounter customers who say they don’t want to use Microsoft products because they don’t realize they’re open source?

[29:36] Is it true that VS Code is the most popular editor?

[31:03] One of the huge advantages of using open source.

[31:53] Damian talks build agents.

[33:33] About the new Windows-hosted container build agent.

[35:50] Damian’s recommendation for listeners who want to go further with data science after listening to this week’s podcast!

Mentioned in this Episode:

Azure DevOps

Azure Pipelines

Octopus Deploy

Clear Measure (Sponsor)

Buck Hodges on the introduction to Azure DevOps Services - Episode 001

Donovan Brown on How to Use Azure DevOps Services - Episode 002
Source control in Azure DevOps

Ubuntu

Machine Learning (ML)

Amazon Web Services (AWS)

Azure Cognitive Services

CustomVision.ai

Raspberry Pi
Azure Data Center

.NET Core

Python

GitHub

Azure IoT Hub

ADP Summit
VS Code

Docker Compose

Subversion

Chocolatey

Want to Learn More?

Visit AzureDevOps.Show for show notes and additional episodes.

Follow Up with Our Guest:

Damian Brady’s LinkedIn

Episoder(371)

Ted Neward: Managing A Software Engineering Department  - Episode 299

Ted Neward: Managing A Software Engineering Department - Episode 299

Ted Neward is sometimes referred to as “The Dude of Software,” owing to both his remarkable (some say frightening) resemblance to the Jeff Bridges character from “The Big Lebowski,” and his ordination as a Dudeist Minister of the Church of the Latter-Day Dude, but he’s also been called the ”Dr. Gregory House of Software,” owing to his tendency to pull no punches when talking about software and how to deliver it successfully. He’s comfortable answering to either title, as well as a few others. He’s familiar with more programming languages than most people knew existed and hasn’t found one yet that he couldn’t turn into a “mission-critical” application when asked.   Topics of Discussion: [4:36] Ted talks about building a tribe and developing a community. [6:48] Leveraging the “who you know” network. [7:21] Tips for keeping track of your network. [9:44] Effective software team management. [13:10] The importance of shifting perspective from individual success to team success. [16:16] The component of compassion in management. [17:53] Managers should actually want to be managers. [18:43] Retaining employees and realizing that management skills need to be recognized and developed. [27:02] The tipping point of needing to hire a full-fledged IT department. [32:34] Advice for managers on the people side. [34:08] Team success metrics, weekly one-on-ones, and building psychological safety. [38:32] Importance of team happiness and direct communication with executives for successful software development. [43:52] Developing the skills of leadership. [44:39] Remembering that not all management is evil.   Mentioned in this Episode: Clear Measure Way Architect Forum Software Engineer Forum Programming with Palermo — New Video Podcast! Email us at programming@palermo.net. Clear Measure, Inc. (Sponsor) .NET DevOps for Azure: A Developer’s Guide to DevOps Architecture the Right Way, by Jeffrey Palermo — Available on Amazon! Jeffrey Palermo’s Twitter — Follow to stay informed about future events! C# In a Nutshell ted.neward@gmail.com Ted Neward LinkedIn Neward Associates   Want to Learn More? Visit AzureDevOps.Show for show notes and additional episodes.

27 Mai 202447min

Dan Garfield: GitOps with Kubernetes - Episode 298

Dan Garfield: GitOps with Kubernetes - Episode 298

Dan Garfield is the Co-founder of Codefresh, a CI/CD platform powered by GitOps and Argo now acquired by Octopus Deploy. As the VP Open Source and Argo Maintainer, he works primarily on Argo CD and Argo Rollouts. He helped create the GitOps Working Group and Open GitOps Principles. He helped create the most popular GitOps certification with Argo CD and writes consistently about best practices for GitOps involving Security, Development processes, and scaling.   Topics of Discussion: [2:37] Dan Garfield’s career journey and his interest in technology from a young age. [4:17] The inspiration behind creating Codefresh. [7:57] Going all in on Kubernetes. [9:55] Meeting Paul, the CEO of Octopus. [10:37] We’re still in the early days of Kubernetes. [12:27] What’s the default choice for deploying to Kubernetes? [15:08] The importance of unified software delivery. [16:50] Linux native crowd adopted containers first, while .NET developers were slow to adopt due to compatibility issues. [22:53] What does Argo CD do? [25:04] GitOps Principles. [29:28] Managing microservices in a dynamic infrastructure. [32:29] Environment management, promotion workflows, and traceability. [34:30] Where exactly the balance between Argo and CodeFresh fits in. [35:09] GitOps Certification.   Mentioned in this Episode: Clear Measure Way Architect Forum Software Engineer Forum Programming with Palermo — New Video Podcast! Email us at programming@palermo.net. Clear Measure, Inc. (Sponsor) .NET DevOps for Azure: A Developer’s Guide to DevOps Architecture the Right Way, by Jeffrey Palermo — Available on Amazon! Jeffrey Palermo’s Twitter — Follow to stay informed about future events! Dan Garfield LinkedIn What is GitOps? Learning Codefresh GitOps Certification   Want to Learn More? Visit AzureDevOps.Show for show notes and additional episodes.

20 Mai 202441min

Richard Campbell: The Future of Software - Episode 297

Richard Campbell: The Future of Software - Episode 297

Richard Campbell wrote his first line of code in 1977. His career has spanned the computing industry on both the hardware and software sides, development, and operations. He was a co-founder of Strangeloop Networks, acquired by Radware in 2013, and was on the board of directors of Telerik, which was acquired by Progress Software in 2014. Today, he is a consultant and advisor to a number of successful technology firms and is the founder and chairman of Humanitarian Toolbox (www.htbox.org), a public charity that builds open-source software for disaster relief. Richard also hosts three podcasts: .NET Rocks! (www.dotnetrocks.com) for .NET developers, RunAs Radio (www.runasradio.com) for IT Professionals, and Windows Weekly (https://twit.tv/shows/windows-weekly).   Topics of Discussion: [2:24] Richard’s podcasting career over 20 years and his advice for new podcasters. [6:30] The common topics that Richard talks about. [11:32] Adaptive cruise control and limitations of current AI. [13:34] Potential for autonomous trucks and freight trains. [16:12] Improving software user experience with machine learning. [17:32] How AI may change (and not change) 10 years from now. [19:32] How the voice interface has gotten better. [22:21] The impact of automation on software development jobs. [28:19] The appropriate uses of low-code platforms. [33:29] Habits vs. wisdom. [37:25] The future of augmented reality. [39:15] Importance of experimenting with different tools. [42:43] How augmented reality may disrupt smartphones. [43:49] Jamming out on your tools, much like a musician experimenting. Mentioned in this Episode: Clear Measure Way Architect Forum Software Engineer Forum Programming with Palermo — New Video Podcast! Email us at programming@palermo.net. Clear Measure, Inc. (Sponsor) .NET DevOps for Azure: A Developer’s Guide to DevOps Architecture the Right Way, by Jeffrey Palermo — Available on Amazon! Jeffrey Palermo’s Twitter — Follow to stay informed about future events! “Richard Campbell on the History of .NET - Episode 133”   Want to Learn More? Visit AzureDevOps.Show for show notes and additional episodes.

13 Mai 202444min

Philip Japikse: Migrating from .NET Framework to .NET 8 - Episode 296

Philip Japikse: Migrating from .NET Framework to .NET 8 - Episode 296

An international speaker, Microsoft MVP, ASPInsider, MCSD, PSM II, PSD, and PST, and a passionate member of the developer community, Phil has been working with .NET since the first betas, developing software for over 35 years, and heavily involved in the agile community since 2005 as well as a Professional Scrum Trainer. Phil has taken over the best-selling Pro C# books (Apress Publishing), including Pro C# 10, is the President of the Cincinnati .NET User’s Group (Cinnug.org), and the Cincinnati Software Architect Group, co-hosted the Hallway Conversations podcast (Hallwayconversations.com), founded and runs the CincyDeliver conference (Cincydeliver.org), and volunteers for the National Ski Patrol. During the day, Phil works as the CTO for Pintas & Mullins. Phil always enjoys learning new tech and is always striving to improve his craft.   Topics of Discussion: [3:47] Philip’s career journey and why he’s still hands-on coding. [5:37] Sometimes it’s not a technical problem, but a process or human interaction problem. [6:37] Philip’s love of mentoring. [8:18] The importance of collaboration. [9:53] Challenges in migrating applications from .NET Framework to .NET Core. [12:55] The importance of staying current. [14:48] Modernizing legacy web applications using .NET Core. [19:22] Rebuilding an old app using new technology, with challenges and lessons learned. [24:22] Gradually introducing a new screen using feature flags is better than a "big bang" rewrite. [26:01] Continuous deployment helps to roll out new features gradually to limited users. [27:53] Differences between the .NET framework and .NET Core apps, including configuration settings to environmental awareness. [34:59] Philip’s favorite resources to dig into, including his book. [41:20] The power of collaborative learning.   Mentioned in this Episode: Clear Measure Way Architect Forum Software Engineer Forum Programming with Palermo — New Video Podcast! Email us at programming@palermo.net. Clear Measure, Inc. (Sponsor) .NET DevOps for Azure: A Developer’s Guide to DevOps Architecture the Right Way, by Jeffrey Palermo — Available on Amazon! Jeffrey Palermo’s Twitter — Follow to stay informed about future events! “Philip Japikse: Professional C# in .NET - Episode 230”   Want to Learn More? Visit AzureDevOps.Show for show notes and additional episodes.

6 Mai 202443min

Brady Gaster: .NET Cloud Native - Episode 295

Brady Gaster: .NET Cloud Native - Episode 295

Brady Gaster is a Principal Program Manager on the .NET and Visual Studio team at Microsoft where he works on Orleans, SignalR, microservices, APIs, and integration with Azure service teams in hopes of making it exciting for developers who work on .NET apps to party in the cloud!   Topics of Discussion: [2:49] Brady’s career highlights and how throwing parties prepared him for Microsoft. [4:07] History of Microsoft’s publishing tools and their evolution towards cloud-native development. [7:37] Using Azure Container Apps for containerization and publishing to Kubernetes. [13:42] Using Aspire for containerized applications in Azure, including toolchain and orchestration. [17:36] Simplifying software development with automation. [23:27] Azure subscriptions and provisioning for developers. [25:38] AZD infra synth. [26:15] Using Azure DevOps and Azure Development Environments for named environments in .NET development. [30:39] The system of record for the names of the environments. [37:13] What we can look forward to with the next release. [38:37] What should we know about Microsoft Learn so far?   Mentioned in this Episode: Clear Measure Way Architect Forum Software Engineer Forum Programming with Palermo — New Video Podcast! Email us at programming@palermo.net. Clear Measure, Inc. (Sponsor) .NET DevOps for Azure: A Developer’s Guide to DevOps Architecture the Right Way, by Jeffrey Palermo — Available on Amazon! Jeffrey Palermo’s Twitter — Follow to stay informed about future events! “Brady Gaster: Orleans — Episode 221” NET Aspire Preview 4 .NET Aspire Documentation Brady Gaster   Want to Learn More? Visit AzureDevOps.Show for show notes and additional episodes.

29 Apr 202440min

Raziel Tabib: GitOps - Episode 294

Raziel Tabib: GitOps - Episode 294

Raziel is the Senior Vice President of Codefresh at Octopus Deploy. He is an entrepreneur, technology enthusiast, and software developer at heart. He is the Founder of Codefresh and is passionate about accelerating the way software is disrupting our day-to-day life by simplifying the way we deploy applications.   Topics of Discussion: [2:23] When Raziel first got interested in making a difference in the industry. [3:05] The role of the software developer has evolved over time. [7:11] What is GitOps? [14:46] Overlap with the concept of infrastructure as code. [14:57] Simplifying software deployment using GitOps. [20:44] Why it’s an exciting time to be in software development. [22:55] What can we do with Codefresh? [25:24] Does Codefresh work with other infrastructure types? [26:29] Storing and managing application configuration and infrastructure code in separate Git repositories. [29:10] What are the most common reasons this infrastructure repository would have a commit pushed to it? [35:27] Codefresh joining Octopus Deploy.   Mentioned in this Episode: Clear Measure Way Architect Forum Software Engineer Forum Programming with Palermo — New Video Podcast! Email us at programming@palermo.net. Clear Measure, Inc. (Sponsor) .NET DevOps for Azure: A Developer’s Guide to DevOps Architecture the Right Way, by Jeffrey Palermo — Available on Amazon! Jeffrey Palermo’s Twitter — Follow to stay informed about future events! Codefresh OpenGitOps   Want to Learn More? Visit AzureDevOps.Show for show notes and additional episodes.

22 Apr 202441min

Glenn Condron: .NET Web Development - Episode 293

Glenn Condron: .NET Web Development - Episode 293

Glenn is a Principal Product Manager for the App Platform team within the Developer Division at Microsoft, focusing on .NET. Before joining Microsoft, Glenn was a developer in Australia where he worked on software for various government departments.   Topics of Discussion: [2:47] Glenn’s career path. [6:33] The old .NET vs the new .NET. [8:09] .NET was initially Windows-only but is now being rebuilt as open-source, cross-platform software. [9:40] The evolution of .NET. [9:53] .NET core. [14:04] New features and ideas presented at .NET Conf. [16:26] Aspire. [18:58] Every piece of an Aspire solution uses open Telemetry as a standard. [19:26] Redis.  [27:15] Aspire knows all the “what’ and “how” to deploy to the cloud, without explicit cloud knowledge. [32:36] The intent of AZD. [36:57] Handling the components of Aspire. [40:21] How to add custom resources to Aspire. [41:00] Opinionated vs non-opinionated development in the .NET ecosystem.   Mentioned in this Episode: Clear Measure Way Architect Forum Software Engineer Forum Programming with Palermo — New Video Podcast! Email us at programming@palermo.net. Clear Measure, Inc. (Sponsor) .NET DevOps for Azure: A Developer’s Guide to DevOps Architecture the Right Way, by Jeffrey Palermo — Available on Amazon! Jeffrey Palermo’s Twitter — Follow to stay informed about future events! Glenn Condron on New Capabilities on .NET - Ep 58 Glenn C GitHub DevBlogs Glenn C Building Cloud Native Apps with .NET 8 Introducing .NET Aspire   Want to Learn More? Visit AzureDevOps.Show for show notes and additional episodes.

15 Apr 202445min

Richard Hundhausen: Product Ownership - Episode 292

Richard Hundhausen: Product Ownership - Episode 292

Richard Hundhausen helps software organizations and teams deliver better products by understanding and leveraging Azure DevOps and Scrum. He is a Professional Scrum Trainer, Professional Scrum Developer, author of Professional Scrum with Azure DevOps (MS Press), and co-creator of the Nexus Scaled Scrum framework. As a software developer and consultant with over 30 years of experience, he understands that software is built and delivered by people and not by processes or tools.   Topics of Discussion: [3:03] Is it really that easy to teach developers? [3:34] Scrum implementation and best practices for developers and managers. [5:11] What is a Scrum trainer and developer? [6:40] Reminding teams to talk to each other and deliver value earlier. [6:47] Remembering not just the nouns, but the verbs: improve, collaborate, share, love the values, commit, have courage, be open, have focus, and be respectful. [8:39] The importance of having the right teams. [12:04] Improving software development efficiency through cross-functional teams. [13:47] The importance of being a self-managing team. [15:04] When we outsource everything to HR to find a good culture, that can perpetuate the “it’s someone else’s job” mentality. [15:24] Bigger companies vs. smaller companies. [17:44] Giving creatives the space to create. [21:09] HDD (Hypothesis-driven development) can help us learn early and adapt. [29:27] The importance of focusing on outcomes and impacts, rather than just measuring resources, activities, and outputs. [31:08] Outcomes and impacts are where we should be focused. [32:40] One percent of product owners using Scrum as intended? [33:27] Even if you don’t have a product owner, have someone who orders the work.   Mentioned in this Episode: Clear Measure Way Architect Forum Software Engineer Forum Programming with Palermo — New Video Podcast! Email us at programming@palermo.net. Clear Measure, Inc. (Sponsor) .NET DevOps for Azure: A Developer’s Guide to DevOps Architecture the Right Way, by Jeffrey Palermo — Available on Amazon! Jeffrey Palermo’s Twitter — Follow to stay informed about future events! Accentient Upgrade Your Team Daniel Pink Practicing Hypothesis-Driven Development in Azure DevOps “Richard Hundhausen on Professional Scrum — Ep 100”   Want to Learn More? Visit AzureDevOps.Show for show notes and additional episodes.

8 Apr 202440min

Populært innen Politikk og nyheter

giver-og-gjengen-vg
aftenpodden
forklart
aftenpodden-usa
stopp-verden
popradet
fotballpodden-2
dine-penger-pengeradet
det-store-bildet
nokon-ma-ga
bt-dokumentar-2
frokostshowet-pa-p5
rss-dannet-uten-piano
aftenbla-bla
rss-ness
e24-podden
rss-penger-polser-og-politikk
rss-borsmorgen-okonominyhetene
rss-gukild-johaug
rss-garne-damer