Damian Brady on DevOps for Data Science and Machine Learning - Episode 008

Damian Brady on DevOps for Data Science and Machine Learning - Episode 008

This week, your host, Jeffrey Palermo, interviews Damian Brady. Damian is a Senior Cloud DevOps Developer Advocate at Microsoft, helping customers implement DevOps methods on the Microsoft platform. He’s been with Microsoft for just over a year now and formerly served as a developer for Octopus Deploy.

In this episode, Damian and Jeffrey talk all things data science and machine learning. Damian answers key questions such as: what has been the biggest change in the area of data science since the Azure DevOps release? What does source control look like for data science projects in DevOps? And more. He also explains some of the interesting architectures he has put together for machine learning and walks Jeffrey through the process of his machine learning model from source control, building, packaging, and finally, to deploying. He also gives his recommendations for those who want to go even further with data science after listening to this week’s episode.

Topics of Discussion:

[:52] About today’s guest, Damian Brady.

[1:06] Damian introduces himself and explains his role at Microsoft.

[1:46] Which group Damian is presently on at Microsoft.

[4:14] With the Azure DevOps release, what’s the big change in the area of data science? What is going to be different for people building or running models?

[6:47] For data science projects what does the source control look like?

[8:49] For the Microsoft ML, is there a particular format that the data is stored in, in source control?

[9:09] If the data is large and needs to be versioned, what are the current methods people are using?

[11:06] A word from Azure DevOps sponsor: Clear Measure.

[11:39] Some of the interesting architectures Damian has put together for machine learning.

[16:10] Damian walks Jeffrey through his machine learning model from source control to building, to packaging up the release, to deploying.

[19:20] For this type of model, where would be the physical environment where it’s measuring information?

[20:24] Damian talks firewall rules, permissions, and security.

[23:16] The advantages of using Azure’s IoT Hub.

[24:46] Damian talks about the new open source features that were added with the release.

[28:20] Does Damian still encounter customers who say they don’t want to use Microsoft products because they don’t realize they’re open source?

[29:36] Is it true that VS Code is the most popular editor?

[31:03] One of the huge advantages of using open source.

[31:53] Damian talks build agents.

[33:33] About the new Windows-hosted container build agent.

[35:50] Damian’s recommendation for listeners who want to go further with data science after listening to this week’s podcast!

Mentioned in this Episode:

Azure DevOps

Azure Pipelines

Octopus Deploy

Clear Measure (Sponsor)

Buck Hodges on the introduction to Azure DevOps Services - Episode 001

Donovan Brown on How to Use Azure DevOps Services - Episode 002
Source control in Azure DevOps

Ubuntu

Machine Learning (ML)

Amazon Web Services (AWS)

Azure Cognitive Services

CustomVision.ai

Raspberry Pi
Azure Data Center

.NET Core

Python

GitHub

Azure IoT Hub

ADP Summit
VS Code

Docker Compose

Subversion

Chocolatey

Want to Learn More?

Visit AzureDevOps.Show for show notes and additional episodes.

Follow Up with Our Guest:

Damian Brady’s LinkedIn

Avsnitt(366)

Martin Hinshelwood: Migration Azure DevOps Server to the Cloud - Episode 302

Martin Hinshelwood: Migration Azure DevOps Server to the Cloud - Episode 302

Martin is a passionate agile leader with a track record of inspiring, encouraging, and igniting momentum. Featured speaker, author, and industry thought leader, Martin has a strong track record of helping organizations build a vision and execute evolutionary and revolutionary change. His deep technical knowledge, business insight, and experience drive impactful change for organizations.   Technologist turned agilist, Martin successfully helps organizations decentralize, democratize, and evolve their way of work to build extraordinary processes and drive organizational change through culture, technology, and teamwork. He’s been recognized by Microsoft as a Microsoft MVP, and he is the maintainer of the open-source Azure DevOps Migration Tools.   Topics of Discussion: [2:59] Martin’s career journey. [4:51] What Martin has learned as an MVP for 15 years. [5:59] If you’re not good at something, do it more. [6:52] Azure DevOps Migration tools. [10:11] Martin adopted platform engineering to streamline processes and reduce costs. [14:31] What you should know before using Martin’s tools. [21:55] It’s not either/or between Microsoft migration tools and Azure DevOps migration tools. [27:00] What made TFS unique. [20:03] TFGit. [30:02] The process used in your source and target, and what challenges might people expect? [31:44] Limitations of migrating data from old TFS to new Azure DevOps using Microsoft tools.   Mentioned in this Episode: Clear Measure Way Architect Forum Software Engineer Forum Programming with Palermo — New Video Podcast! Email us at programming@palermo.net. Clear Measure, Inc. (Sponsor) .NET DevOps for Azure: A Developer’s Guide to DevOps Architecture the Right Way, by Jeffrey Palermo — Available on Amazon! Jeffrey Palermo’s Twitter — Follow to stay informed about future events! GitHub Migration Tools for Azure DevOps Martin — Scrum Naked Agility Agile Actually Podcast   Want to Learn More? Visit AzureDevOps.Show for show notes and additional episodes.

17 Juni 202447min

Scott Forsyth: Gen AI or Generative Artificial Intelligence - Episode 301

Scott Forsyth: Gen AI or Generative Artificial Intelligence - Episode 301

Scott has spent over 25 years in the IT field, working in disciplines such as systems architecture, software development, team growth, and entrepreneurship. He was a Microsoft MVP for 12 years in ASP.NET and IIS. He’s co-authored two books (IIS 7 and IIS 8 Professional), is a Pluralsight author, and has spoken at various conferences, code camps, and user groups. He’s now shifted into the AI space, building AI solutions and supporting others in their AI journey. He’s also co-founding a new startup, so he’s spending much of his time as an Entrepreneur.   Topics of Discussion: [2:15] Scott’s career path and what steered him into AI. [5:18] AI development and Scott’s journey learning about generative AI. [7:15] AI use cases, including chatbots, text-to-speech, and speech-to-text. [13:14] Flowise AI. [15:48] RAG, AKA retrieval augmented generation. [17:32] Code interpreter. [18:10] How do we know that AI is terrible at math, and what are the other things it’s not good at? [26:13] Using small language models for natural language processing. [37:13] Kitchen Co-Pilot app.   Mentioned in this Episode: Clear Measure Way Architect Forum Software Engineer Forum Programming with Palermo — New Video Podcast! Email us at programming@palermo.net. Clear Measure, Inc. (Sponsor) .NET DevOps for Azure: A Developer’s Guide to DevOps Architecture the Right Way, by Jeffrey Palermo — Available on Amazon! Jeffrey Palermo’s Twitter — Follow to stay informed about future events! Flowise Retrieval-Augmented Generation (RAG) Attention is All You Need kitchen copilot zapier Make Perplexity Claude Groq The Groq LPU Inference Engine @scottforsyth Scott on LinkedIn   Want to Learn More? Visit AzureDevOps.Show for show notes and additional episodes.

10 Juni 202443min

Jim Leonardo: Leading Software Teams - Episode 300

Jim Leonardo: Leading Software Teams - Episode 300

Jim has been building solutions for clients in the cloud on Microsoft Azure since 2012 and building solutions in general for 20 years or more. Now, he heads up information technology for biBerk Insurance, overseeing both software development and IT operations. Most of Jim’s experience is in consulting or enterprise with a few forays into product development.   Following the path of least resistance, Jim ended up working primarily with Microsoft tools. The tool you know is the usually best tool to use, so the Microsoft path offers less and less resistance for Jim as time goes on.   On the side, Jim is working on jimsrules.com to share experience and shaky opinions about teamwork and leadership in software development.   Topics of Discussion: [3:33] There is a shortage of software leaders out there. [4:22] Jim’s career progression. [5:26] Pulling back from leadership roles. [6:54] Recognizing the need to be hands-on and fill vacuums in leadership roles. [8:35] Embracing T- or V-shaped development. [11:34] If it isn’t tested, it is broken. [16:47] Know who your customer is and what your product is. [18:10] The Innovator’s Dilemma and the importance of asking why things are the way they are. [21:21] No matter how much experience you have, there is something you can learn from someone with less experience. [23:29] What we can learn from teen YouTubers. [24:25] The 10 specific rules; Rule 77 — Minimum Viable Products (MVP) are the start, not the end of a program. [26:26] Rule #7 about microservices. [27:52] Applying Conway’s Law. [33:18] Rule 37 — Automated tests are my pillow. Rule 59 — A leader’s job is to support the team. Most org charts are upside-down. Rule 68 — No one is a zero. They either add to the team or take away from it. The question is whether those who are taking away are growing towards a positive contribution. Rule 74 — Keeping standards high ultimately creates a better work environment. Rule 75 — When you prepare to teach something, you usually learn more than your potential students.   Mentioned in this Episode: Clear Measure Way Architect Forum Software Engineer Forum Programming with Palermo — New Video Podcast! Email us at programming@palermo.net. Clear Measure, Inc. (Sponsor) .NET DevOps for Azure: A Developer’s Guide to DevOps Architecture the Right Way, by Jeffrey Palermo — Available on Amazon! Jeffrey Palermo’s Twitter — Follow to stay informed about future events! Jim Leonardo LinkedIn Jim’s Rules Jim’s Rules: The List The Innovator’s Dilemma: The Revolutionary Book That Will Change the Way You Do Business, by Clayton M. Christensen    Want to Learn More? Visit AzureDevOps.Show for show notes and additional episodes.

3 Juni 202437min

Ted Neward: Managing A Software Engineering Department  - Episode 299

Ted Neward: Managing A Software Engineering Department - Episode 299

Ted Neward is sometimes referred to as “The Dude of Software,” owing to both his remarkable (some say frightening) resemblance to the Jeff Bridges character from “The Big Lebowski,” and his ordination as a Dudeist Minister of the Church of the Latter-Day Dude, but he’s also been called the ”Dr. Gregory House of Software,” owing to his tendency to pull no punches when talking about software and how to deliver it successfully. He’s comfortable answering to either title, as well as a few others. He’s familiar with more programming languages than most people knew existed and hasn’t found one yet that he couldn’t turn into a “mission-critical” application when asked.   Topics of Discussion: [4:36] Ted talks about building a tribe and developing a community. [6:48] Leveraging the “who you know” network. [7:21] Tips for keeping track of your network. [9:44] Effective software team management. [13:10] The importance of shifting perspective from individual success to team success. [16:16] The component of compassion in management. [17:53] Managers should actually want to be managers. [18:43] Retaining employees and realizing that management skills need to be recognized and developed. [27:02] The tipping point of needing to hire a full-fledged IT department. [32:34] Advice for managers on the people side. [34:08] Team success metrics, weekly one-on-ones, and building psychological safety. [38:32] Importance of team happiness and direct communication with executives for successful software development. [43:52] Developing the skills of leadership. [44:39] Remembering that not all management is evil.   Mentioned in this Episode: Clear Measure Way Architect Forum Software Engineer Forum Programming with Palermo — New Video Podcast! Email us at programming@palermo.net. Clear Measure, Inc. (Sponsor) .NET DevOps for Azure: A Developer’s Guide to DevOps Architecture the Right Way, by Jeffrey Palermo — Available on Amazon! Jeffrey Palermo’s Twitter — Follow to stay informed about future events! C# In a Nutshell ted.neward@gmail.com Ted Neward LinkedIn Neward Associates   Want to Learn More? Visit AzureDevOps.Show for show notes and additional episodes.

27 Maj 202447min

Dan Garfield: GitOps with Kubernetes - Episode 298

Dan Garfield: GitOps with Kubernetes - Episode 298

Dan Garfield is the Co-founder of Codefresh, a CI/CD platform powered by GitOps and Argo now acquired by Octopus Deploy. As the VP Open Source and Argo Maintainer, he works primarily on Argo CD and Argo Rollouts. He helped create the GitOps Working Group and Open GitOps Principles. He helped create the most popular GitOps certification with Argo CD and writes consistently about best practices for GitOps involving Security, Development processes, and scaling.   Topics of Discussion: [2:37] Dan Garfield’s career journey and his interest in technology from a young age. [4:17] The inspiration behind creating Codefresh. [7:57] Going all in on Kubernetes. [9:55] Meeting Paul, the CEO of Octopus. [10:37] We’re still in the early days of Kubernetes. [12:27] What’s the default choice for deploying to Kubernetes? [15:08] The importance of unified software delivery. [16:50] Linux native crowd adopted containers first, while .NET developers were slow to adopt due to compatibility issues. [22:53] What does Argo CD do? [25:04] GitOps Principles. [29:28] Managing microservices in a dynamic infrastructure. [32:29] Environment management, promotion workflows, and traceability. [34:30] Where exactly the balance between Argo and CodeFresh fits in. [35:09] GitOps Certification.   Mentioned in this Episode: Clear Measure Way Architect Forum Software Engineer Forum Programming with Palermo — New Video Podcast! Email us at programming@palermo.net. Clear Measure, Inc. (Sponsor) .NET DevOps for Azure: A Developer’s Guide to DevOps Architecture the Right Way, by Jeffrey Palermo — Available on Amazon! Jeffrey Palermo’s Twitter — Follow to stay informed about future events! Dan Garfield LinkedIn What is GitOps? Learning Codefresh GitOps Certification   Want to Learn More? Visit AzureDevOps.Show for show notes and additional episodes.

20 Maj 202441min

Richard Campbell: The Future of Software - Episode 297

Richard Campbell: The Future of Software - Episode 297

Richard Campbell wrote his first line of code in 1977. His career has spanned the computing industry on both the hardware and software sides, development, and operations. He was a co-founder of Strangeloop Networks, acquired by Radware in 2013, and was on the board of directors of Telerik, which was acquired by Progress Software in 2014. Today, he is a consultant and advisor to a number of successful technology firms and is the founder and chairman of Humanitarian Toolbox (www.htbox.org), a public charity that builds open-source software for disaster relief. Richard also hosts three podcasts: .NET Rocks! (www.dotnetrocks.com) for .NET developers, RunAs Radio (www.runasradio.com) for IT Professionals, and Windows Weekly (https://twit.tv/shows/windows-weekly).   Topics of Discussion: [2:24] Richard’s podcasting career over 20 years and his advice for new podcasters. [6:30] The common topics that Richard talks about. [11:32] Adaptive cruise control and limitations of current AI. [13:34] Potential for autonomous trucks and freight trains. [16:12] Improving software user experience with machine learning. [17:32] How AI may change (and not change) 10 years from now. [19:32] How the voice interface has gotten better. [22:21] The impact of automation on software development jobs. [28:19] The appropriate uses of low-code platforms. [33:29] Habits vs. wisdom. [37:25] The future of augmented reality. [39:15] Importance of experimenting with different tools. [42:43] How augmented reality may disrupt smartphones. [43:49] Jamming out on your tools, much like a musician experimenting. Mentioned in this Episode: Clear Measure Way Architect Forum Software Engineer Forum Programming with Palermo — New Video Podcast! Email us at programming@palermo.net. Clear Measure, Inc. (Sponsor) .NET DevOps for Azure: A Developer’s Guide to DevOps Architecture the Right Way, by Jeffrey Palermo — Available on Amazon! Jeffrey Palermo’s Twitter — Follow to stay informed about future events! “Richard Campbell on the History of .NET - Episode 133”   Want to Learn More? Visit AzureDevOps.Show for show notes and additional episodes.

13 Maj 202444min

Philip Japikse: Migrating from .NET Framework to .NET 8 - Episode 296

Philip Japikse: Migrating from .NET Framework to .NET 8 - Episode 296

An international speaker, Microsoft MVP, ASPInsider, MCSD, PSM II, PSD, and PST, and a passionate member of the developer community, Phil has been working with .NET since the first betas, developing software for over 35 years, and heavily involved in the agile community since 2005 as well as a Professional Scrum Trainer. Phil has taken over the best-selling Pro C# books (Apress Publishing), including Pro C# 10, is the President of the Cincinnati .NET User’s Group (Cinnug.org), and the Cincinnati Software Architect Group, co-hosted the Hallway Conversations podcast (Hallwayconversations.com), founded and runs the CincyDeliver conference (Cincydeliver.org), and volunteers for the National Ski Patrol. During the day, Phil works as the CTO for Pintas & Mullins. Phil always enjoys learning new tech and is always striving to improve his craft.   Topics of Discussion: [3:47] Philip’s career journey and why he’s still hands-on coding. [5:37] Sometimes it’s not a technical problem, but a process or human interaction problem. [6:37] Philip’s love of mentoring. [8:18] The importance of collaboration. [9:53] Challenges in migrating applications from .NET Framework to .NET Core. [12:55] The importance of staying current. [14:48] Modernizing legacy web applications using .NET Core. [19:22] Rebuilding an old app using new technology, with challenges and lessons learned. [24:22] Gradually introducing a new screen using feature flags is better than a "big bang" rewrite. [26:01] Continuous deployment helps to roll out new features gradually to limited users. [27:53] Differences between the .NET framework and .NET Core apps, including configuration settings to environmental awareness. [34:59] Philip’s favorite resources to dig into, including his book. [41:20] The power of collaborative learning.   Mentioned in this Episode: Clear Measure Way Architect Forum Software Engineer Forum Programming with Palermo — New Video Podcast! Email us at programming@palermo.net. Clear Measure, Inc. (Sponsor) .NET DevOps for Azure: A Developer’s Guide to DevOps Architecture the Right Way, by Jeffrey Palermo — Available on Amazon! Jeffrey Palermo’s Twitter — Follow to stay informed about future events! “Philip Japikse: Professional C# in .NET - Episode 230”   Want to Learn More? Visit AzureDevOps.Show for show notes and additional episodes.

6 Maj 202443min

Brady Gaster: .NET Cloud Native - Episode 295

Brady Gaster: .NET Cloud Native - Episode 295

Brady Gaster is a Principal Program Manager on the .NET and Visual Studio team at Microsoft where he works on Orleans, SignalR, microservices, APIs, and integration with Azure service teams in hopes of making it exciting for developers who work on .NET apps to party in the cloud!   Topics of Discussion: [2:49] Brady’s career highlights and how throwing parties prepared him for Microsoft. [4:07] History of Microsoft’s publishing tools and their evolution towards cloud-native development. [7:37] Using Azure Container Apps for containerization and publishing to Kubernetes. [13:42] Using Aspire for containerized applications in Azure, including toolchain and orchestration. [17:36] Simplifying software development with automation. [23:27] Azure subscriptions and provisioning for developers. [25:38] AZD infra synth. [26:15] Using Azure DevOps and Azure Development Environments for named environments in .NET development. [30:39] The system of record for the names of the environments. [37:13] What we can look forward to with the next release. [38:37] What should we know about Microsoft Learn so far?   Mentioned in this Episode: Clear Measure Way Architect Forum Software Engineer Forum Programming with Palermo — New Video Podcast! Email us at programming@palermo.net. Clear Measure, Inc. (Sponsor) .NET DevOps for Azure: A Developer’s Guide to DevOps Architecture the Right Way, by Jeffrey Palermo — Available on Amazon! Jeffrey Palermo’s Twitter — Follow to stay informed about future events! “Brady Gaster: Orleans — Episode 221” NET Aspire Preview 4 .NET Aspire Documentation Brady Gaster   Want to Learn More? Visit AzureDevOps.Show for show notes and additional episodes.

29 Apr 202440min

Populärt inom Politik & nyheter

svenska-fall
p3-krim
rss-krimstad
rss-viva-fotboll
flashback-forever
fordomspodden
rss-sanning-konsekvens
rss-vad-fan-hande
aftonbladet-daily
olyckan-inifran
dagens-eko
rss-frandfors-horna
motiv
svd-dokumentara-berattelser-2
rss-krimreportrarna
krimmagasinet
svd-nyhetsartiklar
blenda-2
spotlight
rss-svalan-krim