Damian Brady on DevOps for Data Science and Machine Learning - Episode 008

Damian Brady on DevOps for Data Science and Machine Learning - Episode 008

This week, your host, Jeffrey Palermo, interviews Damian Brady. Damian is a Senior Cloud DevOps Developer Advocate at Microsoft, helping customers implement DevOps methods on the Microsoft platform. He’s been with Microsoft for just over a year now and formerly served as a developer for Octopus Deploy.

In this episode, Damian and Jeffrey talk all things data science and machine learning. Damian answers key questions such as: what has been the biggest change in the area of data science since the Azure DevOps release? What does source control look like for data science projects in DevOps? And more. He also explains some of the interesting architectures he has put together for machine learning and walks Jeffrey through the process of his machine learning model from source control, building, packaging, and finally, to deploying. He also gives his recommendations for those who want to go even further with data science after listening to this week’s episode.

Topics of Discussion:

[:52] About today’s guest, Damian Brady.

[1:06] Damian introduces himself and explains his role at Microsoft.

[1:46] Which group Damian is presently on at Microsoft.

[4:14] With the Azure DevOps release, what’s the big change in the area of data science? What is going to be different for people building or running models?

[6:47] For data science projects what does the source control look like?

[8:49] For the Microsoft ML, is there a particular format that the data is stored in, in source control?

[9:09] If the data is large and needs to be versioned, what are the current methods people are using?

[11:06] A word from Azure DevOps sponsor: Clear Measure.

[11:39] Some of the interesting architectures Damian has put together for machine learning.

[16:10] Damian walks Jeffrey through his machine learning model from source control to building, to packaging up the release, to deploying.

[19:20] For this type of model, where would be the physical environment where it’s measuring information?

[20:24] Damian talks firewall rules, permissions, and security.

[23:16] The advantages of using Azure’s IoT Hub.

[24:46] Damian talks about the new open source features that were added with the release.

[28:20] Does Damian still encounter customers who say they don’t want to use Microsoft products because they don’t realize they’re open source?

[29:36] Is it true that VS Code is the most popular editor?

[31:03] One of the huge advantages of using open source.

[31:53] Damian talks build agents.

[33:33] About the new Windows-hosted container build agent.

[35:50] Damian’s recommendation for listeners who want to go further with data science after listening to this week’s podcast!

Mentioned in this Episode:

Azure DevOps

Azure Pipelines

Octopus Deploy

Clear Measure (Sponsor)

Buck Hodges on the introduction to Azure DevOps Services - Episode 001

Donovan Brown on How to Use Azure DevOps Services - Episode 002
Source control in Azure DevOps

Ubuntu

Machine Learning (ML)

Amazon Web Services (AWS)

Azure Cognitive Services

CustomVision.ai

Raspberry Pi
Azure Data Center

.NET Core

Python

GitHub

Azure IoT Hub

ADP Summit
VS Code

Docker Compose

Subversion

Chocolatey

Want to Learn More?

Visit AzureDevOps.Show for show notes and additional episodes.

Follow Up with Our Guest:

Damian Brady’s LinkedIn

Episoder(372)

Grant Fritchey: SQL Server Performance Tuning - Episode 236

Grant Fritchey: SQL Server Performance Tuning - Episode 236

A Microsoft Data Platform MVP, Grant Fritchey works for Red Gate Software as a Product Advocate. Grant has more than 30 years of experience in the industry as a DBA and developer. Grant is an active participant in the SQL Server Central discussion forums. He writes articles for SQL Server Central and Simple-Talk. He blogs regularly at scarydba.com. Grant is the author of several books including SQL Server Query Performance Tuning and SQL Server Execution Plans. Grant teaches classes on data management and databases around the world. He teaches in the smallest user group settings and at the largest events.   Topics of Discussion: [2:24] How did Grant get into the industry? [5:40 Are there any big shifts that more recent developers and all developers need to know about shifts in how databases have worked? [13:10] What should developers know about the ecosystem when you’ve taken a system and broken it up into multiple applications? [16:07] What has changed in Grant’s book, Query Performance Tuning? [20:34] Performance comes down to the code. It always comes down to the code. [23:58] What are some of the main tools that developers should have in their toolbox? [26:20] Why Grant recommends Extended Events and Query Store. [32:41] Grant gives us his sales pitch. [38:40] What does Grant think the future looks like?   Mentioned in this Episode: Clear Measure Way Architect Forum Software Engineer Forum Programming with Palermo — New Video Podcast! Email us programming@palermo.network Clear Measure, Inc. (Sponsor) .NET DevOps for Azure: A Developer’s Guide to DevOps Architecture the Right Way, by Jeffrey Palermo — Available on Amazon! Jeffrey Palermo’s Twitter — Follow to stay informed about future events! Architect Tips — Video podcast! Azure DevOps Query Performance Tuning ScaryDBA.com SQL   Want to Learn More? Visit AzureDevOps.Show for show notes and additional episodes.

13 Mar 202344min

Christoph Vollmer: Automated Testing Techniques - Episode 235

Christoph Vollmer: Automated Testing Techniques - Episode 235

Christoph Vollmer is an internationally experienced IT Manager with strong experience in software development and team leadership. He has worked for several years as a developer with multiple languages in several organizations and industries with different methodologies. He has had hands-on experience with a broad range of technologies. Successful team lead for cross-functional agile teams with a strong focus on delivering the right thing in the right way. I've mentored and managed team members on different levels. Christoph is passionate about Agile and Scrum as software development methodology because it bridges the gap between development teams and business needs. He has a focus on security starting at development and going all the way through to the end user and our daily lives. Christoph is also strong with automated testing on every level.   Topics of Discussion: [2:20] What got Christoph into software testing and how did he get into automated testing? [6:53] What is the testing pyramid in software? [10:46] What are the best automated testing tools for .NET? [13:51] What is Mutation testing and Stryker Mutator? [22:46] How does TDD intersect with a bug report? [28:48] What is full-system testing and how does Playwright fit in? [29:49] What is the page object pattern for UI testing? [32:47] How to know when specialized testing might be needed for your application? [34:48] Why Christoph thinks accessibility testing should be important to everyone.   Mentioned in this Episode: Clear Measure Way Architect Forum Software Engineer Forum Programming with Palermo — New Video Podcast! Email us programming@palermo.network Clear Measure, Inc. (Sponsor) .NET DevOps for Azure: A Developer’s Guide to DevOps Architecture the Right Way, by Jeffrey Palermo — Available on Amazon! Jeffrey Palermo’s Twitter — Follow to stay informed about future events! Architect Tips — Video podcast! Azure DevOps Testing pyramid Playwright Build quality checks Mutation testing — Stryker Mutator FluentAssertions   Want to Learn More? Visit AzureDevOps.Show for show notes and additional episodes.

6 Mar 202338min

Christian Clausen: When to Refactor - Episode 234

Christian Clausen: When to Refactor - Episode 234

Christian Clausen works as a Technical Agile Coach teaching teams how to properly refactor their code. Previously he worked as a software engineer on the Coccinelle semantic patching project, an automated refactoring tool. He has an MSc in computer science and five years of experience teaching software quality at a university level. He is the author of the book Five Lines of Code published by Manning. He was one of the Top Three rated speakers at GOTO Aarhus 2022. People were standing in line to get a signed copy of his book Five Lines of Code.   Topics of Discussion: [2:46] Christian talks about what got him into coding from a young age, and some of his favorite things about coding. He also discusses how the industry has changed since he first began his career. [6:19] Christian shares the reason behind the premise that every method should get down to no more than five lines of code. [9:07] What does “collaborate with the compiler” mean in Christian’s book? [13:38] The process behind changing code by addition, rather than modification. [22:16] Christian talks about defending the data. [26:49] Christian’s mental model of spaceship architecture. [30:04] What extra features does Christian’s book come with?   Mentioned in this Episode: Clear Measure Way Architect Forum Software Engineer Forum Programming with Palermo — New Video Podcast! Email us at programming@palermo.network Clear Measure, Inc. (Sponsor) .NET DevOps for Azure: A Developer’s Guide to DevOps Architecture the Right Way, by Jeffrey Palermo — Available on Amazon! Jeffrey Palermo’s Twitter — Follow to stay informed about future events! Architect Tips — Video podcast! Azure DevOps Five Lines of Code Christian on Twitter Christian on Medium   Want to Learn More? Visit AzureDevOps.Show for show notes and additional episodes.

27 Feb 202336min

Christian Wenz: ASP .NET Core Security - Episode 233

Christian Wenz: ASP .NET Core Security - Episode 233

Christian Wenz works as a consultant, trainer, and author with a focus on web technologies and is the author or co-author of over 100 computer books. He regularly contributes to various IT magazines and speaks at conferences around the globe. Christian holds a "Diplom" (the German equivalent of a master’s degree) in Computer Sciences, and one in Business Informatics. In his day job, he is one of the founders of the web agency Arrabiata Solutions (http://www.arrabiata.com/) with offices in Munich, Germany, and in London, UK. He also frequently works with development teams to make their applications better performing, more secure, and more reliable.   Topics of Discussion: [2:51] Has Christian really written over 100 computer books? Christian talks about the books and the high points of technology that he has worked in. [7:16] What is the OWASP (Open Web Application Security Project) Top 10 list? [10:33] You always have to be aware that something may go wrong, and have a security mindset. [12:05] Again and again, make sure that you understand the fundamentals of web app security, because eventually, you will make a mistake in your code. [12:30] What is insecure design? [13:43] Christian talks about the enumeration scheme CWE: common weakness enumeration, which basically assigns a number to each risk or attack. [17:00] How should people be logging into their web sessions now with .NET7? [18:31] The major mistake you can make these days is to write your own authentication mechanism. [23:57] What is Christian’s favorite mechanism today for securing HTTP web services? [31:05] What are some of the tools Christian always reaches for, and how do we differentiate between static auditing and dynamically auditing an application?   Mentioned in this Episode: Clear Measure Way Architect Forum Software Engineer Forum Programming with Palermo — New Video Podcast! Email us programming@palermo.network Clear Measure, Inc. (Sponsor) .NET DevOps for Azure: A Developer’s Guide to DevOps Architecture the Right Way, by Jeffrey Palermo — Available on Amazon! Jeffrey Palermo’s Twitter — Follow to stay informed about future events! Architect Tips — Video podcast! Azure DevOps Christian Microsoft Profile ASP.NET Core Security Christian’s Books on Amazon OWASP Identity Server Dependabot Security Code Scan Configuring Code Scanning for a Repository   Want to Learn More? Visit AzureDevOps.Show for show notes and additional episodes.

20 Feb 202339min

Lars Klint: Microsoft Azure State of the Art - Episode 232

Lars Klint: Microsoft Azure State of the Art - Episode 232

Lars is a Senior Developer Advocate with Pluralsight, author, trainer, Microsoft Azure MVP, community leader, aspiring YouTube host, and part-time classic car collector. He is heavily involved in the space of cloud computing services, especially Azure, and is a published author, solution architect, and writer for numerous publications. He has been a part of the software development community for the past 20 years and co-organizes the DDD Melbourne community conference, organizes developer events with Microsoft, and also runs a part-time car restoration business. He has spoken at numerous technical events around the world and is an expert in Australian Outback Internet.   Topics of Discussion: [4:24] Lars talks about his early start in programming and the IT industry and his path to his present-day career. [6:36] As a self-described “nerd that doesn’t mind talking to people,” Lars worked that characteristic into networking over his career. [8:17] Why did Lars decide to write a book? [9:40] Lars talks about his book, Microsoft Azure in Action. [9:57] What part of Azure should developers be using more than less? [13:00] What ideas have risen to the surface for general internal business application developers? [16:36] What’s the best way to store and manipulate data? [21:58] What are some of Lars’s favorite scenarios where you would reach for the queue? [23:57] How would Lars decipher his architectural decisions on whether to use App Service? [26:57] What is Lars’s thought process when creating service workers to read from that queue versus creating a second app that is installed into the app service plan? [30:34] Lars talks about the importance of Application Insights.   Mentioned in this Episode: Clear Measure Way Architect Forum Software Engineer Forum Programming with Palermo — New Video Podcast!  Email us programming@palermo.network Clear Measure, Inc. (Sponsor) .NET DevOps for Azure: A Developer’s Guide to DevOps Architecture the Right Way, by Jeffrey Palermo — Available on Amazon! Jeffrey Palermo’s Twitter — Follow to stay informed about future events! Architect Tips — Video podcast! Azure DevOps Microsoft Azure in Action Lars On YouTube   Want to Learn More? Visit AzureDevOps.Show for show notes and additional episodes.

13 Feb 202334min

Colin Bowern: Deployments and Ops using Octopus Deploy - Episode 231

Colin Bowern: Deployments and Ops using Octopus Deploy - Episode 231

Colin is the SVP of Product at Octopus Deploy. As a technical product leader, his career has spanned music, health, financial, and technology industries with companies like Microsoft, Johnson Controls, Brink’s, Orion Health, and officialCOMMUNITY. He is passionate about growing product people through his work with the Product Aotearoa community. You can learn more about him at ColinBowern.com.   Topics of Discussion: [2:23] How Colin got involved in Octopus Deploy. [5:43] What is the value proposition for Octopus Deploy? [11:30] Who is Octopus Deploy built for? [12:52] How do we categorize all the after-deploy activities? [14:46] How do we get happy deployments? [18:36] What are some of the themes or categories that have emerged in Runbooks that are universally applicable? [21:51] What has happened in the DevOps space since 2010 when the term “DevOps Engineer” was first used? [24:01] Colin talks about infrastructure as code in the cloud. [30:01] Colin talks about his view on the future of Windows Server and Windows Server Operating System. [36:28] What is the easiest way for someone to get started in Octopus?   Mentioned in this Episode: Clear Measure Way Architect Forum Software Engineer Forum Architect Tips — Video podcast! Azure DevOps Clear Measure (Sponsor) .NET DevOps for Azure: A Developer’s Guide to DevOps Architecture the Right Way, by Jeffrey Palermo — Available on Amazon! Jeffrey Palermo’s YouTube Jeffrey Palermo’s Twitter — Follow to stay informed about future events! Programming with Palermo - New Video Podcast! programming@palermo.network Colin Bowern on Twitter Colin Bowern Website Colin Bowern LinkedIn Colin Bowern Microsoft Octopus Deploy 30 Point Inspection Octopus Deploy Jumpstart Want to Learn More? Visit AzureDevOps.Show for show notes and additional episodes.

6 Feb 202338min

Philip Japikse: Professional C# in .NET  - Episode 230

Philip Japikse: Professional C# in .NET - Episode 230

An international speaker, Microsoft MVP, ASPInsider, MCSD, PSM II, PSD, and PST, and a passionate member of the developer community, Phil has been working with .NET since the first betas, developing software for over 35 years, and heavily involved in the agile community since 2005 as well as a Professional Scrum Trainer. Phil has taken over the best-selling Pro C# books (Apress Publishing), including "Pro C# 10", is the President of the Cincinnati .NET User’s Group (Cinnug.org), and the Cincinnati Software Architect Group, co-hosted the Hallway Conversations podcast (Hallwayconversations.com), founded and runs the CincyDeliver conference (Cincydeliver.org), and volunteers for the National Ski Patrol. During the day, Phil works as the CTO for Pintas & Mullins. Phil always enjoys learning new tech and is always striving to improve his craft.   Topics of Discussion: [2:22] What were the key points that steered Philip along his career and watershed moments? [6:42] The importance of having a contract in place for every job. [8:14] Philip talks about honing his craft and putting himself in rooms with people he admired. [11:01] What did the Library of Congress have to do with Philip’s book? [18:00] As the CTO of a private company, what does Philip think about the software executive role? [19:33] Don’t ask your employees to do anything they’re not willing to do for you. Trust your employees and let them grow. [24:11] The best leaders don’t have to be in management. [24:53] What is an NCO, non-commissioned officer? [27:15] Phil shares his view on object-oriented programming in the modern C#. [32:19] What is technical debt? [33:50] Another really nice feature built into Entity Framework core, or EF core, is the idea of concurrency checking. [37:57] When you refactor, you want the end product to be what you would have made it if you had been going from the beginning. [42:12] Philip talks about running the Cincy Deliver conference.   Mentioned in this Episode: Clear Measure Way Architect Forum Software Engineer Forum Architect Tips — Video podcast! Azure DevOps Clear Measure (Sponsor) .NET DevOps for Azure: A Developer’s Guide to DevOps Architecture the Right Way, by Jeffrey Palermo — Available on Amazon! Jeffrey Palermo’s YouTube Jeffrey Palermo’s Twitter — Follow to stay informed about future events! Programming with Palermo - New Video Podcast! programming@palermo.network Phil on Twitter Phil’s Blog Phil’s Sessions Philip on Microsoft  Philip on Scrum Philip on GitHub Philip’s Books   Want to Learn More? Visit AzureDevOps.Show for show notes and additional episodes.

30 Jan 202344min

Stephanie Herr: Database DevOps with Stephanie Herr - Episode 229

Stephanie Herr: Database DevOps with Stephanie Herr - Episode 229

Stephanie Herr is a Product Manager for Database DevOps at Redgate Software. She’s been an instrumental part of every Database DevOps product at Redgate for the past 13 years and has spoken at industry conferences such as DevOps World.   Topics of Discussion: [3:58] Stephanie talks about taking ideas from her previous working experience into Redgate. [4:29] What makes the database so different from application development? [6:23] What patterns work the best and which ones haven’t really panned out? [9:08] The state-based approach vs. migration approach. [13:30] How do you categorize all the different things that may need to be deployed or changed? [14:09] What is static data? [15:44] What is the latest in the Redgate products that everyone should know about? [21:41] Stephanie talks about the change report and the process behind caching best practices. [23:10] What is Sequel Fluff? [26:28] Stephanie talks about the integration with Sequel Monitor. [27:46] Are the Azure services completely covered? [30:35] Where does Stephanie see Database DevOps going? [32:33] Stephanie shares an exciting new announcement!   Mentioned in this Episode: Clear Measure Way Architect Forum Software Engineer Forum Architect Tips — Video podcast! Azure DevOps Clear Measure (Sponsor) .NET DevOps for Azure: A Developer’s Guide to DevOps Architecture the Right Way, by Jeffrey Palermo — Available on Amazon! Jeffrey Palermo’s YouTube Jeffrey Palermo’s Twitter — Follow to stay informed about future events! Programming with Palermo - New Video Podcast! programming@palermo.network Stephanie Herr LinkedIn Stephanie Herr | Redgate Redgate Flyway Postgres support in December Sqlfluff.com Redgate Software   Want to Learn More? Visit AzureDevOps.Show for show notes and additional episodes.

23 Jan 202336min

Populært innen Politikk og nyheter

giver-og-gjengen-vg
aftenpodden
forklart
aftenpodden-usa
stopp-verden
popradet
fotballpodden-2
nokon-ma-ga
dine-penger-pengeradet
det-store-bildet
rss-dannet-uten-piano
frokostshowet-pa-p5
aftenbla-bla
rss-ness
bt-dokumentar-2
rss-penger-polser-og-politikk
e24-podden
rss-borsmorgen-okonominyhetene
rss-gukild-johaug
ukrainapodden