Damian Brady on DevOps for Data Science and Machine Learning - Episode 008

Damian Brady on DevOps for Data Science and Machine Learning - Episode 008

This week, your host, Jeffrey Palermo, interviews Damian Brady. Damian is a Senior Cloud DevOps Developer Advocate at Microsoft, helping customers implement DevOps methods on the Microsoft platform. He’s been with Microsoft for just over a year now and formerly served as a developer for Octopus Deploy.

In this episode, Damian and Jeffrey talk all things data science and machine learning. Damian answers key questions such as: what has been the biggest change in the area of data science since the Azure DevOps release? What does source control look like for data science projects in DevOps? And more. He also explains some of the interesting architectures he has put together for machine learning and walks Jeffrey through the process of his machine learning model from source control, building, packaging, and finally, to deploying. He also gives his recommendations for those who want to go even further with data science after listening to this week’s episode.

Topics of Discussion:

[:52] About today’s guest, Damian Brady.

[1:06] Damian introduces himself and explains his role at Microsoft.

[1:46] Which group Damian is presently on at Microsoft.

[4:14] With the Azure DevOps release, what’s the big change in the area of data science? What is going to be different for people building or running models?

[6:47] For data science projects what does the source control look like?

[8:49] For the Microsoft ML, is there a particular format that the data is stored in, in source control?

[9:09] If the data is large and needs to be versioned, what are the current methods people are using?

[11:06] A word from Azure DevOps sponsor: Clear Measure.

[11:39] Some of the interesting architectures Damian has put together for machine learning.

[16:10] Damian walks Jeffrey through his machine learning model from source control to building, to packaging up the release, to deploying.

[19:20] For this type of model, where would be the physical environment where it’s measuring information?

[20:24] Damian talks firewall rules, permissions, and security.

[23:16] The advantages of using Azure’s IoT Hub.

[24:46] Damian talks about the new open source features that were added with the release.

[28:20] Does Damian still encounter customers who say they don’t want to use Microsoft products because they don’t realize they’re open source?

[29:36] Is it true that VS Code is the most popular editor?

[31:03] One of the huge advantages of using open source.

[31:53] Damian talks build agents.

[33:33] About the new Windows-hosted container build agent.

[35:50] Damian’s recommendation for listeners who want to go further with data science after listening to this week’s podcast!

Mentioned in this Episode:

Azure DevOps

Azure Pipelines

Octopus Deploy

Clear Measure (Sponsor)

Buck Hodges on the introduction to Azure DevOps Services - Episode 001

Donovan Brown on How to Use Azure DevOps Services - Episode 002
Source control in Azure DevOps

Ubuntu

Machine Learning (ML)

Amazon Web Services (AWS)

Azure Cognitive Services

CustomVision.ai

Raspberry Pi
Azure Data Center

.NET Core

Python

GitHub

Azure IoT Hub

ADP Summit
VS Code

Docker Compose

Subversion

Chocolatey

Want to Learn More?

Visit AzureDevOps.Show for show notes and additional episodes.

Follow Up with Our Guest:

Damian Brady’s LinkedIn

Episoder(372)

Brian Lagunas on Establishing Quality - Episode 252

Brian Lagunas on Establishing Quality - Episode 252

Brian Lagunas is a Microsoft MVP, a Microsoft Patterns & Practices Champion, leader of the Boise .Net Developers User Group (NETDUG), board member of Boise Code Camp, speaker, trainer, and Pluralsight author. He can be found speaking at a variety of developer events around the world. His talks always involve some form of markup (XAML or HTML), as well as how to build well-architected applications with Prism. In his spare time, he authors courses for Pluralsight, blogs, livestreams about various technologies, and manages the Prism Library. The easiest way to find Brian is on Twitter at @BrianLagunas.   Topics of Discussion: [2:21] High points in Brian’s career that have shaped his way of thinking about software, including starting his career at a global infrastructure company construction company. [5:22] The mentor that taught Brian about the importance of getting your foundation right. [7:11] How today’s development mindset is different. [8:40] How does Brian balance or reason those competing pressures from the outside? [9:52] Delivering quality first and creating a long-term plan for the team. [12:43] Fixing problems with the software versus working on new capabilities. [15:56] Brian’s approach when he took the team over, and how he handled any resistance and pushback by showing his team firsthand better efficiency and productivity. [16:26] How Brian measured actual progress. [21:02] The value of having a subjective opinion. [22:30] What quality controls does Brian put in place? [25:42] The issue Brian and his team found. [27:51] What kind of skills did Brian have to employ to make this level of testing possible? [29:15] The importance of everyone being open to helping and learning from each other and helping out where they can. [29:50] How Brian thinks about pull requests. [32:14] Stay tuned for Brian’s thoughts on static analysis. [33:41] The emotional side of things and how people feel about their work when they are focused more on development and spending less time fighting fires.   Mentioned in this Episodes: Clear Measure Way Architect Forum Software Engineer Forum Programming with Palermo — New Video Podcast! Email us programming@palermo.network Clear Measure, Inc. (Sponsor) .NET DevOps for Azure: A Developer’s Guide to DevOps Architecture the Right Way, by Jeffrey Palermo — Available on Amazon! Jeffrey Palermo’s Twitter — Follow to stay informed about future events! Architect Tips — Video podcast! Azure DevOps .NET Brian Lagunas — Ep #228 Improve Pull Request Descriptions Using Templates Continuous Integration: Improving Software Quality and Reducing Risk, by Paul M. Duvall, Steve Matyas, and Andrew Glover   Want to Learn More? Visit AzureDevOps.Show for show notes and additional episodes.

3 Jul 202338min

Kevin LaBranche: Leading teams through DevOps - Episode 251

Kevin LaBranche: Leading teams through DevOps - Episode 251

Kevin is a software developer who finds great joy in teaching and learning from others. He’s been honing my craft for over two and a half decades. If he’s not in code, he’s near it. Kevin is often working on practices and processes that improve the engineering excellence of the team.   Currently, Kevin is in an architecture/lead development position at Northern Arizona University. He develops best practices tailored to the team and company culture. Kevin is a strong believer in applying systems thinking to all he does.   Topics of Discussion: [2:13] How Kevin discovered his passion for software, and proof you can be successful even if you are bad at math! [4:51] Kevin loves giving back to others by offering his mentorship. [5:15] How we can adjust to a changing culture. [8:09] The evolution of his DevOps team. [12:11] The idea of being able to read the code. [13:06] How do you start the DevOps journey? [15:05] What is a build script? Why is it important, and what are the most important components that need to be in the build script, in Kevin’s opinion? [20:16] What are the items that Kevin likes to make sure are in the DevOps environment when developers are starting a new application? [23:00] Creating a new web application in an existing environment vs. a new environment. [27:12] The importance of getting value out the door. [29:41] Safe database deployment, safe database changes. [32:45] Kevin’s chosen practice for using toggling and deprecating feature flags along with some of his favorite tools and libraries. [34:01] Protecting against API changes with third-party services.   Mentioned in this Episodes: Clear Measure Way Architect Forum Software Engineer Forum Programming with Palermo — New Video Podcast! Email us programming@palermo.network Clear Measure, Inc. (Sponsor) .NET DevOps for Azure: A Developer’s Guide to DevOps Architecture the Right Way, by Jeffrey Palermo — Available on Amazon! Jeffrey Palermo’s Twitter — Follow to stay informed about future events! Architect Tips — Video podcast! Azure DevOps .NET Architect Forum   Want to Learn More? Visit AzureDevOps.Show for show notes and additional episodes.

26 Jun 202337min

Greg Leonardo: Responsible AI - Episode 250

Greg Leonardo: Responsible AI - Episode 250

Greg is a Cloud Architect that assists organizations with cloud adoption and innovation and is currently a Public Cloud Architect at AT&T. He has been working in the IT industry since his time in the military and is a developer, teacher, speaker, and early adopter. Greg has worked in many facets of IT throughout his career and is currently the president of TampaDev, a community meetup that runs #TampaCC and various technology events throughout Tampa. Greg holds a certification as a Microsoft Certified Azure Solutions Architect Expert, and Microsoft Certified Trainer, and is an Azure MVP.   Topics of Discussion: [3:01] Greg talks about being a military veteran from the first Gulf War and then transitioning into the technology arena. [3:33] Giving back to the veteran community. [6:04] Is AI inherently irresponsible? [6:30] Greg defines responsible AI. [7:02] Thinking about AI as your personal assistant, but only presenting you with the facts. [8:53] The difference between the public models set out by the big companies, and the other aspect of creating your own model by choosing your own set of data using the GPT technology to analyze that data. [16:43] Hallucinations in AI and GPT models. [17:10] What is actionable right now for developers when they are designing it so that we can have some safeguards built in? [21:55] The difference between fact and affirmation. [23:41] The system shouldn’t just give us what we want, but it should be able to route that want into something that’s factual. [33:10] The design process for developers that want to create their own model. [37:11] Does Greg have any Chat GPT models?   Mentioned in this Episodes: Clear Measure Way Architect Forum Software Engineer Forum Programming with Palermo — New Video Podcast! Email us programming@palermo.network Clear Measure, Inc. (Sponsor) .NET DevOps for Azure: A Developer’s Guide to DevOps Architecture the Right Way, by Jeffrey Palermo — Available on Amazon! Jeffrey Palermo’s Twitter — Follow to stay informed about future events! Architect Tips — Video podcast! Azure DevOps .NET Architect Forum “Architecting For Azure with Greg Leonardo”   Want to Learn More? Visit AzureDevOps.Show for show notes and additional episodes.

19 Jun 202338min

Matthew Renze: AI Ethics - Episode 249

Matthew Renze: AI Ethics - Episode 249

Matthew Renze is a data science consultant, author, and public speaker. He is the founder of Renze Consulting, an AI consulting company that has trained over 500,000 software developers and IT professionals. His clients range from small tech start-ups to Fortune 500 companies. He is also the President of Serenze Global, a 501(c)(3) non-profit organization dedicated to improving access to technology education for under-represented individuals by empowering the next generation of tech community leaders. Matthew is currently working on his Master’s degree in Artificial Intelligence with a Data Science specialization at Johns Hopkins University. He currently has double degrees in Computer Science and Philosophy with a minor in Economics from Iowa State University. He is a Microsoft MVP in AI, an ASPinsider, and an author for Pluralsight, Udemy, and Skillshare. His interests include AI, ML, data science, mindfulness, technology education, and tech community leadership.   Topics of Discussion: [1:41] How Matthew got into software development and eventually AI, rebranding himself as a data scientist and then AI consultant. [5:40] Matthew is getting his Master’s Degree in Artificial Intelligence. [6:04] How can we demystify AI and all the buzzwords we use? [9:13] Are there any current products that meet the definition of strong general AI? [11:03] What does weak general AI mean? [13:51] For .NET developers, what can they actually do today, with this latest generation of generative AI? [17:02] What are some examples in AI right now that Matthew has come across that clearly violate any standard of ethical boundary? [19:00] A few of the issues with AI currently or ways that AI systems are being abused: AI hallucination AI-generated misinformation Algorithmic bias and discrimination Lack of trust in AI Recommendation engines (rabbit holes) Lack of basic AI literacy [22:00] Is it even possible for these models not to be biased? [22:35] We have to make sure that we’ve got balanced data sets in order to get the models to train properly. [25:41] How do we regulate ethics? [27:55] The distinction between using supervised learning, and then self-supervised learning, or reinforcement learning. [39:20] How we can prevent deep fake videos. [42:01] It’s important to get these tools in the hands of the right people, provide education, and move forward mindfully. [47:02] Curating your own algorithm and handling information overload. Mentioned in this Episode: Clear Measure Way Architect Forum Software Engineer Forum Programming with Palermo — New Video Podcast! Email us programming@palermo.network Clear Measure, Inc. (Sponsor) .NET DevOps for Azure: A Developer’s Guide to DevOps Architecture the Right Way, by Jeffrey Palermo — Available on Amazon! Jeffrey Palermo’s Twitter — Follow to stay informed about future events! Architect Tips — Video podcast! Azure DevOps .NET Architect Forum Matthew Renze Developing Your AI Strategy Matthew's Website Want to Learn More? Visit AzureDevOps.Show for show notes and additional episodes.

12 Jun 202352min

Sagar Lad: Data DevOps and Security - Episode 248

Sagar Lad: Data DevOps and Security - Episode 248

Sagar Lad is a Technical Solution Architect with a leading multinational software company and has deep expertise in implementing Data & Analytics solutions for large enterprises using Cloud and Artificial Intelligence. He is an experienced Azure Platform evangelist with 9+ Years of IT experience and a strong focus on driving cloud adoption for enterprise organizations using Microsoft Cloud Solutions & Offerings. He loves blogging and is an active blogger on Medium, LinkedIn, and the C# Corner developer community. He was awarded the C# Corner MVP in September 2021 for his contributions to the developer community. He’s also the author of three books, Mastering Databricks Lakehouse Platform, Azure Security for Critical Workloads, and Hands-On Azure Data Platform.   Topics of Discussion: [2:57] Sagar talks about the critical points in his career that led him to technology. [6:01] What turned Sagar on to a love of data? [8:39] With so much technical jargon out there, how do you simplify? [12:40] What is Data Lakehouse? [13:25] What are some common scenarios where Data Lakehouse can be really valuable? [18:53] What does unit testing mean in the data bricks world? [22:10] How long does it take to run the tests in Azure? [25:42] What’s the most expensive Databricks environment that Sagar has seen on a monthly basis? [27:54] What are some of the things that are being missed around the industry? [31:42] Sagar says that when we talk about security, there are seven layers.   Mentioned in this Episode: Clear Measure Way Architect Forum Software Engineer Forum Programming with Palermo — New Video Podcast! Email us programming@palermo.network Clear Measure, Inc. (Sponsor) .NET DevOps for Azure: A Developer’s Guide to DevOps Architecture the Right Way, by Jeffrey Palermo — Available on Amazon! Jeffrey Palermo’s Twitter — Follow to stay informed about future events! Architect Tips — Video podcast! Azure DevOps .NET Clear Measure Architect Forum Sagar Lad books on Amazon Certifications: Sagar Lad on Credly LinkedIn: Sagar Lad on LinkedIn Twitter: @AzureSagar (Twitter: Sagar Lad) Medium: Sagar Lad on Medium   Want to Learn More? Visit AzureDevOps.Show for show notes and additional episodes.

5 Jun 202334min

René Schumacher: The DevOps Mindset - Episode 247

René Schumacher: The DevOps Mindset - Episode 247

René is a Principal Cloud Solution Architect - Engineering (CSA-E) and technical lead for Azure DevOps and software development processes at Microsoft in Germany. In his role as CE, he helps customers adopt good development practices and processes as well as understanding the principles of DevOps. As an Azure DevOps expert, René trains customers in using the DevOps toolchain and shows ways to integrate Azure DevOps into existing heterogeneous environments.   Before his start at Microsoft in late 2008, René had been working as a developer of enterprise logistic systems for almost ten years.   Topics of Discussion: [3:05] René’s start of his career and how he got into programming. [5:20] How does René define the real difference between the 1990s waterfall mindset and the agile mindset, just from a process perspective? [7:49] How DevOps is an evolution of Agile. [9:13] What is DevOps all about? [11:29] The three ways of DevOps as described in The Phoenix Project: Maximize flow or system thinking. Amplify feedback loops. The culture of continuous experimentation and learning. [16:52] The importance of creating a natural cadence in your iteration. [17:16] What’s the best way to standardize across different teams? [21:13] Choosing the right tool at the right point in time. [24:10] What type of test automation does René find himself recommending? [27:50] To René, the most important thing is to get your code right. In addition, unit testing also has a very positive impact on your architecture and design because you're building a testable product. [28:50] What is Rene’s view on open telemetry in a DevOps mindset?   Mentioned in this Episode: Clear Measure Way Architect Forum Software Engineer Forum Programming with Palermo — New Video Podcast! Email us programming@palermo.network Clear Measure, Inc. (Sponsor) .NET DevOps for Azure: A Developer’s Guide to DevOps Architecture the Right Way, by Jeffrey Palermo — Available on Amazon! Jeffrey Palermo’s Twitter — Follow to stay informed about future events! Architect Tips — Video podcast! Azure DevOps .NET Clear Measure Architect Forum The Phoenix Project book: A Novel about IT, DevOps, and Helping Your Business Win, by Gene Kim, Kevin Behr, and George Spafford Test-driven development: By Example, by Kent Beck Extreme Programming Explained: Embrace Change, by Kent Beck and Cynthia Andres The Unicorn Project: A Novel about Developers, Digital Disruption, and Thriving in the Age of Data, by Gene Kim The Mythical Man-Month: Essays on Software Engineering, by Frederick Brooks Jr. The Art of Unit Testing: With examples in JavaScript, by Roy Osherove Site Reliability Engineering: How Google Runs Production Systems, by Jennifer Petoff, Niall Murphy, Betsy Beyer, and Chris Jones   Want to Learn More? Visit AzureDevOps.Show for show notes and additional episodes.

29 Mai 202337min

Toi Wright: Blazor WebAssembly - Episode 246

Toi Wright: Blazor WebAssembly - Episode 246

Toi B. Wright is an independent consultant who has been working as a software developer for over 25 years. She has a BS in Computer Science and Engineering from the Massachusetts Institute of Technology and an MBA from Carnegie Mellon University. She has been a Microsoft MVP in ASP/ASP.NET since 2005. She is also an ASPInsider. Ms. Wright is the author of two editions of Blazor WebAssembly by Example: A project-based guide to building web apps with .NET, Blazor WebAssembly, and C#. She is also the author of other .NET books and training courses.   Ms. Wright was the organizer of the original We Are Microsoft — Charity Challenge Weekend, www.wearemicrosoft.com, which was the precursor to Give Camps Everywhere. She is the Founder of the Dallas ASP.NET User Group, www.dallasasp.net. She has been involved with various user groups around Dallas since 1994 and has been running one or more user groups since 2000. She most recently helped organize the new Geeks in Pink group. This group supports women in technology.   Topics of Discussion: [3:46] What got Toi into web development? [8:17] What inspired Toi to write a book, and what is it about this version of Blazor web application technology on top of .NET that just that really captivated her? [10:54] What’s new in the second version of Blazor web assembly? [13:21] What can people expect now, using Visual Studio and debugging with Blazor WebAssembly? [15:01] Are there specific things that are in a Blazor project that people need to think about when it comes to secure web applications? [17:34] Does Toi know the state of the component vendors out there for web assembly? And do all those components work in the web Assembly version? [20:10] What is Toi’s favorite hosting model? [22:59] More about Blazor Unity, and what Toi is excited about most for the future. [28:15] What does Toi think the “normal” .NET application is going to be with all of these choices?   Mentioned in this Episode: Clear Measure Way Architect Forum Software Engineer Forum Programming with Palermo — New Video Podcast! Email us at programming@palermo.network Clear Measure, Inc. (Sponsor) .NET DevOps for Azure: A Developer’s Guide to DevOps Architecture the Right Way, by Jeffrey Palermo — Available on Amazon! Jeffrey Palermo’s Twitter — Follow to stay informed about future events! Architect Tips — Video podcast! Azure DevOps Toi Wright Toi on Twitter Blazor WebAssembly By Example: Use practical projects to start building web apps with .NET 7, Blazor WebAssembly, and C#, 2nd Edition   Want to Learn More? Visit AzureDevOps.Show for show notes and additional episodes.

22 Mai 202331min

Ryan Booz- Modern Databases - Episode 245

Ryan Booz- Modern Databases - Episode 245

Ryan is an Advocate at Redgate focusing on PostgreSQL. Ryan has been working as a PostgreSQL advocate, developer, DBA, and product manager for more than 20 years, primarily working with time-series data on PostgreSQL and the Microsoft Data Platform.   Ryan is a long-time DBA, starting with MySQL and Postgres in the late ’90s. He spent more than 15 years working with SQL Server before returning to PostgreSQL full-time in 2018. He’s at the top of his game when he's learning something new about the data platform or teaching others about the technology he loves.   Topics of Discussion: [1:23] Ryan’s background and his love of helping people with their data. [6:06] What are some features of Postgres that really intrigued Ryan? [6:12] What are some of the choices in the database world that people should be well versed in? [11:00] Is there a marketplace for these extensions? [15:00] Google, Amazon, Microsoft, and many others have been very interested over the last 3‒4 years in the open-source code base. [15:50] Is there any environment or platform where Postgres can’t run? [17:24] Can we use a downsized database engine? [19:19] Ryan discusses Amazon Redshift. [23:58] What’s the state of the modern Redgate tools? [26:42] What are the top three tools developers should reach for? [27:00] What are the features of Flyway?   Mentioned in this Episode: Clear Measure Way Architect Forum Software Engineer Forum Programming with Palermo — New Video Podcast! Email us at programming@palermo.network Clear Measure, Inc. (Sponsor) .NET DevOps for Azure: A Developer’s Guide to DevOps Architecture the Right Way, by Jeffrey Palermo — Available on Amazon! Jeffrey Palermo’s Twitter — Follow to stay informed about future events! Architect Tips — Video podcast! Azure DevOps Ryan Booz Ryan on Sessionize Flyway   Want to Learn More? Visit AzureDevOps.Show for show notes and additional episodes.

15 Mai 202332min

Populært innen Politikk og nyheter

giver-og-gjengen-vg
aftenpodden
forklart
aftenpodden-usa
popradet
stopp-verden
fotballpodden-2
dine-penger-pengeradet
det-store-bildet
nokon-ma-ga
rss-dannet-uten-piano
frokostshowet-pa-p5
aftenbla-bla
bt-dokumentar-2
rss-ness
e24-podden
rss-borsmorgen-okonominyhetene
rss-gukild-johaug
rss-penger-polser-og-politikk
rss-fredrik-og-zahid-loser-ingenting