Scaling in the Cloud: A Conversation with Jon Tirsen

Scaling in the Cloud: A Conversation with Jon Tirsen

In this episode of the Business Cloud Native, host Emily Omier talks with Jon Tirsen, who is engineering lead for storage at Cash App. This conversation focuses on Cash App’s cloud native journey, and how they are working to build an application that is more scalable, flexible, and easier to manage.


The conversation covers:


  • How the need for hybrid cloud services and uniform program models led Cash App to Kubernetes.
  • Some of the major scaling issues that Cash App was facing. For example, the company needed to increase user capacity, and add new product lines.
  • The process of trying to scale Cash App’s MySQL database, and the decision to split up their dataset into smaller parts that could run on different databases.
  • Cash App’s monolithic application, which contains hundreds of thousands of lines of code — and why it’s becoming increasingly difficult to manage and grow.
  • How Jon’s team is trying to balance product/ business and technical needs, and deliver value while rearchitecting their system to scale their operations.
  • Why Cash App is working to build small, product-oriented teams, and a system where products can be executed and deployed at their own pace through the cloud. Jon also discusses some of the challenges that are preventing this from happening.
  • How Cash App was able to help during the pandemic, by facilitating easy stimulus transfers through their service — and why it wouldn’t have been possible without a cloud native architecture.


Links:


Transcript


Announcer: Welcome to The Business of Cloud Native podcast where we explore how end users talk and think about the transition to Kubernetes and cloud-native architectures.



Emily: Welcome to The Business of Cloud Native. My name is Emily Omier, I'm here chatting with Jon Tirsen.



Jon: Happy to be here. My name is, as you said, Jon Tirsen, and I work as the engineering lead of storage here at Cash App. I've been at Cash for maybe four or five years now. So, I've been with it from the very early days. And before Cash, I was doing a startup, that failed, for five years. So, it's a travel guide in the mobile phone startup. And before that, I was at Google working on another failed product called the Google Wave, which you might remember, and before that, it was a company called ThoughtWorks, which some of you probably know about as well.



Emily: And in case people don't know, the Cash App is part of Square, right?



Jon: Yes. Cash App is where we're separating all the different products quite a lot these days. So, it used to be called just Square Cash, but now it has its own branding and its own identity, and its own leadership, and everything. So, we're trying to call it an ecosystem of startups. So, each product line can run its business the way it wants to, to a large degree.



Emily: And so, what do you actually spend your day doing?



Jon: Most of my days, I'm still code, and doing various operational tasks, and setting up systems, and testing, and that sort of thing. I also, maybe about half my day, I spend on more management tasks, which is reviewing documents, writing documents, and talking to people trying to figure out our strategy and so on. So, maybe about half my time, I do real technical things, and then the other half I do more management stuff.



Emily: Where would you say the cloud-native journey started for you?



Jon: Well, so a lot of Square used to run on-premises. So, we had our own data centers and things. But especially for Cash App, since we've grown so quickly, it started getting slightly out of control. We were basically outgrowing—we could not physically put more machines into our data centers. So, we've started moving a lot of our services over to Amazon in this case, and we want to have a shared way of building services that would work both in the Cloud and also in our data centers.



So, something like Kubernetes and all the tools around that would give us a more uniform programming model that we could use to deploy apps in both of these environments. We started that, two, three years ago. We started looking at moving our workload out of our data centers.



Emily: What were the issues that you were encountering? Give me a little bit more details about the scaling issues that we were talking about.



Jon: There two dimensions that we needed to scale out the Cash App, sort of, system slash [unintelligible] architecture. So, one thing was that we just grew so quickly that we needed to be able to increase capacity. So, that was across the board. So, from databases to application servers, and bandwidth, everywhere. We need to just be able to increase our capacity of handling more users, but also we were trying to grow our product as well. So, at the same time, we also want to build and be able to add new features at an increased pace. So, we want to be able to add new product lines in the Cash App.



So, for example, we built the Cash Card, which is a way you can keep your money in the Cash App bank accounts, and then you can spend that money using a separate card, and then we add a new functionality around that card, and so on. So, we also needed to be able to scale out the team to be able to have more people working on the team to build new products for our users, for our customers. Those are the two dimensions: we needed to scale out the system, but we also needed to have more people be able to work productively. So, that's why we started trying to chop up—we have this big monolith as most companies probably do, which that's I don't know how many hundreds of thousands of lines of code in there. But we also wanted to move things out of that, to be able to have more people contribute productively.



Emily: And where are you in that process?



Jon: Well, [laughs], we're probably adding still adding code at an exponential rate to the monolith. We're also adding code at an exponential rate outside of the monolith, but it just feels so much easier to just build some code in the monolith than it is outside of it, unfortunately, which something we're trying to fix, but it's very hard. And it is getting a little bit out of hand, this monolith now. So, we have, sort of, a moratorium on adding new code to the monolith now, and I'm not sure how much of an effect that has made. But the monolith is still growing, as well as our non-monolith services as well, of course.



Emily: When you were faced with this scaling issue, what were the conversations happening between the technical side and the business owners? And how is this decision made about the best way to solve this problem is x, is the Cloud, is cloud-native architecture?


<...

Jaksot(267)

Open Source Internal Startups with Saurav Pathak

Open Source Internal Startups with Saurav Pathak

This week on The Business of Open Source I spoke with Saurav Pathak, chief product officier at Bagisto, about a very different kind of business relationship with open source — and open source software incubated in a larger company. There were tons of interesting nuggets in this episode, but some things I wanted to call out are:For open source projects, the tech stack that the project is built with can in fact be a differentiating feature. This is unique to open source (and has come up before, both in my consulting work and in podcast interviews). Users might want to choose a project because it’s written in the language they are familiar with, even if the functionality is exactly the same as a competing projectThe difference in needs between the merchants (who just want to get their ecommerce store up and running) and developers building ecommerce platforms, who was worried about being able to build extensions How an open source company like Bagisto fits into the larger commercial strategy for the parent company. Build a community of developers versus building a community of merchants, and why both are important for a project like BagistoHow Saurav manages the tension between adding features that people want and not building an overly bloated product, including how to manage this tension when someone wants to contribute a feature that the core team may or may not want. It’s always interesting to me to see different models for open source companies, and Bagisto certainly is a different model. Especially after last week’s episode with Tanmai Gopal, which had a much more classic story.

5 Kesä 202438min

Improving Your Value Prop Exponentially with Tanmai Gopal

Improving Your Value Prop Exponentially with Tanmai Gopal

This week on The Business of Open Source I spoke with Tanmai Gopal, co-founder of Hasura. We talked about how Hasura grew out of Tanmai’s previous company, which was a consulting company. I like to call out examples of really novel open source businesses, but in fact the thing that stuck with me from the conversation with Tanmai was that Hasura is going the ‘classic’ route… and it’s working. What does the ‘classic’ route look like to me? It’s an open source project that targets individual developers and a commercial product that targets teams and teams of teams. It’s having additional network security features in the commercial options. It’s using the open source project as a growth engine and getting leads from companies that depend on it. It’s also using the open source project as a way to get feedback on the product roadmap. Here were some of the takeaways from our conversation: It’s a lot easier to sell a product if your customers see it as mission-critical. One of Hasura’s first inbound leads was from a Fortune 100 company who said they’d be unable to ship any software for two weeks if Hasura went down — and so they wanted to make sure the team behind Hasura was serious and also wanted to pay them to make sure they didn’t go down. For Hasura, the first clear difference between open source project and commercial product was that the open source project is for individual developers but the commercial product is aimed at the team level.Even for the cloud hosted edition, the product with ‘developer-level’ focus is free. In fact, if you go to the Hasura CE product page, the CTA asks you to use for free on the cloud. Tanmai said this is an intentional choice because they want to reduce friction for people to test it out, and the fastest way to get up and running will always be to use the cloud version, not the open source. We talked a lot about the control plane versus the data plane — all the editions have the same functionality at the data plane level. But the control plane, where people are collaborating — that is commercial only. The open source project can be a great way to stay close to your users / customers and use their feedback to constantly refine your product roadmap. In fact, this can be a main advantage of being open source, because it is the only way you stay close to your users and get their feedback — otherwise you would often only talk to the buyer, who is likely an exec with a big budget but not using the technology on a daily basis. This doesn’t mean open source doesn’t create liabilities for Hasura — it does, and those liabilities have to be managed. And Tanmai is frank about the fact that creating enough value on top of the open source project without crippling the growth engine is a tough balancing act. Pay attention to what your best customers are doing! That has informed some really important product decisions for Hasura — and it took them way to long to figure out the unique way their happiest customers were getting more value out of Hasura than other users. Definitely check out the full episode for more insights from Tanmai!

29 Touko 202445min

Using Open Source for Trust, not Growth, with Reshma Khilnani

Using Open Source for Trust, not Growth, with Reshma Khilnani

This week on The Business of Open Source I spoke with Reshma Khilnani, CEO and founder of Medplum. Medplum is an open source electronic health record development platform, and one of the things I loved about this conversation is that Reshma is so focused on the healthcare industry — a level of focus that I find relatively rare in open source companies. And not only that, when I asked her if she thought the company’s focus was too narrow, she responded that actually she often worries that it’s too broad. Another thing I really liked about this episode is that open source, for Medplum, is about trust and transparency, not growth. Medplum’s customers, Reshma said, just don’t mess around with free software that doesn’t come with compliance certificates and some kind of support guarantees. It’s a great episode to come on the heels of the episode with Adam Jacob, who talked about the difference between code, software and a product — that is a distinction that Medplum has clearly nailed. Other takeaways if you’re running an open source company: Reshma is clearly really passionate not just about developing software, but about building software for the healthcare industry. She can also clearly articulate why her customers are not well served by the standard, off the shelf development platforms that can be used by any industry. This industry-specific expertise is really powerful, and quite frankly something I don’t encounter very often. Even though there are different legal regimes in different countries, the underlying needs are pretty similar, so even for something as specific as healthcare companies it’s not particularly challenging to provide a solution that meets the needs of customers around the worldMedplum is Reshma’s third company, but her first open source company. She talked about how one of the key differences between building an open source company and a her previous companies that that the company has to pay incredible attention to the implementation details that at any other company no one would care about. Yes, you’re building a product company… but that doesn’t mean you should never sell professional services. Reshma says that one mistake she made was being too rigid about not selling any professional services at all, and ultimately they ended up offering packages of services to help customers get their implementations running. One last bit of info: Reshma compared the conversation around open source startups now with “internet startups’ in 2013. Will all startups be open source startups in 10 years? I guess we’ll see.

22 Touko 202439min

The Difference between Code and Product with Adam Jacob

The Difference between Code and Product with Adam Jacob

This week on The Business of Open Source, I spoke with Adam Jacob, founder and CEO of System Initiative and formerly the CTO and co-founder at Chef. We had a wide-ranging conversation that at times veered into the philosophical (what is the meaning for ‘strategy’?) but also has plenty of concrete, practical insights. We talked about:The difference between being the CTO and being the CEO of a startup, even if you’re a founder in both cases (and why Adam wanted to try out the CEO role this time)How Chef started out open source primarily because Adam and his co-founder really believed in open source values How they figured out a business model for Chef, but that it really felt like they were just making it up was they went along — and how he suspects that’s what most people doGetting disrupted four times, and trying out many different business models along the wayWe also talked a lot about total addressable markets, serviceable available market and serviceable obtainable market in the context of open source companies. Three key takeaways: The software is not the product. A product is the entire experience of using the software, including how it is installed, how the team is onboarded, what compliance certifications you have, what happens if you have a problem, etc. As a vendor of open source software, you need to focus on creating and selling a whole product and take the focus away from the code. You can have 100% open source code and still sell a product, because they want to have a complete experience with support and compliance paperwork etc — and because they value buying those things from the same people who are writing the code. The way to calculate TAM is to multiply the number of people who want to buy a product by the average selling price of the product. When you phrase it this way, it becomes obvious that the TAM for any open source software is zero, because the average selling price is zero. If you enjoy this podcast, please share with other founders and leadership in open source companies! And if you like the idea of open source lawyer trading cards, reach out to Adam and he’ll start a physical product company next :).

15 Touko 202447min

A Buyer's View of Open Source Companies with Mark Boost

A Buyer's View of Open Source Companies with Mark Boost

This week on The Business of Open Source, I had a very different sort of guest — Mark Boost, the CEO and founder of Civo. We talked not only about Mark’s history as an entrepreneur, but also Civo’s recent acquisition of KubeFirst. This topic caught my eye because it’s not often I get an offer to talk with an acquirer of open source companies, and I wanted to take him up on it. (Though if you missed it, I also talked to Thomas di Giacomo about this topic, and it was fabulous). The that is different about this case is that Suse is fundamentally an open source company, but Civo is not, and this was the first time that Civo had acquired an open source company. We talked about:How the relationship started long before anyone was thinking about an acquisitionWhat the 1 + 1 = 3 equation looked like in this particular caseHow it makes sense for an infrastructure company to acquire a complementary software company What it means to hire a pre-revenue open source companyIt’s a relatively new acquisition, so we did a pre-mortem on it together, and Mark talked about what could go wrong — a super interesting process. Lastly, we talked about Civo’s open source projects and what business value the company gets out of it’s relationship with open source in generalCome join me at Open Source Founders Summit if you want more conversations about building open source companies!

8 Touko 202428min

Trying All the Open Source Business Models with Brian Fox

Trying All the Open Source Business Models with Brian Fox

This week on The Business of Open Source, I spoke with Brian Fox, co-founder and CTO of Sonatype. In addition to having a really interesting discussion about the usual topic of how to build a business around open source software, we also had a good conversation about security — it was hard to avoid, because we recorded this right after the xz backdoor discovery, and software supply chain security is kind of Brian’s thing. Business-wise, though, we also covered some really cool topics. Including: The tension between an open source project that’s “too good” and yet the need for the sales team to close dealsIn some ways, the fully commercial, closed-source products in Sonatype’s product line are more straightforward… but there are challenges that go along with a pure closed-source approach, too, especially for a DevTool company. Choosing your relationship with open source depending on who your target user / target buyer isPivoting to a top-down sales motion because the bottoms-up motion just didn’t work; and how that means the features that sell aren’t always the features that get usedWhat Sonatype gets out of it’s relationship with Apache Maven and open source NexusHow do we solve real problems, and how do we solve them for real? Keeping in mind that no one buys what they need; they only buy what they want. Check out the full episode, and come to Open Source Founders Summit if you want more opportunities to talk about about business and open source.

1 Touko 202445min

Aligning with User + Customer Needs with Rod Johnson

Aligning with User + Customer Needs with Rod Johnson

This week on The Business of Open Source I had Rod Johnson, founder/CEO of Spring Source and creator of the Spring Framework (as well as board member of many other open source companies) on to talk about Spring, monetizing open source and what’s changed in the open source ecosystem since 2008. Key takeaways:Consulting was burning the entire team out, and that threatened the health not just of the consulting business, but of the open source project as wellAn amazing salesperson can often sell anything, but that doesn’t mean that you’ll be able scale, because your entire sales team is not likely to be incredibly brilliant Spring Source ended up not monetizing Spring at all — but rather worked on monetizing with products that were complementary to Spring. “We monetized Spring by not monetizing Spring, by using it to open the door” The moment that the company really started to see success as a product company was when the team stopped thinking about what they wanted to build and instead focused on what customers where telling them that they wanted.The risk of having a bunch of very good engineers on your team is that they’re excited about solving hard technical problems — but your customers might want something that is not very technically challenging or interesting. A major part of the job of a company leader is to talk to your team and get them on board with your plans The environment around monetizing open source projects has changed — there are things that worked in 2008 that wouldn’t work today, and things that didn’t work then that would be fine nowIf you love (insert your favorite open source project here), it has to have a sustainable economic modelIt’s really critical to have a rationale behind what functionality goes in your product and what goes into your open source projectAt the end we talked briefly about Open Source Founders Summit, a conference for leaders in open source businesses happening this May 27th and 28th in Paris.

24 Huhti 202446min

Taking a hard look at what community means and if every OSS company needs one with Deepak Prabhakara

Taking a hard look at what community means and if every OSS company needs one with Deepak Prabhakara

This week on The Business of Open Source, I spoke with BoxyHQ co-founder and CEO Deepak Prabhakara. We talked about a number of things, from BoxyHQ’s relationship with its open source project, called SAML Jackson to how to build a growth flywheel and how that flywheel does and does not depend on a community. Is BoxyHQ a security company? Does it matter either way? Starting the open source project at the same time as the company, and why they did it that wayThe relationship between the user community and the customer communityBoxyHQ as the anti-platform — instead of trying to build a platform, which is the default goal for a lot of companies I speak with — they are explicitly trying to build a more a la carte experience for usersThe challenges of community building around a project that isn’t sexy and how to build community that isn’t project-focused, but rather that’s focused around a problem spaceMaking the mistake of assuming your startup is completely unique and unlike any others! We talked about much more as well, and it’s definitely an episode you should check out.

17 Huhti 202435min

Suosittua kategoriassa Liike-elämä ja talous

sijotuskasti
mimmit-sijoittaa
psykopodiaa-podcast
puheenaihe
rss-rahapodi
ostan-asuntoja-podcast
pomojen-suusta
rss-startup-ministerio
rss-lahtijat
rss-rahamania
rahapuhetta
rss-neuvottelija-sami-miettinen
kasvun-kipuja
rss-h-asselmoilanen
rss-turvacast
taloudellinen-mielenrauha
leadcast
syo-nuku-saasta
muutosakatemia-coaching-podcast
lakicast