Aman Khan: prediction

Transcript context

…So product manager is responsible for bringing together design, engineering, the biz dev people, operations, sales, what have you at the organization and going and shipping impact. So you're responsible for representing the customer and ultimately getting to a solution to solve their problems. I think in addition to that, the AI component is, I really break it down into maybe three flavors of AI product management. So the first is AI platform PMs, and that's kind of where I find myself. These are people who are building tools for AI engineers. So for context, I work at a company called Arize. We're a observability and evaluation platform for artificial intelligence. We've been around for a few years, we started with machine learning and ranking, regression, classification models, basically any recommender system or black box you might find in an application. And we've slowly been translating and pivoting over into broadly speaking, any type of AI. These days, it's a lot of large language models. And so I think that with the rise of all of these tools that are being built on top of Open AI's APIs or Anthropic APIs, basically any tools on top of the large language model providers, it's actually pretty clunky. These interfaces are pretty new. We've only really had people building on top of large language models for a couple of years, and so the whole space is really nascent and the tools that you would use to build on top of and understand is my app doing the thing I expect it to do, is really, really early. So that's the space I'm focused on around enabling AI engineers to understand the impact. And if you're an AI PM at another company, one of our customer companies, you understand that when you go to leadership, that my app is actually doing something and doing what I expect it to do on the end business. I think on top of that there's also AI product PMs. And AI product PMs are really the flavor of PM where the core product is centered around AI. And an example of that would actually be something like a ChatGPT. Actually, another good example would be, you had Raiza on, and NotebookLM is a really great example of that too. What I mean by that is, the core experience is enabled by the model underneath the hood. That's sort of the secret sauce. You have these researchers and engineers really pushing the boundaries of technology forward in AI and then your job is really to package that technology and make it consumable for either a business or enterprise or a consumer to really utilize that tech in some way. So that's sort of the AI powered PM role, where the core competency, the core tech is really what you're packaging and distributing. I think the third type of PM here is really the one we were talking about a little bit earlier, which is this concept of you're an AI powered PM. And to that end, I think that you're going to be enabled by AI technology across the entire stack of the role you might already be doing as a product manager. this concept of you're an AI powered PM. And to that end, I think that you're going to be enabled by AI technology across the entire stack of the role you might already be doing as a product manager. And we'll get into a little bit what that means as well, have some ideas and thoughts around that. But really what an AI powered product manager in my mind does is, you're not really responsible for building the core model from the ground up. Maybe you don't have the access to the resources or research teams that you might have a Google or Open AI, but you can still utilize large language models, or models of any kind really, to build an experience that is best for your customers. And that's really I think where a lot of PMs will also start trending towards as AI becomes more pervasive from a technology standpoint. It almost feels a little bit like AI will be as common as the database to some degree for SaaS applications. And so I think that's really where if you really break it down, I kind of see in the future, in the near future, most PMs are probably going to be one flavor of an AI product manager, either building tools for other PMs or other companies that are deploying AI. Maybe you're behind one of the cutting edge models that's going to go and be the next NotebookLM, or you're building around a transformer of some kind or a GPT model that's doing some part of the work that you would want to do to solve a customer's problem. Let's actually make it even more real, what are some tools you use in your PM work to be more efficient and productive?…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.