Transcript
41 min
Ram Yalamanchili: Hey, Natha, how are you?
Dr. Namrata Saroj: Good Ram.
Ram Yalamanchili: All right. Nice to see you again.
And, uh, I'm excited about, uh, having a conversation with you about, uh, what, uh, what's happening in the world of, uh, ophthalmology and also, uh, more of the, uh, topics on the AI front, which, uh, I think is fascinating. So, to begin, uh, I'd love to get a introduction on, uh, uh, uh, about you and your experience so far.
Uh, could you maybe, uh, speak a few words on that?
Dr. Namrata Saroj: Yeah, for, first of all, thank you so much for having me on this podcast. And as, as we've discussed before, um, AI in the clinical trial arena is, is happening and it's happening fast. And, and I think we all need to sort of embrace this, uh, which has been sort of part of my journey.
I, I've been in clinical trials for over. 20 years, um, primarily in ophthalmology. And um, you know, I've seen sort of the evolution of not just the trials, but the landscape of the trials as well, where, um, when I used to work at, as a coordinator back in the day, it was, um, very few therapeutic trials and now.
Uh, we have, you know, some sites doing over 50 trials, so this is where sort of the need for efficiency comes in. And I think AI has sort of this misconstrued, um, it's a misconstrued, maybe it's, it's, um, one dimensional, um, aspect of, uh, predictive and imaging. And that's sort of been sort of the, the buzzwords and ophthalmology.
Um, but recently I've been exposed to, uh, doing a little bit more research on where AI could help and, and there's so many more pillars, uh, where AI can contribute as well, and Tilda being one of them as an AI teammate. So I think there's, there's a lot, um, of support we can get from AI in making our trials much more efficient and ultimately, you know, expediting the drug development process.
Ram Yalamanchili: Yeah. And I know you've, you've had, uh, a lot of experience in this space. I'm curious, have you seen, um, things in the ophthalmology space, uh, which contrast with other therapeutic areas, maybe ophthalmology being either, either an earlier after or later after that sort of a thing? Right. Have you, we kind of, uh, any, any thoughts to share on that front?
Dr. Namrata Saroj: I wish I could, but I pretty much have worked in ophthalmology. I also hear that arch trials in compared to even i, I primarily do retina. Even arch trials are much longer than some of the trials. Um, it just depends on, you know, the, um. Um, the specialty, uh, because you can have very short trials where the biomarkers are very distinct and you can actually have readouts.
But for us in retina, um, I know that we know we have to do primarily minimum for at least a year, if not two year trials. Right. So that's, that is a pretty long duration.
Ram Yalamanchili: Yeah, and I think it probably also differs between the anterior and the posterior side of things. Right. Uh, in terms of duration. Right.
Yep. And, uh, I, I, I thought it was interesting the way you started off with, uh, AI having many pillars and, uh, uh, I know the predictive part of it is a lot of, uh, a lot of literature, a lot of conferences. I think, um, you know, they get a good amount of coverage in that pillar. Mm-hmm. But, uh, just to kind of set the stage here, could you explain a little bit more about what you mean by that?
What, what is predictive in your, in your, uh, uh, usage of that term?
Dr. Namrata Saroj: Yeah. No, it's, it's, it's, I've, this is my term now, it's the four pillars of, of drug development and where AI can come in. I think the first one, uh, pillar is, um, target identification or drug identification. Right? So this is, uh, this sits with the scientists.
I have nothing to do with it. I don't ever wanna have anything to do with it. Um, uh, that's smart. Um, but it's, it's using AI to be able to streamline, um. Identification of potential therapeutics. Uh, so that's the first pillar, right? And then we come to the second pillar. Once that has been identified, what's our next step is to bring, um, this in humans and design trials.
So the second pillar is trial design. Where can we use. Existing data to streamline the inclusion exclusion criteria. Can we use data to understand, um, where the biomarkers would be more efficient, that we can actually select the population the right way? Um, because a lot of times trials fail, uh, because maybe we didn't select the right population, right?
And postdoc analysis, you find a subgroup, so that's your second pillar. Then eventually the third pillar, um, is about the trial execution, where. It's, it's the process. It's, it's the, the administrative work, it's the collection of data, it's the patient management, and that's where the, the sponsors, CROs, as well as the sites, have probably the most heavy lifting to do.
And then finally, it's the fourth pillar, which is looking at outcomes and understanding the data. Right? So those, I think that's sort of the journey of the trials and I think each, at each pillar there's a different role of ai.
Ram Yalamanchili: Yeah. And also different. Parts of the ecosystem, right? I think the individuals who get involved in trials may not be the same across all four pillars.
I, I, I assume it's actually not quite, quite, probably fairly siloed.
Dr. Namrata Saroj: Absolutely. I, you know, my work starts usually when the trial is ready to be in humans. That's why I say that the drug identification part is, is way above my head. But, um, but I do, I do, there is overlap of personnel, but I think what is needed is different in different stages.
Ram Yalamanchili: Right, right. So, uh, that kind of brings me to some experience on this front as well. Right? I, I started off in my biotech career primarily on the predictive side of things, uh, building a molecular diagnostics company. And, uh, you know, early science was, uh, sort of when we got founded as a company at Lent.
Uh, and, uh, after that it was more or less proving that that early science is actually a product. So running into the clinical trial process. So I assume. Uh, you're sort of talking about that phase of a biotech where, you know, you, you might acquire an early science and then you now start to build a company around it.
And, uh, a good chunk of your company building, whether it be fundraising, whether it be sort of, uh, creating the, uh, first set of team, uh, really depends on how good is your clinical development program. Mm-hmm. And how fast can you go through it? What is your, you know, ability to like run these large programs, I guess, or, or whatever size they might be.
Right. Um. So what something I'm curious about is, given your experience in this space, what are some challenges which you've seen, uh, in, in, uh, particularly in the area which you worked in?
Dr. Namrata Saroj: Yeah, so I think there was one, one stats that I just recently read, which it's we're very familiar with. The number keeps going up.
Um, but the latest stats is to bring a drug to market can cost anywhere between 1.5 to $2 billion and it can take up to 15 years. Right? And then if you start looking, actually look. And the funnel is how many sort of candidates you have to look through before you can actually get that one approval.
That's also pretty stagnant. Uh uh, pretty remarkable. So, um, so I think looking at that, just so keeping that in perspective, that is the challenge, right? It takes so many trials and errors sometimes before you can actually, um, get to a drug that's marketable and good for patients. And then, and, you know, um, I.
I'm trained as an optometrist. Vision care is very, very important to me. So my goal is to bring the best treatments to patients as soon as possible. Um, and I think the, the process is lengthy, right? I've worked in a coup, I mean, I look back at to some of the drugs that I've worked on, and now we take them for granted, they're available, but the process was so long and the, the biggest, you know, once you've identified the drug, and I don't wanna focus on that 'cause that's a, that's a scientist thing, but.
Running, designing the trial, you can, right? That's, you get your feedback, you design your trial, but you are also still designing the trial for masses. And as we're learning more and more about diseases, especially in retina, now we're realizing we're not treating one disease, we're treating like an umbrella of diseases.
So if we can, if we can streamline that, we, we've had some unsuccessful trials and now we look back and say maybe there it was too much of a general population that was recruited. One of the reasons maybe, right. And then I wanna come to the fact that we have. So much development and innovation happening in our field, which is remarkable.
But what does that mean? It means a lot of trials. And there are only so many sites and there are only so many clinical research sites. So we have overwhelmed some of our sites with so many trials running. I mean, I even like in neovascular a MD right now, we have so many competing studies that even how do you choose patients and how do you, um, you know, monitor and assign the right amount of staff to each study so that that workload is increasing.
And you know, we've got very enthusiastic investigators and sites, they wanna be part of every study. One thing the investigators always don't pay attention to is how much work goes on behind the scene. I, I remember when I was back in the hospital, I, I mentioned I didn't have that many studies and so my investigators would like keep taking studies on and decide, ah, I don't wanna do it anymore.
And I'm like, you have no idea how much my team has to work to actually even get the study up and running. So anything that we can help the study staff is, is, is very critical at this point, only because of the fact that we have so much volume of, of studies that are happening.
Ram Yalamanchili: That makes sense. Yeah. And I've seen this as well, right?
I think it's not just ophthalmology. I think there's many other therapeutic areas which probably fit in right into this description, which you just gave. Right. Um, what I'm also fascinated about right now, uh, uh, you know, and, and, uh, we can obviously talk about what, uh, what some of the other pillars, the layer parts of the operational AI parts, uh, which are interesting.
But, um, just taking a look at what's happening in the AI domain right now, there's. LLMs, which are being trained on drug discovery, on, uh, you know, predicting protein folding. And I think we've made some pretty impressive, uh, breakthroughs there, uh, including the, the, the recent novel prize going to Demis and his team.
Right. Uh, right. So, um, and then of course they're, they've launched their own company now and, uh, the, I think, uh, I read this, uh, fascinating, uh, article and I think his quote was literally like, we're gonna solve all, all known diseases in 10 years or something like that. And. And I, I, I, I would love for them to do that, but I also think there is an enormous amounts of bandwidth problem they're gonna face, uh, exactly like what you're talking about, which is who is the, unless you eliminate human trials in our altogether, maybe, um, maybe that, that they can come at some point.
But, uh, at least given the current regime and, uh, uh, you know, process, uh, I sort of see the bandwidth massively increasing in certain pillars as you've categorized it. And in some areas we're, we're desperately in need of better solutions to improve the bandwidth there, uh, and productivity there. Right, right.
Which again, comes back to the number of sites, number of people at the sites and everything else, which goes on at the site and uh, uh, and the CRO and the sponsor. So, so the clinical development at aspect of it. So is that sort of how you, you would see it as well, like in terms of where we're probably going?
I
Dr. Namrata Saroj: do, you know, there's aspiration and then there's realism. Right. And I think for a long time we've been hearing ai. I mean, I remember a few years ago at arvo, which is our, one of our big research meeting meetings, as you know, um, there was like one session on AI and now we both have just come back from arvo.
I mean, it was. Everywhere. Right? There was no topic that was getting discussed without ai. So let's, that's, that's the progress and it's, it's really good progress. But you are right. There's, there's a lot of aspirations, but we have to be realistic about what's going to be achievable, right? Um, predict predictive biomarkers are, are going to be amazing, but I think we still have a lot of work to do.
It's not, we're not there yet. I think where, you know, if you look at our day-to-day work, and I'm not talking about. The clinical work that, that I'm engaged with or you are engaged with. It's more about even our personal lives, right? AI is. Assisting us in so many ways. So I think this concept of assisting where execution is needed, um, it, it's a no brainer for me, right?
Like, why wouldn't I want that help? I'm in, you know, I, I have, I have nephews who they always say, auntie, we start writing everything with chat GPT, right? Like, that's the norm now. So where is our chat g, pt?
Ram Yalamanchili: Yeah, I agree. And, and, and more, right? I think, uh, I, I also am a big believer that we're. We're gonna be seeing more agentic style use cases developing from now on.
Uh, I think for the past couple of years we've certainly done a lot of the, uh, traditional like chat or conversational ai, uh, chat bots, uh, that sort of thing. But, um, you know, the, the technology is maturing to a point where I think you can certainly start to think about. Uh, having an assistant or an agent, which is able to, uh, you know, very, very ca a capable assistant right.
Was able to take on some of this work and, uh, perform it on your behalf and come back. Uh, and yeah, we certainly need that. I think clinical research can definitely use that, multiple different roles in the research industry could use that. Uh, and, you know, the roles are across multiple organizations. We have sponsors, we have CROs, we have sites, and they all have different roles.
And I would say a, a, a, uh. Uh, a need exists for all of these different roles to have some form of a AI team, mayor and assistant. Uh, yeah. I
Dr. Namrata Saroj: think the only comment I'll make is I don't think it's gonna be replacing anything. It's gonna be assisting, and I think that's the word we wanna emphasize. It's, it's an assistant, right?
Ram Yalamanchili: Yeah. Um,
Dr. Namrata Saroj: and as you guys put it at, tell that it's a teammate. And I think that's important for people to understand that, uh, you know, we still need the workforce the way we do. We just need to become more efficient because of the needs that we have now.
Ram Yalamanchili: Absolutely. I mean, I, I think there's several camps on this.
I've seen people say, oh, you know, AI is gonna replace, uh, you know, this and that. But I, I've been pretty convinced from, uh, you know, several years now that we're gonna see sort of like an abundance of opportunity driven by ai. I think the. Ultimate, uh, uh, you know, the, the world where we would probably hopefully live in soon will be an a place where we have many problems in front of us and we have the resources to solve those many problems, or at least take shots of these many problems.
Right? And I think anyone who's worked in the drug discovery space know that there are many challenges which we have not even touched upon, right? There's so many, uh, areas we could, we could probably ask the questions and hopefully if we had the resources and the ability we should go and. Pursue those.
Um, and that's not possible in the current regime. Like we've been at the current style of operations for the past decades, many decades now. And we've only achieved so much of productivity or bandwidth as we call the number of patients recruited. Like we've got the same exact issues and problems we've seen for the last many years now.
Dr. Namrata Saroj: So it's interesting you say that Is, um, I used to say this, uh, a lot and I still actually say is, you know, we've made such great advancements in the actual medicine, but how we bring those medicines to market are, we're so antiquated in how we work still, right? I mean, I worked. When I started my career, we were doing everything was paperwork, right?
Actual paperwork. And fortunately we've transitioned electronic, but just the way that things are managed and a lot of it, it still has to do with the regulatory sort of guidelines. But you know, nobody wants to take the risk and do something different because. There's so much at stake when you're developing a drug, so God forbid something goes wrong, you don't know if it's a drug or the way you did it, and so that's why there's this sort of apprehension to make these bold changes in the drug development process.
But at the same time, I think we are doing ourselves a disservice by not changing the the process. Or not, or, or not, you know, having the process, um, evolve the way it should be. Mm-hmm.
Ram Yalamanchili: Yeah. And, and I think changing process is probably one of the biggest aspects of how all of this is gonna get adopted.
Right. In general, like what is, what is your strategy there? Um, what I found fascinating is things like. Uh, you know, put aside the predictive AI parts of it. I think there's a, there's a certain amount of regulatory hurdle you would have to cross before you can actually adopt those type of, uh, use cases into your, uh, automation or ai.
Uh, I mean, I, I think like an example of that would be maybe looking at certain. Uh, imaging and predicting eligibility, for example. And I think that there's some excellent science in that aspect. Uh, but I, I think the hurdle is also pretty high, right? There's, there's companies which are focused on that, running their own clinical trials, for example, on the data and, and sort of, uh, proving out whether their models actually can predict and whether that can be used from a clinical setting, things like that.
But I also see another world where there's ample sets of opportunities in the workflow where you do not need to cross such a regulatory burden or a regulatory hurdle. Uh, you know, this could be something as simple as, uh, you know, did we dot all the i's and did we cross all the T's right on all my documentation?
Uh, did I follow the checklist of things which I'm supposed to follow as per the protocol? And, you know, is that, is there some kind of an, um, AI. Agent or a teammate, which can help me do that. And by and large, I think what we've noticed is those type of problems are the ones where there's a majority of, uh, focus in terms of actual day-to-day execution.
And it eases up a lot of time. There's multiple layers of checks currently in place because none of these are automated, so they're all manual. So you have people checking other people's work and, and so on and so forth, right? There's layers of checking and uh, I know the industry calls it monitoring, but.
Uh, overall I think there's, there's interesting opportunities where you, you have to sort of take a more holistic view and say, you know, I'm not gonna change so much of my process, it's just the way I, I come into this, um, execution model and, uh, use technology to do exactly what I would have, you know, my staff of five or 10 or 20 people do.
But, uh, have them use AI to be more productive, more consistent, more, more, more, uh, you know, reliable in terms of like the quality, they're able to do the set. And I'm, I'm seeing that already happen. I think from, from site sponsors and CROs perspective, uh, there's just tremendous amount of opportunity. The entire industry seems to be very much in like a manual mode right now.
And, uh. And sort of, uh, watching that transition slowly into a, a sort of a hybrid model. Um, so I think the question in my mind is what's, what's going to be that catalyst? I, I think at some point every industry needs a catalyst to adopt any type of technology. I know you've mentioned paper and papers, pretty much.
I think in certain areas it's not existent anymore, especially data capture is now electronic. Mm-hmm. Um. But I'm curious, like do you see any other trends which are gonna come in, which will basically drive the need for productivity or efficiency? Right. Yeah,
Dr. Namrata Saroj: I think the number one catalyst is competition, right?
I think, uh, every company right now is whatever they're doing, they're trying to get to that next milestone in an expedited way. So whatever you can do to get to the next milestone you're going to do. And, and if that the increasing of the efficiency can get you to the next milestone, they'll do it. So it's from a sponsor's perspective, that's essential.
There's also differentiation, right? So the, um, the c the CROs and the sites and, you know, what are they doing differently than somebody else is doing, right? I, I Coen a CRO as well. And when I'm looking to sort of pitch to companies, I'm looking to see why would you wanna choose me? Right. So it's, it's because I can give you something that maybe some other company doesn't have and, and I think this is where, you know, um, the adoption is so critical.
Becu is, um, if you don't adopt it, you are gonna be left behind. I mean, I think that's really the simplicity of this. So in
Ram Yalamanchili: some ways it's the competition which will drive that option.
Dr. Namrata Saroj: Absolutely.
Ram Yalamanchili: Uh, among, among your peers. Yeah.
Dr. Namrata Saroj: Yeah. Because how are you going to do something better? You know, I mean, let's look at tech.
The tech world, one technology versus the other. Technology only succeeds because somebody, they offered something that the other person did.
Ram Yalamanchili: Mm-hmm. Mm-hmm.
Dr. Namrata Saroj: Right. So, so that's going to be the key is like, how do I differentiate? And as I said, what we're doing in clinical trials has expanded so much. The volume is so much that you have to stand out from every perspective, right?
As a sponsor, you wanna be bringing a drug that, that is helpful to patient, that's safe. From a CRO perspective, you're able to execute really well. And from a site perspective, you have to show up and say, I can deliver, right? So I'm gonna be, my patients are gonna be well taken care of because I can do this trial efficiently.
And I, again, I just, the one thing I wanted also touch was I did do some monitoring way back in my days, and it was one of the most tedious jobs you can ever do. Like hats off to every monitor. We do some remote monitoring now, so things have helped with the ECRs. But to your point, double checking something just to make sure there's no error.
Probably still leaves arrows on the table. Mm-hmm. Mm-hmm.
Ram Yalamanchili: And I have a case study there where I think, um, frequently I've seen certain worksheets, like your visual equity scores, for example, I. Where you're expecting the person doing the test to also do calculations and eventually, based on that calculation, make a decision whether this particular patient is gonna be put into a arm or is there an, uh, an additional dosing which is coming up into the, into the treatment for, for, for the patient.
Right. And uh, I think it's pretty fascinating that those type of worksheets are not automated because you would think that those can be, I mean those are, um. You don't need AI for that. It's, it's, uh, it's much simpler than that. But, um, but to the extent that what I've seen, it's a pretty interesting scenario where, uh.
You know, something like that could meaningfully change the, the direction of the trial itself. Like, you know, the data which is being captured and whether you're doing it right or not, and yet it's not being done this way. Um, I'm curious, like, what, what, what's, why, like, why, why is this not happening?
Already?
Dr. Namrata Saroj: Asking the question I asked, remember I said. Medicines of advance, but our process hasn't. Right. Because it's about validations and, and, uh, guidelines. I, I, I wish I could give you an answer, but that's the unmet need. And I think it's, it's, you know, until recently we were still doing source documents.
Actually a lot of people still do source documents as a paper. 'cause you need to see where the pen hit the paper. But we're doing, you know, the EMRs everywhere. A lot of time there are no source documents. So eSource has come into Bing, which is really helpful. But it's, it's not that eSource has been around for a long time.
People are still adopt, adapting to it. So I think the process has been slow to evolve because as I mentioned, it's, it's just, it's, the change is scare is. Creates fear, I think, right? Like, we don't wanna do this 'cause it's always been done this way. Uh, but I think people have, actually, the word I would use now is instead of looking at it as changed, let's look at it as evolution.
This is, this is the next evolution.
Ram Yalamanchili: Yeah. I also found a lot of the systems today are not easy enough to configure or set up to, to suit this particular type of a use case. Oh, okay. But you could, you could try to do it. You might have the intention to try to do it. Um, but then you're becoming a software company yourself.
Exactly. You know what I mean? Like, you, you would have to budget a, a certain amount of your clinical trial budgets to, to do, go, go do this. And that's not something which you probably have, uh, you know, the right resourcing or the, or the talent, uh, uh, allocation within the company to go pursue. So, so these are another interesting, uh, aspect of what I've seen.
Dr. Namrata Saroj: I'll add to that, right. So sponsors are looking at. But most sponsors, as you know, outsource it with CROs to run the studies, right? So sponsors are not investigated it. They do what they're told to do. It's the CROs that have to invest. And until recently, I don't think CRO was this big business. It was a vendor, and that runs your trials.
But we've seen over the last five to 10 years where CROs sort of activity has, has gone up tremendously. They've been acquired by big companies. So there's, you know, when acquisition by big companies as you know, it's, it's good. In some ways, but not so good in some ways. And good is that they have, they can invest in in progress.
Right. And, um, what we're seeing, I mean I'm, I'm hearing this from the big CROs right now. They're looking into AI technology. Some of them are developing things on their own. So I think it's that movement that's happened in sort of creating these bigger organizations that will invest, to your point, somebody has to do it right, A small or a small sponsor, which are very budget constrained.
Are not going to invest, they're gonna say, Hey, this works why we don't need to change it. Right?
Ram Yalamanchili: Yeah. Yeah. I, I think being able to present a, a solution which is easy to adopt and, uh, is not, uh, you know, uh, obviously can be so prohibitive in the cost that it's, it's hard to adopt or even sell that as a value.
So I think that's where the gap is and certainly where, where, you know, we're trying to play a role here. Um. But, uh, but I do see quite a few of these sort of use cases, even in that situation, which I was telling you about. We, we had a study, um, where we had some access to the retrospective data, looking at these, uh, essentially scanned documents in their, in their repository.
Um, I mean the, the error rate, we were able to just showcase immediately saying, Hey, you know, do, did you realize that these, these, you know, set of worksheets had these calculation errors? And, uh, it's, uh, you know, it's critical from a, from a study execution perspective to know that, right? And it, it's one of those things where you have that aha moment.
You're like, wow, I wish I had this on a real time basis, because every time a site did it, it doesn't matter whether a paper or not. You know, nowadays LMS have the able to have visual, uh, cortex, you know, like they, they can see, they can read just like how we were. And, um, and you can have, uh, workflows built on top of it.
And you can, you can do some, some sort of, uh. Quality check. Just like, you know, you and I would if we were, uh, reading through this paperwork. Right. And, uh, this is what's like really interesting to me. I think there's some pretty clear benefits, which are not in the regulatory sort of realm of prediction or data generation.
It's more of I just have to do this. There's so much of this to do and there's a high error rate because it's a tedious amount of work and. And I would rather have an assistant there and an AI could do this day in and day, you know, day and night. Right. So it's uh, uh, that's just one example, but I've seen several such examples across the workflow.
Dr. Namrata Saroj: I think the word tedious is really important here, right? Because as we're talking about sort of the volume of trials going up, right? But we also, within a trial, the volume of data we're collecting is going up as well because, um. We, at least in say, in retina, we have many more imaging devices. There are functional tests and, and pros, right?
So all of that data, the number, the amount of data we're collecting goes up. So the, the aspect of, you know, being tedious goes up as well. And to your point, it's human nature, you know, we're not, we're not perfect. Well, there's going to be some errors.
Ram Yalamanchili: Yeah. Yeah. Um, my, probably like towards the tail end of some, some of these questions.
How do you see, you used the word competition and is that largely a time, is it a budget, is it a mix of everything? Like how, how do you see that? And, and what about talent? Like, you know, uh, just hiring and retaining, keeping the right talent as well. Right. So I'm, I'm curious, what, what are, is there more to, uh.
Discuss there in terms of like when you define it as competition and being competitive? I think
Dr. Namrata Saroj: everything you mentioned, right, so it starts with talent because you only want the right people running the studies. In all three. So let's just, you know, we'll do sponsor CRO insights, right? You need, you need, um, uh, talented individuals to actually design the right studies, design the right products, and be able to actually execute the right way.
See, and same thing for CROs. You need to be, um, you know. Have the right people to execute on the ground. And of course, at the site level for sure. And at site level, it's a combination. You know, you've got the investigators and you've got a study staff and study staff have become, you know, uh, a huge department.
There is because you want, it takes so much to run the studies to coordinate all these different aspects of what the sponsors are asking for. So the competition all comes in. The competition is, again, different for different. These three different elements, right? For the sponsor, the competition comes like, Hey, what am I, what are we providing to the sites?
Right? Is. Is, is a drug, I'm sorry, is a drug the right, um, something that's good for my patients. Um, but also we wanna be re we wanna be compensating the sites for the right amount too as well, right? There's a lot of hard work that goes in. So, you know, over the course of the years, I think it's more because the studies have become so, so.
Um, um, intensive and, and time consuming that you have to be compensating at a, at a really high level. So that's competition as well. Um, you know, I'll tell you, most of my sites, sometimes they wanna pick study, not because of the sponsor, but based on the CRO. They have very strong opinions about the CROs they wanna work with because that's the interaction on a, almost, on a daily level.
And if they don't like the people they're working with, they're not gonna do it. So. So if a CRO is gonna have, um, a monitor that's going to be, um, not well-trained or doesn't understand, um, the details of the trials or doesn't have experience in the therapeutic area and goes to a site that the coordinators have tremendous, uh, therapeutic experience, it's not gonna be a good match.
Um, um, so again, there's so many elements of the trial that, you know, you mentioned this earlier in the PO podcast that we haven't even uncovered everything because we don't know that this is an issue. And you can only uncover when you, when, when you sort of actually start delving into fixing things and you go, okay, maybe that other thing needs to be fixed as well.
Ram Yalamanchili: Mm-hmm. Mm-hmm. I'm curious, why do you think we have a sort of like, why, why don't we have more sites participating in this? In, in this, uh, ecosystem of research, uh, because I do hear sites are a bottleneck and there's only so many sites and, and investigators out there. Uh, but I'm curious, like, because it's, it's economically, it's viable.
Uh, at least it seems like it, and it's, it's a, uh, you really are pursuing something as a very interesting, uh, sort of a, um. Workflow, right? Like it's, you're working on cutting edge, uh, drugs or devices, there's tremendous benefit you can bring to the patient population in general. So, uh, I, I, I'd, I'd be curious to, to hear, hear, hear your thoughts, uh, given your experience in the space.
Dr. Namrata Saroj: So the impression is that it's not economically viable. Right. So that's actually how it started. So that's the nu probably one of the number one reasons. Um, the number of clinical sites now that we have is significantly higher than when I started. I. You know, uh, 20 year over 20 years ago, um, there is an interest in research, but it really depends on the type of practice we're seeing more and more.
Um, fellows and residents get exposed to the clinical trial world when they're in their trainings. So when they leave, they want to start it. Back in the day, that exposure was not there, so they didn't know any better, and you sort of join a practice and you. Kind of, um, do you know your routine clinical practice.
But now because they're doing their training, they're getting exposed. Um, I have a lot of young investigators who've gone into established practices with no research department, um, start their own department. Right. But it's a challenge still. I have, uh, one side where they have really, uh, great recruitment and I, I'm offering them to expand and do things.
And I was reminded that the rest of the group doesn't really believe in research, so they're not gonna invest in it. So that's the thing. It's, you have to invest in it. Before you can profit from it like anything else. Right?
Ram Yalamanchili: Right.
Dr. Namrata Saroj: So, so there is still a struggle. There's, you know, you would think that for all the number of retina practices I have, we should have so many sites and there should never be an issue.
So. But it's, it still is, it's, it's a, it's a lot of convincing for some, some of the younger investigators, um, to, for their senior partners to be, to be bought in, and then they have to deliver, and then they have to show that, you know, they're not losing money. They, they're actually making money. And that doesn't always happen with the first research project you do.
Um, so hopefully more and more people will see the bigger picture of research. Where you, you kind, I said, you know, it's cutting you on the cutting edge treatment. You can offer that to your patients, you, for your academic and, um, career growth. That's really great as well. So hopefully more and more people will see that in more and more practices will get established.
In fact, I will tell you, most of the great recruiters that we have in our studies right now are not your seasoned, uh, researchers. It's the young ones because they're motivated to do it.
Ram Yalamanchili: Mm-hmm. Yeah. Yeah. No, I, I think that's. That's an interesting take, and I can see that the activation energy required, you know, especially if you're a new site, just getting started, um, yeah, you have to invest and that there's a certain amount of uncertain, uh, uh, I should say, there's uncertainty in that process.
Yeah. In terms of what you're, uh, what you're getting into. Uh, it's a commitment. Uh, but again, I think. This is the type of interesting places where automation is, you know, always so much more beneficial than sort of, uh, you know, not, not using any automation, completely relying on manual processes. Right. So I think, uh, we, we've definitely seen sites even, uh, our, you know, our own experience has been like getting a lot from, uh, uh, bringing some of the cutting edge technologies to, to their practice.
Dr. Namrata Saroj: Yeah, so I think one other aspect of starting research or even some, some research centers, they share, um, study staff between the, the research department and clinic, right? And. I always say that's not always the best move because the work we do in clinic is not the same as we do in, uh, not exactly the same as we do in stu in the study arena.
And I think if, especially for those folks where they might have, um, you know, resource, um, limitations, any automation support helps because. Then they can balance both aspects because it is very demanding to be balancing both. If you spoke to study coordinators who are doing both, it's like, it is very difficult to kind of keep switching off like, okay, I'm doing the study, which is more documentation, I'm gonna clinic and I need to get the patients through.
So any automation we can help, there would definitely be, uh, appreciate it.
Ram Yalamanchili: Yeah. It's, uh, interesting, you, you put it that way. I've seen two, two versions of this, right? Uh, one is the early sites where. Uh, you know, they, they really are looking for any sort of help, which can, which can off floor, um, the work from their current staff.
So that's, that's one site, one set, one sort of a, uh, uh, phenotype. And then there's, these other sites are very high volume, high recruiting, like successful practices, which have built great research programs. But for them it's more about how can I do more with the, with the number of staff I trust and I've worked with for many, many years, and.
We don't necessarily, we're not too keen on like doubling, tripping out our, our staff because we have done it and there's some problem or the other, and they, that that's not the path they want to go after. Right. So I think, uh, either way I can see, you know, benefits from essentially like, you know, bringing in some sort of a, uh, automation or like AI technology, right.
So that's kind of where, where we are and what we're seeing.
Dr. Namrata Saroj: Absolutely. I think that, and this is what's the beauty of. Uh, technology and AI is, you can c it to what your need, right? It's not one formula fits all. And I think this is why the discussions I have with folks right now is, you know, when people say ai, it's not a, it's not one thing.
There's so many aspects to it. So what are, what is it that you need and do you have an AI solution for it? It's very different than saying. I'm, I have ai that means nothing.
Ram Yalamanchili: Yeah, I agree. And, and I think another realization which we've had is you have to go after, from a persona pers perspective, so which persona are you looking for?
Help? And, and, and can we solve it or can we not? Right. So, so, you know, we, we go that
Dr. Namrata Saroj: right. What's the in, in drug development? The biggest thing we go for is unmet need. Mm-hmm. What is that? And I, I'll give you an example of, of tech. It's not AI related, but several years ago I was helping a company that, um, it's on the other side of clinical trials.
We do prior authorizations for our drugs, right? I sit on clinical. I didn't know that. Priors were still being done with faxes and telephone calls, and somebody came up with an electronic system, and when we were trying to implement that, I, we got resistance from some sites that, oh my God, like, would my prior person get, you know, um, laid off or whatever.
You're like, no, they're helping them. They're gonna be more efficient in the prior are gonna do, right? Mm-hmm. That's. That's the conversation we're having now, again, in this respect with AI as well, that hey, we are not talking about replacement, we're not talking. This is about how we can make everybody more efficient.
Ram Yalamanchili: Yeah, yeah. No, absolutely. I think, uh, and like you said, I like the way you put it, right. I think. The competition will eventually drive this towards adoption. It's, uh, the benefits are very clear. It's not just about having a shiny tool. I think the productivity gain, the economic, uh, and the quality benefits you're getting are pretty tremendous.
Uh, with, with what we have. Uh. What we're seeing right now. So I do look at it as a matter of time rather than, um, you know, a matter of if or, uh, that sort of a thing. Right?
Dr. Namrata Saroj: Yeah. I, I, productivity and quality are gonna be very essential. So, you know, when we do site selections, um, we're looking at how do they recruit, which, you know, of course that's a different AI that's gonna work on that.
But the quality of the data really matters, right? When the monitors go in and tell us they have so many outstanding queries, you are getting red flagged. And so next time around, people will think twice like, okay, maybe they recruited well, but the data was a disaster, so we can't risk that anymore. Right?
Over the course of, uh, running clinical trials, I've had data from sites we had to actually exclude because it was not good, right? And. Think about how much of an investment cost that is and, and it can really affect the outcomes of virtual trial. And that, uh, affects sort of the entire drug development process.
So that's really critical that the sites provide good data. Mm-hmm. And, and if we can help them do that, their visibility goes up. And guess what? They're gonna be on top of the list for the next recruitment.
Ram Yalamanchili: Yeah. Yeah. Fascinating. Well, uh, thanks for your time. I think this has been a pretty interesting call and, uh, um, yeah, I hope to talk to you soon after that.
Thanks for, thanks for your time again.
Dr. Namrata Saroj: Thank you and, and great work on Tel. I think, you know, going as an AI teammate to the sites, to the sponsors, to the CROs, um, I think it's, it's gonna be really helpful. And I, as far as I know, I think you guys are the only ones doing that right now. So hopefully more sites will, will adopt and will get some companies to adopt them too.
Ram Yalamanchili: Yeah, it's happening. But, uh, thank you.
Dr. Namrata Saroj: All right.
Ram Yalamanchili: All right. Take care. Bye.
Ram Yalamanchili: Hey, Natha, how are you?
Dr. Namrata Saroj: Good Ram.
Ram Yalamanchili: All right. Nice to see you again.
And, uh, I'm excited about, uh, having a conversation with you about, uh, what, uh, what's happening in the world of, uh, ophthalmology and also, uh, more of the, uh, topics on the AI front, which, uh, I think is fascinating. So, to begin, uh, I'd love to get a introduction on, uh, uh, uh, about you and your experience so far.
Uh, could you maybe, uh, speak a few words on that?
Dr. Namrata Saroj: Yeah, for, first of all, thank you so much for having me on this podcast. And as, as we've discussed before, um, AI in the clinical trial arena is, is happening and it's happening fast. And, and I think we all need to sort of embrace this, uh, which has been sort of part of my journey.
I, I've been in clinical trials for over. 20 years, um, primarily in ophthalmology. And um, you know, I've seen sort of the evolution of not just the trials, but the landscape of the trials as well, where, um, when I used to work at, as a coordinator back in the day, it was, um, very few therapeutic trials and now.
Uh, we have, you know, some sites doing over 50 trials, so this is where sort of the need for efficiency comes in. And I think AI has sort of this misconstrued, um, it's a misconstrued, maybe it's, it's, um, one dimensional, um, aspect of, uh, predictive and imaging. And that's sort of been sort of the, the buzzwords and ophthalmology.
Um, but recently I've been exposed to, uh, doing a little bit more research on where AI could help and, and there's so many more pillars, uh, where AI can contribute as well, and Tilda being one of them as an AI teammate. So I think there's, there's a lot, um, of support we can get from AI in making our trials much more efficient and ultimately, you know, expediting the drug development process.
Ram Yalamanchili: Yeah. And I know you've, you've had, uh, a lot of experience in this space. I'm curious, have you seen, um, things in the ophthalmology space, uh, which contrast with other therapeutic areas, maybe ophthalmology being either, either an earlier after or later after that sort of a thing? Right. Have you, we kind of, uh, any, any thoughts to share on that front?
Dr. Namrata Saroj: I wish I could, but I pretty much have worked in ophthalmology. I also hear that arch trials in compared to even i, I primarily do retina. Even arch trials are much longer than some of the trials. Um, it just depends on, you know, the, um. Um, the specialty, uh, because you can have very short trials where the biomarkers are very distinct and you can actually have readouts.
But for us in retina, um, I know that we know we have to do primarily minimum for at least a year, if not two year trials. Right. So that's, that is a pretty long duration.
Ram Yalamanchili: Yeah, and I think it probably also differs between the anterior and the posterior side of things. Right. Uh, in terms of duration. Right.
Yep. And, uh, I, I, I thought it was interesting the way you started off with, uh, AI having many pillars and, uh, uh, I know the predictive part of it is a lot of, uh, a lot of literature, a lot of conferences. I think, um, you know, they get a good amount of coverage in that pillar. Mm-hmm. But, uh, just to kind of set the stage here, could you explain a little bit more about what you mean by that?
What, what is predictive in your, in your, uh, uh, usage of that term?
Dr. Namrata Saroj: Yeah. No, it's, it's, it's, I've, this is my term now, it's the four pillars of, of drug development and where AI can come in. I think the first one, uh, pillar is, um, target identification or drug identification. Right? So this is, uh, this sits with the scientists.
I have nothing to do with it. I don't ever wanna have anything to do with it. Um, uh, that's smart. Um, but it's, it's using AI to be able to streamline, um. Identification of potential therapeutics. Uh, so that's the first pillar, right? And then we come to the second pillar. Once that has been identified, what's our next step is to bring, um, this in humans and design trials.
So the second pillar is trial design. Where can we use. Existing data to streamline the inclusion exclusion criteria. Can we use data to understand, um, where the biomarkers would be more efficient, that we can actually select the population the right way? Um, because a lot of times trials fail, uh, because maybe we didn't select the right population, right?
And postdoc analysis, you find a subgroup, so that's your second pillar. Then eventually the third pillar, um, is about the trial execution, where. It's, it's the process. It's, it's the, the administrative work, it's the collection of data, it's the patient management, and that's where the, the sponsors, CROs, as well as the sites, have probably the most heavy lifting to do.
And then finally, it's the fourth pillar, which is looking at outcomes and understanding the data. Right? So those, I think that's sort of the journey of the trials and I think each, at each pillar there's a different role of ai.
Ram Yalamanchili: Yeah. And also different. Parts of the ecosystem, right? I think the individuals who get involved in trials may not be the same across all four pillars.
I, I, I assume it's actually not quite, quite, probably fairly siloed.
Dr. Namrata Saroj: Absolutely. I, you know, my work starts usually when the trial is ready to be in humans. That's why I say that the drug identification part is, is way above my head. But, um, but I do, I do, there is overlap of personnel, but I think what is needed is different in different stages.
Ram Yalamanchili: Right, right. So, uh, that kind of brings me to some experience on this front as well. Right? I, I started off in my biotech career primarily on the predictive side of things, uh, building a molecular diagnostics company. And, uh, you know, early science was, uh, sort of when we got founded as a company at Lent.
Uh, and, uh, after that it was more or less proving that that early science is actually a product. So running into the clinical trial process. So I assume. Uh, you're sort of talking about that phase of a biotech where, you know, you, you might acquire an early science and then you now start to build a company around it.
And, uh, a good chunk of your company building, whether it be fundraising, whether it be sort of, uh, creating the, uh, first set of team, uh, really depends on how good is your clinical development program. Mm-hmm. And how fast can you go through it? What is your, you know, ability to like run these large programs, I guess, or, or whatever size they might be.
Right. Um. So what something I'm curious about is, given your experience in this space, what are some challenges which you've seen, uh, in, in, uh, particularly in the area which you worked in?
Dr. Namrata Saroj: Yeah, so I think there was one, one stats that I just recently read, which it's we're very familiar with. The number keeps going up.
Um, but the latest stats is to bring a drug to market can cost anywhere between 1.5 to $2 billion and it can take up to 15 years. Right? And then if you start looking, actually look. And the funnel is how many sort of candidates you have to look through before you can actually get that one approval.
That's also pretty stagnant. Uh uh, pretty remarkable. So, um, so I think looking at that, just so keeping that in perspective, that is the challenge, right? It takes so many trials and errors sometimes before you can actually, um, get to a drug that's marketable and good for patients. And then, and, you know, um, I.
I'm trained as an optometrist. Vision care is very, very important to me. So my goal is to bring the best treatments to patients as soon as possible. Um, and I think the, the process is lengthy, right? I've worked in a coup, I mean, I look back at to some of the drugs that I've worked on, and now we take them for granted, they're available, but the process was so long and the, the biggest, you know, once you've identified the drug, and I don't wanna focus on that 'cause that's a, that's a scientist thing, but.
Running, designing the trial, you can, right? That's, you get your feedback, you design your trial, but you are also still designing the trial for masses. And as we're learning more and more about diseases, especially in retina, now we're realizing we're not treating one disease, we're treating like an umbrella of diseases.
So if we can, if we can streamline that, we, we've had some unsuccessful trials and now we look back and say maybe there it was too much of a general population that was recruited. One of the reasons maybe, right. And then I wanna come to the fact that we have. So much development and innovation happening in our field, which is remarkable.
But what does that mean? It means a lot of trials. And there are only so many sites and there are only so many clinical research sites. So we have overwhelmed some of our sites with so many trials running. I mean, I even like in neovascular a MD right now, we have so many competing studies that even how do you choose patients and how do you, um, you know, monitor and assign the right amount of staff to each study so that that workload is increasing.
And you know, we've got very enthusiastic investigators and sites, they wanna be part of every study. One thing the investigators always don't pay attention to is how much work goes on behind the scene. I, I remember when I was back in the hospital, I, I mentioned I didn't have that many studies and so my investigators would like keep taking studies on and decide, ah, I don't wanna do it anymore.
And I'm like, you have no idea how much my team has to work to actually even get the study up and running. So anything that we can help the study staff is, is, is very critical at this point, only because of the fact that we have so much volume of, of studies that are happening.
Ram Yalamanchili: That makes sense. Yeah. And I've seen this as well, right?
I think it's not just ophthalmology. I think there's many other therapeutic areas which probably fit in right into this description, which you just gave. Right. Um, what I'm also fascinated about right now, uh, uh, you know, and, and, uh, we can obviously talk about what, uh, what some of the other pillars, the layer parts of the operational AI parts, uh, which are interesting.
But, um, just taking a look at what's happening in the AI domain right now, there's. LLMs, which are being trained on drug discovery, on, uh, you know, predicting protein folding. And I think we've made some pretty impressive, uh, breakthroughs there, uh, including the, the, the recent novel prize going to Demis and his team.
Right. Uh, right. So, um, and then of course they're, they've launched their own company now and, uh, the, I think, uh, I read this, uh, fascinating, uh, article and I think his quote was literally like, we're gonna solve all, all known diseases in 10 years or something like that. And. And I, I, I, I would love for them to do that, but I also think there is an enormous amounts of bandwidth problem they're gonna face, uh, exactly like what you're talking about, which is who is the, unless you eliminate human trials in our altogether, maybe, um, maybe that, that they can come at some point.
But, uh, at least given the current regime and, uh, uh, you know, process, uh, I sort of see the bandwidth massively increasing in certain pillars as you've categorized it. And in some areas we're, we're desperately in need of better solutions to improve the bandwidth there, uh, and productivity there. Right, right.
Which again, comes back to the number of sites, number of people at the sites and everything else, which goes on at the site and uh, uh, and the CRO and the sponsor. So, so the clinical development at aspect of it. So is that sort of how you, you would see it as well, like in terms of where we're probably going?
I
Dr. Namrata Saroj: do, you know, there's aspiration and then there's realism. Right. And I think for a long time we've been hearing ai. I mean, I remember a few years ago at arvo, which is our, one of our big research meeting meetings, as you know, um, there was like one session on AI and now we both have just come back from arvo.
I mean, it was. Everywhere. Right? There was no topic that was getting discussed without ai. So let's, that's, that's the progress and it's, it's really good progress. But you are right. There's, there's a lot of aspirations, but we have to be realistic about what's going to be achievable, right? Um, predict predictive biomarkers are, are going to be amazing, but I think we still have a lot of work to do.
It's not, we're not there yet. I think where, you know, if you look at our day-to-day work, and I'm not talking about. The clinical work that, that I'm engaged with or you are engaged with. It's more about even our personal lives, right? AI is. Assisting us in so many ways. So I think this concept of assisting where execution is needed, um, it, it's a no brainer for me, right?
Like, why wouldn't I want that help? I'm in, you know, I, I have, I have nephews who they always say, auntie, we start writing everything with chat GPT, right? Like, that's the norm now. So where is our chat g, pt?
Ram Yalamanchili: Yeah, I agree. And, and, and more, right? I think, uh, I, I also am a big believer that we're. We're gonna be seeing more agentic style use cases developing from now on.
Uh, I think for the past couple of years we've certainly done a lot of the, uh, traditional like chat or conversational ai, uh, chat bots, uh, that sort of thing. But, um, you know, the, the technology is maturing to a point where I think you can certainly start to think about. Uh, having an assistant or an agent, which is able to, uh, you know, very, very ca a capable assistant right.
Was able to take on some of this work and, uh, perform it on your behalf and come back. Uh, and yeah, we certainly need that. I think clinical research can definitely use that, multiple different roles in the research industry could use that. Uh, and, you know, the roles are across multiple organizations. We have sponsors, we have CROs, we have sites, and they all have different roles.
And I would say a, a, a, uh. Uh, a need exists for all of these different roles to have some form of a AI team, mayor and assistant. Uh, yeah. I
Dr. Namrata Saroj: think the only comment I'll make is I don't think it's gonna be replacing anything. It's gonna be assisting, and I think that's the word we wanna emphasize. It's, it's an assistant, right?
Ram Yalamanchili: Yeah. Um,
Dr. Namrata Saroj: and as you guys put it at, tell that it's a teammate. And I think that's important for people to understand that, uh, you know, we still need the workforce the way we do. We just need to become more efficient because of the needs that we have now.
Ram Yalamanchili: Absolutely. I mean, I, I think there's several camps on this.
I've seen people say, oh, you know, AI is gonna replace, uh, you know, this and that. But I, I've been pretty convinced from, uh, you know, several years now that we're gonna see sort of like an abundance of opportunity driven by ai. I think the. Ultimate, uh, uh, you know, the, the world where we would probably hopefully live in soon will be an a place where we have many problems in front of us and we have the resources to solve those many problems, or at least take shots of these many problems.
Right? And I think anyone who's worked in the drug discovery space know that there are many challenges which we have not even touched upon, right? There's so many, uh, areas we could, we could probably ask the questions and hopefully if we had the resources and the ability we should go and. Pursue those.
Um, and that's not possible in the current regime. Like we've been at the current style of operations for the past decades, many decades now. And we've only achieved so much of productivity or bandwidth as we call the number of patients recruited. Like we've got the same exact issues and problems we've seen for the last many years now.
Dr. Namrata Saroj: So it's interesting you say that Is, um, I used to say this, uh, a lot and I still actually say is, you know, we've made such great advancements in the actual medicine, but how we bring those medicines to market are, we're so antiquated in how we work still, right? I mean, I worked. When I started my career, we were doing everything was paperwork, right?
Actual paperwork. And fortunately we've transitioned electronic, but just the way that things are managed and a lot of it, it still has to do with the regulatory sort of guidelines. But you know, nobody wants to take the risk and do something different because. There's so much at stake when you're developing a drug, so God forbid something goes wrong, you don't know if it's a drug or the way you did it, and so that's why there's this sort of apprehension to make these bold changes in the drug development process.
But at the same time, I think we are doing ourselves a disservice by not changing the the process. Or not, or, or not, you know, having the process, um, evolve the way it should be. Mm-hmm.
Ram Yalamanchili: Yeah. And, and I think changing process is probably one of the biggest aspects of how all of this is gonna get adopted.
Right. In general, like what is, what is your strategy there? Um, what I found fascinating is things like. Uh, you know, put aside the predictive AI parts of it. I think there's a, there's a certain amount of regulatory hurdle you would have to cross before you can actually adopt those type of, uh, use cases into your, uh, automation or ai.
Uh, I mean, I, I think like an example of that would be maybe looking at certain. Uh, imaging and predicting eligibility, for example. And I think that there's some excellent science in that aspect. Uh, but I, I think the hurdle is also pretty high, right? There's, there's companies which are focused on that, running their own clinical trials, for example, on the data and, and sort of, uh, proving out whether their models actually can predict and whether that can be used from a clinical setting, things like that.
But I also see another world where there's ample sets of opportunities in the workflow where you do not need to cross such a regulatory burden or a regulatory hurdle. Uh, you know, this could be something as simple as, uh, you know, did we dot all the i's and did we cross all the T's right on all my documentation?
Uh, did I follow the checklist of things which I'm supposed to follow as per the protocol? And, you know, is that, is there some kind of an, um, AI. Agent or a teammate, which can help me do that. And by and large, I think what we've noticed is those type of problems are the ones where there's a majority of, uh, focus in terms of actual day-to-day execution.
And it eases up a lot of time. There's multiple layers of checks currently in place because none of these are automated, so they're all manual. So you have people checking other people's work and, and so on and so forth, right? There's layers of checking and uh, I know the industry calls it monitoring, but.
Uh, overall I think there's, there's interesting opportunities where you, you have to sort of take a more holistic view and say, you know, I'm not gonna change so much of my process, it's just the way I, I come into this, um, execution model and, uh, use technology to do exactly what I would have, you know, my staff of five or 10 or 20 people do.
But, uh, have them use AI to be more productive, more consistent, more, more, more, uh, you know, reliable in terms of like the quality, they're able to do the set. And I'm, I'm seeing that already happen. I think from, from site sponsors and CROs perspective, uh, there's just tremendous amount of opportunity. The entire industry seems to be very much in like a manual mode right now.
And, uh. And sort of, uh, watching that transition slowly into a, a sort of a hybrid model. Um, so I think the question in my mind is what's, what's going to be that catalyst? I, I think at some point every industry needs a catalyst to adopt any type of technology. I know you've mentioned paper and papers, pretty much.
I think in certain areas it's not existent anymore, especially data capture is now electronic. Mm-hmm. Um. But I'm curious, like do you see any other trends which are gonna come in, which will basically drive the need for productivity or efficiency? Right. Yeah,
Dr. Namrata Saroj: I think the number one catalyst is competition, right?
I think, uh, every company right now is whatever they're doing, they're trying to get to that next milestone in an expedited way. So whatever you can do to get to the next milestone you're going to do. And, and if that the increasing of the efficiency can get you to the next milestone, they'll do it. So it's from a sponsor's perspective, that's essential.
There's also differentiation, right? So the, um, the c the CROs and the sites and, you know, what are they doing differently than somebody else is doing, right? I, I Coen a CRO as well. And when I'm looking to sort of pitch to companies, I'm looking to see why would you wanna choose me? Right. So it's, it's because I can give you something that maybe some other company doesn't have and, and I think this is where, you know, um, the adoption is so critical.
Becu is, um, if you don't adopt it, you are gonna be left behind. I mean, I think that's really the simplicity of this. So in
Ram Yalamanchili: some ways it's the competition which will drive that option.
Dr. Namrata Saroj: Absolutely.
Ram Yalamanchili: Uh, among, among your peers. Yeah.
Dr. Namrata Saroj: Yeah. Because how are you going to do something better? You know, I mean, let's look at tech.
The tech world, one technology versus the other. Technology only succeeds because somebody, they offered something that the other person did.
Ram Yalamanchili: Mm-hmm. Mm-hmm.
Dr. Namrata Saroj: Right. So, so that's going to be the key is like, how do I differentiate? And as I said, what we're doing in clinical trials has expanded so much. The volume is so much that you have to stand out from every perspective, right?
As a sponsor, you wanna be bringing a drug that, that is helpful to patient, that's safe. From a CRO perspective, you're able to execute really well. And from a site perspective, you have to show up and say, I can deliver, right? So I'm gonna be, my patients are gonna be well taken care of because I can do this trial efficiently.
And I, again, I just, the one thing I wanted also touch was I did do some monitoring way back in my days, and it was one of the most tedious jobs you can ever do. Like hats off to every monitor. We do some remote monitoring now, so things have helped with the ECRs. But to your point, double checking something just to make sure there's no error.
Probably still leaves arrows on the table. Mm-hmm. Mm-hmm.
Ram Yalamanchili: And I have a case study there where I think, um, frequently I've seen certain worksheets, like your visual equity scores, for example, I. Where you're expecting the person doing the test to also do calculations and eventually, based on that calculation, make a decision whether this particular patient is gonna be put into a arm or is there an, uh, an additional dosing which is coming up into the, into the treatment for, for, for the patient.
Right. And uh, I think it's pretty fascinating that those type of worksheets are not automated because you would think that those can be, I mean those are, um. You don't need AI for that. It's, it's, uh, it's much simpler than that. But, um, but to the extent that what I've seen, it's a pretty interesting scenario where, uh.
You know, something like that could meaningfully change the, the direction of the trial itself. Like, you know, the data which is being captured and whether you're doing it right or not, and yet it's not being done this way. Um, I'm curious, like, what, what, what's, why, like, why, why is this not happening?
Already?
Dr. Namrata Saroj: Asking the question I asked, remember I said. Medicines of advance, but our process hasn't. Right. Because it's about validations and, and, uh, guidelines. I, I, I wish I could give you an answer, but that's the unmet need. And I think it's, it's, you know, until recently we were still doing source documents.
Actually a lot of people still do source documents as a paper. 'cause you need to see where the pen hit the paper. But we're doing, you know, the EMRs everywhere. A lot of time there are no source documents. So eSource has come into Bing, which is really helpful. But it's, it's not that eSource has been around for a long time.
People are still adopt, adapting to it. So I think the process has been slow to evolve because as I mentioned, it's, it's just, it's, the change is scare is. Creates fear, I think, right? Like, we don't wanna do this 'cause it's always been done this way. Uh, but I think people have, actually, the word I would use now is instead of looking at it as changed, let's look at it as evolution.
This is, this is the next evolution.
Ram Yalamanchili: Yeah. I also found a lot of the systems today are not easy enough to configure or set up to, to suit this particular type of a use case. Oh, okay. But you could, you could try to do it. You might have the intention to try to do it. Um, but then you're becoming a software company yourself.
Exactly. You know what I mean? Like, you, you would have to budget a, a certain amount of your clinical trial budgets to, to do, go, go do this. And that's not something which you probably have, uh, you know, the right resourcing or the, or the talent, uh, uh, allocation within the company to go pursue. So, so these are another interesting, uh, aspect of what I've seen.
Dr. Namrata Saroj: I'll add to that, right. So sponsors are looking at. But most sponsors, as you know, outsource it with CROs to run the studies, right? So sponsors are not investigated it. They do what they're told to do. It's the CROs that have to invest. And until recently, I don't think CRO was this big business. It was a vendor, and that runs your trials.
But we've seen over the last five to 10 years where CROs sort of activity has, has gone up tremendously. They've been acquired by big companies. So there's, you know, when acquisition by big companies as you know, it's, it's good. In some ways, but not so good in some ways. And good is that they have, they can invest in in progress.
Right. And, um, what we're seeing, I mean I'm, I'm hearing this from the big CROs right now. They're looking into AI technology. Some of them are developing things on their own. So I think it's that movement that's happened in sort of creating these bigger organizations that will invest, to your point, somebody has to do it right, A small or a small sponsor, which are very budget constrained.
Are not going to invest, they're gonna say, Hey, this works why we don't need to change it. Right?
Ram Yalamanchili: Yeah. Yeah. I, I think being able to present a, a solution which is easy to adopt and, uh, is not, uh, you know, uh, obviously can be so prohibitive in the cost that it's, it's hard to adopt or even sell that as a value.
So I think that's where the gap is and certainly where, where, you know, we're trying to play a role here. Um. But, uh, but I do see quite a few of these sort of use cases, even in that situation, which I was telling you about. We, we had a study, um, where we had some access to the retrospective data, looking at these, uh, essentially scanned documents in their, in their repository.
Um, I mean the, the error rate, we were able to just showcase immediately saying, Hey, you know, do, did you realize that these, these, you know, set of worksheets had these calculation errors? And, uh, it's, uh, you know, it's critical from a, from a study execution perspective to know that, right? And it, it's one of those things where you have that aha moment.
You're like, wow, I wish I had this on a real time basis, because every time a site did it, it doesn't matter whether a paper or not. You know, nowadays LMS have the able to have visual, uh, cortex, you know, like they, they can see, they can read just like how we were. And, um, and you can have, uh, workflows built on top of it.
And you can, you can do some, some sort of, uh. Quality check. Just like, you know, you and I would if we were, uh, reading through this paperwork. Right. And, uh, this is what's like really interesting to me. I think there's some pretty clear benefits, which are not in the regulatory sort of realm of prediction or data generation.
It's more of I just have to do this. There's so much of this to do and there's a high error rate because it's a tedious amount of work and. And I would rather have an assistant there and an AI could do this day in and day, you know, day and night. Right. So it's uh, uh, that's just one example, but I've seen several such examples across the workflow.
Dr. Namrata Saroj: I think the word tedious is really important here, right? Because as we're talking about sort of the volume of trials going up, right? But we also, within a trial, the volume of data we're collecting is going up as well because, um. We, at least in say, in retina, we have many more imaging devices. There are functional tests and, and pros, right?
So all of that data, the number, the amount of data we're collecting goes up. So the, the aspect of, you know, being tedious goes up as well. And to your point, it's human nature, you know, we're not, we're not perfect. Well, there's going to be some errors.
Ram Yalamanchili: Yeah. Yeah. Um, my, probably like towards the tail end of some, some of these questions.
How do you see, you used the word competition and is that largely a time, is it a budget, is it a mix of everything? Like how, how do you see that? And, and what about talent? Like, you know, uh, just hiring and retaining, keeping the right talent as well. Right. So I'm, I'm curious, what, what are, is there more to, uh.
Discuss there in terms of like when you define it as competition and being competitive? I think
Dr. Namrata Saroj: everything you mentioned, right, so it starts with talent because you only want the right people running the studies. In all three. So let's just, you know, we'll do sponsor CRO insights, right? You need, you need, um, uh, talented individuals to actually design the right studies, design the right products, and be able to actually execute the right way.
See, and same thing for CROs. You need to be, um, you know. Have the right people to execute on the ground. And of course, at the site level for sure. And at site level, it's a combination. You know, you've got the investigators and you've got a study staff and study staff have become, you know, uh, a huge department.
There is because you want, it takes so much to run the studies to coordinate all these different aspects of what the sponsors are asking for. So the competition all comes in. The competition is, again, different for different. These three different elements, right? For the sponsor, the competition comes like, Hey, what am I, what are we providing to the sites?
Right? Is. Is, is a drug, I'm sorry, is a drug the right, um, something that's good for my patients. Um, but also we wanna be re we wanna be compensating the sites for the right amount too as well, right? There's a lot of hard work that goes in. So, you know, over the course of the years, I think it's more because the studies have become so, so.
Um, um, intensive and, and time consuming that you have to be compensating at a, at a really high level. So that's competition as well. Um, you know, I'll tell you, most of my sites, sometimes they wanna pick study, not because of the sponsor, but based on the CRO. They have very strong opinions about the CROs they wanna work with because that's the interaction on a, almost, on a daily level.
And if they don't like the people they're working with, they're not gonna do it. So. So if a CRO is gonna have, um, a monitor that's going to be, um, not well-trained or doesn't understand, um, the details of the trials or doesn't have experience in the therapeutic area and goes to a site that the coordinators have tremendous, uh, therapeutic experience, it's not gonna be a good match.
Um, um, so again, there's so many elements of the trial that, you know, you mentioned this earlier in the PO podcast that we haven't even uncovered everything because we don't know that this is an issue. And you can only uncover when you, when, when you sort of actually start delving into fixing things and you go, okay, maybe that other thing needs to be fixed as well.
Ram Yalamanchili: Mm-hmm. Mm-hmm. I'm curious, why do you think we have a sort of like, why, why don't we have more sites participating in this? In, in this, uh, ecosystem of research, uh, because I do hear sites are a bottleneck and there's only so many sites and, and investigators out there. Uh, but I'm curious, like, because it's, it's economically, it's viable.
Uh, at least it seems like it, and it's, it's a, uh, you really are pursuing something as a very interesting, uh, sort of a, um. Workflow, right? Like it's, you're working on cutting edge, uh, drugs or devices, there's tremendous benefit you can bring to the patient population in general. So, uh, I, I, I'd, I'd be curious to, to hear, hear, hear your thoughts, uh, given your experience in the space.
Dr. Namrata Saroj: So the impression is that it's not economically viable. Right. So that's actually how it started. So that's the nu probably one of the number one reasons. Um, the number of clinical sites now that we have is significantly higher than when I started. I. You know, uh, 20 year over 20 years ago, um, there is an interest in research, but it really depends on the type of practice we're seeing more and more.
Um, fellows and residents get exposed to the clinical trial world when they're in their trainings. So when they leave, they want to start it. Back in the day, that exposure was not there, so they didn't know any better, and you sort of join a practice and you. Kind of, um, do you know your routine clinical practice.
But now because they're doing their training, they're getting exposed. Um, I have a lot of young investigators who've gone into established practices with no research department, um, start their own department. Right. But it's a challenge still. I have, uh, one side where they have really, uh, great recruitment and I, I'm offering them to expand and do things.
And I was reminded that the rest of the group doesn't really believe in research, so they're not gonna invest in it. So that's the thing. It's, you have to invest in it. Before you can profit from it like anything else. Right?
Ram Yalamanchili: Right.
Dr. Namrata Saroj: So, so there is still a struggle. There's, you know, you would think that for all the number of retina practices I have, we should have so many sites and there should never be an issue.
So. But it's, it still is, it's, it's a, it's a lot of convincing for some, some of the younger investigators, um, to, for their senior partners to be, to be bought in, and then they have to deliver, and then they have to show that, you know, they're not losing money. They, they're actually making money. And that doesn't always happen with the first research project you do.
Um, so hopefully more and more people will see the bigger picture of research. Where you, you kind, I said, you know, it's cutting you on the cutting edge treatment. You can offer that to your patients, you, for your academic and, um, career growth. That's really great as well. So hopefully more and more people will see that in more and more practices will get established.
In fact, I will tell you, most of the great recruiters that we have in our studies right now are not your seasoned, uh, researchers. It's the young ones because they're motivated to do it.
Ram Yalamanchili: Mm-hmm. Yeah. Yeah. No, I, I think that's. That's an interesting take, and I can see that the activation energy required, you know, especially if you're a new site, just getting started, um, yeah, you have to invest and that there's a certain amount of uncertain, uh, uh, I should say, there's uncertainty in that process.
Yeah. In terms of what you're, uh, what you're getting into. Uh, it's a commitment. Uh, but again, I think. This is the type of interesting places where automation is, you know, always so much more beneficial than sort of, uh, you know, not, not using any automation, completely relying on manual processes. Right. So I think, uh, we, we've definitely seen sites even, uh, our, you know, our own experience has been like getting a lot from, uh, uh, bringing some of the cutting edge technologies to, to their practice.
Dr. Namrata Saroj: Yeah, so I think one other aspect of starting research or even some, some research centers, they share, um, study staff between the, the research department and clinic, right? And. I always say that's not always the best move because the work we do in clinic is not the same as we do in, uh, not exactly the same as we do in stu in the study arena.
And I think if, especially for those folks where they might have, um, you know, resource, um, limitations, any automation support helps because. Then they can balance both aspects because it is very demanding to be balancing both. If you spoke to study coordinators who are doing both, it's like, it is very difficult to kind of keep switching off like, okay, I'm doing the study, which is more documentation, I'm gonna clinic and I need to get the patients through.
So any automation we can help, there would definitely be, uh, appreciate it.
Ram Yalamanchili: Yeah. It's, uh, interesting, you, you put it that way. I've seen two, two versions of this, right? Uh, one is the early sites where. Uh, you know, they, they really are looking for any sort of help, which can, which can off floor, um, the work from their current staff.
So that's, that's one site, one set, one sort of a, uh, uh, phenotype. And then there's, these other sites are very high volume, high recruiting, like successful practices, which have built great research programs. But for them it's more about how can I do more with the, with the number of staff I trust and I've worked with for many, many years, and.
We don't necessarily, we're not too keen on like doubling, tripping out our, our staff because we have done it and there's some problem or the other, and they, that that's not the path they want to go after. Right. So I think, uh, either way I can see, you know, benefits from essentially like, you know, bringing in some sort of a, uh, automation or like AI technology, right.
So that's kind of where, where we are and what we're seeing.
Dr. Namrata Saroj: Absolutely. I think that, and this is what's the beauty of. Uh, technology and AI is, you can c it to what your need, right? It's not one formula fits all. And I think this is why the discussions I have with folks right now is, you know, when people say ai, it's not a, it's not one thing.
There's so many aspects to it. So what are, what is it that you need and do you have an AI solution for it? It's very different than saying. I'm, I have ai that means nothing.
Ram Yalamanchili: Yeah, I agree. And, and I think another realization which we've had is you have to go after, from a persona pers perspective, so which persona are you looking for?
Help? And, and, and can we solve it or can we not? Right. So, so, you know, we, we go that
Dr. Namrata Saroj: right. What's the in, in drug development? The biggest thing we go for is unmet need. Mm-hmm. What is that? And I, I'll give you an example of, of tech. It's not AI related, but several years ago I was helping a company that, um, it's on the other side of clinical trials.
We do prior authorizations for our drugs, right? I sit on clinical. I didn't know that. Priors were still being done with faxes and telephone calls, and somebody came up with an electronic system, and when we were trying to implement that, I, we got resistance from some sites that, oh my God, like, would my prior person get, you know, um, laid off or whatever.
You're like, no, they're helping them. They're gonna be more efficient in the prior are gonna do, right? Mm-hmm. That's. That's the conversation we're having now, again, in this respect with AI as well, that hey, we are not talking about replacement, we're not talking. This is about how we can make everybody more efficient.
Ram Yalamanchili: Yeah, yeah. No, absolutely. I think, uh, and like you said, I like the way you put it, right. I think. The competition will eventually drive this towards adoption. It's, uh, the benefits are very clear. It's not just about having a shiny tool. I think the productivity gain, the economic, uh, and the quality benefits you're getting are pretty tremendous.
Uh, with, with what we have. Uh. What we're seeing right now. So I do look at it as a matter of time rather than, um, you know, a matter of if or, uh, that sort of a thing. Right?
Dr. Namrata Saroj: Yeah. I, I, productivity and quality are gonna be very essential. So, you know, when we do site selections, um, we're looking at how do they recruit, which, you know, of course that's a different AI that's gonna work on that.
But the quality of the data really matters, right? When the monitors go in and tell us they have so many outstanding queries, you are getting red flagged. And so next time around, people will think twice like, okay, maybe they recruited well, but the data was a disaster, so we can't risk that anymore. Right?
Over the course of, uh, running clinical trials, I've had data from sites we had to actually exclude because it was not good, right? And. Think about how much of an investment cost that is and, and it can really affect the outcomes of virtual trial. And that, uh, affects sort of the entire drug development process.
So that's really critical that the sites provide good data. Mm-hmm. And, and if we can help them do that, their visibility goes up. And guess what? They're gonna be on top of the list for the next recruitment.
Ram Yalamanchili: Yeah. Yeah. Fascinating. Well, uh, thanks for your time. I think this has been a pretty interesting call and, uh, um, yeah, I hope to talk to you soon after that.
Thanks for, thanks for your time again.
Dr. Namrata Saroj: Thank you and, and great work on Tel. I think, you know, going as an AI teammate to the sites, to the sponsors, to the CROs, um, I think it's, it's gonna be really helpful. And I, as far as I know, I think you guys are the only ones doing that right now. So hopefully more sites will, will adopt and will get some companies to adopt them too.
Ram Yalamanchili: Yeah, it's happening. But, uh, thank you.
Dr. Namrata Saroj: All right.
Ram Yalamanchili: All right. Take care. Bye.