Building AI Agents with Memory

How long did it take to integrate into composite? We had a PR done in like 45 minutes and merged in an hour. Dumping will work, but it will make your agent worse in quality. Okay.

And worse at just answering the question in general. And this is one of the biggest problems with Open Law, that sometimes you would just wanted to invalidate some previous piece of information and have a new piece that's built on top of it. How we do it is we call them like, you know, the update edges. The agent will know that, okay, this was the prior one and this is the newer one, and the new one is built So, we're here at Dravya's place.

He is the founder of Super Memory, and Hi, how's it going? Hi, nice to meet you. Yes, nice to meet you. for inviting us.

We're really excited to chat. I love this space. Is this where you live and work? Yeah, yeah, that's right.

That's so amazing. Come in, let's sit. So nice to meet you, Dravya, finally. I love what you're building, and I'm excited to hear more.

Can you give a little bit more of an introduction of who you are? Yeah, a little bit about me. I'm Dravya. I'm the founder of Super Memory.

Um I have started Super Memory about a year ago to solve like the the memory problem of AI, and we can go in more into that, but yeah, that's a little bit about me. Amazing, and how I found out about you, so I searched you up on LinkedIn for some research, and I saw that you were a part of Build Space season 5, which is really exciting because I was also part of that, and I really want to know, did the early iterations of Super Memory start when you were at the um 6-week program? Yeah, yeah, so it did. So, right before the 6 weeks of Build Space started, season 5 was over the summer.

Uh I had like this like this app I had made for myself, and I had put it on GitHub. It was very new at the time. Build Space kind of literally guided me from making that into a from project to something that people actually use, uh which is like a product, and then into a company. So, it was like a an amazing experience for me.

I made so many friends uh during that time. It was in 2024. So, Supermemory became like one of the largest repositories or fastest-growing repositories of 2024 because of Build Space and like all the people that are that were helping each other. So, yeah.

Wait, that's so awesome. How old were you when you when you started this? So, I was 18 when the first iteration started. Now, I'm 20, unfortunately.

So, What inspired Is it something like personal in your life? What inspired you? So, it is actually both personal and very very interesting. So, I was you know, like the the idea came from this fact that I had a note-taking app for myself, which turned into a journal app.

And I was, you know, like writing a lot of letters to a lot of my friends on this letter-writing app. Very interesting. And I was like, "Dude, I'm writing like millions and millions of tokens of everything about myself. Yeah.

What if I take this and turn it into a chatbot that is me? And so, I made this thing for a friend's birthday, like this my own chatbot, which is kind of interesting, but um that was terrible at the time. And then, I was also like, you know, I I was not doing I did not do high school. Like, I was essentially dropped out.

So, I was like really knowledge-hungry for anything I could learn. So, I was saving all of these things to my note-taking app. And again, I was like, "Oh, maybe this should also be something that is about me. " So, I turned that into like it was called Anycontext before, which is all context about me.

ai which is also an insane story and then that turned into super memory. So yeah. What's the insane story? Should we talk?

let's do it. So there was this guy at meta. He was working on React Native and he just saw my project in the wild like the on GitHub and he he then found me on Twitter where my latest tweet was like should I call this super memory at this point? Then he was like oh, I happen to own the super memory domain.

Yeah. I can give it to you for free if you let me invest in your first round. And I was like I was just a guy in college building this as a side project. So I was like okay, obviously just give it to me and then two years later when I did raise my first round I let him know that I'm raising and he invested.

So yeah. That is so so amazing. And so why do you think memory is such a big deal for AI agents? What breaks without it?

Yeah, so right now there there's like two general problems here. So one is the context length being like either short or really bad when it's long and the second is self-learning about the user and personalization is really hard. Um so we we solve both of these use cases. So on the context length front there's this paper called No Lima and then there's another called context length or there's a bunch of papers that's that tell us that after uh like 30,000 tokens for most LLMs the performance really becomes bad.

Uh in fact sometimes less than 50% of like the intelligence that LLM has. Um and that's bad. So you have to optimize like despite having the long context to con- context length, you have to make sure you're giving it the right context to answer a certain question. On the other hand, um right now, like so that's something that already exists but needs to be better.

But right now, there's very few apps that are personalized to like AI personalization in any way right now. So, you know, when the internet started, there was like after web 2, everything started becoming personalized and that was the essence of the new new web. Um with with ChatGPT now being personalized, Cleo now being personalized, but everything else not being personalized is a big problem and it's either too expensive to do it or it's too difficult to do it for most companies to add that to their apps. So, we provide that as as well.

Oh, amazing. Should we go outside? Yeah, let's do it. Let's walk Let's walk to Dolores Park.

Yes. I noticed that you have a ODF poster. Yes. Were you part of So, you were part of Build Space and then you're also part of ODF?

Yeah. So, you mentioned that you are solo founder. Yeah. Were you like always a solo founder and like why did you decide to be a founder?

So, I um I had a few like quote-unquote co-founders that I was trying out with throughout the journey because Supernote has now existed for 3 years. Um And then like in all times, it either became like, okay, they're doing it part-time and they are amazing engineers and I would want to do it full-time with them, um but they want to go to college, for example. Um or it it was like, okay, this guy was going in a completely different direction than what I wanted to do. So, after all of these questions, I was like, I I already had been building this product for a year for 2 years at that point.

So, I was like, I'll just keep going on I'll see if I get a co-founder, I'll get it. Yeah. Otherwise, it's fine. I'll continue building solo.

And I stopped looking for one and I started focusing on the product and that's when it became like you know, really um like I I I think there's a lot of advantages to it. " Wow. And so, the reason why we're even like chatting with you, too, is because so, TrustCloud was using OpenCloud. Yeah.

Uh and so, the OpenCloud pattern for memory and like so, and the users, they started complaining about it wasn't good enough. Yeah. So, we switched to Supermemory and saw improvements. So, how does Supermemory deliver better performance compared to OpenCloud?

Yes. And existing memory systems. And there's a there's a lot of uh reasons for this and I'll start with our own core memory engine itself. Okay.

So, the way we built Supermemory and the way it understands users, um we make sure that it's very good across six facets. Um one is kind of knowledge extraction and understanding about what to learn and what not to learn about the user. Yeah. Um then there's temporal reasoning.

Multi-session temporal is through time, like understanding the change in time. Multi-session, which is if there's a lot of things that need to be answered with knowledge from multiple different places, it should be good at that. Um and you know, understanding preferences, user actions, and understanding what even the assistant says. Uh so, that's one facet to like that's one part to it, which is our core memory engine is really good at these things.

Okay. Then there's forgetfulness, which we think is very important and you cannot get that data out of markdown files. Um and so, like you know, you'll have to explicitly ask it to forget or explicitly ask it to remember. And the thing is you don't know like what the agent wants to remember with like at ingestion time.

Because you can bring up anything in the future. So, how do you make it such that it knows everything at all times? So, but on one hand you cannot extract everything into memories or save everything. And on the other hand, you have to still be selective and like handle updates and stuff like that.

Um, so the way we do it is we call this hybrid search where there's both memories that show up as context to the user and the raw information if the memory does not exist. It will just show up the raw part of the context where it should answer the question from. Oh, okay, okay. So, you have these update edges.

So, green for new memories and purple for updates. That's right. Why does that matter? Yes.

again tell me Let's start. So, knowledge updates are extremely overlooked when people think about memory. Because this and this is one of the biggest problems with Open Claw that sometimes you would just want it to like, you know, invalidate some previous piece of information and have a new piece that's built on top of it. Um, and so how we do it is we call them like, you know, the update edges um, where that old fact is completely forgotten.

It's not completely forgotten. It can still be brought up, but it will the agent will know that, okay, this was the prior one and this is the newer one. Yeah. Um, and the new one is built on top of it.

So, what's the difference between super memory and just jumping everything into an agent's context window? Yes. Um, this brings brings me back to the point I said before, which is dumping will work, but it will make your agent worse in quality Okay. and worse at just answering the question in general.

Um, so and also there's a limit to how much you can dump. You still have to be selective about what exactly you want to give it. and Open Claude has this really annoying thing where it will only send back the 15 last messages to Or or it's configurable, but like Um so imagine you have the last 15 messages with all the tool calls in between. Um and then you have the memory files below it.

Um So yeah, like you'll spend too much money on the tokens. Uh it will be slower to respond every single time because the way the LLMs work. Uh because this is not prompt cacheable because of the compaction. Um You will be sending the entire thread to the model provider and get it back on every single turn.

So you'll be billed like crazy. So yeah. So this is just more like organized. Yeah.

It's So in this case, you it's prompt cacheable because I I What What do you mean by prompt prompt cacheable again? So the way Super Memories returns the memories, it can be cached by the LLMs, is like And the like our SDK is injected at the right part of the messages array where it will, you know, like the static information is on the top and it rarely changes, so it's prompt cached, and the dynamic is in the bottom. And we only update the last point of the dynamic in the profile. Okay.

So maximum like, you know, 99% of it is actually already sent to the LLM before, so you're not billed on that. Yeah. How does Compose you now fit into Super Memories' architecture? Yes.

Uh and this is awesome because we reached out to Compose you last year Okay. uh asking if they want to use us. Okay. And now we use you guys as well.

Um Wow. So we have a consumer-facing app where, um you know, it's also an agent and you can use any LLM with it. It's the same thing that I mentioned which I built for the first version of Super Memory. But now the point is that you can take your memory and you You go to any LLM you want.

And so we were like okay, what tools should we add to make it like really good? Like Open Claw has it can do anything. We were like okay, we we first added the linear tools the Google Drive. We added all of these tools and then Soham from Composer told me about Toolbox.

Oh, hello. That's the amazing clips. So Soham told me about Composer Toolbox. Wow.

And I was like okay, I'll just add Toolbox and it has everything. So Okay. now the only two things that Soham we can do is use Composer Toolbox which is to do anything. Yeah.

Or reference its memory which is awesome. Nice. Uh what would building the those interrogations yourself would have looked like? How much how would it taken more time?

Yeah, it would definitely have taken a lot of time. Wow. We also have this sync product right now which we did build ourselves which syncs from Google Drive like the reason for building ourselves is like very deep but it syncs from Google Drive, Notion, web pages, all of these things. S3 and all of these things.

And it was such a pain to build it because like we we have to manage auth webhooks to make sure that okay, everything is in sync. Uh we have to debounce updates by 10 minutes so we have all of these complicated like workflow logic. Um and we had to do that for our enterprise customers. Um but we wish that we could use Composer for that also.

Oh, okay. So so you mentioned enterprise so are you targeting are your consumer like is it consumers and enterprise or Yes. So there's two products like Super Memories many companies in one company but the the two big products is the consumer facing offering which is our app which is your memory wallet that you can carry around anywhere. And then there's our API which these companies use to add memory to their own chatbots.

Yeah. Okay. How long did it take to integrate into Composer? Yeah, literally we thought about it like in one of these morning calls and we had a PR done in like 45 minutes and merged in an hour.

Oh my gosh. ly office and you knew the team. How did that How did you know the team? What was the story behind that?

Uh I have known the team for very long now. Okay. I actually don't remember how I met them. Uh-huh.

ly office. Okay. ly office and then there were three of us at the time. Wow.

So, it was like very early days for us. ly. Yeah, uh very early days for everyone. Where were you before that?

Where were you living before moving to I was in Arizona. I was studying. I dropped out to to start this company. Yeah.

Arizona. Wow. And so, did you take a big risk dropping out? Like, did you feel like it was a big risk for you?

Honestly, I would say that uh I also dropped out of high school as I mentioned before to start company. Oh my gosh. And then I sold that company and then I started another one. So, this time I felt like all right.

Like, no matter what, I'll be fine. Yeah. So, that's fine. And it's it's fine.

It's going great. ly folks. How? They reached out to me because they wanted to hire me.

Oh. And at the time I was like going to go to Anthropic, but then I decided to not do either of those. Oh my gosh. And so, because I think another big thing or what people are nervous about is they feel like they need more of that ex- start-up experience.

They need to work at a start-up. They need to work at big tech to gain that experience, mentorship, and you just you dropped out of school. You just went into it. Like, I would say you still do need it.

Uh I was very lucky to get get the both the start-up experience and the big tech experience very early because I was at Cloudflare. So, while I was building the version of Supermemory, I I working at Cloudflare. Uh I was working on like infrastructure and research, but also then I was doing developer marketing there. So yeah, like um And you were you were a how eight how old 18 18 How did you get that internship?

So this is a interesting story, but I was building a lot of like right after coming to the US, it was fresh after the acquisition, so I had no purpose in life. Okay. So I was like building a lot of things. Yeah.

And I was tweeting about how building is so easy today like with all of these things. Yeah. And yeah, it was not a thing yet. So it was just like Wow.

With with my stack you can build anything real quick. And the the I made like a template and that also went viral. And um So essentially in one of these products that I built it went like so viral. It got like 500k views in like a few hours and then a few million later.

Oh my gosh. That people started attacking the platform in any way they could. And they actually were able to DDoS it. They were able to publish like a lot of like you know, very interesting things despite me having all of these filters.

Yeah. And so I had to reverse engineer CloudFlare to change the ruleset's API and like to do all of these things to protect myself against a DDoS. And I wrote a blog about it. I made a video about it.

And the CTO saw it. The now CTO saw it. At the time he was VP of engineering engineering he saw it. " I got the offer letter in a few hours.

So yeah. So amazing. Oh my gosh. Such a good story.

Oh my gosh, have you been in the video? Oh my gosh, yeah. Yeah. Bye.

Yeah, right. I I love being here though. I think like you should always be around kids and dogs. Kids and dogs, yeah.

Yeah, that's that is the way. Why why do you think because why kids have exude this like youthful energy and they're very like Yeah, they're pretty much never sad and if they're sad and they're sad in a cute way. Oh, yeah. So, yeah.

Yeah. But I was just so first I was writing about blogs Okay. on this blogging platform. What blogging platform?

to Oh, okay. Have you heard of it? No. Yeah, it was just like some corner of the internet.

Wow. And um even there I was just sharing like oh, this is a little CLI I made. Oh, this is something I made. And over there no one saw saw the posts.

There was one of them that got to like 500k views. Uh and like that was funny because it was it was about Docker and that was my entry into Twitter. So, yeah. What How was that entry into Twitter?

So, like the founder the the founder of Docker and the current CEO of Docker both followed me. So, I just mentioned like oh, wow, like like both of these followed me. They were they were one of my first followers. So, that's awesome.

Wait, what year was this? I was 2020. 2020 and you were so you were on Twitter that you started going on Twitter because I feel like don't you think like I feel like now Twitter is becoming more of a like a a space for founders and like the tech people. Yeah.

When were you when you were on Twitter back then like was it different? Yeah, yeah, it was. I was not in these bubbles at all. In fact, I was not scrolling Twitter all day.

I was just posting things. Now it's the opposite unfortunately. What do you mean? Now you don't Now I I still post but I still scroll more than I post.

So, Okay. Yeah, but you gain the inspiration, yeah. We'll go back back to Compozio and so for memory can you give me a specific example of something Compozio made possible that would have been a nightmare to build yourself? I know you probably mentioned this but yeah.

Yes. So, I mentioned this before which is um the tool router of like you know, we wanted our agent which is Nova on the consumer side of things. We wanted it to feel like it can truly do anything and it knows a lot about you. Okay.

So, we wanted like a few use cases with that. Like, for example, um look at um your tasks today and send my team a small you know like nudge to do them. Yeah. And so first it it knows who my team is through Super memory.

Uh-huh. It's like okay, this is the general tasks uh of the company. This is the things that is going on. Yeah.

This is the teammates. This is the last few calls that Super memory is seeing through Google Drive. So, it will take them and then it would like you know use Slack API Yeah. to send them a message.

So, it can do that right now, which we like Wow. it would have been a huge pain for us to build. Wow. Yeah.

So, what's the world you're trying to create with Super memory? If this succeeds, what does that look like? Yes. So, I think in like a in a post AGI world, right?

Like, um we'll have robots walking around serving people. Like, anything you can imagine. Wow. You have to imagine it highly personalized.

Yeah. And you have to imagine that it knows that there's a feeling of okay, it's truly extremely smart. Like, with even with open claw like the biggest problem that people had with this new technology is that it's it's memory. Mhm.

And there's a reason for this. Like, people beli- like people want memory to be the building block. I think like agents is pretty much solved or is being solved. Yeah.

Memory is the the missing component to it, which we want to enable. That's awesome. If an another fou- founders building AI products right now, what advice would you give them? So, I I always say you have to have you have to be really public about it because to do anything new, you have to get like a lot of people to believe in you.

Um You have to approach it like I I think infrastructure is the better better place to be which composer is also building. So, um but I also think that there's a lot of consumer use cases that are not enabled. So, you have to have like a better product sense and for that the only way to do it is do the build space way, which is talk to users etc. etc.

Um So, yeah, like I think like people are not doing as much research as they should be doing um with all the like with all the benchmarks available like with everything like you literally open source. Like you can just find out how you can improve it and there's so many low-hanging fruits in all of these agents um that I I would you know I would want like all of these are very very technical, but uh I think that's pretty important to build a good product. Okay, and to really know the technical like do the yeah. Do you use like Perplexity for research?

No, I just use Cloud for everything. Oh, Cloud okay, for everything. And you mentioned talking to a lot of users. Like how many users did you have to talk to before you realized like this was like a a viable like a like a good thing?

So, the interesting part is Supermemory was never supposed to be a company. Um it was just like this build space project I was building while I was at Cloudflare. Um and so, what happened was I became a consultant first because I was posting about like oh, I have now have 100,000 users on this app, but I only have to pay $5 to run this. And all of these companies who wanted the same, they were like dude, we pay like 500 for this.

And uh so, I was like oh, let me come help you. I helped them for whatever use case they had and you know, they also like I have I made them really happy and I worked with like more than 30 companies. Uh and one of them actually uh raised from A16Z and when they when they were raising they they said that oh, like in in our series in their series they they said that dude, like our entire infrastructure was held by this 19-year-old and that's why A16Z reached to me and then that's when I started it as a company. So, yeah.

Wow. That Is A16Z um No, I did not raising from them. Uh which is It was speedrun and they wanted to me to do the consumer aspect of it. So, who did you raise Who did you raise from or I raised from Souza Ventures, Browder Capital, SF1 which is Sudarshan fund.

There's uh It's like a really cool guy. Um and Jeff Dean from who's the head of uh like research at Google and like a few other people at Google, Microsoft, OpenAI, Meta. Wow. Yeah, just like researchers everywhere.

So, yeah. How does your team look like now? How many people working on it? Who are they?

Yes. So, the way I I like to think about the team is I like believing in in underdogs. Um and so right now the team is mostly people who are low like less than 25 years of age. Um that's really cool.

We have two researchers, uh one product, one like one engineering, and one growth. So, I mean everyone is an engineer, but yeah, that's how we think of it. So, there's six of us now, all work in the office. Uh it's really fun people to be with.

And yeah, like really smart people. And I met all of them years ago. Like all of the I I have known known most of them for more than 3 years. So, yeah.

Wait, that's the best. You've known them for Because some people say that you can't you shouldn't do business with friends. But, it's been working for you and you wouldn't have it any other way. Like you think Like how does conflict like when you're when you're you have conflicts, how do you resolve those?

How does that work? Yeah, so we we usually don't have conflicts because we are all pretty aligned because the way I met these people was also because they started contributing to Supermemory, the open source version. The open source. And I was like, "Dude, like okay, you have been contributing so much for years and like just come and I'm I'm building a company now.

So I had to poach them from wherever they were working already. You convinced them. Wow. Yeah, that was really nice.

Um and you know like it's pretty hard to to hire. Oh. Especially people you already already know and get them aligned to what you're building. And I think that's pretty important.

So um we have to essentially become a salesman. Um A what? A salesman. Oh.

You have to do sales. Yeah. Um Like you have to do sales to even get people in your team. And and like once they're pretty aligned then there's not that many conflicts to begin with because everyone is like okay, this is the basics that we all believe in.

Mhm. And now for anything that like you know, what's the literally the better solution here? Like what does the data say? And what do the people say?

Yeah. Yeah. Wow, that's amazing. And you you're going to continue growing it or are you hoping to relocate another office in San Francisco or Yeah, we are we are we are looking at a few places.

Okay. Nice. Because I'm like I mentioned after the next round we'll have like a few more people so that room that will become too too small of a space. So yeah.

That is amazing. Okay. Any any last encouraging words? Um do you have um anything you're excited for in the next You mentioned how you're going to be raising for your series A.

Yeah. Yeah. Yeah. After um so when did you decide?

Like when do you when do you know you're ready for that? Yeah, so I think like I have I'm a huge believer in these inflection points throughout the world. Mhm. Uh in fact like you know, I I I I was watching the first rocket like the SpaceX rocket like land Yeah.

uh when I was a kid. I was like, okay, that was an inflection point for space space flight. There is there was a certain inflection points for LLM inference. Mhm.

And there there's been all these inflection points throughout humanity. And like the latest one was agents with lot code and open claw. Yeah. And now with the inflection point with agents you know, like happening, the next one is memory.

And so the market is like you know, asking for stuff like this pretty much every single day. And we are currently able to say that okay, we are one of the better solutions for memory. And we have like good revenue, we have good pretty much everything you would need. And yeah, I mean that's part of the reasons that makes me really excited for for what's next.

That's so amazing. Thank you so much for chatting with me. I'm really excited to see where Super memory is going to go and where should people check you out? Where are you most active on?

I am the most active is probably my Twitter, Super memory Twitter, our Discord server if you're really interested in the product. And yeah. I am hiring for a few roles both in infrastructure. Like the combination of infrastructure and research is one role and another is developer relations.

If you are like you know, really good at building Nice. products from zero to one then reach out to me. Are you selling this merch? Oh yeah.

How does it I'm not selling it, I'm just giving it away. Oh. One important thing in the back. Unforgettable.

He is unforgettable. That is part of the