Meeting Title: [HOLD] EOD Delivery Standup Date: 2025-11-19 Meeting participants: Mustafa Raja, Rico Rejoso, Uttam Kumaran
WEBVTT
1 00:00:02.920 ⇒ 00:00:03.700 Mustafa Raja: Hey.
2 00:01:09.880 ⇒ 00:01:11.220 Mustafa Raja: Here we go.
3 00:01:14.330 ⇒ 00:01:15.769 Rico Rejoso: I’m Safa, how are you?
4 00:01:15.770 ⇒ 00:01:18.040 Mustafa Raja: How are you? Yeah, I’m doing good, how are you?
5 00:01:18.280 ⇒ 00:01:20.109 Rico Rejoso: Good, I’m good. Yes.
6 00:01:21.250 ⇒ 00:01:24.950 Rico Rejoso: With, missile, in a meeting with partner.
7 00:01:26.840 ⇒ 00:01:29.430 Mustafa Raja: Oh, yeah. Yeah, I guess that’s okay.
8 00:01:29.580 ⇒ 00:01:31.419 Mustafa Raja: I guess I’ll wait.
9 00:01:31.770 ⇒ 00:01:34.940 Mustafa Raja: Let me know if I should be, though, or not.
10 00:01:35.300 ⇒ 00:01:37.730 Rico Rejoso: Yeah, we sh- I think we should,
11 00:01:38.030 ⇒ 00:01:42.399 Rico Rejoso: You can move the movie, so I think there’s probably some things that you want to discuss.
12 00:01:42.780 ⇒ 00:01:45.139 Rico Rejoso: During this… during this meeting.
13 00:01:46.300 ⇒ 00:01:47.050 Mustafa Raja: Okay.
14 00:01:47.670 ⇒ 00:01:51.739 Rico Rejoso: Yeah, but I’ll let you know. I’ll contact him in a while, after a few minutes.
15 00:01:52.240 ⇒ 00:01:52.900 Mustafa Raja: Okay.
16 00:13:04.810 ⇒ 00:13:05.820 Uttam Kumaran: Hello, sir.
17 00:13:07.650 ⇒ 00:13:08.479 Uttam Kumaran: Give me the name.
18 00:13:08.480 ⇒ 00:13:09.170 Mustafa Raja: Mmm.
19 00:13:11.040 ⇒ 00:13:11.810 Mustafa Raja: How are you?
20 00:13:12.080 ⇒ 00:13:15.619 Uttam Kumaran: Did anyone else show up? Sorry, we just, we just got off this call.
21 00:13:17.530 ⇒ 00:13:22.469 Mustafa Raja: Yeah, I have been seeing only me and Rico for now.
22 00:13:23.540 ⇒ 00:13:24.070 Uttam Kumaran: Great.
23 00:13:26.080 ⇒ 00:13:43.309 Mustafa Raja: Okay, yeah, so, I read through the Excel file, and I found that the agent usage metric, they’ve been tracking it with the name Assistant Admin Prompt, so I added that, and the graph looks not so good.
24 00:13:43.610 ⇒ 00:13:51.919 Mustafa Raja: I’ve shared that in Slack, if you can take a look. So let me know if I should, you know, have a graph separate for each.
25 00:13:52.110 ⇒ 00:13:53.260 Mustafa Raja: metric?
26 00:13:55.070 ⇒ 00:13:57.000 Mustafa Raja: Or if this is good enough.
27 00:13:58.350 ⇒ 00:14:00.400 Uttam Kumaran: You wanna share your screen?
28 00:14:00.740 ⇒ 00:14:02.870 Mustafa Raja: Oh, yeah. Oh, let me share.
29 00:14:03.820 ⇒ 00:14:06.500 Uttam Kumaran: Hold on, I’m just gonna leave to get my dog outside.
30 00:14:06.850 ⇒ 00:14:07.470 Mustafa Raja: Yeah.
31 00:14:52.850 ⇒ 00:14:53.620 Uttam Kumaran: Together.
32 00:14:54.380 ⇒ 00:14:55.320 Uttam Kumaran: Great.
33 00:14:56.750 ⇒ 00:14:59.230 Mustafa Raja: Yeah, so.
34 00:14:59.810 ⇒ 00:15:02.640 Uttam Kumaran: So this orange one is the.
35 00:15:02.690 ⇒ 00:15:05.919 Mustafa Raja: Agent usage metric, okay.
36 00:15:06.240 ⇒ 00:15:10.830 Mustafa Raja: Before that, it was looking, a little good, but now… .
37 00:15:10.830 ⇒ 00:15:16.080 Uttam Kumaran: Can you actually show it to me in the… in the, in the space? Yeah.
38 00:15:16.990 ⇒ 00:15:19.040 Mustafa Raja: Yeah,
39 00:15:25.500 ⇒ 00:15:28.759 Mustafa Raja: Yeah, this is, oh, yeah, I didn’t save that, sorry.
40 00:15:33.010 ⇒ 00:15:33.820 Mustafa Raja: Yeah.
41 00:15:38.270 ⇒ 00:15:39.320 Uttam Kumaran: Okay, great.
42 00:15:42.000 ⇒ 00:15:43.289 Mustafa Raja: Yeah, what do you think about this?
43 00:15:50.450 ⇒ 00:15:55.260 Mustafa Raja: I feel separating them would create a lot of graphs, so I’m.
44 00:15:55.260 ⇒ 00:15:58.250 Uttam Kumaran: Can you go to Chart Settings, or you’re in chart settings, right?
45 00:15:58.600 ⇒ 00:15:59.300 Mustafa Raja: Yeah.
46 00:16:02.780 ⇒ 00:16:04.750 Uttam Kumaran: You can’t do a dual axis?
47 00:16:07.230 ⇒ 00:16:09.089 Uttam Kumaran: I guess this is fine.
48 00:16:10.060 ⇒ 00:16:13.300 Mustafa Raja: I guess we can do… biography.
49 00:16:13.300 ⇒ 00:16:15.920 Uttam Kumaran: That’s okay, that’s okay.
50 00:16:16.480 ⇒ 00:16:19.460 Uttam Kumaran: So… so what did… what did this spreadsheet say?
51 00:16:20.010 ⇒ 00:16:24.039 Uttam Kumaran: Because one Clearly, clearly some of these got launched before, right?
52 00:16:25.230 ⇒ 00:16:34.079 Mustafa Raja: Yeah, so, only one of these got launched before, which is this one, the agent, admin prompt.
53 00:16:34.420 ⇒ 00:16:40.200 Mustafa Raja: And then I believe the rest of these were added on November 13th, which adds up.
54 00:16:41.060 ⇒ 00:16:43.549 Mustafa Raja: Since we start tracking it.
55 00:16:44.230 ⇒ 00:16:46.089 Mustafa Raja: Right… right about there.
56 00:16:46.650 ⇒ 00:16:47.970 Mustafa Raja: November 13th.
57 00:16:48.140 ⇒ 00:16:51.039 Mustafa Raja: This, agent usage one was added before, though.
58 00:16:51.970 ⇒ 00:16:55.299 Mustafa Raja: And they say that they have been already tracking it.
59 00:16:58.740 ⇒ 00:17:02.490 Uttam Kumaran: Okay, so… Let’s do two.
60 00:17:02.590 ⇒ 00:17:06.850 Uttam Kumaran: Can we create two views? Is it in a dashboard, though, or what is… what is it in Amplitude?
61 00:17:07.410 ⇒ 00:17:16.690 Mustafa Raja: I just joined this piece that Robert has been working on, and I just added it there. I don’t know if you have a dashboard or not.
62 00:17:19.440 ⇒ 00:17:22.969 Uttam Kumaran: Oh, okay, so can you, can you create…
63 00:17:26.630 ⇒ 00:17:30.060 Uttam Kumaran: Well, can you just create a new folder for just this task?
64 00:17:30.480 ⇒ 00:17:32.289 Uttam Kumaran: By chance? In here?
65 00:17:34.650 ⇒ 00:17:40.400 Uttam Kumaran: So you can just say, like, you can just say November 19th, yeah, AI,
66 00:17:40.550 ⇒ 00:17:42.649 Uttam Kumaran: Michael, I don’t know, whatever she said.
67 00:17:47.100 ⇒ 00:17:51.559 Mustafa Raja: Yeah, well, she said it AI tracking and revenue…
68 00:17:52.760 ⇒ 00:18:00.610 Uttam Kumaran: linting and docs audit that were launched in October. README engineers added these amplitude events. Most went live on November 13th.
69 00:18:03.570 ⇒ 00:18:05.360 Uttam Kumaran: So… yeah.
70 00:18:05.680 ⇒ 00:18:10.169 Uttam Kumaran: Basically, You can just put,
71 00:18:15.200 ⇒ 00:18:18.800 Uttam Kumaran: You can just put linting and docs audit.
72 00:18:21.860 ⇒ 00:18:26.869 Uttam Kumaran: We’ll do… do capitals for everything. Like, or capital as the first letter.
73 00:18:27.880 ⇒ 00:18:28.659 Mustafa Raja: Oh, okay.
74 00:18:30.850 ⇒ 00:18:34.140 Uttam Kumaran: You can do November 19th dash,
75 00:18:36.230 ⇒ 00:18:42.320 Uttam Kumaran: Like, November 19th hyphen, yeah, and then you could just put… Linting and docs audit.
76 00:18:47.590 ⇒ 00:18:48.660 Uttam Kumaran: events.
77 00:18:51.480 ⇒ 00:18:52.190 Uttam Kumaran: Okay.
78 00:18:52.340 ⇒ 00:18:56.530 Uttam Kumaran: And then, yeah. And then in here, if you can create two graphs, one that is just…
79 00:18:57.880 ⇒ 00:19:02.389 Uttam Kumaran: The one that’s always… that’s been working, and then one with the other ones that are…
80 00:19:03.550 ⇒ 00:19:05.690 Uttam Kumaran: been going since November 13th.
81 00:19:06.830 ⇒ 00:19:11.870 Mustafa Raja: Yeah, I’m trying… yeah, folder comes, yeah, I was trying to find it in the table.
82 00:19:12.690 ⇒ 00:19:15.349 Mustafa Raja: Okay, so I need to move the graph, right?
83 00:19:15.350 ⇒ 00:19:15.960 Uttam Kumaran: Yeah.
84 00:19:27.120 ⇒ 00:19:28.599 Mustafa Raja: Remove it, though.
85 00:19:47.790 ⇒ 00:19:51.549 Mustafa Raja: Yeah, so this should be in there now,
86 00:19:55.610 ⇒ 00:20:00.010 Mustafa Raja: And then, sorry, sorry, what did you say about, splitting them?
87 00:20:01.520 ⇒ 00:20:04.380 Uttam Kumaran: Well, I don’t… I just want one… like…
88 00:20:06.630 ⇒ 00:20:07.270 Mustafa Raja: One part?
89 00:20:07.270 ⇒ 00:20:12.840 Uttam Kumaran: Just create… just create two… I don’t know, what is this, like, thing? This is a chart?
90 00:20:13.540 ⇒ 00:20:14.020 Uttam Kumaran: Like…
91 00:20:14.020 ⇒ 00:20:14.610 Mustafa Raja: Yeah, so…
92 00:20:14.610 ⇒ 00:20:15.410 Uttam Kumaran: content.
93 00:20:15.860 ⇒ 00:20:19.109 Uttam Kumaran: So create one chart with just the… what is the orange one?
94 00:20:20.390 ⇒ 00:20:34.230 Mustafa Raja: One is the AI usage, that they, they have, and then these are the specific metrics on, on what the usage is. So, this is limit, usage limit hit, and then this is
95 00:20:34.340 ⇒ 00:20:44.839 Mustafa Raja: This AI agent add layout clicked, and then fixed drama, and then we have… This one, make concise.
96 00:20:46.220 ⇒ 00:20:47.660 Mustafa Raja: make concise collect.
97 00:20:47.660 ⇒ 00:20:52.629 Uttam Kumaran: But is there a… is there a dashboard in Amplitude? Like, can you create a dashboard, or what is, like…
98 00:20:53.450 ⇒ 00:20:55.180 Uttam Kumaran: Do you have to only, like…
99 00:20:59.070 ⇒ 00:21:02.849 Uttam Kumaran: Like, can you go back to that folder, and can you just see, create…
100 00:21:05.180 ⇒ 00:21:09.409 Mustafa Raja: So, in this space… Product usage.
101 00:21:15.900 ⇒ 00:21:18.060 Mustafa Raja: Yeah, this is… this is valuable, yeah.
102 00:21:21.410 ⇒ 00:21:26.400 Uttam Kumaran: So, can you just create a dashboard for this… this ask, and you can just put…
103 00:21:26.890 ⇒ 00:21:30.829 Uttam Kumaran: all the relevant charts into this dashboard. So if you go…
104 00:21:31.550 ⇒ 00:21:35.540 Uttam Kumaran: back to the November 19th folder, and you can just create a dashboard in there.
105 00:21:35.760 ⇒ 00:21:39.580 Uttam Kumaran: And then… Put everything in the dashboard.
106 00:21:46.450 ⇒ 00:21:49.760 Uttam Kumaran: I would just, you know… I mean…
107 00:21:49.760 ⇒ 00:21:52.329 Mustafa Raja: The template, right? .
108 00:21:52.930 ⇒ 00:21:56.300 Uttam Kumaran: I don’t think you need to do a template, yeah, I would just start from…
109 00:21:57.340 ⇒ 00:22:00.069 Uttam Kumaran: Zero, and just make sure, yeah, just start.
110 00:22:04.090 ⇒ 00:22:06.409 Uttam Kumaran: You just go back, just go back twice.
111 00:22:07.460 ⇒ 00:22:08.640 Mustafa Raja: Okay.
112 00:22:09.640 ⇒ 00:22:12.420 Uttam Kumaran: Yep, I did just create a new dashboard here.
113 00:22:12.840 ⇒ 00:22:13.450 Mustafa Raja: Oh.
114 00:22:14.580 ⇒ 00:22:19.279 Uttam Kumaran: Yep, then you can just add your existing content. You could add the existing content.
115 00:22:19.640 ⇒ 00:22:21.010 Uttam Kumaran: Or whatever.
116 00:22:21.620 ⇒ 00:22:24.570 Uttam Kumaran: So if you can add not only the total number of events.
117 00:22:25.470 ⇒ 00:22:29.709 Uttam Kumaran: Across… segmented by these three, but also the unique users.
118 00:22:33.410 ⇒ 00:22:36.769 Mustafa Raja: So, which users triggered this, right?
119 00:22:38.660 ⇒ 00:22:41.580 Uttam Kumaran: Yeah, but dude, it’s just… it’s just the event, right? So…
120 00:22:41.580 ⇒ 00:22:42.430 Mustafa Raja: Yeah.
121 00:22:45.360 ⇒ 00:22:50.300 Uttam Kumaran: No, no, no, not looking at all users, we’re looking at the number of events by event type.
122 00:22:58.740 ⇒ 00:23:06.180 Mustafa Raja: So, so this metric is, how many unique… Users did this okay.
123 00:23:07.170 ⇒ 00:23:08.489 Mustafa Raja: Even totals.
124 00:23:11.990 ⇒ 00:23:15.149 Uttam Kumaran: Yeah, but you want to see it broken out by event type, dude.
125 00:23:16.140 ⇒ 00:23:19.869 Uttam Kumaran: Like, go back to what the question she asked… she asked.
126 00:23:20.320 ⇒ 00:23:25.770 Uttam Kumaran: Right? She wants to track adoption and revenue metrics for two product features.
127 00:23:29.850 ⇒ 00:23:30.540 Mustafa Raja: Hmm.
128 00:23:30.710 ⇒ 00:23:36.000 Uttam Kumaran: So your job is to show That, right?
129 00:23:36.280 ⇒ 00:23:41.879 Uttam Kumaran: So… they sh… And did you happen to look through? There’s, like, a bunch of other…
130 00:23:43.370 ⇒ 00:23:46.990 Mustafa Raja: Yeah, I’m just not too much familiar with…
131 00:23:47.610 ⇒ 00:23:47.970 Uttam Kumaran: No, but I…
132 00:23:47.970 ⇒ 00:23:48.749 Mustafa Raja: I also think you’re missing.
133 00:23:48.750 ⇒ 00:23:52.839 Uttam Kumaran: things, but no, no, no, but I want you to start first by, like.
134 00:23:53.500 ⇒ 00:23:56.699 Uttam Kumaran: Understand what your goal is. You’re moving way too fast.
135 00:23:56.860 ⇒ 00:23:57.960 Mustafa Raja: Yeah. Right.
136 00:23:58.070 ⇒ 00:24:04.090 Uttam Kumaran: So… first of all, like, what is she asking? She’s asking, hey, we launched these two products.
137 00:24:04.840 ⇒ 00:24:10.359 Uttam Kumaran: And we want to know how many people are using it, and what are they doing, right? So…
138 00:24:10.360 ⇒ 00:24:14.369 Mustafa Raja: Open up… so first, open up the spreadsheet that I sent.
139 00:24:14.470 ⇒ 00:24:15.490 Uttam Kumaran: Do you have that?
140 00:24:17.150 ⇒ 00:24:20.160 Uttam Kumaran: So you can see how there’s other tabs, right?
141 00:24:21.440 ⇒ 00:24:22.120 Mustafa Raja: Boom.
142 00:24:23.170 ⇒ 00:24:26.330 Mustafa Raja: I was in Luca, so…
143 00:24:26.330 ⇒ 00:24:29.240 Uttam Kumaran: Yep, so… so now… okay, so…
144 00:24:29.390 ⇒ 00:24:47.489 Uttam Kumaran: what you need to… what you need to do is work… and this is where, like, you’re already working with AI, right? So… so keep working with… keep working with AI. Tell it to have… ask it for feedback on what dashboard to build, but give… give it what they ask… tell the AI what they asked for. So she said, we want to measure these…
145 00:24:47.520 ⇒ 00:24:55.750 Uttam Kumaran: Two products, and… We want to measure… not only… We want to measure…
146 00:24:56.890 ⇒ 00:25:02.660 Uttam Kumaran: Anything around insights we can get from those events? How many times are the events going?
147 00:25:02.970 ⇒ 00:25:09.940 Uttam Kumaran: like, which, like, how many users are clicking each event? And they want it to be broken out by the different products.
148 00:25:10.940 ⇒ 00:25:13.490 Uttam Kumaran: So I don’t… so I think you got… you’re like…
149 00:25:13.810 ⇒ 00:25:17.159 Uttam Kumaran: You rushed it, number one. Like, you went way too fast.
150 00:25:18.010 ⇒ 00:25:21.590 Uttam Kumaran: Slow down and think about, like, put your… take yourself out of, like.
151 00:25:21.850 ⇒ 00:25:25.530 Uttam Kumaran: Solving the problem for one second, and think through…
152 00:25:25.920 ⇒ 00:25:31.179 Uttam Kumaran: okay, what am I… what am I trying to… Solve for here, you know?
153 00:25:32.630 ⇒ 00:25:33.320 Mustafa Raja: Hmm.
154 00:25:35.480 ⇒ 00:25:40.289 Uttam Kumaran: So you need a dashboard with a couple different things. You need to look… you need to have it broken down by
155 00:25:40.790 ⇒ 00:25:47.079 Uttam Kumaran: each product, right? So, she said, we want to look at linting and docs audit.
156 00:25:47.980 ⇒ 00:25:48.810 Uttam Kumaran: Right.
157 00:25:49.350 ⇒ 00:25:59.159 Uttam Kumaran: So there’s two sections to the dashboard, and then you’re like, okay, what type of… I have these four events, what should I show? Okay, you want to look at how many people are doing the events.
158 00:25:59.400 ⇒ 00:26:04.739 Uttam Kumaran: per product, there are 4 or 5 events, right? So go to the linter in the spreadsheet.
159 00:26:06.830 ⇒ 00:26:13.640 Uttam Kumaran: So, see, there’s these events, right? So, you want to look at what are the total number of events for the linter product.
160 00:26:13.750 ⇒ 00:26:22.239 Uttam Kumaran: How does that break down per event? How many people are doing each event? So not only number of events, but
161 00:26:22.400 ⇒ 00:26:29.539 Uttam Kumaran: People. Who’s doing it, right? Who’s doing the most? Who’s doing the least? These are all the things that you want to create the dashboard around.
162 00:26:31.640 ⇒ 00:26:32.210 Mustafa Raja: Okay.
163 00:26:35.290 ⇒ 00:26:40.950 Uttam Kumaran: So it’s gonna take some… but this is where, like, it’s… but this is where you’re still… you’re still…
164 00:26:41.310 ⇒ 00:26:47.599 Uttam Kumaran: you’re still going too fast, like, what I want to hear is, like, what does the dashboard layout look like?
165 00:26:48.430 ⇒ 00:26:56.470 Mustafa Raja: Yeah, so, firstly, I believe, firstly, I need to segment the dashboard between these two.
166 00:26:56.780 ⇒ 00:27:04.320 Mustafa Raja: And also get, get some of the, review from AI, and then…
167 00:27:05.170 ⇒ 00:27:14.279 Mustafa Raja: And then I also need to get myself familiar with, how I can build, not only just events, how I can break down
168 00:27:14.380 ⇒ 00:27:15.609 Mustafa Raja: the users.
169 00:27:15.910 ⇒ 00:27:20.970 Mustafa Raja: See, yeah, so maybe I should see.
170 00:27:21.800 ⇒ 00:27:24.560 Mustafa Raja: I should ask it how this dashboard.
171 00:27:24.560 ⇒ 00:27:30.009 Uttam Kumaran: No, and you can put the… put the whole spreadsheet in there, by the way. Like, put the file in there. You don’t need… you don’t…
172 00:27:31.020 ⇒ 00:27:34.969 Mustafa Raja: You don’t necessarily need to copy-paste, you can just throw the entire file in there.
173 00:27:35.870 ⇒ 00:27:45.620 Uttam Kumaran: But ask… but give it context on, like, what you need. Ask it for help to create, like, a dashboard plan. And the other thing is, we already have… we have a dashboard outline in Notion, right?
174 00:27:49.010 ⇒ 00:27:52.089 Uttam Kumaran: So there is a… there is a Notion Outline 4 dashboard.
175 00:28:34.120 ⇒ 00:28:38.889 Uttam Kumaran: So this is a dash… if you search… go to KSN in Zoom chat.
176 00:28:41.180 ⇒ 00:28:41.990 Mustafa Raja: Oh, thank you.
177 00:28:47.820 ⇒ 00:28:52.749 Uttam Kumaran: So this is, like, what you want to do before you create a dashboard. So you can copy this to the README,
178 00:28:53.170 ⇒ 00:29:00.039 Uttam Kumaran: And basically, You have to do some data exploration, but ultimately, like.
179 00:29:00.750 ⇒ 00:29:06.540 Uttam Kumaran: You have to plan what you want this dashboard to look like, and then you can start building each component, you know?
180 00:29:16.420 ⇒ 00:29:17.500 Mustafa Raja: Yeah, this makes sense.
181 00:32:04.710 ⇒ 00:32:08.880 Uttam Kumaran: Yeah, so exactly, like, these are all really, really good ideas.
182 00:32:10.470 ⇒ 00:32:12.820 Mustafa Raja: But the first thing I would just start…
183 00:32:13.010 ⇒ 00:32:18.330 Uttam Kumaran: Is by showing the events, by product.
184 00:32:18.500 ⇒ 00:32:21.870 Uttam Kumaran: The people, and the number of events. So start there.
185 00:32:22.210 ⇒ 00:32:23.150 Uttam Kumaran: But, like.
186 00:32:23.440 ⇒ 00:32:32.559 Uttam Kumaran: this is how you should think about it, like, it’s… it’s not just like, oh, I found the event and I show the graph. Like, these are people clicking and using a product, dude, so put yourself in that.
187 00:32:33.160 ⇒ 00:32:37.609 Uttam Kumaran: and that, in that sense.
188 00:32:38.670 ⇒ 00:32:39.370 Mustafa Raja: Yeah.
189 00:32:43.240 ⇒ 00:32:50.490 Mustafa Raja: And let me see how I can, break down… That’s tough.
190 00:36:10.770 ⇒ 00:36:11.380 Mustafa Raja: Hmm.
191 00:36:21.030 ⇒ 00:36:28.650 Mustafa Raja: So, yeah, so I’m seeing how I can, break it down by… Buy more properties.
192 00:36:29.130 ⇒ 00:36:41.730 Mustafa Raja: We have grouped by, and so I can use that. I just want… wanted to ask, what did you say about how, how I should start this, dashboard?
193 00:36:41.850 ⇒ 00:36:43.509 Mustafa Raja: Like, yeah, so you…
194 00:36:44.240 ⇒ 00:36:47.590 Uttam Kumaran: You just want to start by showing, by product.
195 00:36:49.040 ⇒ 00:36:53.069 Uttam Kumaran: Like, the number of events by event type.
196 00:36:53.420 ⇒ 00:36:56.329 Uttam Kumaran: And the number of unique users by event type.
197 00:36:56.700 ⇒ 00:36:58.740 Uttam Kumaran: And just start there, you know?
198 00:36:59.610 ⇒ 00:37:00.010 Mustafa Raja: Okay.
199 00:37:00.010 ⇒ 00:37:02.919 Uttam Kumaran: Think about if you were… think about if you were running README.
200 00:37:03.480 ⇒ 00:37:04.280 Uttam Kumaran: Right.
201 00:37:04.600 ⇒ 00:37:06.529 Uttam Kumaran: Do you know what README is, by the way?
202 00:37:06.900 ⇒ 00:37:08.959 Mustafa Raja: Yeah, they do the documentations.
203 00:37:09.300 ⇒ 00:37:10.109 Uttam Kumaran: Yeah, so think about.
204 00:37:10.110 ⇒ 00:37:11.450 Mustafa Raja: They released some features…
205 00:37:11.450 ⇒ 00:37:20.500 Uttam Kumaran: yeah, they release some features, and they just want to know who’s using it, what are they using it for, how is it impacting, right? So, that’s sort of where you want to start here.
206 00:39:26.670 ⇒ 00:39:30.760 Mustafa Raja: Yeah, so I’ll, I’ll work on this and, come back to you with a version.
207 00:39:30.930 ⇒ 00:39:32.360 Mustafa Raja: Then… Okay.
208 00:39:32.840 ⇒ 00:39:33.620 Mustafa Raja: Yeah.
209 00:39:34.060 ⇒ 00:39:41.589 Mustafa Raja: So for the rest of my day, I work the riddle on, ABC triages, and then
210 00:39:41.800 ⇒ 00:39:50.290 Mustafa Raja: The AI team met… To discuss, how the PERD should go, and then,
211 00:39:50.450 ⇒ 00:39:59.620 Mustafa Raja: Onboard that… Gabe on, LangFuse, okay. To, help…
212 00:40:00.470 ⇒ 00:40:07.859 Mustafa Raja: Adjust the prompt and also, test how the agent is working after each iteration.
213 00:40:07.970 ⇒ 00:40:14.680 Mustafa Raja: And then… And then, yeah, rest of it was mostly… Reading.
214 00:40:15.620 ⇒ 00:40:20.919 Uttam Kumaran: Okay, well, yeah, keep working on Remy. I would say today, if possible, if you can just get
215 00:40:21.140 ⇒ 00:40:25.180 Uttam Kumaran: a couple things into a dashboard I can review. I’ll be on the rest of the day, so…
216 00:40:25.180 ⇒ 00:40:30.180 Mustafa Raja: Oh, yeah, yeah, yeah, I’ll be… I’ll be up for more… 2… 2-3 more hours.
217 00:40:30.380 ⇒ 00:40:33.860 Mustafa Raja: So, I’ll have something for your review.
218 00:40:34.560 ⇒ 00:40:36.410 Uttam Kumaran: Okay, okay. Thanks, dude.
219 00:40:36.410 ⇒ 00:40:37.800 Mustafa Raja: You…
220 00:40:37.800 ⇒ 00:40:47.499 Uttam Kumaran: Use the… use the outline for your advantage, you know? And also, if you end up making, like, good… if you end up making a good prompt or something, feel free to save it and share it.
221 00:40:48.870 ⇒ 00:40:50.210 Mustafa Raja: Oh yeah, I’ll do that.
222 00:40:50.330 ⇒ 00:41:02.429 Mustafa Raja: Also, I saw that, the queries I, I made were not, what’s it called?
223 00:41:03.000 ⇒ 00:41:21.230 Mustafa Raja: quite relating to, to this. So, what this funnel says, okay, the people that signed up, on, in, in September, only the, these, projects created are about only, only those users.
224 00:41:21.230 ⇒ 00:41:29.320 Mustafa Raja: Whereas my query would… would say, okay, these are all, created projects in…
225 00:41:29.540 ⇒ 00:41:34.480 Mustafa Raja: September. So what I did is I created,
226 00:41:35.850 ⇒ 00:41:41.840 Mustafa Raja: An aggregate, an aggregation on, what’s it called?
227 00:41:42.060 ⇒ 00:41:50.030 Mustafa Raja: MongoDB, and these numbers then are very close to what the funnel, is in.
228 00:41:50.030 ⇒ 00:41:50.530 Uttam Kumaran: Mmm.
229 00:41:52.390 ⇒ 00:41:53.410 Uttam Kumaran: Oh, okay, wait.
230 00:41:53.410 ⇒ 00:41:53.790 Mustafa Raja: Yeah.
231 00:41:53.790 ⇒ 00:41:54.120 Uttam Kumaran: Okay.
232 00:41:54.120 ⇒ 00:42:11.890 Mustafa Raja: So the total created users for, are still 8,000. I believe if we add, not only just these filters, so these filters are created at, but add more filters, maybe we can capture, capture it better.
233 00:42:12.740 ⇒ 00:42:16.160 Mustafa Raja: But apart from that,
234 00:42:16.750 ⇒ 00:42:25.530 Mustafa Raja: The project created is pretty close, so total project’s 1,993, and it says 1869, and then…
235 00:42:25.640 ⇒ 00:42:30.509 Mustafa Raja: Similar for, attempted launch.
236 00:42:30.660 ⇒ 00:42:40.039 Mustafa Raja: So launch projects would be 227, and then this, this is a little higher, amplitude says 11, and this is 33.
237 00:42:40.820 ⇒ 00:42:42.000 Mustafa Raja: So, yeah.
238 00:42:42.110 ⇒ 00:42:44.740 Mustafa Raja: I’ve updated this in the…
239 00:42:45.040 ⇒ 00:42:47.179 Mustafa Raja: Fred? For Robert, so he can just…
240 00:42:47.180 ⇒ 00:42:48.699 Uttam Kumaran: Let me, let me just see the…
241 00:42:49.160 ⇒ 00:42:51.900 Uttam Kumaran: Yeah, let me take a look at the notion…
242 00:42:52.220 ⇒ 00:42:54.699 Uttam Kumaran: Maybe I can even just ship it today.
243 00:42:56.100 ⇒ 00:42:56.460 Mustafa Raja: Okay.
244 00:42:56.460 ⇒ 00:42:57.190 Uttam Kumaran: second.
245 00:42:57.470 ⇒ 00:43:00.359 Uttam Kumaran: Hold on, give me one sec, let me just look at it while you have it.
246 00:43:00.360 ⇒ 00:43:01.860 Mustafa Raja: Yeah, easy. Yeah.
247 00:43:08.010 ⇒ 00:43:09.260 Uttam Kumaran: amplitude…
248 00:43:14.160 ⇒ 00:43:19.619 Mustafa Raja: I didn’t remove what I said earlier, though, I just added this down below.
249 00:43:22.860 ⇒ 00:43:24.760 Mustafa Raja: I hope it’s… that’s okay.
250 00:43:26.890 ⇒ 00:43:29.649 Uttam Kumaran: Wait, say that one more time?
251 00:43:30.210 ⇒ 00:43:35.950 Mustafa Raja: So, the previous, analysis that I did, I didn’t remove that.
252 00:43:36.160 ⇒ 00:43:41.189 Mustafa Raja: I added this, new thing, down below.
253 00:43:41.830 ⇒ 00:43:44.819 Uttam Kumaran: Oh, okay, then let’s, well, then I’m just gonna…
254 00:43:45.220 ⇒ 00:43:47.070 Uttam Kumaran: Let me move this to the top.
255 00:43:47.750 ⇒ 00:43:48.380 Mustafa Raja: Okay.
256 00:43:49.080 ⇒ 00:43:50.229 Uttam Kumaran: And then…
257 00:43:53.380 ⇒ 00:43:57.300 Mustafa Raja: Yeah, I just wanted visibility on what I was doing and what I changed.
258 00:43:57.300 ⇒ 00:43:58.020 Uttam Kumaran: Yeah.
259 00:43:58.220 ⇒ 00:44:02.250 Uttam Kumaran: And then, so what can I call the… what can I call the top section?
260 00:44:04.770 ⇒ 00:44:16.079 Mustafa Raja: Top section, we can say that this is more aligned with funnel, on how funnel is working, whereas the below one is, like, yeah, it’s… it’s not…
261 00:44:16.190 ⇒ 00:44:23.069 Mustafa Raja: It’s like, all of the filters are overall, and not relating to the users that were created.
262 00:44:23.370 ⇒ 00:44:26.510 Mustafa Raja: On September.
263 00:44:29.450 ⇒ 00:44:30.450 Uttam Kumaran: Okay.
264 00:44:31.130 ⇒ 00:44:31.810 Mustafa Raja: Yeah.
265 00:44:32.560 ⇒ 00:44:48.400 Mustafa Raja: So this… the top one would only include projects that were created by the users that were, that signed up in September, whereas the below one is like, oh, it doesn’t filter on any sort of user.
266 00:44:48.850 ⇒ 00:44:50.070 Uttam Kumaran: Okay, okay, okay.
267 00:44:50.620 ⇒ 00:44:54.149 Uttam Kumaran: So I put looking at all users, not just September users created.
268 00:44:54.510 ⇒ 00:45:01.890 Uttam Kumaran: So then here, I’m just gonna put, well… Amplitude funnel verification…
269 00:45:03.940 ⇒ 00:45:06.980 Uttam Kumaran: Below this one occurs to fulfillment.
270 00:45:20.070 ⇒ 00:45:22.100 Uttam Kumaran: Okay, but I guess still…
271 00:45:25.140 ⇒ 00:45:29.000 Uttam Kumaran: here on the updated results, we’re not… I need to see…
272 00:45:29.450 ⇒ 00:45:32.390 Uttam Kumaran: A table of what it is in both systems.
273 00:45:34.600 ⇒ 00:45:35.050 Mustafa Raja: boots.
274 00:45:35.050 ⇒ 00:45:36.380 Uttam Kumaran: You see what I’m saying? Like…
275 00:45:37.550 ⇒ 00:45:44.750 Mustafa Raja: So, I guess in, from Amplitude, this, I have this graph that Robert shared.
276 00:45:46.370 ⇒ 00:45:48.180 Mustafa Raja: I’m adding it to the.
277 00:45:48.180 ⇒ 00:45:51.900 Uttam Kumaran: Yeah, but I think… but I think… oh, but think about, like, it’s not… I…
278 00:45:52.260 ⇒ 00:46:00.710 Uttam Kumaran: I don’t… you don’t… you… think about, like, science, right? You don’t just put a… you don’t want to put just a screenshot and say, like, look what it says, like, make a table, you know?
279 00:46:01.550 ⇒ 00:46:03.099 Mustafa Raja: Okay.
280 00:46:03.100 ⇒ 00:46:05.890 Uttam Kumaran: Like, think about, think about, think about it.
281 00:46:06.050 ⇒ 00:46:13.369 Uttam Kumaran: Right? Like, if we… what… it’s not… it’s not very scientific to just say, look, screenshot matches, like, make a table, put the… what you’re seeing in both.
282 00:46:13.660 ⇒ 00:46:15.220 Uttam Kumaran: And then you can link, also.
283 00:46:15.220 ⇒ 00:46:16.340 Mustafa Raja: Oh, yeah.
284 00:46:16.340 ⇒ 00:46:18.639 Uttam Kumaran: You can link also to the query there, right?
285 00:46:20.200 ⇒ 00:46:23.229 Mustafa Raja: Did the query I made in, what’s it called?
286 00:46:23.520 ⇒ 00:46:24.590 Uttam Kumaran: Mongo, yeah.
287 00:46:24.590 ⇒ 00:46:25.270 Mustafa Raja: Yeah.
288 00:46:28.660 ⇒ 00:46:30.429 Mustafa Raja: Okay, let me do that.
289 00:46:30.430 ⇒ 00:46:34.270 Uttam Kumaran: So let’s… let’s also… let’s turn this to the table with values.
290 00:46:35.360 ⇒ 00:46:43.109 Uttam Kumaran: Comparing… Mongo and Amplitude, with links to each Mongo query.
291 00:46:43.640 ⇒ 00:46:46.099 Uttam Kumaran: Yeah, so if you do that, I can… I can ship this.
292 00:46:47.140 ⇒ 00:46:47.730 Mustafa Raja: B.
293 00:46:58.930 ⇒ 00:47:01.599 Mustafa Raja: I actually have the table in here, somewhere.
294 00:48:28.260 ⇒ 00:48:37.770 Mustafa Raja: So this, so these values are not actually coming from, the queries. Mongo, unfortunately, doesn’t work like
295 00:48:38.010 ⇒ 00:48:42.680 Mustafa Raja: what’s it called? SQL, so we have to do aggregations instead.
296 00:48:44.370 ⇒ 00:48:45.050 Uttam Kumaran: Okay.
297 00:48:45.050 ⇒ 00:48:58.539 Mustafa Raja: So, what that means is, I went into the project’s, collection, and I said, okay, I, I need, so let’s filter from users.
298 00:48:58.690 ⇒ 00:49:04.389 Mustafa Raja: Where users were, created, in September.
299 00:49:04.580 ⇒ 00:49:10.720 Mustafa Raja: And, and then I, went from the added filters for
300 00:49:11.450 ⇒ 00:49:15.710 Mustafa Raja: They launch that, and then subscription.
301 00:49:15.910 ⇒ 00:49:22.769 Mustafa Raja: To get those. Yeah, that is pretty much it. I can share my screen, and I’ve added the link over here.
302 00:49:23.460 ⇒ 00:49:24.390 Mustafa Raja: for that.
303 00:49:26.410 ⇒ 00:49:29.170 Mustafa Raja: Below the screenshot for aggregations.
304 00:49:32.220 ⇒ 00:49:34.409 Uttam Kumaran: Sorry, my dog is just barking.
305 00:49:34.610 ⇒ 00:49:35.240 Mustafa Raja: Yeah.
306 00:49:36.270 ⇒ 00:49:38.700 Uttam Kumaran: Okay.
307 00:49:42.020 ⇒ 00:49:42.760 Mustafa Raja: This one.
308 00:49:43.320 ⇒ 00:49:45.000 Uttam Kumaran: Okay, okay. That’s fine.
309 00:49:45.350 ⇒ 00:49:50.529 Uttam Kumaran: Yeah, so… so you can just leave the link there. I think just make it, like, super, super clear.
310 00:49:51.390 ⇒ 00:49:56.700 Uttam Kumaran: So, maybe I can read it one more time. Okay, I understand what you mean, like…
311 00:50:04.050 ⇒ 00:50:05.580 Uttam Kumaran: Okay. Fair.
312 00:50:05.900 ⇒ 00:50:06.680 Uttam Kumaran: Come here.
313 00:50:08.770 ⇒ 00:50:09.800 Uttam Kumaran: Come inside.
314 00:50:10.720 ⇒ 00:50:11.410 Uttam Kumaran: Damn.
315 00:50:11.410 ⇒ 00:50:12.100 Mustafa Raja: Huh.
316 00:50:12.930 ⇒ 00:50:14.319 Uttam Kumaran: Sorry, my mic was just blank.
317 00:50:14.320 ⇒ 00:50:16.909 Mustafa Raja: It’s going, outside again and again.
318 00:50:19.690 ⇒ 00:50:20.620 Uttam Kumaran: He hasn’t.
319 00:50:21.570 ⇒ 00:50:23.100 Uttam Kumaran: This is what he does.
320 00:50:24.060 ⇒ 00:50:26.569 Mustafa Raja: You want to walk?
321 00:50:27.470 ⇒ 00:50:29.499 Uttam Kumaran: No, he’s been sitting outside.
322 00:50:29.990 ⇒ 00:50:30.970 Mustafa Raja: Oh.
323 00:50:31.410 ⇒ 00:50:32.809 Uttam Kumaran: He doesn’t do anything.
324 00:50:33.460 ⇒ 00:50:39.820 Uttam Kumaran: Okay, let me pull up… So… okay.
325 00:50:40.290 ⇒ 00:50:41.880 Uttam Kumaran: I see what you mean, okay, cool.
326 00:50:44.610 ⇒ 00:50:45.989 Mustafa Raja: Yeah, and then…
327 00:50:45.990 ⇒ 00:50:50.780 Uttam Kumaran: See, but it’s still, like, pretty far out, right? User sign-up success is not close.
328 00:50:53.680 ⇒ 00:51:03.880 Mustafa Raja: Oh yeah, user sign-up success isn’t close. I believe that, that might be, we need to add more filters.
329 00:51:04.690 ⇒ 00:51:06.840 Mustafa Raja: For success.
330 00:51:07.720 ⇒ 00:51:17.840 Mustafa Raja: It could be email activation and all. I don’t know, what events need to occur for Amplitude to record that.
331 00:51:20.390 ⇒ 00:51:21.310 Mustafa Raja: You know?
332 00:51:22.370 ⇒ 00:51:23.200 Uttam Kumaran: Hmm.
333 00:51:42.630 ⇒ 00:51:46.560 Mustafa Raja: Yeah, email verified… I guess we can do that.
334 00:52:41.970 ⇒ 00:52:44.269 Mustafa Raja: They have a lot of users, 1 million.
335 00:52:45.160 ⇒ 00:52:47.420 Uttam Kumaran: Yeah, yeah, yeah. It’s a famous product.
336 00:52:48.120 ⇒ 00:52:50.950 Mustafa Raja: Yeah, operating.io uses that.
337 00:52:53.960 ⇒ 00:53:06.559 Mustafa Raja: Yeah, so, yeah, only adding the email verified through reduced it from 8,900 to 5200, I believe.
338 00:53:08.870 ⇒ 00:53:13.200 Mustafa Raja: There could be more, we could… we need.
339 00:53:13.320 ⇒ 00:53:15.810 Mustafa Raja: For more accurate results.
340 00:53:16.250 ⇒ 00:53:22.780 Mustafa Raja: But, yeah, it just comes down to… I don’t know when Amplitude is recording it.
341 00:53:31.610 ⇒ 00:53:33.279 Mustafa Raja: Yeah, does it make sense?
342 00:53:34.230 ⇒ 00:53:35.350 Uttam Kumaran: Yeah, okay.
343 00:53:39.030 ⇒ 00:53:47.639 Mustafa Raja: Yeah, let me know if we should put 5200 or 8900, because with email verified true filter, it’s 5200.
344 00:53:48.710 ⇒ 00:53:52.719 Uttam Kumaran: But then what about subscription success? Still not close, right?
345 00:53:53.550 ⇒ 00:53:57.649 Mustafa Raja: Yeah, subscription success is not too close, yeah.
346 00:53:57.990 ⇒ 00:53:59.420 Uttam Kumaran: That is true.
347 00:55:43.810 ⇒ 00:55:47.019 Mustafa Raja: Yeah, so for… what’s it called?
348 00:55:48.610 ⇒ 00:55:51.450 Mustafa Raja: Per subscription,
349 00:55:51.610 ⇒ 00:56:02.560 Mustafa Raja: So the subscription, what’s it called? Subscription fields are attached to projects, not to users, right? So…
350 00:56:02.790 ⇒ 00:56:05.909 Mustafa Raja: A single user might have multiple projects.
351 00:56:07.960 ⇒ 00:56:18.130 Mustafa Raja: With subscriptions, no, I, I don’t know how it plays in amplitude, like, is it based on user, or is it based on…
352 00:56:19.130 ⇒ 00:56:23.589 Mustafa Raja: projects. So I’m assuming it’s… it’s based on projects.
353 00:56:24.010 ⇒ 00:56:25.460 Mustafa Raja: Does it make sense?
354 00:56:27.470 ⇒ 00:56:31.810 Uttam Kumaran: Not really.
355 00:56:32.370 ⇒ 00:56:39.390 Uttam Kumaran: I swear, I don’t know… I don’t really know. So, you can look into pricing, you can Google, look at, like, what… how they…
356 00:56:40.010 ⇒ 00:56:42.810 Uttam Kumaran: how README does pricing, you know, so…
357 00:56:42.810 ⇒ 00:56:43.560 Mustafa Raja: Wow.
358 00:56:45.720 ⇒ 00:56:48.070 Uttam Kumaran: But this is where I’m not very much help here.
359 00:57:21.290 ⇒ 00:57:23.860 Mustafa Raja: Yeah, they only include one project per…
360 00:57:27.680 ⇒ 00:57:32.469 Mustafa Raja: So, for multiple projects, we’ll have to have multiple subscriptions, I believe.
361 00:57:35.360 ⇒ 00:57:36.680 Mustafa Raja: Transition to good.
362 00:57:41.690 ⇒ 00:57:44.859 Uttam Kumaran: So, we should see… oh, I see what you mean, okay.
363 00:57:45.860 ⇒ 00:57:51.040 Uttam Kumaran: So, what… but I guess, shouldn’t we see multiple subscription events?
364 00:57:54.750 ⇒ 00:57:58.929 Mustafa Raja: Yeah, we do. Again, this is where,
365 00:57:59.340 ⇒ 00:58:01.770 Mustafa Raja: I don’t know how MGT is doing that.
366 00:58:34.770 ⇒ 00:58:36.580 Uttam Kumaran: Okay,
367 00:58:37.710 ⇒ 00:58:45.220 Uttam Kumaran: Yeah, I need to just drop to kind of finish some stuff on my own. Just been in meetings for, like, 6 hours,
368 00:58:45.600 ⇒ 00:59:05.530 Uttam Kumaran: I guess… I don’t know if… I just need… for me, like, ultimately, like, they’re trying to understand why these are different, so I just really need… if you can just put that in here, and make sure, like, see, I’m asking so many… I’m just asking question after question, because it’s not making… I’m not really understanding.
369 00:59:05.900 ⇒ 00:59:06.820 Uttam Kumaran: Like…
370 00:59:07.140 ⇒ 00:59:15.529 Uttam Kumaran: these numbers should be the same, right? So then you need to provide the reasoning on why they could be different, and leave that as an open question.
371 00:59:17.220 ⇒ 00:59:18.190 Mustafa Raja: Okay. Right.
372 00:59:18.580 ⇒ 00:59:26.270 Uttam Kumaran: So that’s, like, kind of what I would like to see here, because otherwise, I can’t really be of much more help. Like, right now, you know more than I do.
373 00:59:26.380 ⇒ 00:59:27.139 Uttam Kumaran: So, I’m just.
374 00:59:27.140 ⇒ 00:59:27.540 Mustafa Raja: I’m kidding.
375 00:59:27.540 ⇒ 00:59:40.810 Uttam Kumaran: helpful questions, but if they are different, I would like you to really indicate here on, like, what the potential reasons could be for the difference, and, like, make it really easy to see, like, to show your work, you know? That would be helpful.
376 00:59:41.380 ⇒ 00:59:42.000 Mustafa Raja: Okay.
377 00:59:44.340 ⇒ 00:59:48.509 Uttam Kumaran: Okay, and then let me know, I can review the dashboard, too, whenever you’re ready.
378 00:59:49.240 ⇒ 00:59:50.180 Mustafa Raja: Yeah.
379 00:59:50.460 ⇒ 00:59:59.340 Mustafa Raja: Yeah, let me just, let me know if I should work on Dashboard for the rest of the day, or if I should, you know, work on Notion a little bit more.
380 01:00:01.190 ⇒ 01:00:05.939 Uttam Kumaran: Yeah, I mean, I think if the notion is close, then I would like to finish that up.
381 01:00:06.850 ⇒ 01:00:07.610 Mustafa Raja: Yeah.
382 01:00:08.400 ⇒ 01:00:09.300 Mustafa Raja: Okay.
383 01:00:11.880 ⇒ 01:00:16.679 Uttam Kumaran: Right. So, if the notion is close, if you could finish that up, I can send it over to them.
384 01:00:17.490 ⇒ 01:00:18.130 Mustafa Raja: Okay.
385 01:00:18.980 ⇒ 01:00:19.570 Uttam Kumaran: Okay.
386 01:00:19.690 ⇒ 01:00:21.400 Uttam Kumaran: Alright. Thanks, dude.
387 01:00:21.910 ⇒ 01:00:23.090 Mustafa Raja: Thank you. Bye.
388 01:00:23.440 ⇒ 01:00:24.190 Uttam Kumaran: I…