Meeting Title: Brainforge Date: 2025-02-19 Meeting participants: Luke Daque, Mitchell Wright, Uttam Kumaran
WEBVTT
1 00:02:24.410 ⇒ 00:02:25.939 Mitchell Wright: Hey? How’s it going.
2 00:02:25.940 ⇒ 00:02:28.310 Luke Daque: Hi Mitch! Good day! How’s it going.
3 00:02:28.700 ⇒ 00:02:29.520 Mitchell Wright: Good.
4 00:02:31.000 ⇒ 00:02:32.490 Luke Daque: How’s everything? So far?
5 00:02:34.490 ⇒ 00:02:38.190 Mitchell Wright: It’s good. Yeah. Things are going well enough. How about you.
6 00:02:39.250 ⇒ 00:02:42.490 Luke Daque: Yeah, same, everything’s going well, so far. So yeah.
7 00:02:43.960 ⇒ 00:02:44.670 Uttam Kumaran: Hey, guys.
8 00:02:45.370 ⇒ 00:02:46.650 Mitchell Wright: What’s up? Bhutan?
9 00:02:47.107 ⇒ 00:02:47.850 Uttam Kumaran: How are you?
10 00:02:48.550 ⇒ 00:02:49.630 Mitchell Wright: Good.
11 00:02:51.340 ⇒ 00:02:55.620 Uttam Kumaran: Cool. So yeah, I guess, Luke, if you wanna sort of drive things and
12 00:02:56.350 ⇒ 00:02:58.309 Uttam Kumaran: and sort of see how far we can get today.
13 00:02:58.590 ⇒ 00:02:59.470 Luke Daque: Yeah, sure.
14 00:02:59.890 ⇒ 00:03:02.139 Luke Daque: So yeah, we wanted this
15 00:03:02.868 ⇒ 00:03:10.040 Luke Daque: meeting. So we can like, push, I mean, like, continue working on the both metrics stuff, especially the
16 00:03:10.970 ⇒ 00:03:17.760 Luke Daque: yeah. We have, like the the fields that we’re like, unsure where to get. And maybe we can, we can provide some clarity on that.
17 00:03:18.475 ⇒ 00:03:22.499 Luke Daque: Maybe before that. I I did. And I’m sharing my screen.
18 00:03:22.880 ⇒ 00:03:27.080 Luke Daque: So yeah, cool. So I did. Just
19 00:03:27.390 ⇒ 00:03:34.259 Luke Daque: map this out based on like all the events that we have in Snowflake currently from segment.
20 00:03:34.450 ⇒ 00:03:38.299 Luke Daque: So it looks like we have everything needed, and even some other
21 00:03:39.930 ⇒ 00:03:45.189 Luke Daque: tables that are in this list, like related to messages, for example, and like
22 00:03:45.730 ⇒ 00:03:49.909 Luke Daque: tokens and stuff like that. And I did actually create some
23 00:03:51.166 ⇒ 00:03:58.480 Luke Daque: tables back tables like for chat events, for example, which is just a consolidation of all the chat
24 00:03:59.080 ⇒ 00:04:02.860 Luke Daque: related sources that we have.
25 00:04:04.558 ⇒ 00:04:08.409 Luke Daque: So these are like event stables for for chat.
26 00:04:09.020 ⇒ 00:04:12.550 Luke Daque: And then there’s 1 for opens.
27 00:04:13.870 ⇒ 00:04:19.050 Luke Daque: So yeah, they’re all coming from. I’ll show you here.
28 00:04:20.130 ⇒ 00:04:23.880 Luke Daque: Like for tokens. For instance, there’s a lot of
29 00:04:24.090 ⇒ 00:04:27.649 Luke Daque: tables that are used like token limit reach
30 00:04:28.550 ⇒ 00:04:35.240 Luke Daque: monthly token limit rate reach daily monthly percentage of tokens used
31 00:04:35.700 ⇒ 00:04:39.430 Luke Daque: tokens purchased. So basically anything with token related.
32 00:04:40.200 ⇒ 00:04:40.610 Mitchell Wright: And.
33 00:04:40.610 ⇒ 00:04:44.160 Luke Daque: Also the the failed failures like failed to serve.
34 00:04:44.730 ⇒ 00:04:47.590 Luke Daque: Yeah, failed to fetch super base
35 00:04:48.000 ⇒ 00:04:50.360 Luke Daque: stuff like that. So anything that’s like failed.
36 00:04:50.750 ⇒ 00:04:55.580 Mitchell Wright: So those are gonna be like different tokens. So
37 00:04:56.260 ⇒ 00:05:01.769 Mitchell Wright: when it’s saying, like the super base Api token, that’s different than
38 00:05:02.793 ⇒ 00:05:09.710 Mitchell Wright: tokens that we’re using for, like the Llm. Provider.
39 00:05:10.070 ⇒ 00:05:12.129 Luke Daque: I see. So yeah, maybe we can
40 00:05:12.970 ⇒ 00:05:15.420 Luke Daque: move this into a different model than like for a.
41 00:05:15.420 ⇒ 00:05:15.850 Mitchell Wright: Yeah.
42 00:05:15.850 ⇒ 00:05:17.140 Luke Daque: But they really didn’t.
43 00:05:18.540 ⇒ 00:05:18.860 Luke Daque: So.
44 00:05:18.860 ⇒ 00:05:39.922 Mitchell Wright: I think so. Cause. Yeah. If you scroll down, just look at the like Union select star from daily token limit union all. So let’s see, so daily, token, limit, monthly token, limit, token, usage, tokens, purchase, referral tokens. Those all seem, I mean, without looking directly at the code. Those seem
45 00:05:40.670 ⇒ 00:05:43.820 Mitchell Wright: right. It’s gonna be probably the token failures. So.
46 00:05:43.820 ⇒ 00:05:44.560 Luke Daque: Yeah.
47 00:05:44.560 ⇒ 00:05:54.540 Mitchell Wright: The yeah. So failed to refresh super base token is a no or yeah. Let’s just go to the top of this token failures. And let’s just go through them one by one.
48 00:05:55.592 ⇒ 00:06:03.049 Mitchell Wright: Yeah. So that one delete that is gonna be different 3rd party tokens and rails. Yeah, that’ll be different.
49 00:06:05.610 ⇒ 00:06:08.120 Mitchell Wright: Refresh. Yeah, remove that.
50 00:06:08.710 ⇒ 00:06:10.730 Mitchell Wright: Yeah. I remember, or does that at.
51 00:06:12.320 ⇒ 00:06:13.380 Luke Daque: And doing him.
52 00:06:13.840 ⇒ 00:06:18.200 Mitchell Wright: And token request, update failed.
53 00:06:18.430 ⇒ 00:06:20.599 Mitchell Wright: I don’t know what that one is, but that would
54 00:06:20.810 ⇒ 00:06:25.119 Mitchell Wright: probably be relevant, so we can leave that one in.
55 00:06:25.290 ⇒ 00:06:25.870 Luke Daque: Okay.
56 00:06:26.920 ⇒ 00:06:28.280 Luke Daque: Sounds good. Yeah.
57 00:06:28.830 ⇒ 00:06:29.730 Mitchell Wright: Cool.
58 00:06:30.070 ⇒ 00:06:37.650 Mitchell Wright: and then, just for all the other ones, can we just look at those real quick scroll up to the oh, sorry on the tokens go back to the token events
59 00:06:38.240 ⇒ 00:06:44.750 Mitchell Wright: and just scroll up. Are these all just single table? Ctes, okay, that’s that’s great.
60 00:06:45.020 ⇒ 00:06:48.079 Luke Daque: I was basically just made sure, like they had all the
61 00:06:48.480 ⇒ 00:06:51.949 Luke Daque: same fields. So that, yeah, during the Union, they will.
62 00:06:52.870 ⇒ 00:06:53.929 Mitchell Wright: Like it.
63 00:06:54.610 ⇒ 00:07:01.859 Luke Daque: And yeah, we did the same for chats like, there’s bulk chat created event the bulk chat cancelled by user.
64 00:07:01.860 ⇒ 00:07:02.400 Mitchell Wright: Cool.
65 00:07:02.400 ⇒ 00:07:06.329 Luke Daque: Be able to. You’ll be able to see everything using the event type. So.
66 00:07:06.330 ⇒ 00:07:06.710 Mitchell Wright: Yeah.
67 00:07:06.920 ⇒ 00:07:10.880 Luke Daque: Example, and then chat mode used.
68 00:07:12.990 ⇒ 00:07:15.510 Luke Daque: Cat stopped, due to an error event.
69 00:07:15.510 ⇒ 00:07:16.989 Mitchell Wright: Okay, yeah, those are great.
70 00:07:16.990 ⇒ 00:07:20.640 Luke Daque: Like. Oh, these are the 4 events for chats.
71 00:07:20.990 ⇒ 00:07:25.259 Mitchell Wright: Love it. Messages. We have this one as well.
72 00:07:25.950 ⇒ 00:07:37.140 Luke Daque: Message sent bulk message complete, both message being started and message token limit.
73 00:07:39.010 ⇒ 00:07:42.159 Luke Daque: Or I wonder if this would be.
74 00:07:42.560 ⇒ 00:07:46.710 Mitchell Wright: Yeah, yeah, I’m not exactly sure what that event is.
75 00:07:47.900 ⇒ 00:07:54.590 Mitchell Wright: Bolt message, token limit. Let me just see.
76 00:07:55.440 ⇒ 00:07:58.529 Mitchell Wright: Let me pull up segment and have a look real quick.
77 00:07:59.870 ⇒ 00:08:01.279 Luke Daque: So check it. Here.
78 00:08:14.740 ⇒ 00:08:17.229 Luke Daque: let’s just do. The rows in here.
79 00:08:18.330 ⇒ 00:08:18.980 Luke Daque: Looks like.
80 00:08:19.020 ⇒ 00:08:23.480 Mitchell Wright: Oh, bolt message, token limit.
81 00:08:24.370 ⇒ 00:08:25.900 Mitchell Wright: Keep keep going right.
82 00:08:29.000 ⇒ 00:08:29.850 Mitchell Wright: Huh?
83 00:08:30.490 ⇒ 00:08:31.400 Mitchell Wright: Yeah.
84 00:08:32.179 ⇒ 00:08:38.360 Mitchell Wright: I don’t know. You just remove it. I don’t. This, since there’s only 2 rows. I don’t even know what that’s being used for.
85 00:08:45.767 ⇒ 00:08:47.552 Luke Daque: Yeah. Next we’d have the
86 00:08:48.870 ⇒ 00:08:53.379 Luke Daque: template events. So anything template related like template use.
87 00:08:53.380 ⇒ 00:08:55.280 Mitchell Wright: Oh, yes, this is great.
88 00:08:55.590 ⇒ 00:08:57.120 Luke Daque: No template used.
89 00:08:58.480 ⇒ 00:09:00.990 Luke Daque: And angular template generated.
90 00:09:01.110 ⇒ 00:09:01.730 Luke Daque: That’s what I.
91 00:09:03.940 ⇒ 00:09:04.780 Mitchell Wright: Thank God.
92 00:09:05.320 ⇒ 00:09:09.220 Mitchell Wright: delete that one! I don’t know what that one is, and I don’t think it’s related to Bolt.
93 00:09:09.640 ⇒ 00:09:10.260 Luke Daque: Okay.
94 00:09:12.780 ⇒ 00:09:21.669 Luke Daque: yeah. And so I’m still working on the others like page view events, for example, sessions and stuff like that. Maybe I’ll have another model for that one.
95 00:09:23.090 ⇒ 00:09:34.080 Mitchell Wright: Yeah, that’s perfect. I think what would also be helpful is if we go through the
96 00:09:34.290 ⇒ 00:09:38.920 Mitchell Wright: model worksheet with the entities and entity details.
97 00:09:41.467 ⇒ 00:09:55.370 Mitchell Wright: So let me pull this. Yeah, I’ll pull this up on mine. Which one would be, oh, okay, yeah. I could just actually see all the stuff. Okay? So what I think I’ll do is.
98 00:09:57.290 ⇒ 00:10:02.729 Mitchell Wright: yeah. So these were fine to leave out for now.
99 00:10:04.694 ⇒ 00:10:07.660 Mitchell Wright: We should have the data for
100 00:10:08.322 ⇒ 00:10:14.290 Mitchell Wright: created at and deleted that right now let me just see.
101 00:10:14.650 ⇒ 00:10:21.610 Mitchell Wright: and it might make sense. Also let me pull up table.
102 00:10:22.680 ⇒ 00:10:27.860 Mitchell Wright: So those are gonna be in the postgres stack blitz production. And I think.
103 00:10:28.581 ⇒ 00:10:32.189 Mitchell Wright: organizations is what we call them.
104 00:10:33.090 ⇒ 00:10:40.760 Mitchell Wright: So maybe we let me. Let’s rename this to, did I
105 00:10:40.940 ⇒ 00:10:53.519 Mitchell Wright: organizations. So this will be organization created at and organization deleted at
106 00:10:57.360 ⇒ 00:11:03.570 Mitchell Wright: postgres blitz organizations table.
107 00:11:03.920 ⇒ 00:11:08.269 Mitchell Wright: And I think, yeah, they should have. They both have a created at and deleted app field
108 00:11:09.170 ⇒ 00:11:11.509 Mitchell Wright: so that should get you those.
109 00:11:14.480 ⇒ 00:11:19.400 Mitchell Wright: This is gonna be in the organization members.
110 00:11:21.720 ⇒ 00:11:32.729 Mitchell Wright: I think. Let’s see. Yeah. So you’ll have to. You’ll have to just count the number of member rows for each organization, I believe. But
111 00:11:34.827 ⇒ 00:11:41.189 Mitchell Wright: for account team seats this, this, this, this, this.
112 00:11:42.880 ⇒ 00:11:45.017 Mitchell Wright: Those are deleted.
113 00:11:47.470 ⇒ 00:11:51.750 Mitchell Wright: this will be from Hubspot, so we can leave that for now and leave that for now.
114 00:11:54.640 ⇒ 00:12:06.763 Mitchell Wright: This would be organization. Id, and that will be that.
115 00:12:13.160 ⇒ 00:12:18.980 Luke Daque: The others, though there’s these would be stripe. Really right likes plan.
116 00:12:19.160 ⇒ 00:12:20.280 Mitchell Wright: Which which ones.
117 00:12:20.530 ⇒ 00:12:22.849 Luke Daque: Or is there anything for us
118 00:12:23.200 ⇒ 00:12:25.609 Luke Daque: from subscriptions that’s coming from stripe.
119 00:12:27.580 ⇒ 00:12:29.100 Luke Daque: Feel like coming from.
120 00:12:29.100 ⇒ 00:12:32.900 Mitchell Wright: Let me see what is on the organization’s table.
121 00:12:34.200 ⇒ 00:12:38.249 Mitchell Wright: Yeah, it’s weird that it doesn’t seem like they have the subscription.
122 00:12:39.480 ⇒ 00:12:42.009 Luke Daque: So we’ll probably have to pull that from.
123 00:12:44.540 ⇒ 00:12:47.569 Luke Daque: There’s an Id. I guess this is the subscription Id.
124 00:12:47.680 ⇒ 00:12:48.550 Luke Daque: The org.
125 00:12:48.890 ⇒ 00:12:57.320 Mitchell Wright: Yeah, yeah, it’s gonna be. It’s gonna be stripe subscription. Id is gonna be in stripe. And then the plan will also come from stripe, and then we’ll need to tie the
126 00:12:57.740 ⇒ 00:12:58.810 Mitchell Wright: stripe
127 00:12:58.970 ⇒ 00:13:08.009 Mitchell Wright: to the organization. And I’m looking at organizations right now, and I don’t think they have a stripe id like stripe customer id in there.
128 00:13:09.130 ⇒ 00:13:15.809 Luke Daque: Yeah, there’s there’s organizations. But yeah, it does have the stripe customer.
129 00:13:15.810 ⇒ 00:13:21.060 Mitchell Wright: Oh, organization subscriptions. Okay? Then it does. Okay. Okay, cool. So that should work. Then.
130 00:13:21.670 ⇒ 00:13:23.270 Luke Daque: Okay. Yeah.
131 00:13:23.270 ⇒ 00:13:25.740 Mitchell Wright: That you should be able to tie it via that table.
132 00:13:28.802 ⇒ 00:13:32.240 Mitchell Wright: And then the other thing. I want to look organizations members.
133 00:13:37.450 ⇒ 00:13:40.339 Mitchell Wright: I don’t know if they have the
134 00:13:42.840 ⇒ 00:13:50.490 Mitchell Wright: yeah to get the organization creator user, id, you’re gonna probably have to do like a window function and just find
135 00:13:50.700 ⇒ 00:13:54.019 Mitchell Wright: the 1st organization member for an organization.
136 00:13:55.890 ⇒ 00:13:56.740 Luke Daque: Gotcha.
137 00:13:58.030 ⇒ 00:13:59.050 Mitchell Wright: Does that make sense.
138 00:13:59.050 ⇒ 00:13:59.690 Luke Daque: Yeah.
139 00:14:00.000 ⇒ 00:14:00.600 Mitchell Wright: Okay.
140 00:14:03.520 ⇒ 00:14:07.759 Luke Daque: I guess that would be for the Creator and.
141 00:14:09.110 ⇒ 00:14:12.040 Mitchell Wright: Yeah, yeah, so I want essentially the 1st
142 00:14:12.330 ⇒ 00:14:16.170 Mitchell Wright: member of an organization should be the
143 00:14:16.350 ⇒ 00:14:24.120 Mitchell Wright: creator of the organization. I assume I could be wrong. But
144 00:14:24.730 ⇒ 00:14:27.830 Mitchell Wright: yeah, logically, that would make sense. I think.
145 00:14:27.990 ⇒ 00:14:28.610 Luke Daque: Yeah.
146 00:14:33.350 ⇒ 00:14:40.319 Luke Daque: And for the conversion path, downgrade path and conversion source for decent organization. Does it look like.
147 00:14:41.962 ⇒ 00:14:45.890 Mitchell Wright: So for these we can ignore these, for now.
148 00:14:46.310 ⇒ 00:14:46.750 Luke Daque: Okay.
149 00:14:46.750 ⇒ 00:14:49.849 Mitchell Wright: There’s something I’d like to add later. But it’s going to be
150 00:14:50.260 ⇒ 00:15:01.233 Mitchell Wright: needing to like. Take into account probably page views. And essentially how the if there’s
151 00:15:03.180 ⇒ 00:15:14.730 Mitchell Wright: just like the the pages, essentially, that the that the person took to get to the conversion path. And then if they downgrade same thing. So just yeah, just ignore those for now.
152 00:15:17.770 ⇒ 00:15:21.520 Mitchell Wright: But I want to leave them there just as a reminder to myself.
153 00:15:22.625 ⇒ 00:15:33.559 Mitchell Wright: cool users stack with user id create at deleted at do we not have it deleted at? Are we just actually deleting and not soft deleting.
154 00:15:35.440 ⇒ 00:15:37.829 Luke Daque: These are still postgres.
155 00:15:39.490 ⇒ 00:15:41.460 Luke Daque: This will be post resolution.
156 00:15:42.250 ⇒ 00:15:48.820 Mitchell Wright: Yeah, I’m just looking. I don’t. I don’t see it deleted at reset.
157 00:15:48.820 ⇒ 00:15:50.100 Luke Daque: Dated at
158 00:15:52.990 ⇒ 00:15:53.760 Mitchell Wright: Yeah.
159 00:15:53.760 ⇒ 00:15:54.390 Luke Daque: Yeah.
160 00:15:55.030 ⇒ 00:15:58.229 Mitchell Wright: So it seems like we’re probably just deleting
161 00:15:59.380 ⇒ 00:16:03.849 Mitchell Wright: the users, and not like a soft delete, or anything like that.
162 00:16:05.320 ⇒ 00:16:05.770 Luke Daque: Yeah.
163 00:16:06.440 ⇒ 00:16:16.348 Mitchell Wright: So, okay, that’s a future. Me problem. Cause I think what we’ll, what we would do is
164 00:16:17.050 ⇒ 00:16:22.230 Mitchell Wright: essentially just do like a snapshot table, and then from there we would.
165 00:16:23.680 ⇒ 00:16:27.440 Mitchell Wright: Well, really, we should have an event for user deleted. And that’s escalation.
166 00:16:27.630 ⇒ 00:16:38.700 Luke Daque: I guess if there’s some a field that would determine if the user is inactive or deleted, then we can use the updated app, but it doesn’t look like.
167 00:16:39.050 ⇒ 00:16:46.020 Mitchell Wright: Yeah, there’s not looking for that, too. I think ideally, what we need to do is I’ll I need to get an event created.
168 00:16:46.630 ⇒ 00:16:52.090 Mitchell Wright: Hmm, when the user gets deleted, and then we can update the record that way.
169 00:16:52.210 ⇒ 00:16:55.053 Mitchell Wright: But for now, yeah, just ignore that.
170 00:16:57.870 ⇒ 00:17:07.039 Mitchell Wright: for this is employee, we would just need to look at the email domain. And if it’s a@stackblitz.com
171 00:17:22.109 ⇒ 00:17:24.099 Mitchell Wright: highest plans.
172 00:17:28.780 ⇒ 00:17:36.440 Mitchell Wright: yeah, I think the logic I had here was, if they had ever been a higher plan, but had downgraded.
173 00:17:38.360 ⇒ 00:17:39.040 Luke Daque: Hmm.
174 00:17:39.330 ⇒ 00:17:46.120 Mitchell Wright: Does that make sense? So we’d have to look at stripe subscription data. Probably.
175 00:17:46.640 ⇒ 00:17:49.220 Luke Daque: I see? Yeah. And the mapping.
176 00:17:50.590 ⇒ 00:17:51.000 Mitchell Wright: Yeah.
177 00:17:51.000 ⇒ 00:17:51.640 Luke Daque: Yeah.
178 00:17:51.920 ⇒ 00:18:00.140 Mitchell Wright: I don’t know if it’s like super high priority on that one, but if you want to take some notes, and then, if you like get a chance to get at. That’s fine.
179 00:18:04.330 ⇒ 00:18:06.460 Uttam Kumaran: Just for downgrades, not for churns.
180 00:18:06.630 ⇒ 00:18:17.129 Mitchell Wright: Yeah. Yeah. Well, well, for downgrades or churns, I guess, just to see like if they ever had been, you know, just a pro or pro. 50 pro. 100. So.
181 00:18:17.420 ⇒ 00:18:18.070 Uttam Kumaran: Okay.
182 00:18:18.070 ⇒ 00:18:23.180 Mitchell Wright: Yeah, yeah, I think for either. I’m gonna delete this row. Don’t care about that.
183 00:18:26.576 ⇒ 00:18:35.410 Mitchell Wright: I don’t think we’re soft blocking users that for now.
184 00:18:38.114 ⇒ 00:18:45.209 Mitchell Wright: I don’t even think we’re blocking users, either, because but we probably should.
185 00:18:46.380 ⇒ 00:18:50.580 Mitchell Wright: But for now we’re going to just remove those, because we don’t have data on that
186 00:18:51.440 ⇒ 00:18:58.980 Mitchell Wright: for these ignore these ones for now, because that’s gonna be something that we
187 00:18:59.300 ⇒ 00:19:01.909 Mitchell Wright: get from page view data, probably.
188 00:19:02.130 ⇒ 00:19:02.940 Luke Daque: And.
189 00:19:03.697 ⇒ 00:19:07.799 Mitchell Wright: This one. Actually, this one I’m not sure on.
190 00:19:10.550 ⇒ 00:19:14.090 Mitchell Wright: I wonder if let’s see.
191 00:19:16.240 ⇒ 00:19:19.380 Mitchell Wright: So if we look at selects
192 00:19:19.880 ⇒ 00:19:26.400 Mitchell Wright: are from users where Github Id is null.
193 00:19:31.500 ⇒ 00:19:34.653 Mitchell Wright: or that will be from. Let’s see, what is this table?
194 00:19:38.050 ⇒ 00:19:40.020 Mitchell Wright: I’m so depressed.
195 00:19:52.590 ⇒ 00:19:53.770 Mitchell Wright: Hold on.
196 00:20:00.810 ⇒ 00:20:01.960 Mitchell Wright: copy the table.
197 00:20:04.080 ⇒ 00:20:06.050 Mitchell Wright: Sorry I’m just looking real quick.
198 00:20:13.210 ⇒ 00:20:14.060 Mitchell Wright: Oh, God!
199 00:20:19.970 ⇒ 00:20:21.610 Mitchell Wright: Just looking real quick on.
200 00:20:21.760 ⇒ 00:20:35.240 Mitchell Wright: I think. So with Bolt. But before with our product, you only could sign in via Github. But now with Bolt, we, I think, added a
201 00:20:37.840 ⇒ 00:20:45.389 Mitchell Wright: way for people to sign in with email address. And so I’m just looking that
202 00:20:46.590 ⇒ 00:20:47.579 Luke Daque: Yeah, there’s like.
203 00:20:48.210 ⇒ 00:20:54.570 Mitchell Wright: Yeah. So we’re we’re Github. Id is null. And then I wanna look at the where is the.
204 00:20:56.190 ⇒ 00:20:57.350 Luke Daque: Yep. Email.
205 00:20:59.850 ⇒ 00:21:03.029 Mitchell Wright: Yeah. Yeah. So there’s there’s like 2 million of those.
206 00:21:04.350 ⇒ 00:21:08.100 Mitchell Wright: Didn’t. Isn’t there like, oh, yeah, try. There we go. The
207 00:21:09.270 ⇒ 00:21:13.770 Mitchell Wright: Oh, really there’s some sign, IP, but I don’t know that.
208 00:21:14.510 ⇒ 00:21:15.490 Luke Daque: And.
209 00:21:15.810 ⇒ 00:21:19.469 Mitchell Wright: Yeah. So I think for sign up method.
210 00:21:20.690 ⇒ 00:21:25.920 Mitchell Wright: We would say, if Github Id is null.
211 00:21:27.300 ⇒ 00:21:32.079 Mitchell Wright: then email is sign up method.
212 00:21:32.400 ⇒ 00:21:37.729 Luke Daque: Hmm! I see, and if it is not now, then, it’s Github.
213 00:21:37.940 ⇒ 00:21:45.180 Mitchell Wright: Then it would be Github. Yeah, yeah, that’s that’s what I think for now. But that also that could change.
214 00:21:47.057 ⇒ 00:21:53.509 Mitchell Wright: Yeah, just do it that way, for now I don’t know how valuable that field is actually gonna be, anyway. But
215 00:21:53.990 ⇒ 00:22:02.989 Mitchell Wright: let’s leave it for now it’s easy logic. Okay, then let’s look at organizations.
216 00:22:05.420 ⇒ 00:22:05.755 Luke Daque: Yeah.
217 00:22:06.090 ⇒ 00:22:08.910 Mitchell Wright: Yeah. Organization. Name. Good. Call out,
218 00:22:12.357 ⇒ 00:22:23.890 Mitchell Wright: account name. So this should be account name from Hubspot. So you can ignore that one for now, because we don’t have the Hubspot stuff set up.
219 00:22:28.010 ⇒ 00:22:30.280 Luke Daque: Current subscription status.
220 00:22:31.320 ⇒ 00:22:35.549 Luke Daque: So I guess we have to tie this to stripe to get this subscription status.
221 00:22:35.550 ⇒ 00:22:41.389 Mitchell Wright: Yeah, yeah, or whether it’s an active if they have an active subscription or not.
222 00:22:46.090 ⇒ 00:22:51.920 Mitchell Wright: Let’s see, I don’t know that we’re actually excuse me doing trials right now.
223 00:22:56.600 ⇒ 00:23:04.649 Mitchell Wright: We will just delete these cause I don’t. We’re not doing anything there.
224 00:23:08.850 ⇒ 00:23:16.679 Mitchell Wright: Yes, ignore these for now, because we’re not really doing yeah,
225 00:23:23.190 ⇒ 00:23:26.060 Luke Daque: All the trial and pro and enterprise.
226 00:23:26.060 ⇒ 00:23:31.409 Mitchell Wright: Yeah, like we we don’t. We aren’t really doing much with organizations on bolt. So.
227 00:23:31.410 ⇒ 00:23:31.850 Luke Daque: -
228 00:23:31.850 ⇒ 00:23:37.760 Mitchell Wright: I think whatever you have is probably fine, and then this is one that we’ll build out more later.
229 00:23:38.710 ⇒ 00:23:39.460 Luke Daque: Okay.
230 00:23:40.230 ⇒ 00:23:47.480 Mitchell Wright: So, yeah, just whatever you have is great. Otherwise you can ignore that stuff cool.
231 00:23:48.160 ⇒ 00:23:50.959 Mitchell Wright: And I think that’s everything so far. Yeah.
232 00:23:53.060 ⇒ 00:24:02.400 Luke Daque: Okay, yeah. Sounds good. Then I can update, like whatever we have for subscriptions, users and organizations. And
233 00:24:02.920 ⇒ 00:24:06.412 Luke Daque: we should be good from there. There. I’ll also update the
234 00:24:06.950 ⇒ 00:24:11.010 Luke Daque: the real dashboard, so you can like play around with it as well.
235 00:24:11.330 ⇒ 00:24:12.120 Mitchell Wright: Okay.
236 00:24:12.120 ⇒ 00:24:12.690 Mitchell Wright: Cool.
237 00:24:13.000 ⇒ 00:24:14.409 Luke Daque: I’ll add the events.
238 00:24:14.600 ⇒ 00:24:16.190 Luke Daque: Models there as well.
239 00:24:17.960 ⇒ 00:24:18.740 Luke Daque: Yeah.
240 00:24:19.100 ⇒ 00:24:20.080 Mitchell Wright: Very cool.
241 00:24:20.922 ⇒ 00:24:29.130 Mitchell Wright: Let’s see, I think. Well, what else? The other thing was going, I think, through the bare metrics.
242 00:24:34.990 ⇒ 00:24:35.840 Uttam Kumaran: Which ones.
243 00:24:36.877 ⇒ 00:24:37.830 Mitchell Wright: Me going through.
244 00:24:38.367 ⇒ 00:24:41.052 Mitchell Wright: Yeah. Exactly like what? What?
245 00:24:41.770 ⇒ 00:24:44.509 Uttam Kumaran: The bull team is currently using out of their metrics.
246 00:24:44.650 ⇒ 00:24:45.000 Mitchell Wright: Yeah.
247 00:24:45.000 ⇒ 00:24:49.880 Uttam Kumaran: And that way we can map one to one with what’s in row.
248 00:24:51.510 ⇒ 00:24:52.120 Luke Daque: Oh, right, right.
249 00:24:52.647 ⇒ 00:24:54.230 Mitchell Wright: Here we go.
250 00:24:55.740 ⇒ 00:25:02.820 Mitchell Wright: So what do you think is gonna be the best way to do this? Should I
251 00:25:02.950 ⇒ 00:25:07.290 Mitchell Wright: kind of walk you through, and then maybe grab some screenshots or.
252 00:25:07.290 ⇒ 00:25:10.610 Uttam Kumaran: Yeah, I think we can focus on one month.
253 00:25:11.010 ⇒ 00:25:12.209 Mitchell Wright: Yeah, I think. January.
254 00:25:12.210 ⇒ 00:25:22.409 Uttam Kumaran: One month that’s closed. And then, yeah, if you could just walk us through what the most like the core things that we’re looking at. And we can just make sure that these are all available.
255 00:25:22.720 ⇒ 00:25:23.480 Luke Daque: Yeah.
256 00:25:23.480 ⇒ 00:25:24.050 Mitchell Wright: Yeah.
257 00:25:24.570 ⇒ 00:25:32.470 Mitchell Wright: Okay, so Mrr, gonna be you know a big one.
258 00:25:34.130 ⇒ 00:25:41.189 Mitchell Wright: Other revenue in as much as it is related to token reloads. I don’t know
259 00:25:41.390 ⇒ 00:25:48.069 Mitchell Wright: in stripe if there is what that product name looks like.
260 00:25:48.390 ⇒ 00:25:50.890 Mitchell Wright: or if that was on the spreadsheet that I gave you
261 00:25:51.970 ⇒ 00:26:02.620 Mitchell Wright: right now, that should be the only source of other revenue. But there’s going to be additional other sources of revenue that are coming in in the near ish future.
262 00:26:02.860 ⇒ 00:26:11.930 Mitchell Wright: So this, this is like, yeah, token reloads. So they’re like one time purchases of tokens that are separate from the actual subscription. If that makes sense.
263 00:26:16.860 ⇒ 00:26:20.610 Mitchell Wright: So you might have to do a little digging around Luke to figure that piece out.
264 00:26:20.610 ⇒ 00:26:21.370 Luke Daque: And.
265 00:26:21.660 ⇒ 00:26:23.299 Mitchell Wright: Are we recording this.
266 00:26:23.730 ⇒ 00:26:24.390 Uttam Kumaran: Yes.
267 00:26:24.390 ⇒ 00:26:27.726 Mitchell Wright: Oh, perfect. Okay, great. I was. Gonna say, that’ll be helpful.
268 00:26:30.364 ⇒ 00:26:35.199 Mitchell Wright: average revenue per user is probably also helpful.
269 00:26:37.440 ⇒ 00:26:39.790 Mitchell Wright: The annual run rate.
270 00:26:40.030 ⇒ 00:26:44.434 Mitchell Wright: But there’s kind of like 2 versions of this one that’s actually not even on here.
271 00:26:44.900 ⇒ 00:26:49.299 Mitchell Wright: so this is obviously just our subscription revenue annualized.
272 00:26:50.340 ⇒ 00:27:00.000 Mitchell Wright: I wanna have this view of it, but also another view that takes into account the annualization of
273 00:27:00.310 ⇒ 00:27:04.530 Mitchell Wright: our token or other revenue as well.
274 00:27:04.530 ⇒ 00:27:11.560 Luke Daque: Per product. You mean, like, maybe break it down by product.
275 00:27:11.560 ⇒ 00:27:20.940 Mitchell Wright: Well, so basically saying, like, Okay, this is our subscription revenue. Then we have this one off revenue. But it’s actually like, fairly consistent in the last.
276 00:27:21.140 ⇒ 00:27:33.650 Mitchell Wright: You know, however many months or weeks, days whatever, and so just kind of annualizing this and adding it in so like. Altogether, I think that brings us to close to like 30 million in arr.
277 00:27:34.403 ⇒ 00:27:39.100 Mitchell Wright: That’s a number that Eric looks at. A lot of is like
278 00:27:39.990 ⇒ 00:27:44.359 Mitchell Wright: subscription, plus this additional usage annualized.
279 00:27:44.360 ⇒ 00:27:45.320 Luke Daque: Gotcha.
280 00:27:45.730 ⇒ 00:27:54.110 Luke Daque: So basically, the breakdown of the the gross revenue or something, right? But an annualized yeah, yeah.
281 00:27:54.110 ⇒ 00:27:55.430 Luke Daque: Analyzed view.
282 00:27:55.670 ⇒ 00:28:04.079 Mitchell Wright: Taking like right, like January 31, st it was almost 19,000. So you know, 19 times
283 00:28:05.070 ⇒ 00:28:06.340 Mitchell Wright: 3, 65.
284 00:28:07.260 ⇒ 00:28:08.290 Luke Daque: Oh, yeah.
285 00:28:10.630 ⇒ 00:28:13.750 Mitchell Wright: Is like 7 million annualized.
286 00:28:14.080 ⇒ 00:28:14.710 Luke Daque: Right.
287 00:28:15.380 ⇒ 00:28:25.169 Mitchell Wright: So, yeah, lifetime value. Average lifetime value is probably a good one to have.
288 00:28:29.030 ⇒ 00:28:36.689 Mitchell Wright: I’m not sure if he’s looking at Mrr. Growth rate user churn for sure.
289 00:28:40.972 ⇒ 00:28:49.169 Mitchell Wright: Revenue churn also number of active customers definitely, and then.
290 00:28:49.170 ⇒ 00:28:50.550 Uttam Kumaran: For churn. It’s.
291 00:28:50.810 ⇒ 00:28:51.450 Mitchell Wright: What was that?
292 00:28:51.450 ⇒ 00:28:55.640 Uttam Kumaran: Yeah, for quick question for churn. You’re looking at like month over month churn. I see this.
293 00:28:56.170 ⇒ 00:28:59.180 Uttam Kumaran: Both these graphs are sort of like daily.
294 00:28:59.740 ⇒ 00:29:00.780 Uttam Kumaran: I guess
295 00:29:01.970 ⇒ 00:29:06.620 Uttam Kumaran: I guess I don’t really know what I guess it is it daily. It’s literally, I guess, day over day.
296 00:29:06.870 ⇒ 00:29:15.880 Mitchell Wright: Yeah, right right here. I guess it’s day over day. This is, this is where, like, I don’t know how they are defining some of these metrics.
297 00:29:18.010 ⇒ 00:29:23.020 Uttam Kumaran: Yeah, like, what is the starting number?
298 00:29:24.250 ⇒ 00:29:26.140 Uttam Kumaran: Yeah, looks like, okay.
299 00:29:29.640 ⇒ 00:29:41.079 Uttam Kumaran: okay, this is probably more helpful. Okay? Great. Alright. Well, yeah, we’ll do month. It’s it’s probably some calculation on a daily side. But really like that’s like the monthly churn numbers that are.
300 00:29:41.080 ⇒ 00:29:43.109 Mitchell Wright: Yeah, that’s what we’re gonna wanna look at. Yeah.
301 00:29:43.110 ⇒ 00:29:46.969 Uttam Kumaran: This is all. The billing is monthly right.
302 00:29:47.730 ⇒ 00:29:49.550 Mitchell Wright: Yeah, billing is monthly. Okay?
303 00:29:52.605 ⇒ 00:29:56.059 Mitchell Wright: Yeah. So I don’t know if they’re if they’re just looking at like.
304 00:29:56.240 ⇒ 00:30:12.919 Mitchell Wright: And and and we’re on like. There’s it’s not like beginning of month, right? So there’s no like proration. It’s when you sign up like, say, the 18, th and then you’ll be building it on February 18, th March 18.th So I think this this could be something of like on a given day, like what percentage.
305 00:30:12.920 ⇒ 00:30:13.420 Uttam Kumaran: Thank you.
306 00:30:13.420 ⇒ 00:30:16.950 Mitchell Wright: There’s are not renewing.
307 00:30:17.750 ⇒ 00:30:18.150 Uttam Kumaran: For sure.
308 00:30:18.150 ⇒ 00:30:21.669 Mitchell Wright: That day. I I that’s just a guess. I don’t actually know.
309 00:30:23.420 ⇒ 00:30:28.050 Uttam Kumaran: And then, do you guys do any level of like customer segmentation beyond new.
310 00:30:28.750 ⇒ 00:30:44.579 Mitchell Wright: No. So that’s what that’s what where I’m like, excited to get this into real, because, like active customers, I couldn’t tell you like what percentage right now of our customers are on each plan, or new customers like, what percentage are signing up for which plans that kind of stuff.
311 00:30:45.420 ⇒ 00:30:45.715 Uttam Kumaran: Okay.
312 00:30:46.010 ⇒ 00:30:50.599 Luke Daque: Yeah. So a breakdown between plans for each of these metrics would be great.
313 00:30:50.960 ⇒ 00:30:52.920 Mitchell Wright: Yeah, exactly, exactly.
314 00:30:55.230 ⇒ 00:31:00.389 Mitchell Wright: Reactivation. So so yeah, total customers, new customers.
315 00:31:01.120 ⇒ 00:31:06.339 Mitchell Wright: reactivations. We can skip for now cause that calculation.
316 00:31:06.994 ⇒ 00:31:11.070 Mitchell Wright: The definition is, gonna be a little bit different, I think, from what they do here.
317 00:31:14.390 ⇒ 00:31:22.129 Mitchell Wright: New subscriptions. Yeah, this is where, like, I don’t know what the difference here between new subscriptions and new customers is.
318 00:31:22.460 ⇒ 00:31:27.189 Mitchell Wright: if that if that’s maybe. I guess maybe that’s take into account reactivations as well.
319 00:31:27.850 ⇒ 00:31:32.620 Mitchell Wright: 7, 57 and 1 10 is 8, 67. Yeah, okay, it is.
320 00:31:36.100 ⇒ 00:31:46.190 Mitchell Wright: Yeah. Active subscriptions should be the same as active customers. That’s interesting, that it’s off by 2
321 00:31:46.630 ⇒ 00:31:51.529 Uttam Kumaran: And like, Are you guys, you guys aren’t doing none. None of this is also filtering like both folks.
322 00:31:52.870 ⇒ 00:31:55.120 Mitchell Wright: No, it’s not. It’s not. Yeah.
323 00:31:55.890 ⇒ 00:31:59.259 Mitchell Wright: Will that all be under the stock? Blitz domain
324 00:31:59.260 ⇒ 00:32:03.509 Mitchell Wright: should all be under stack Blitz? We do. Yeah, yes.
325 00:32:04.030 ⇒ 00:32:11.999 Mitchell Wright: but those I mean we have coupons. But and it’s going to be such a small number. But I think that it’s worth filtering them out
326 00:32:14.540 ⇒ 00:32:18.510 Mitchell Wright: upgrades definitely important, and downgrades
327 00:32:20.260 ⇒ 00:32:26.993 Mitchell Wright: churned customers coupons is another interesting one that it like not high priority. But I think
328 00:32:28.120 ⇒ 00:32:29.520 Mitchell Wright: that is interesting.
329 00:32:30.690 ⇒ 00:32:37.890 Mitchell Wright: And then, yeah, refunds and failed charges. So I think a majority of the stuff from here would be good and helpful to have.
330 00:32:38.130 ⇒ 00:32:42.099 Mitchell Wright: Because I think this I think this has been.
331 00:32:44.330 ⇒ 00:32:48.979 Mitchell Wright: Oh, I don’t know if this is just out of the box with bare metrics.
332 00:32:49.503 ⇒ 00:32:53.836 Mitchell Wright: But then let’s see if there’s anything else that I look at that.
333 00:32:57.270 ⇒ 00:33:01.399 Mitchell Wright: yeah, I mean, I think that hits all the main ones that I look at.
334 00:33:09.410 ⇒ 00:33:10.030 Mitchell Wright: Yeah.
335 00:33:10.320 ⇒ 00:33:12.139 Uttam Kumaran: That makes sense. It’s like a very good.
336 00:33:12.140 ⇒ 00:33:13.920 Mitchell Wright: Starting point. I mean, that’s a lot.
337 00:33:14.030 ⇒ 00:33:14.900 Uttam Kumaran: Yeah, yeah.
338 00:33:14.900 ⇒ 00:33:15.330 Luke Daque: Yeah.
339 00:33:17.880 ⇒ 00:33:20.459 Uttam Kumaran: I guess, Luke, is there anything else on the
340 00:33:20.710 ⇒ 00:33:23.519 Uttam Kumaran: stripe side we should talk about
341 00:33:24.040 ⇒ 00:33:37.270 Uttam Kumaran: otherwise. What we’re gonna also start to do is we sort of have a a format for building like we have a, we basically create a Google sheet. That sort of becomes like a sort of semantic model where we’ll evolve this bold metric seat. But basically, you’ll be able to see
342 00:33:37.410 ⇒ 00:33:47.240 Uttam Kumaran: all of the metrics and dimensions available. And then we can start using that as sort of the okay. There’s a nuance on how we’re calculating plan or any sort of nuances. We’ll sort of document there.
343 00:33:50.790 ⇒ 00:33:52.519 Uttam Kumaran: And then, yeah, we’ll try to get, I think.
344 00:33:53.190 ⇒ 00:34:03.389 Uttam Kumaran: I guess, Luke, we could talk, but I do think that we could probably get the events there quickly and then start to work on all of the Mrr. Arr high level, higher level metrics.
345 00:34:03.730 ⇒ 00:34:09.089 Uttam Kumaran: Customer churn will do next. After that. Once we get all that in.
346 00:34:09.900 ⇒ 00:34:10.699 Mitchell Wright: Perfect.
347 00:34:11.550 ⇒ 00:34:13.102 Mitchell Wright: This is great.
348 00:34:15.130 ⇒ 00:34:21.120 Mitchell Wright: yeah, is there anything else I can go through while we’re here? We’ve still got some time on the calendar, so.
349 00:34:21.980 ⇒ 00:34:36.669 Uttam Kumaran: I feel like that’s probably most of it. I think we’ll try to do get something by Wednesday, but I by Friday, but I may see if I can grab some time earlier next week, too, if we make better progress, so we can keep iterating, maybe just for like 30 min.
350 00:34:37.135 ⇒ 00:34:41.649 Uttam Kumaran: As much as we could share. Async. I think we are also.
351 00:34:42.040 ⇒ 00:34:42.670 Mitchell Wright: Cool.
352 00:34:46.190 ⇒ 00:34:48.610 Uttam Kumaran: Okay, awesome. Alright guys.
353 00:34:48.980 ⇒ 00:34:49.380 Uttam Kumaran: Thanks.
354 00:34:49.380 ⇒ 00:34:58.520 Mitchell Wright: Looking good. I’m I’m liking where we’re going. And like I said, we’ve got. We’ve got a couple people in the hiring pipeline
355 00:34:58.650 ⇒ 00:35:07.036 Mitchell Wright: that I feel like we’re really close. So they would be able to help awesome the more
356 00:35:09.180 ⇒ 00:35:11.250 Mitchell Wright: involved on a day to day basis.
357 00:35:11.980 ⇒ 00:35:14.170 Mitchell Wright: So all good.
358 00:35:14.560 ⇒ 00:35:15.290 Uttam Kumaran: All right.
359 00:35:15.540 ⇒ 00:35:17.080 Luke Daque: Cool alright guys.
360 00:35:17.400 ⇒ 00:35:19.050 Mitchell Wright: Thank you. Talk to you later.
361 00:35:19.050 ⇒ 00:35:20.349 Luke Daque: Sounds good thanks. Guys.