Meeting Title: AI Internal: Migration Catchup Date: 2025-12-08 Meeting participants: Gabriel Lam, Mustafa Raja, Samuel Roberts
WEBVTT
1 00:03:07.490 ⇒ 00:03:08.190 Gabriel Lam: Hello?
2 00:03:09.190 ⇒ 00:03:10.140 Gabriel Lam: How are you?
3 00:03:11.240 ⇒ 00:03:13.289 Mustafa Raja: Sorry for joining late.
4 00:03:13.290 ⇒ 00:03:14.110 Gabriel Lam: I’m worried.
5 00:03:14.860 ⇒ 00:03:19.620 Gabriel Lam: No worries, I think Sam’s meeting is also running late.
6 00:03:20.910 ⇒ 00:03:21.890 Gabriel Lam: So…
7 00:03:21.890 ⇒ 00:03:23.309 Mustafa Raja: Oh, the delivery one, yeah.
8 00:03:25.910 ⇒ 00:03:28.189 Gabriel Lam: How’s… how’s everything for you?
9 00:03:28.530 ⇒ 00:03:30.230 Gabriel Lam: All your projects going okay?
10 00:03:31.260 ⇒ 00:03:31.940 Mustafa Raja: Yeah.
11 00:03:32.580 ⇒ 00:03:33.889 Gabriel Lam: Okay, good to hear.
12 00:03:37.710 ⇒ 00:03:46.919 Gabriel Lam: Quick question about all the PRs. I haven’t encountered any new bugs testing on the review app as well for any of our updates.
13 00:03:47.250 ⇒ 00:03:55.839 Gabriel Lam: or the… New… React update, or Next.js update?
14 00:03:57.530 ⇒ 00:04:03.260 Mustafa Raja: Oh, in the new… In the newest reviewer that we just rolled out.
15 00:04:04.040 ⇒ 00:04:10.420 Gabriel Lam: Yeah, yeah, yeah, I’m not encountering any bugs, so I… from my end, I feel like… we can…
16 00:04:10.420 ⇒ 00:04:10.960 Mustafa Raja: Yeah, yeah.
17 00:04:10.960 ⇒ 00:04:16.349 Gabriel Lam: push to main, just because I feel like there’s a big backlog of feature updates.
18 00:04:16.350 ⇒ 00:04:17.800 Mustafa Raja: Yes, yes.
19 00:04:19.640 ⇒ 00:04:20.380 Mustafa Raja: I mean
20 00:04:20.790 ⇒ 00:04:28.589 Mustafa Raja: The, the newest one, it should… it should… we can… we can just do it right now, but…
21 00:04:28.860 ⇒ 00:04:31.979 Mustafa Raja: For the ones with… what’s it called?
22 00:04:32.550 ⇒ 00:04:37.219 Mustafa Raja: The client hubs, where we moved the client hubs to a general client hub.
23 00:04:37.580 ⇒ 00:04:47.010 Mustafa Raja: That one, that one we can also move, and we can, you know, create another one where we transfer the table to the master table, right?
24 00:04:47.170 ⇒ 00:04:47.840 Gabriel Lam: Yeah.
25 00:04:51.280 ⇒ 00:04:56.850 Mustafa Raja: Yeah, yeah, I guess… I guess these should be… these should now be mature enough to, you know.
26 00:04:57.490 ⇒ 00:04:59.889 Mustafa Raja: Let them be in production.
27 00:04:59.890 ⇒ 00:05:01.330 Gabriel Lam: I think so.
28 00:05:05.610 ⇒ 00:05:06.630 Mustafa Raja: How’s your day going?
29 00:05:07.180 ⇒ 00:05:09.379 Gabriel Lam: It’s good. There’s a lot of,
30 00:05:11.050 ⇒ 00:05:16.120 Gabriel Lam: I’m working on this, like, insurance… kind of partnership?
31 00:05:16.280 ⇒ 00:05:22.769 Gabriel Lam: So basically… Brainforge and Contextual AI.
32 00:05:23.050 ⇒ 00:05:27.499 Gabriel Lam: Utam and the contextual team are thinking of, like, oh.
33 00:05:28.650 ⇒ 00:05:42.150 Gabriel Lam: what are the use cases for what we’ve done for insurance, like, commercial insurance? So basically, if you… if you are, you know, a construction company, and you’re building a house, and you want to buy insurance, and…
34 00:05:42.490 ⇒ 00:05:46.250 Gabriel Lam: For, you know, everything you’re doing. Right now, everything’s done by hand.
35 00:05:46.630 ⇒ 00:05:52.140 Gabriel Lam: And so they’re like, oh, maybe there’s a partnership thing going, and I’m doing a lot of research.
36 00:05:52.370 ⇒ 00:06:00.240 Gabriel Lam: On all these tools and apps, and it’s… it’s confusing. It’s really tough, actually. So, figuring it out.
37 00:06:00.590 ⇒ 00:06:07.850 Gabriel Lam: I don’t know, I’m used to when I get insurance, You know, through…
38 00:06:08.060 ⇒ 00:06:13.390 Gabriel Lam: a broker, you’re just like, oh, you know, this is my information, this is how much I want to pay, and they figure it out, and then…
39 00:06:13.760 ⇒ 00:06:16.689 Gabriel Lam: You’re on the other side, and you’re like, oh my god.
40 00:06:16.690 ⇒ 00:06:22.090 Mustafa Raja: Yeah, I haven’t ever gotten a… gotten a sc- what’s it called? The insur- the insurance for anything.
41 00:06:22.560 ⇒ 00:06:28.629 Gabriel Lam: Hmm… Yeah, it’s… A lot of paperwork, you know?
42 00:06:28.910 ⇒ 00:06:29.560 Mustafa Raja: Yeah.
43 00:06:29.560 ⇒ 00:06:33.269 Gabriel Lam: It’s like applying for a visa a little bit.
44 00:06:35.750 ⇒ 00:06:39.549 Samuel Roberts: Alright. Hey, Sam, how are you doing? Doing alright.
45 00:06:39.550 ⇒ 00:06:40.120 Gabriel Lam: I’m sure you.
46 00:06:40.120 ⇒ 00:06:40.959 Samuel Roberts: How long, how long?
47 00:06:41.360 ⇒ 00:06:43.549 Gabriel Lam: No, you’re good, don’t worry about it.
48 00:06:45.350 ⇒ 00:06:49.439 Gabriel Lam: Yeah, do you feel caught up, or… I think we can maybe…
49 00:06:49.590 ⇒ 00:06:53.430 Gabriel Lam: Keep this shorter, and just do, like, a sort of status update for you.
50 00:06:53.790 ⇒ 00:06:56.919 Gabriel Lam: That would be perfect for now. Yeah, let’s start there.
51 00:06:57.430 ⇒ 00:07:00.099 Gabriel Lam: So,
52 00:07:00.730 ⇒ 00:07:18.809 Gabriel Lam: Long story short, and Mustafi, feel free to interrupt me at any time. Long story short, last week was a bit of a slower week, just because client work had, picked up. The main thing we did do was, first, Casey documented the Dagster workflow,
53 00:07:19.080 ⇒ 00:07:20.760 Gabriel Lam: And put it on the Notion doc.
54 00:07:21.020 ⇒ 00:07:24.449 Gabriel Lam: And then Mustafa handled a generic client hub.
55 00:07:24.650 ⇒ 00:07:30.590 Gabriel Lam: and also a master table on Supabase. And so, things are ready to be moved.
56 00:07:30.590 ⇒ 00:07:32.959 Mustafa Raja: No, no, no, master table, we didn’t…
57 00:07:34.570 ⇒ 00:07:35.130 Gabriel Lam: Oh, no, it’s.
58 00:07:35.130 ⇒ 00:07:41.779 Mustafa Raja: We didn’t work on master table, we just, you know, worked on… what’s it called?
59 00:07:42.340 ⇒ 00:07:53.339 Mustafa Raja: a general client hub, so what it does is it just, listens to the client ID by which client page we are on.
60 00:07:53.620 ⇒ 00:07:55.700 Mustafa Raja: And then the client…
61 00:07:56.160 ⇒ 00:08:07.830 Mustafa Raja: Superbase client table that has, the names of the tables that has embeddings for both Slack and Zoom.
62 00:08:07.990 ⇒ 00:08:14.979 Mustafa Raja: And then that gets ingested into the tool, and then the tool just, you know, works
63 00:08:15.760 ⇒ 00:08:20.129 Mustafa Raja: Works to, you know, find the right embeddings for the questions.
64 00:08:20.530 ⇒ 00:08:21.380 Samuel Roberts: Okay, great.
65 00:08:21.990 ⇒ 00:08:25.339 Mustafa Raja: So it’s one… one client hub only now.
66 00:08:25.820 ⇒ 00:08:26.470 Samuel Roberts: Okay, and that’s in…
67 00:08:26.470 ⇒ 00:08:31.320 Mustafa Raja: That’s handled. One client hub, two tools. That’s all.
68 00:08:31.990 ⇒ 00:08:36.759 Samuel Roberts: Perfect. Okay, and that pretty much mirrors what NAM was doing. Two tools, an agent.
69 00:08:37.710 ⇒ 00:08:44.650 Mustafa Raja: Yes. Of course, inerton, we had to, you know, create… what’s it called?
70 00:08:45.350 ⇒ 00:08:47.560 Mustafa Raja: A new workflow for each client.
71 00:08:47.560 ⇒ 00:08:52.569 Samuel Roberts: Right, right, it’s funny, but it mirrors the overall structure that each of those client hubs was doing.
72 00:08:52.920 ⇒ 00:08:53.940 Samuel Roberts: Cool, okay.
73 00:08:53.940 ⇒ 00:08:57.319 Mustafa Raja: That’s correct. One thing to mention… Where’s up right now?
74 00:08:57.320 ⇒ 00:08:57.940 Samuel Roberts: Go ahead.
75 00:08:59.020 ⇒ 00:09:01.719 Mustafa Raja: One thing to mention here is that…
76 00:09:02.900 ⇒ 00:09:11.760 Mustafa Raja: PG Vector, was having connectivity issues on my end, so I just went ahead and used PG.
77 00:09:14.370 ⇒ 00:09:15.949 Samuel Roberts: Mmm, okay.
78 00:09:15.950 ⇒ 00:09:28.479 Mustafa Raja: then what I did is I converted whatever the response, or whatever the question is, to embeddings, and then matched those, and it works pretty good. Gabe has been testing it out.
79 00:09:28.760 ⇒ 00:09:31.160 Mustafa Raja: And it looks good.
80 00:09:31.810 ⇒ 00:09:34.089 Mustafa Raja: So this is on a branch?
81 00:09:34.340 ⇒ 00:09:34.899 Samuel Roberts: Okay, that’s true.
82 00:09:34.900 ⇒ 00:09:36.070 Mustafa Raja: We have a review app.
83 00:09:37.360 ⇒ 00:09:38.050 Samuel Roberts: Okay.
84 00:09:39.910 ⇒ 00:09:48.500 Samuel Roberts: Cool, yeah, that’s good to hear. I would love to take a look at that now that I know that that’s happening. So that, that’s,
85 00:09:49.180 ⇒ 00:09:51.280 Samuel Roberts: Bye, let me just pull up GitHub real quick.
86 00:09:55.040 ⇒ 00:10:01.320 Samuel Roberts: So, that is the… Very neat.
87 00:10:03.210 ⇒ 00:10:06.120 Samuel Roberts: What, what branch is that on, or what.
88 00:10:06.120 ⇒ 00:10:08.030 Mustafa Raja: Let me, let me check also.
89 00:10:08.520 ⇒ 00:10:09.270 Samuel Roberts: Okay.
90 00:10:09.640 ⇒ 00:10:13.779 Mustafa Raja: Yeah, Gabe might have the link. Gabe, could you share the link in Zoom chat?
91 00:10:14.300 ⇒ 00:10:15.010 Mustafa Raja: What do you have?
92 00:10:15.440 ⇒ 00:10:16.870 Gabriel Lam: the review app.
93 00:10:16.970 ⇒ 00:10:18.359 Gabriel Lam: Yes.
94 00:10:24.020 ⇒ 00:10:24.940 Samuel Roberts: Excuse me.
95 00:10:31.000 ⇒ 00:10:31.870 Gabriel Lam: Shoot.
96 00:10:32.540 ⇒ 00:10:33.080 Gabriel Lam: Sorry.
97 00:10:33.080 ⇒ 00:10:36.410 Samuel Roberts: It’s somewhere in the info alerts, right? I just didn’t know which.
98 00:10:36.410 ⇒ 00:10:37.070 Gabriel Lam: Yeah.
99 00:10:37.250 ⇒ 00:10:42.640 Gabriel Lam: I think it’s the one on Thursday, so let me just grab it.
100 00:10:43.100 ⇒ 00:10:43.910 Samuel Roberts: Okay.
101 00:10:48.320 ⇒ 00:10:52.160 Samuel Roberts: Brain Forge Contextual AI Brain Forge Insurance Partnership.
102 00:10:52.160 ⇒ 00:11:01.249 Gabriel Lam: So that… I added a new markdown in the PRDs, and I think it also ended up capturing all the additional updates.
103 00:11:01.720 ⇒ 00:11:03.379 Gabriel Lam: Between the last PR.
104 00:11:04.500 ⇒ 00:11:06.810 Samuel Roberts: Oh, okay, let me… oh, I see, okay, okay.
105 00:11:06.810 ⇒ 00:11:07.430 Gabriel Lam: Shit.
106 00:11:07.430 ⇒ 00:11:14.849 Samuel Roberts: Okay, okay. I see I have PRD in the… okay, that’s fine. All right, I just wasn’t… that’s… the naming was throwing me off when I was trying to figure stuff out.
107 00:11:14.850 ⇒ 00:11:15.300 Gabriel Lam: You’re good.
108 00:11:15.300 ⇒ 00:11:20.270 Samuel Roberts: But that’s the branch for me to take a look at then, basically, 32… or PR32, I should say.
109 00:11:20.540 ⇒ 00:11:21.960 Gabriel Lam: Yes. Okay.
110 00:11:23.590 ⇒ 00:11:26.880 Gabriel Lam: I think 31 we can close out.
111 00:11:27.360 ⇒ 00:11:37.499 Samuel Roberts: 31 is… extra item extraction Proof Ticket Generation? Two weeks ago. Yeah, okay, cool.
112 00:11:37.950 ⇒ 00:11:42.660 Gabriel Lam: As well as maybe 28 and 29, I don’t think those need to be… Fair enough.
113 00:11:42.660 ⇒ 00:11:49.729 Samuel Roberts: PRD is just… yeah, there’s no reason to keep Heroku up there with those, too. So, yeah, I would say go ahead and…
114 00:11:51.960 ⇒ 00:11:53.020 Samuel Roberts: do that.
115 00:11:53.200 ⇒ 00:12:00.409 Samuel Roberts: Case study PRD, that’s, like, way… yeah, it’s just… that’s just markdown files, isn’t it? Yeah. Okay.
116 00:12:00.990 ⇒ 00:12:02.210 Samuel Roberts: Definitely.
117 00:12:02.340 ⇒ 00:12:03.180 Samuel Roberts: Okay.
118 00:12:03.540 ⇒ 00:12:07.829 Samuel Roberts: So I’ll take a look at the…
119 00:12:07.990 ⇒ 00:12:13.689 Samuel Roberts: 31 at some point. So, talk to me about the difference between the PG and the PG vector, though. I’m a little…
120 00:12:13.810 ⇒ 00:12:19.160 Samuel Roberts: So PG Vector wasn’t connecting to Postgres?
121 00:12:21.110 ⇒ 00:12:30.690 Mustafa Raja: Yes, but PG, PG did. It’s essentially the same thing, it’s just PGVector.
122 00:12:31.530 ⇒ 00:12:35.769 Mustafa Raja: Had some instrumentation, you know.
123 00:12:35.770 ⇒ 00:12:36.450 Samuel Roberts: Right.
124 00:12:36.450 ⇒ 00:12:37.890 Mustafa Raja: Yeah.
125 00:12:38.140 ⇒ 00:12:40.759 Mustafa Raja: But we still needed to, you know, convert
126 00:12:40.860 ⇒ 00:12:50.749 Mustafa Raja: the question to embeddings, or give those embeddings to a parameter. So the difference only is we do not have to create a query, right?
127 00:12:51.410 ⇒ 00:12:56.479 Mustafa Raja: And in PG, we would have to create a query with the table structure.
128 00:12:59.250 ⇒ 00:13:00.170 Samuel Roberts: Okay.
129 00:13:03.880 ⇒ 00:13:12.180 Samuel Roberts: Okay, maybe I need to see the code, because I’m… so yeah, so there was… so this is in… yeah, sorry, I haven’t looked at anything yet, so I’m just kind of talking without seeing what.
130 00:13:12.180 ⇒ 00:13:12.640 Gabriel Lam: Doors.
131 00:13:12.640 ⇒ 00:13:14.609 Samuel Roberts: on here.
132 00:13:15.140 ⇒ 00:13:22.880 Samuel Roberts: Because there’s my understanding that, like, PGVector would work well with Monster, but if it’s not, then… or it’s not connecting to post… whichever way, it’s not working. It’s just…
133 00:13:23.060 ⇒ 00:13:28.990 Samuel Roberts: a straight PG connection from Monster, then, to… our Postgres database.
134 00:13:29.230 ⇒ 00:13:30.200 Samuel Roberts: Which…
135 00:13:32.120 ⇒ 00:13:38.739 Samuel Roberts: has the embeddings and the logic. So, okay, I think I understand what you’re saying. Okay, I’m just making sure we’re not, like, missing out on any, like, major…
136 00:13:38.850 ⇒ 00:13:42.870 Samuel Roberts: Like, performance or having any real slowdowns that, like.
137 00:13:43.200 ⇒ 00:13:47.360 Samuel Roberts: We might avoid, but it sounds like if you’ve been testing it, it’s been okay, you said?
138 00:13:47.980 ⇒ 00:13:48.780 Samuel Roberts: Or a game’s mentality?
139 00:13:48.780 ⇒ 00:13:50.180 Mustafa Raja: Yeah, okay, geek.
140 00:13:50.180 ⇒ 00:13:54.850 Gabriel Lam: Yeah, I’ve been testing it, it seems… pretty good. I think there’s…
141 00:13:54.850 ⇒ 00:14:13.350 Mustafa Raja: Also, also, now, what we also did is, prior to this, what was happening is, the groomer, ticket groomer for linear tickets, what it did is, it was linking to, what’s it called,
142 00:14:14.090 ⇒ 00:14:22.400 Mustafa Raja: client hubs in NHN, right? So what we did is we… we now… we are now using the general client hub that we have in our…
143 00:14:22.510 ⇒ 00:14:30.680 Mustafa Raja: instance in master, and it’s now using that to pull more information about whatever the question is.
144 00:14:31.950 ⇒ 00:14:33.420 Samuel Roberts: Okay, great.
145 00:14:34.120 ⇒ 00:14:46.380 Samuel Roberts: Good, that was definitely something that was… yeah, that was definitely the next step, so that’s perfect. Are we noticing any major, like, differences in the, like, speed from NA to N to this?
146 00:14:48.060 ⇒ 00:14:52.640 Samuel Roberts: I guess… has anyone… have we done any, like, side-by-side? So, I haven’t been…
147 00:14:52.920 ⇒ 00:14:55.619 Mustafa Raja: I haven’t really used that.
148 00:14:56.150 ⇒ 00:14:56.560 Samuel Roberts: Okay.
149 00:14:56.560 ⇒ 00:15:00.690 Mustafa Raja: Again, have you… have you been using… using the Client Hubs on platform?
150 00:15:01.010 ⇒ 00:15:11.300 Gabriel Lam: I have a little bit. I don’t think there’s too much of a… like, to me, the timing isn’t really a problem, it’s more…
151 00:15:11.710 ⇒ 00:15:19.820 Gabriel Lam: maybe functionality. I haven’t noticed too different of… a… time difference,
152 00:15:21.310 ⇒ 00:15:26.020 Gabriel Lam: Okay. I think it’s more just when certain client hubs aren’t available, then…
153 00:15:26.720 ⇒ 00:15:29.440 Gabriel Lam: Either it’s not picking up certain things, or, you know…
154 00:15:31.230 ⇒ 00:15:35.209 Samuel Roberts: Mmm, okay. Yeah, I mean, the bottleneck here might really just be the database anyway, like…
155 00:15:35.210 ⇒ 00:15:36.000 Gabriel Lam: Yeah.
156 00:15:36.000 ⇒ 00:15:40.040 Samuel Roberts: That’s… that’s… I just wasn’t sure if there was gonna be, like, massive gains or not, but…
157 00:15:40.260 ⇒ 00:15:48.560 Samuel Roberts: like, the real benefit is not duplicating the time we’re gonna take, so I just wasn’t sure what other side benefits we might have there. Yep. Okay.
158 00:15:49.080 ⇒ 00:15:57.050 Samuel Roberts: Great, I mean, that’s… that’s… that’s progress. That’s definitely, like, yeah, I mean, slow week, like you said, but that’s definitely, like, the big… a big lift there. The…
159 00:15:57.170 ⇒ 00:16:02.049 Samuel Roberts: I’m glad, I’m glad to hear that that’s working then. I’ll do a little bit of, like, a…
160 00:16:02.280 ⇒ 00:16:06.450 Samuel Roberts: a rough PR review, I guess, and make sure, but I also want to do some testing as well.
161 00:16:06.810 ⇒ 00:16:10.150 Samuel Roberts: Good, okay.
162 00:16:10.150 ⇒ 00:16:12.809 Mustafa Raja: Yeah, let me know if you need the new ENV.
163 00:16:14.510 ⇒ 00:16:18.659 Samuel Roberts: Yeah, is it… is it on Heroku?
164 00:16:19.560 ⇒ 00:16:25.730 Mustafa Raja: Yeah, it should be on Heroku for the review app. Yeah, if that’s the case.
165 00:16:25.730 ⇒ 00:16:29.290 Samuel Roberts: As long as it was on the, the overall pipeline.
166 00:16:32.660 ⇒ 00:16:35.720 Samuel Roberts: Like, what changed in terms of the…
167 00:16:36.210 ⇒ 00:16:41.290 Mustafa Raja: So we needed to add, connection strings, right?
168 00:16:41.290 ⇒ 00:16:43.369 Samuel Roberts: Oh, of course, of course, of course.
169 00:16:43.480 ⇒ 00:16:46.120 Mustafa Raja: connects with, Postgres is with.
170 00:16:46.120 ⇒ 00:16:46.910 Samuel Roberts: Right, right.
171 00:16:46.910 ⇒ 00:16:47.440 Mustafa Raja: We weren’t.
172 00:16:47.440 ⇒ 00:16:50.049 Samuel Roberts: doing that before… Yes. Yeah, okay.
173 00:16:50.050 ⇒ 00:16:53.039 Mustafa Raja: We were using the Anand key, sorry, yeah.
174 00:16:53.040 ⇒ 00:16:56.100 Samuel Roberts: Yeah, because we were just using the Postgres, yeah.
175 00:16:56.100 ⇒ 00:16:56.800 Mustafa Raja: Absolutely, yeah.
176 00:16:56.800 ⇒ 00:17:06.069 Samuel Roberts: SuperBase, yeah, sorry. Superbase key. Okay, so now we’re connecting right to it with the connection string. That makes… that makes sense.
177 00:17:06.430 ⇒ 00:17:09.909 Mustafa Raja: Hmm, so we would need those, and… Okay.
178 00:17:09.910 ⇒ 00:17:12.200 Samuel Roberts: Those are in Heroku right now, right?
179 00:17:12.630 ⇒ 00:17:19.360 Mustafa Raja: Yes, of… and then there’s one more key that is for the embedding model, right?
180 00:17:19.530 ⇒ 00:17:24.919 Mustafa Raja: So that’s not really a key, but, you know, where it is, right?
181 00:17:26.030 ⇒ 00:17:30.010 Mustafa Raja: The deployment URL for the embedding model.
182 00:17:30.200 ⇒ 00:17:35.400 Samuel Roberts: Yes, okay, cool, yeah. I’ll take a look, if I need anything, if I can’t find it in Heroku, I’ll message you.
183 00:17:35.570 ⇒ 00:17:39.550 Samuel Roberts: But I should be able to hopefully get whatever I can off there.
184 00:17:40.500 ⇒ 00:17:41.170 Mustafa Raja: Yes.
185 00:17:41.740 ⇒ 00:17:42.960 Samuel Roberts: Okay, cool.
186 00:17:43.490 ⇒ 00:17:48.840 Samuel Roberts: And then you said, Casey, documented the Dagster stuff?
187 00:17:50.530 ⇒ 00:17:54.600 Gabriel Lam: Yeah, it should be in the same Notion doc as we have always had.
188 00:17:55.110 ⇒ 00:17:57.910 Samuel Roberts: For the client, or for the client hubs?
189 00:17:58.020 ⇒ 00:17:59.739 Gabriel Lam: Yes, I boogie.
190 00:17:59.740 ⇒ 00:18:00.170 Samuel Roberts: Okay.
191 00:18:02.530 ⇒ 00:18:04.179 Samuel Roberts: Okay, yeah, I got it open now.
192 00:18:11.490 ⇒ 00:18:13.169 Samuel Roberts: Never to consume.
193 00:18:13.830 ⇒ 00:18:15.000 Samuel Roberts: Or is it…
194 00:18:19.740 ⇒ 00:18:23.960 Samuel Roberts: I mean, I think I saw something in Slack today as I was going through everything else, so…
195 00:18:24.270 ⇒ 00:18:25.139 Samuel Roberts: Let me…
196 00:18:37.240 ⇒ 00:18:38.150 Samuel Roberts: Okay.
197 00:18:40.220 ⇒ 00:18:45.900 Gabriel Lam: Should be the Zoom Embedding pipeline, Zoom Event S3 Storage, I believe, is…
198 00:18:46.560 ⇒ 00:18:47.250 Samuel Roberts: Got it.
199 00:18:48.430 ⇒ 00:18:49.520 Samuel Roberts: Okay, cool.
200 00:18:49.720 ⇒ 00:18:50.510 Gabriel Lam: Yep.
201 00:18:54.670 ⇒ 00:18:58.500 Samuel Roberts: Okay, cool. I’ll take a look at that, too, then. That’s… yes, I see that. Okay, yeah.
202 00:18:59.750 ⇒ 00:19:08.049 Gabriel Lam: Sweet. And the Slack embed. It’s basically everything in the current embedding pipelines header, except the Loom video, is basically new.
203 00:19:08.820 ⇒ 00:19:11.649 Samuel Roberts: Yep, okay, the only video’s old, besides that. Alright, cool.
204 00:19:12.080 ⇒ 00:19:13.910 Samuel Roberts: Alright, good.
205 00:19:14.650 ⇒ 00:19:23.219 Samuel Roberts: That’s progress. Yeah, that sounds… I’m glad, I’m glad. I’m very happy with all that so far. I know you said it was lightweight, but that seems like pretty, pretty solid work so far, so…
206 00:19:23.360 ⇒ 00:19:28.869 Samuel Roberts: That definitely gets us a good chunk of the way. So, if the generic client hub
207 00:19:29.350 ⇒ 00:19:32.549 Samuel Roberts: is… is working pretty well.
208 00:19:33.130 ⇒ 00:19:34.880 Samuel Roberts: I’m trying to think, the only… so…
209 00:19:35.790 ⇒ 00:19:40.850 Samuel Roberts: If we take a step back and think, like, what has to happen when a new client gets onboarded?
210 00:19:41.700 ⇒ 00:19:44.860 Samuel Roberts: At this point, we still need the tables created, right?
211 00:19:46.140 ⇒ 00:19:50.459 Mustafa Raja: Yeah, yes. Oh, for that…
212 00:19:50.570 ⇒ 00:19:57.940 Mustafa Raja: We had a ticket, where we would pull the new clients from the client table. I don’t know if we worked on it, though.
213 00:19:58.140 ⇒ 00:19:59.300 Samuel Roberts: Okay, yeah, that’s what I was gonna say.
214 00:19:59.300 ⇒ 00:19:59.980 Mustafa Raja: Any idea on that?
215 00:19:59.980 ⇒ 00:20:04.880 Samuel Roberts: We can have it added to the clients, and then we can even just have a… you know.
216 00:20:05.090 ⇒ 00:20:07.580 Samuel Roberts: A job that could create those tables.
217 00:20:07.900 ⇒ 00:20:09.639 Samuel Roberts: Uninsert or something.
218 00:20:09.810 ⇒ 00:20:11.449 Samuel Roberts: But yeah, I’m not too worried about that now.
219 00:20:11.450 ⇒ 00:20:19.300 Mustafa Raja: I mean, what happens is, the tables are automatically created. We just need to, you know,
220 00:20:19.480 ⇒ 00:20:30.029 Mustafa Raja: manually have to mention them. What we can rather do is, rather than manually mentioning them in the jobs, have Superbase pull them.
221 00:20:30.140 ⇒ 00:20:33.119 Mustafa Raja: Yes, that’s right. From the client’s table, and that should be good to go.
222 00:20:33.650 ⇒ 00:20:34.719 Samuel Roberts: Okay, great.
223 00:20:36.080 ⇒ 00:20:36.990 Samuel Roberts: Okay.
224 00:20:38.050 ⇒ 00:20:43.070 Mustafa Raja: Yeah, this is something that was assigned, though, I don’t know if you worked on it. Gabe, do you have any idea?
225 00:20:43.470 ⇒ 00:20:43.990 Samuel Roberts: Okay.
226 00:20:43.990 ⇒ 00:20:47.430 Gabriel Lam: Sorry, do you have the ticket number?
227 00:20:47.430 ⇒ 00:20:53.969 Mustafa Raja: I don’t actually… I haven’t been looking at the AI board recently.
228 00:20:53.970 ⇒ 00:20:55.420 Gabriel Lam: Okay, no worries.
229 00:20:55.420 ⇒ 00:21:02.300 Mustafa Raja: And I have it filtered to my tickets only, and I do think that it’s… Assigned to Mimi.
230 00:21:08.940 ⇒ 00:21:12.480 Gabriel Lam: Is it $699, upgrade client table with embedding table references?
231 00:21:14.690 ⇒ 00:21:15.290 Mustafa Raja: Let me…
232 00:21:15.290 ⇒ 00:21:19.269 Samuel Roberts: See. For the client table contains the references, that’s done.
233 00:21:19.780 ⇒ 00:21:22.970 Samuel Roberts: The new agent will require accurate mappings, yes…
234 00:21:23.770 ⇒ 00:21:24.830 Mustafa Raja: 699…
235 00:21:24.830 ⇒ 00:21:26.610 Samuel Roberts: Man, it feels so quantity. I think that…
236 00:21:31.720 ⇒ 00:21:32.470 Samuel Roberts: Huh.
237 00:21:35.320 ⇒ 00:21:41.030 Mustafa Raja: Oh, that looks like it, to be honest. No, no, no, this is… this is something different. This is done, actually.
238 00:21:41.190 ⇒ 00:21:44.130 Samuel Roberts: Yeah, that was just… I was just putting the right things into the table that weren’t already.
239 00:21:44.130 ⇒ 00:21:48.300 Mustafa Raja: Yeah, adding columns, that was the… I was just adding columns, yeah.
240 00:21:48.570 ⇒ 00:21:52.699 Mustafa Raja: Awesome. Yeah, maybe if the ticket isn’t there, maybe we should create it, you know?
241 00:21:52.810 ⇒ 00:22:00.109 Mustafa Raja: I don’t know if you want to do that, or if you want to just move ahead to migrating to a master table for all of the clients?
242 00:22:01.450 ⇒ 00:22:08.409 Samuel Roberts: Yeah, I guess that depends on the… how much work the pipeline updates are gonna be, right?
243 00:22:09.520 ⇒ 00:22:10.469 Samuel Roberts: Oh, yeah.
244 00:22:11.710 ⇒ 00:22:19.419 Samuel Roberts: Because, like, we can’t go to the master table until we fix, or not fix, but, you know, update the pipeline from, like, Zoom and Slack.
245 00:22:19.910 ⇒ 00:22:26.810 Samuel Roberts: to do that as well. So I… I think that’s kind of why we were sticking with these tables for now, is just to give us some breathing room on that part.
246 00:22:26.810 ⇒ 00:22:36.709 Mustafa Raja: Okay, yeah, then let’s just, let’s just, you know, solve this problem also by, not hard-going the clients, but pulling them from Superbase.
247 00:22:36.710 ⇒ 00:22:39.230 Samuel Roberts: Yeah, exactly, exactly, yeah.
248 00:22:39.570 ⇒ 00:22:42.120 Samuel Roberts: And probably, like, cash it every day or something.
249 00:22:43.530 ⇒ 00:22:44.060 Samuel Roberts: Yeah, that’s…
250 00:22:44.060 ⇒ 00:22:45.060 Mustafa Raja: doable, and…
251 00:22:45.060 ⇒ 00:22:49.109 Samuel Roberts: Dexter. So, I mean, I think Daxter’s not that big a deal. We can hit it every time, it doesn’t really matter.
252 00:22:49.590 ⇒ 00:22:50.490 Mustafa Raja: Yeah.
253 00:22:52.260 ⇒ 00:22:55.970 Samuel Roberts: Cause that’s running every time… a Zoom meeting happens.
254 00:22:56.390 ⇒ 00:23:01.379 Mustafa Raja: No, these pipelines run every 5 hours.
255 00:23:01.830 ⇒ 00:23:06.589 Samuel Roberts: Oh, that’s… I’m sorry, yeah, that’s right. This is all the embedding stuff, right?
256 00:23:06.930 ⇒ 00:23:12.360 Mustafa Raja: Yes, yes. So what ends up happening is the tables are deleted, and the whole…
257 00:23:12.360 ⇒ 00:23:12.930 Samuel Roberts: Oh my god.
258 00:23:12.930 ⇒ 00:23:14.060 Mustafa Raja: Okay, yes.
259 00:23:14.060 ⇒ 00:23:19.369 Samuel Roberts: That was, like, the last thing we talked about right before I went on vacation, wasn’t it? Okay,
260 00:23:19.870 ⇒ 00:23:22.360 Samuel Roberts: That’s a whole other… Sort out.
261 00:23:22.360 ⇒ 00:23:29.200 Mustafa Raja: It’s like we are incurring… I believe we should be incurring… Big cost, though, right?
262 00:23:31.110 ⇒ 00:23:34.540 Samuel Roberts: I mean, embedding is not… but yes, I mean, relatively, yes, yes.
263 00:23:34.880 ⇒ 00:23:38.860 Samuel Roberts: That’s definitely unnecessary. As far as I can tell, I… I…
264 00:23:39.770 ⇒ 00:23:44.119 Samuel Roberts: I think it was unnecessary, I think it was, like, a Band-Aid fix back in the day, is what Casey said.
265 00:23:45.460 ⇒ 00:23:46.159 Mustafa Raja: Oh, yeah.
266 00:23:46.370 ⇒ 00:23:48.580 Samuel Roberts: So I think Something we need to change.
267 00:23:48.750 ⇒ 00:23:49.750 Samuel Roberts: One way or the other.
268 00:23:49.750 ⇒ 00:23:52.579 Mustafa Raja: Also while, yeah, yeah, also while we are at it.
269 00:23:53.040 ⇒ 00:23:56.180 Mustafa Raja: The way these tables are detected is…
270 00:23:56.600 ⇒ 00:24:02.119 Mustafa Raja: I think I mentioned this before, is by their titles, right? And the titles…
271 00:24:02.420 ⇒ 00:24:06.419 Mustafa Raja: I’m the same anymore. We used to have separate,
272 00:24:06.690 ⇒ 00:24:09.989 Mustafa Raja: stand-ups for each client. Now we have one merged.
273 00:24:10.540 ⇒ 00:24:10.920 Samuel Roberts: Yes.
274 00:24:10.920 ⇒ 00:24:18.630 Mustafa Raja: One, and the title is not something that… that would be caught, right? So, need to do something about that.
275 00:24:20.420 ⇒ 00:24:22.729 Mustafa Raja: I think Total Perform might help us.
276 00:24:24.870 ⇒ 00:24:33.309 Samuel Roberts: Right, because we’re going to want to then do that, like, which… what is the context, what is the… or the, content of the meeting, and where in the meeting? Yeah, okay.
277 00:24:34.340 ⇒ 00:24:40.110 Mustafa Raja: Yeah, because Turbo Puffer… turbo puffer does not only look into what’s it called?
278 00:24:40.250 ⇒ 00:24:44.510 Mustafa Raja: The title, right? It looks into the transcripts.
279 00:24:44.510 ⇒ 00:24:45.050 Samuel Roberts: Right.
280 00:24:45.300 ⇒ 00:24:46.289 Mustafa Raja: And stuff.
281 00:24:48.160 ⇒ 00:24:49.030 Samuel Roberts: Okay.
282 00:24:51.590 ⇒ 00:25:00.680 Mustafa Raja: It might pull… pull some… some… Irrelevant meetings per… I think that is… That is, you know, workable.
283 00:25:01.980 ⇒ 00:25:05.379 Samuel Roberts: Yeah, I think, especially for these longer,
284 00:25:05.510 ⇒ 00:25:10.410 Samuel Roberts: meetings that have multiple clients, we need to come up with a better system in general, because I think…
285 00:25:10.410 ⇒ 00:25:11.250 Mustafa Raja: segment.
286 00:25:11.400 ⇒ 00:25:14.779 Samuel Roberts: Yeah, exactly, that’s what I was gonna say. I think what we need to do is have some process
287 00:25:15.090 ⇒ 00:25:17.710 Samuel Roberts: Some step that can potentially say, like, here’s
288 00:25:18.070 ⇒ 00:25:21.369 Samuel Roberts: Like, at any given time in the transcript, what…
289 00:25:21.570 ⇒ 00:25:24.899 Samuel Roberts: Client project are we talking about? Would be…
290 00:25:25.670 ⇒ 00:25:28.740 Samuel Roberts: Probably something that’s worthwhile, because that…
291 00:25:28.740 ⇒ 00:25:29.140 Gabriel Lam: do that.
292 00:25:29.140 ⇒ 00:25:29.890 Mustafa Raja: I think this is…
293 00:25:29.890 ⇒ 00:25:33.769 Gabriel Lam: Or the stand-up assistant, where, like, you sort of pre-process the transcript?
294 00:25:34.370 ⇒ 00:25:39.079 Samuel Roberts: Yeah, I’m thinking we want to just pull that all the way ahead, so that every time we have a Zoom meeting.
295 00:25:40.160 ⇒ 00:25:44.510 Samuel Roberts: It might just say, like, What parts of the meeting are what?
296 00:25:45.080 ⇒ 00:25:54.090 Samuel Roberts: We don’t have to do that for the stand-up assistant, we don’t have to do that for the client hub. Like, if it’s already done for every meeting, instead of ad hoc.
297 00:25:54.340 ⇒ 00:25:55.919 Samuel Roberts: That might be the way to go about it.
298 00:25:57.420 ⇒ 00:26:00.349 Samuel Roberts: That might be a little overkill, because not all meetings are going to be…
299 00:26:00.720 ⇒ 00:26:06.060 Samuel Roberts: Talking about multiple clients, but… and that… if that’s the case, then something that would say.
300 00:26:08.750 ⇒ 00:26:12.120 Samuel Roberts: It would just say that, you know, whatever client, you know, the whole time.
301 00:26:13.270 ⇒ 00:26:17.029 Mustafa Raja: Yeah, I’m just also wondering if words like default
302 00:26:18.200 ⇒ 00:26:19.830 Mustafa Raja: Oh, of course. You know, are going to be in…
303 00:26:19.830 ⇒ 00:26:20.759 Samuel Roberts: Of course, yeah.
304 00:26:20.760 ⇒ 00:26:24.869 Mustafa Raja: We are not talking about the client default at all, right?
305 00:26:25.390 ⇒ 00:26:26.329 Samuel Roberts: That’s true, I mean.
306 00:26:26.330 ⇒ 00:26:32.530 Mustafa Raja: CTA. Yeah, we have some pretty… And all of these are just, like.
307 00:26:32.530 ⇒ 00:26:32.980 Samuel Roberts: Oh my god.
308 00:26:32.980 ⇒ 00:26:42.620 Mustafa Raja: We have element… And… It’s LMNT, and it’s going to be passed as element.
309 00:26:42.830 ⇒ 00:26:43.550 Samuel Roberts: It is gonna get fun.
310 00:26:43.550 ⇒ 00:26:45.369 Mustafa Raja: These are some of the problems.
311 00:26:45.510 ⇒ 00:26:48.930 Mustafa Raja: Some of the problems that… that we might need to, you know.
312 00:26:49.560 ⇒ 00:26:50.879 Samuel Roberts: Of course. Look into.
313 00:26:51.570 ⇒ 00:26:57.869 Samuel Roberts: Okay, I think… I think this is… yeah, I mean, obviously, that’s… those are all good points.
314 00:26:58.220 ⇒ 00:27:03.779 Samuel Roberts: I think we can mitigate some of them by knowing some of these aliases that we’re gonna have to do, like…
315 00:27:03.920 ⇒ 00:27:09.700 Samuel Roberts: Knowing that LMNT might get parsed in a transcript as element spelled out.
316 00:27:10.120 ⇒ 00:27:15.059 Samuel Roberts: is good to know. We do have some aliases in the clients table, so maybe.
317 00:27:15.060 ⇒ 00:27:15.580 Mustafa Raja: Maybe we can make.
318 00:27:15.580 ⇒ 00:27:16.420 Samuel Roberts: More use of that.
319 00:27:16.420 ⇒ 00:27:25.109 Mustafa Raja: Those aliases are, are for, like, the titles, which are mostly manageable by the way we name the meetings, right?
320 00:27:25.110 ⇒ 00:27:28.119 Samuel Roberts: Yeah, so maybe we need something else that does, like, a…
321 00:27:29.360 ⇒ 00:27:36.160 Samuel Roberts: another step to come up with other ones of those, but I’m just thinking a little bit more about the,
322 00:27:38.370 ⇒ 00:27:42.940 Samuel Roberts: What client is this relevant to part of the, like.
323 00:27:42.940 ⇒ 00:27:43.680 Mustafa Raja: Yes.
324 00:27:43.870 ⇒ 00:27:47.020 Samuel Roberts: Part of the step, because Yeah, there…
325 00:27:47.830 ⇒ 00:27:51.480 Samuel Roberts: Maybe, maybe that needs a little more of a spike to think about, like, what are the good.
326 00:27:51.480 ⇒ 00:27:52.009 Mustafa Raja: Yes, yes.
327 00:27:52.010 ⇒ 00:27:53.859 Samuel Roberts: What are some good ways to think about that, because
328 00:27:54.270 ⇒ 00:27:59.350 Samuel Roberts: We could do something that’s a little more, like, rate…
329 00:27:59.470 ⇒ 00:28:06.670 Samuel Roberts: And, how confident it is, rather than just assigning a given a given client.
330 00:28:07.500 ⇒ 00:28:16.869 Samuel Roberts: You know, so instead of being, I… I think this client is 100% default, it could be, like, 90% default, 10% something else, and then, like, we can use that to…
331 00:28:19.440 ⇒ 00:28:20.549 Samuel Roberts: to influence this.
332 00:28:20.550 ⇒ 00:28:21.300 Mustafa Raja: Animal food.
333 00:28:21.300 ⇒ 00:28:24.849 Samuel Roberts: And the other… and… and, yeah, other pieces, like the,
334 00:28:25.160 ⇒ 00:28:27.850 Samuel Roberts: classification, the client hub and stuff. Go ahead.
335 00:28:28.970 ⇒ 00:28:33.960 Mustafa Raja: I’m also wondering that, I remember you wanted to do chapters, right?
336 00:28:34.380 ⇒ 00:28:40.690 Samuel Roberts: Yes, I was just thinking the same thing. You’re reading my mind right now, because I think for something like these stand-up.
337 00:28:40.690 ⇒ 00:28:42.909 Mustafa Raja: And that might solve everything for us, no?
338 00:28:43.070 ⇒ 00:28:53.630 Samuel Roberts: That would help, because then these chapters could be broken up by clients, we could do some other, you know, that’s… I forget exactly how it works with the video player, but it’s basically…
339 00:28:54.000 ⇒ 00:28:59.699 Samuel Roberts: similar to the way the subtitles work, where it’s just timestamps and titles and things. So if we could…
340 00:29:01.510 ⇒ 00:29:08.080 Samuel Roberts: Yeah, that definitely is something worth spiking on, how best to do that. I think the output effectively becomes…
341 00:29:09.220 ⇒ 00:29:13.279 Samuel Roberts: Like, a file that is, like, timestamped with titles.
342 00:29:13.390 ⇒ 00:29:15.500 Samuel Roberts: And then maybe we use that in other forms.
343 00:29:15.500 ⇒ 00:29:21.009 Mustafa Raja: Or other pieces, rather, down there. They’re going to chapter it by, by the client, right?
344 00:29:21.480 ⇒ 00:29:27.889 Samuel Roberts: But, yeah, ideally, I think that’s exactly where, you know, that’s the best case scenario, is that, you know, the meeting is broken up by clients.
345 00:29:28.160 ⇒ 00:29:29.430 Mustafa Raja: by chapter.
346 00:29:30.130 ⇒ 00:29:33.499 Samuel Roberts: So you could jump in one meeting to that. We could maybe even
347 00:29:33.800 ⇒ 00:29:38.810 Samuel Roberts: You know, pull those parts of the transcripts only, and display only those, potentially, and…
348 00:29:39.050 ⇒ 00:29:41.260 Samuel Roberts: There’s a few other things we can do there, but…
349 00:29:41.540 ⇒ 00:29:47.969 Samuel Roberts: But getting to that point is definitely a, A non-trivial thing. Yeah.
350 00:29:47.970 ⇒ 00:29:55.650 Mustafa Raja: bike seems to be the way. But yeah, for a quick win, we can… we can do the… do the super-based thing.
351 00:29:55.780 ⇒ 00:29:59.230 Mustafa Raja: Replace the hard-coded… Elements.
352 00:29:59.580 ⇒ 00:30:02.689 Samuel Roberts: Yeah, I think for now, that’s definitely, like, bulldoze ones.
353 00:30:03.350 ⇒ 00:30:09.360 Samuel Roberts: from Superbase, and then make a plan to change how we do that in general.
354 00:30:09.490 ⇒ 00:30:12.899 Samuel Roberts: Which would include a bunch of the stuff. Okay. Alright.
355 00:30:13.800 ⇒ 00:30:18.759 Samuel Roberts: That’s a decent amount of stuff to do.
356 00:30:20.420 ⇒ 00:30:24.809 Samuel Roberts: Was there… I mean, I guess we’re starting a new week.
357 00:30:25.270 ⇒ 00:30:29.369 Samuel Roberts: Is there a rough plan? Is it just continuing this that we’re thinking? Is that the…
358 00:30:29.600 ⇒ 00:30:35.169 Samuel Roberts: like… Were there other things on our plate this week, Gabe?
359 00:30:35.320 ⇒ 00:30:37.689 Gabriel Lam: Not so much, okay.
360 00:30:37.870 ⇒ 00:30:44.670 Gabriel Lam: I think… The rest are sort of quality-of-life things,
361 00:30:45.120 ⇒ 00:30:48.840 Gabriel Lam: the main thing Rico had mentioned in terms of
362 00:30:50.010 ⇒ 00:30:53.850 Gabriel Lam: adoption of the client hub has really been, like.
363 00:30:54.160 ⇒ 00:31:00.259 Gabriel Lam: you know, we have these massive meetings in the morning, and then it takes a while. It takes, like, an hour and a half sometimes.
364 00:31:00.260 ⇒ 00:31:00.940 Samuel Roberts: Boy, yeah.
365 00:31:00.940 ⇒ 00:31:08.379 Gabriel Lam: be ingested, and by then, it’s like, well, I could have taken the transcript and put it in and, you know, done something there.
366 00:31:09.280 ⇒ 00:31:18.119 Samuel Roberts: Yeah, I was looking at that a little bit, because he pointed out that one that wasn’t working, and it doesn’t take a ton of time for us to do it, but I think it’s a Zoom thing.
367 00:31:18.120 ⇒ 00:31:18.970 Gabriel Lam: Mmm…
368 00:31:18.970 ⇒ 00:31:25.220 Samuel Roberts: Cuz… Actually, I don’t… I should log into the platform.
369 00:31:25.680 ⇒ 00:31:28.270 Samuel Roberts: And see when those meetings are done, cause…
370 00:31:29.910 ⇒ 00:31:36.189 Samuel Roberts: I mean, correct me if I’m wrong here, for example, but I think Zoom is what’s giving us the video files and the transcripts, right?
371 00:31:37.020 ⇒ 00:31:37.690 Gabriel Lam: Yes.
372 00:31:38.290 ⇒ 00:31:49.370 Samuel Roberts: So, like, it’s… they’re doing the processing, and then that triggers all of our stuff. But, like, from what I saw, it was only a couple minutes for even that giant meeting to be done.
373 00:31:49.610 ⇒ 00:31:54.260 Samuel Roberts: When I looked at the runs earlier, and got that one of the winter… yeah.
374 00:31:54.410 ⇒ 00:31:57.619 Samuel Roberts: 10 seconds and 10 seconds, that’s not what I’m looking for,
375 00:31:58.020 ⇒ 00:32:04.139 Samuel Roberts: 30 seconds… like, it was a minute or two to run completely.
376 00:32:04.390 ⇒ 00:32:07.189 Samuel Roberts: How do I find where that one is now?
377 00:32:11.330 ⇒ 00:32:13.140 Samuel Roberts: Oh, it’s just way back, isn’t it?
378 00:32:18.970 ⇒ 00:32:21.189 Samuel Roberts: So, like, it’s not…
379 00:32:22.530 ⇒ 00:32:26.890 Samuel Roberts: we’re not the bottleneck right now, so I’m not sure how we either try to…
380 00:32:27.130 ⇒ 00:32:34.280 Samuel Roberts: get that out of Zoom, or…
381 00:32:34.280 ⇒ 00:32:34.900 Mustafa Raja: the war.
382 00:32:36.160 ⇒ 00:32:36.800 Samuel Roberts: Go ahead.
383 00:32:37.700 ⇒ 00:32:44.679 Mustafa Raja: So… so the issue, the issue really is that meetings are taking longer to, you know, show up in the platform? Is that… is that correct?
384 00:32:45.200 ⇒ 00:32:48.319 Gabriel Lam: I think it’s just… Is… is there a…
385 00:32:49.530 ⇒ 00:32:54.859 Gabriel Lam: bottleneck on our side. If it’s a bottleneck on the Zoom side, I don’t think there’s anything we can do, and I think it’s just…
386 00:32:54.860 ⇒ 00:32:56.459 Mustafa Raja: Sort of something…
387 00:32:56.670 ⇒ 00:32:57.240 Gabriel Lam: that…
388 00:32:57.240 ⇒ 00:33:00.079 Mustafa Raja: Yeah, I don’t think I need to pay any attention or side, yeah.
389 00:33:00.270 ⇒ 00:33:00.880 Gabriel Lam: No.
390 00:33:01.090 ⇒ 00:33:08.179 Samuel Roberts: I mean, there’s gotta be something we can do, because I can click transcript and see the live transcript of what we’re saying.
391 00:33:09.260 ⇒ 00:33:15.199 Samuel Roberts: So, I just don’t know what is Zoom doing… That is taking so long.
392 00:33:15.880 ⇒ 00:33:19.209 Samuel Roberts: And if it is that, again, maybe I’m wrong about that?
393 00:33:19.730 ⇒ 00:33:26.179 Samuel Roberts: Let me take a quick… Look at these things,
394 00:33:27.070 ⇒ 00:33:34.100 Samuel Roberts: This is the one that failed to import. Okay, so yeah, so this one was triggered at…
395 00:33:34.950 ⇒ 00:33:49.160 Samuel Roberts: Otherwise, I gotta open that up. Okay. So this one, let’s see, it was triggered at 10… we received the job, 1042, started the job at 1042. What time was that meeting? I’m just… the meeting is at 9.
396 00:33:49.410 ⇒ 00:33:52.630 Samuel Roberts: It went to at least 1030. Let’s go to the…
397 00:33:54.500 ⇒ 00:33:59.779 Samuel Roberts: Let’s go to, the dashboard, see how long that meeting actually was.
398 00:34:00.990 ⇒ 00:34:09.239 Samuel Roberts: The meeting this morning, it says it was…
399 00:34:11.350 ⇒ 00:34:14.189 Samuel Roberts: It’s a big video. An hour and 8 minutes.
400 00:34:16.300 ⇒ 00:34:26.760 Samuel Roberts: Okay… So, if it was an hour and 8 minutes, and the start time was 9…
401 00:34:27.080 ⇒ 00:34:32.340 Samuel Roberts: It went just past 10, we’ll assume, and we didn’t get it for 40 minutes.
402 00:34:33.150 ⇒ 00:34:34.920 Samuel Roberts: Yeah, that’s definitely it.
403 00:34:35.540 ⇒ 00:34:36.440 Samuel Roberts: Okay.
404 00:34:37.780 ⇒ 00:34:38.719 Samuel Roberts: So…
405 00:34:41.810 ⇒ 00:34:45.129 Samuel Roberts: I don’t know… All the details of what.
406 00:34:45.420 ⇒ 00:34:47.999 Gabriel Lam: No worries, it’s just something I noticed.
407 00:34:48.179 ⇒ 00:34:54.359 Samuel Roberts: No, no, this is a huge… this is a big thing, because I would much rather have that happen faster, and I’m wondering if there’s ways we can…
408 00:34:55.079 ⇒ 00:34:58.859 Samuel Roberts: Like, I’m just looking at the logs of what we process.
409 00:34:59.519 ⇒ 00:35:08.539 Samuel Roberts: And again, the processing took… take minutes, but there are a… Several videos that get processed.
410 00:35:09.329 ⇒ 00:35:10.379 Samuel Roberts: from Zoom.
411 00:35:10.719 ⇒ 00:35:12.109 Samuel Roberts: Right? Because there’s…
412 00:35:12.489 ⇒ 00:35:22.519 Samuel Roberts: what is it? The, shared screen with gallery view, gallery view, shared screen with speaker view, speaker view, active speaker, shared screen, audio only, and then there’s the…
413 00:35:22.879 ⇒ 00:35:29.519 Samuel Roberts: Timeline… The transcript, and the chat file.
414 00:35:29.899 ⇒ 00:35:32.669 Samuel Roberts: So I think Zoom’s just taking a while. I don’t know…
415 00:35:33.359 ⇒ 00:35:39.699 Samuel Roberts: What to do about that, per se, but… Probably worth looking into.
416 00:35:40.639 ⇒ 00:35:46.899 Samuel Roberts: Especially if we’re gonna be… adding,
417 00:35:48.939 ⇒ 00:35:51.909 Samuel Roberts: Adding any more processing steps, but like…
418 00:35:55.429 ⇒ 00:35:56.329 Samuel Roberts: Yeah.
419 00:35:58.409 ⇒ 00:36:07.119 Samuel Roberts: Because that is… that is a, like, even if it’s not us, it’s still, like, a thing I’d want to figure out, because that is annoying, and… and wasting time.
420 00:36:08.309 ⇒ 00:36:09.269 Samuel Roberts: So…
421 00:36:16.510 ⇒ 00:36:19.719 Samuel Roberts: I mean, how long have we been in this meeting now? Like, I’m wondering how I…
422 00:36:19.910 ⇒ 00:36:24.100 Samuel Roberts: Wonder how long it’ll… Take from this.
423 00:36:24.100 ⇒ 00:36:25.300 Mustafa Raja: It’s been 30 minutes.
424 00:36:26.480 ⇒ 00:36:27.410 Samuel Roberts: Yeah.
425 00:36:28.930 ⇒ 00:36:29.870 Samuel Roberts: Okay.
426 00:36:31.730 ⇒ 00:36:36.119 Samuel Roberts: Alright, so maybe that’s another thing to keep on the radar, at least for now.
427 00:36:36.610 ⇒ 00:36:41.090 Samuel Roberts: maybe even tomorrow morning, I’ll try to, like… really monitor it.
428 00:36:42.410 ⇒ 00:36:43.780 Samuel Roberts: After the meeting.
429 00:36:45.390 ⇒ 00:36:51.080 Samuel Roberts: Because if that’s taken 40-ish minutes, I just… I don’t know.
430 00:36:52.690 ⇒ 00:36:54.320 Samuel Roberts: What is happening?
431 00:36:54.580 ⇒ 00:37:00.440 Samuel Roberts: like… Yeah, that’s all I got at this point. I can just keep talking, but…
432 00:37:00.440 ⇒ 00:37:07.839 Gabriel Lam: I think for me, it didn’t show up till, like, noon, and I was eating lunch, and I was like, wait, I don’t see any updates on our dashboard, on our meetings, so that’s…
433 00:37:07.840 ⇒ 00:37:08.190 Samuel Roberts: Well, that.
434 00:37:08.190 ⇒ 00:37:10.189 Gabriel Lam: That’s when I started digging into it.
435 00:37:10.190 ⇒ 00:37:22.409 Samuel Roberts: Yeah, yeah, well, that was, I think, when it, Rico pointed out that it wasn’t there, I re-ran it, that’s another thing that I already might have a fix for. Yep. But I…
436 00:37:22.560 ⇒ 00:37:25.760 Samuel Roberts: I don’t know exactly why it failed, I have some…
437 00:37:26.050 ⇒ 00:37:27.690 Samuel Roberts: Just things I was looking at, but…
438 00:37:27.870 ⇒ 00:37:33.709 Samuel Roberts: Basically, we need to add some retry logic, because I think either of these long meetings are causing,
439 00:37:35.240 ⇒ 00:37:40.160 Samuel Roberts: Causing, like, a network issue during our processing of it?
440 00:37:41.390 ⇒ 00:37:48.130 Samuel Roberts: Or it just sometimes flakes out, and we just need to have a retry thing, either way.
441 00:37:52.890 ⇒ 00:37:55.040 Samuel Roberts: So… yeah.
442 00:37:55.950 ⇒ 00:38:00.119 Samuel Roberts: Like, I think there’s other ones here that have also failed today, and I don’t know what the…
443 00:38:02.980 ⇒ 00:38:04.740 Samuel Roberts: Yeah. Okay.
444 00:38:07.440 ⇒ 00:38:09.539 Samuel Roberts: Alright,
445 00:38:12.330 ⇒ 00:38:24.189 Samuel Roberts: I don’t even… yeah, that’s pretty much all I got right now. I appreciate all the updates and everything today, and everything from last week. I’m really curious about this Zoom thing, so I might actually take a look and see what we’re doing, but…
446 00:38:24.500 ⇒ 00:38:27.780 Samuel Roberts: I don’t know if I even have the right access in Zoom for that.
447 00:38:28.000 ⇒ 00:38:33.069 Samuel Roberts: So, I might wait till tomorrow, then. Casey might know that. Unless, Mustafa, do you know where in Zoom?
448 00:38:33.250 ⇒ 00:38:33.950 Samuel Roberts: the, like.
449 00:38:33.950 ⇒ 00:38:34.440 Mustafa Raja: the book is.
450 00:38:34.440 ⇒ 00:38:34.969 Samuel Roberts: Is that your interest.
451 00:38:34.970 ⇒ 00:38:35.680 Mustafa Raja: Things.
452 00:38:36.200 ⇒ 00:38:38.460 Mustafa Raja: This was set up before me, so…
453 00:38:38.460 ⇒ 00:38:42.720 Samuel Roberts: I assumed that, but I didn’t want to just, like, assume you didn’t know. So, no, no worries.
454 00:38:42.720 ⇒ 00:38:49.029 Mustafa Raja: Yeah, yeah, yeah, I, I never got to, got to work with, with, with this, Zoom feature. Yeah.
455 00:38:49.170 ⇒ 00:38:50.000 Samuel Roberts: Okay.
456 00:38:50.180 ⇒ 00:38:54.870 Samuel Roberts: Alright, well, yeah, we’ll get with Casey tomorrow, then, and see what,
457 00:38:55.050 ⇒ 00:39:00.860 Samuel Roberts: what is currently set up, and maybe we can even see, maybe, some kind of logs from Zoom about…
458 00:39:00.990 ⇒ 00:39:15.080 Samuel Roberts: What’s taking so long, and processing all the… because we probably need them to process the transcripts, because they’re the ones that are going to know who’s who, and we don’t want to end up in a problem where we just have, like, us trying to transcript an audio… or transcribe an audio file or something.
459 00:39:16.840 ⇒ 00:39:17.310 Mustafa Raja: Yeah.
460 00:39:17.310 ⇒ 00:39:21.429 Samuel Roberts: Man, it’s live processing our transcript as we’re talking right now, so…
461 00:39:22.650 ⇒ 00:39:25.269 Samuel Roberts: It shouldn’t take forever, I don’t know.
462 00:39:25.880 ⇒ 00:39:27.540 Samuel Roberts: Okay, we’ll deal with that later.
463 00:39:27.540 ⇒ 00:39:32.020 Mustafa Raja: It might be just taking some… but yeah, uploading shouldn’t also take time, right?
464 00:39:32.490 ⇒ 00:39:37.519 Samuel Roberts: No, this is what I’m saying, it took 40 minutes for us to even get the thing to do the upload, so I don’t know.
465 00:39:38.930 ⇒ 00:39:39.700 Mustafa Raja: Hmm.
466 00:39:40.370 ⇒ 00:39:42.219 Samuel Roberts: But we’ll… we’ll deal with that later.
467 00:39:42.960 ⇒ 00:39:48.020 Samuel Roberts: Okay. In the meantime, I guess, I would say…
468 00:39:48.280 ⇒ 00:39:53.720 Samuel Roberts: what comes out of this? We talked about updating the… the Dyxter to pull from Superbase, right?
469 00:39:54.120 ⇒ 00:39:54.650 Gabriel Lam: Yep.
470 00:39:55.480 ⇒ 00:39:59.359 Samuel Roberts: Okay, that’s probably the Immediate next steps like this, but what else?
471 00:39:59.360 ⇒ 00:40:02.589 Gabriel Lam: And I think getting the PRs, out.
472 00:40:02.730 ⇒ 00:40:04.119 Gabriel Lam: As soon as possible.
473 00:40:04.120 ⇒ 00:40:13.370 Samuel Roberts: Yeah, I’ll… I’ll… let’s see, where did I put… Github…
474 00:40:13.850 ⇒ 00:40:19.220 Samuel Roberts: Okay, yeah, I’ll just merge some of those PR, the easy ones, and then I’m gonna take a look at the…
475 00:40:20.420 ⇒ 00:40:25.080 Samuel Roberts: The biggest one, the… With the generic client hub and stuff today.
476 00:40:25.080 ⇒ 00:40:25.790 Gabriel Lam: Awesome.
477 00:40:25.980 ⇒ 00:40:28.600 Samuel Roberts: But I’ll get those other ones merged in, because I think they’re all good.
478 00:40:29.880 ⇒ 00:40:34.370 Samuel Roberts: Once that’s done, how long, or what’s the lift, do you think, on…
479 00:40:34.810 ⇒ 00:40:36.040 Gabriel Lam: the…
480 00:40:36.690 ⇒ 00:40:45.260 Gabriel Lam: two new clients, like Lilo Social and Element, because I think that has been sitting in Casey’s court for a while, and I’d rather not have those drag on.
481 00:40:45.790 ⇒ 00:40:47.370 Samuel Roberts: Oh.
482 00:40:49.720 ⇒ 00:41:03.360 Mustafa Raja: Since we now do not have to create specific superbase function, if we just update the pipelines to, you know, not be hard-coded, but pull from the client’s table.
483 00:41:03.360 ⇒ 00:41:04.069 Gabriel Lam: Then it should automatically.
484 00:41:04.070 ⇒ 00:41:10.229 Mustafa Raja: I think this should be good to go, and moving forward, we would then have to, you know.
485 00:41:10.370 ⇒ 00:41:13.590 Mustafa Raja: Yeah. Just add the clients.
486 00:41:13.680 ⇒ 00:41:17.840 Samuel Roberts: Yeah, that’s the dream, so hopefully that we’re close to that, I think it’s good.
487 00:41:17.840 ⇒ 00:41:20.199 Gabriel Lam: And then bringing that into the platform.
488 00:41:20.360 ⇒ 00:41:21.350 Gabriel Lam: On the, sort of, front end.
489 00:41:21.350 ⇒ 00:41:22.470 Mustafa Raja: Oh, one shouldn’t do that.
490 00:41:22.470 ⇒ 00:41:23.130 Gabriel Lam: difficult.
491 00:41:23.760 ⇒ 00:41:27.600 Mustafa Raja: Once it’s in the database, you know, the client’s table.
492 00:41:27.600 ⇒ 00:41:28.550 Gabriel Lam: Got it, yup, okay.
493 00:41:28.550 ⇒ 00:41:29.859 Mustafa Raja: Shows up on there.
494 00:41:30.550 ⇒ 00:41:36.180 Samuel Roberts: Yeah, so if you go to, other actions, manage clients.
495 00:41:37.390 ⇒ 00:41:39.449 Samuel Roberts: You can add clients there.
496 00:41:39.900 ⇒ 00:41:40.280 Gabriel Lam: I see.
497 00:41:40.280 ⇒ 00:41:42.609 Samuel Roberts: And so, I think…
498 00:41:42.720 ⇒ 00:41:52.100 Samuel Roberts: I don’t know if that’s the best flow, or if we want to try to trigger something from some other system eventually, but my thought is, like, whoever goes in and adds the client there.
499 00:41:52.570 ⇒ 00:41:53.980 Samuel Roberts: Would be the, like…
500 00:41:54.320 ⇒ 00:42:04.169 Samuel Roberts: trigger for creating those tables in Supabase, which would then update the Dagster pipelines when they run, which would eventually upgrade the
501 00:42:04.530 ⇒ 00:42:12.610 Samuel Roberts: Yeah, now the generic client hub would just use that, so… We’re getting closer.
502 00:42:13.740 ⇒ 00:42:14.450 Gabriel Lam: Awesome.
503 00:42:16.380 ⇒ 00:42:17.060 Samuel Roberts: So I would say…
504 00:42:17.060 ⇒ 00:42:35.680 Mustafa Raja: one thing that the generic, client hub agent, what it needs is the names of the table for embeddings, right? So once we add the clients to the client table, we will have to wait for at least one run until the tables exist.
505 00:42:35.680 ⇒ 00:42:44.360 Mustafa Raja: Once the tables exist, we can add the names of the tables in the client table, and then that would enable our generic
506 00:42:44.700 ⇒ 00:42:45.910 Mustafa Raja: Client Hub.
507 00:42:45.910 ⇒ 00:42:46.570 Samuel Roberts: Okay.
508 00:42:46.840 ⇒ 00:42:54.529 Samuel Roberts: In the meantime, then, It’s gonna be creating these tables, so it’s gonna use a standard naming convention, right?
509 00:42:55.340 ⇒ 00:43:02.549 Mustafa Raja: Yes, we have a standard naming convention. It’s just a little weird that some of these,
510 00:43:02.720 ⇒ 00:43:07.970 Mustafa Raja: tables are, you know, weirdly named. I don’t know if that is because.
511 00:43:07.970 ⇒ 00:43:09.230 Samuel Roberts: But that’s the historic…
512 00:43:09.230 ⇒ 00:43:11.369 Mustafa Raja: Code change that sometime, yeah.
513 00:43:11.370 ⇒ 00:43:16.019 Samuel Roberts: Yeah, but I’m saying, going forward, we don’t need to… we can just assume the table names.
514 00:43:16.020 ⇒ 00:43:21.729 Mustafa Raja: Yeah, yeah, yeah. Going forward. We can assume what… what is going… what’s the probable name going to be.
515 00:43:22.140 ⇒ 00:43:27.450 Samuel Roberts: Okay, so then we can put that in the table, and then we just have to have something that’ll catch and find when the tables don’t exist.
516 00:43:27.550 ⇒ 00:43:28.530 Mustafa Raja: Yes.
517 00:43:28.870 ⇒ 00:43:29.660 Samuel Roberts: Okay.
518 00:43:30.080 ⇒ 00:43:35.620 Samuel Roberts: Yeah, so, I think, yeah, the plan of action, plan of attack here is…
519 00:43:35.840 ⇒ 00:43:40.430 Samuel Roberts: update the Daxter pipelines to use the tables. That will then
520 00:43:41.420 ⇒ 00:43:51.189 Samuel Roberts: also create the tables, is that how that works? Because it’s going to delete and create every time. So we want to make sure it’s pulling from Superbase client file, or client table.
521 00:43:51.570 ⇒ 00:43:53.660 Samuel Roberts: And then…
522 00:43:53.660 ⇒ 00:43:54.210 Mustafa Raja: Yeah.
523 00:43:54.880 ⇒ 00:43:57.080 Samuel Roberts: At the same time.
524 00:43:57.480 ⇒ 00:44:01.020 Samuel Roberts: It’ll create those tables, but when we create clients.
525 00:44:02.980 ⇒ 00:44:07.820 Samuel Roberts: We can actually also store the client table names, and then…
526 00:44:07.820 ⇒ 00:44:08.470 Mustafa Raja: Yeah.
527 00:44:08.720 ⇒ 00:44:17.320 Samuel Roberts: we just need to have a catch somewhere that does the proper error that says, like, please allow, you know, like, that something’s not working, but we can deal with that later. Okay, cool.
528 00:44:20.460 ⇒ 00:44:26.499 Samuel Roberts: Alright, so I think, yeah, if we could run with that, that… I mean, I don’t know what the rest of your day looks like, stuff, but…
529 00:44:27.750 ⇒ 00:44:31.059 Mustafa Raja: This is going to be tomorrow, I have two more meetings.
530 00:44:31.060 ⇒ 00:44:31.699 Gabriel Lam: No worries. Perfect.
531 00:44:31.700 ⇒ 00:44:36.379 Samuel Roberts: Okay, that sounds good. That’s just making sure we have a good sense of where everything’s happening. That’s fine then. Alright, cool.
532 00:44:36.520 ⇒ 00:44:38.370 Samuel Roberts: Alright, anything else?
533 00:44:38.740 ⇒ 00:44:39.500 Gabriel Lam: I think that’s it.
534 00:44:39.500 ⇒ 00:44:40.380 Mustafa Raja: Thanks, guys, awesome.
535 00:44:41.170 ⇒ 00:44:51.890 Samuel Roberts: Welcome back. Hope you had a good break. Yes, oh yeah, it was great. Yeah, I mean, Thanksgiving was fun, we were in Indiana with my wife’s family, and then in Boston with my family last week, so had a wonderful.
536 00:44:51.890 ⇒ 00:44:53.370 Gabriel Lam: Yeah. All right.
537 00:44:54.450 ⇒ 00:44:56.959 Gabriel Lam: Great, awesome, thank you, we’ll talk soon.
538 00:44:56.960 ⇒ 00:44:58.040 Samuel Roberts: Sounds good, talk to you all later.
539 00:44:58.080 ⇒ 00:44:58.920 Gabriel Lam: Bye.
540 00:44:59.610 ⇒ 00:45:00.500 Mustafa Raja: Thank you, bye.