Meeting Title: AI Service Standup Date: 2026-01-27 Meeting participants: Mustafa Raja, Samuel Roberts
WEBVTT
1 00:00:40.060 ⇒ 00:00:41.260 Samuel Roberts: Hello.
2 00:00:42.840 ⇒ 00:00:43.720 Mustafa Raja: Hey, how are you?
3 00:00:45.100 ⇒ 00:00:48.670 Samuel Roberts: Doing okay, as long as my audio’s good.
4 00:00:49.030 ⇒ 00:00:50.209 Samuel Roberts: This one again?
5 00:00:50.540 ⇒ 00:00:51.560 Samuel Roberts: There we go, okay.
6 00:00:52.430 ⇒ 00:00:53.300 Mustafa Raja: Alright, audio’s good.
7 00:00:54.200 ⇒ 00:00:57.919 Samuel Roberts: Yeah, no, it’s… I… I… I went to go turn on my… my…
8 00:00:58.300 ⇒ 00:01:03.920 Samuel Roberts: headphones, and the volume knob just gives me an error, but I can do it on the headphones, I guess.
9 00:01:04.150 ⇒ 00:01:06.049 Samuel Roberts: My whole setup of this is…
10 00:01:06.420 ⇒ 00:01:08.510 Samuel Roberts: I don’t know, this Mac just has issues.
11 00:01:09.570 ⇒ 00:01:10.930 Samuel Roberts: With my setup, at least.
12 00:01:14.670 ⇒ 00:01:15.970 Samuel Roberts: Oh, how you doing today?
13 00:01:16.610 ⇒ 00:01:17.610 Mustafa Raja: Doing good.
14 00:01:19.320 ⇒ 00:01:20.269 Samuel Roberts: Can, can.
15 00:01:20.940 ⇒ 00:01:25.539 Mustafa Raja: Yeah. We have this new, sign-up format that we’ll be following, right?
16 00:01:26.840 ⇒ 00:01:30.490 Samuel Roberts: Yeah, I’m gonna try to stick to that today as best as we can,
17 00:01:30.930 ⇒ 00:01:34.399 Samuel Roberts: We’ll… we’ll… we’ll see how it goes today, but yeah, we’ll…
18 00:01:34.540 ⇒ 00:01:39.760 Mustafa Raja: I’m thinking with that, we might need a new, stand-up, at least for today, for ABC.
19 00:01:41.770 ⇒ 00:01:42.880 Samuel Roberts: A new one?
20 00:01:43.140 ⇒ 00:01:43.980 Mustafa Raja: Yeah.
21 00:01:44.390 ⇒ 00:01:46.949 Mustafa Raja: Since I would want to work again, yeah.
22 00:01:49.090 ⇒ 00:01:50.970 Samuel Roberts: You would want to what? I’m sorry, you cut off.
23 00:01:50.970 ⇒ 00:01:56.249 Mustafa Raja: Sorry, with this new, format, we cannot go in detail of the tickets, right?
24 00:01:56.890 ⇒ 00:02:00.999 Samuel Roberts: Yeah, we can… we can do that, we can parking lot that for… for something else.
25 00:02:01.000 ⇒ 00:02:01.570 Mustafa Raja: Yeah.
26 00:02:01.760 ⇒ 00:02:05.520 Mustafa Raja: Yeah, that’s what I might want to do for today.
27 00:02:05.670 ⇒ 00:02:08.660 Samuel Roberts: Yeah, that’s fine. I think… I think that makes sense.
28 00:02:08.930 ⇒ 00:02:20.349 Samuel Roberts: Yeah, I’ve been trying to balance out the, like, technical, quick little things with parking lot… parking lot… parking lotting things for later.
29 00:02:20.540 ⇒ 00:02:23.119 Samuel Roberts: But… you know, I…
30 00:02:23.400 ⇒ 00:02:28.689 Samuel Roberts: I think we should try it out. Try the… the script a little bit today and see how that goes.
31 00:02:28.890 ⇒ 00:02:41.269 Samuel Roberts: I think also I was noticing yesterday, like, we had our SL meeting, and I realized, you know, Awash is struggling a little bit with the certain things, because, like, I’m on Lilo and Andy, so I don’t, you know, when the tickets aren’t up to date, I still know what’s going on.
32 00:02:41.540 ⇒ 00:02:42.730 Mustafa Raja: Yeah, yeah.
33 00:02:42.730 ⇒ 00:02:46.750 Samuel Roberts: But I think we… I want to get a little more… Say that again?
34 00:02:46.750 ⇒ 00:02:50.899 Mustafa Raja: Over there, with the data stand-up, it’s a lot of clients.
35 00:02:51.020 ⇒ 00:02:51.530 Mustafa Raja: 5…
36 00:02:51.530 ⇒ 00:03:04.539 Samuel Roberts: Exactly, exactly. And we’ll get to that point, so I want to make sure that we’re, you know, keeping linear up to date. I might even spend a bit of time in linear today, just, like, going over things, because I hopefully don’t have a ton to…
37 00:03:04.650 ⇒ 00:03:06.780 Samuel Roberts: dive into for Levo yet, but we’ll see.
38 00:03:06.780 ⇒ 00:03:12.240 Mustafa Raja: I think, I think handling the linear would be, would be the easiest thing to do, no?
39 00:03:12.790 ⇒ 00:03:15.869 Samuel Roberts: Yes, but I still need to understand what’s going on, you know what I mean?
40 00:03:15.870 ⇒ 00:03:16.300 Mustafa Raja: Yeah.
41 00:03:16.300 ⇒ 00:03:25.770 Samuel Roberts: So I want to make sure that, like, linear is up to, kind of, you know, helpful for other people. Like, yeah, keep, like, keeping the records there is definitely, like, an EP thing.
42 00:03:26.310 ⇒ 00:03:34.360 Samuel Roberts: But if I don’t know what’s going on, then it’s not, you know, it’s not helpful enough, and if I don’t know what’s going on, then the CSO might not know what’s going on, and then, you know, it’s that kind of thing.
43 00:03:34.360 ⇒ 00:03:35.090 Mustafa Raja: I agree.
44 00:03:35.910 ⇒ 00:03:43.719 Samuel Roberts: So, I’ll spend a little bit of time… I also want to get some other views set up so I can see actual, like, you know… like, we closed out 4 tickets yesterday, like, I need… I need a better…
45 00:03:43.930 ⇒ 00:03:44.810 Mustafa Raja: views.
46 00:03:44.830 ⇒ 00:03:48.000 Samuel Roberts: what I have defined and stuff, so I gotta spend a little time.
47 00:03:48.720 ⇒ 00:03:53.580 Samuel Roberts: in linear, just making sure I have better views for being able to do those kinds of reports, because…
48 00:03:53.580 ⇒ 00:03:55.330 Mustafa Raja: Right now, it’s.
49 00:03:56.220 ⇒ 00:03:58.840 Samuel Roberts: I just kind of bounce around the views that are there.
50 00:03:59.970 ⇒ 00:04:00.630 Mustafa Raja: Yep.
51 00:04:03.820 ⇒ 00:04:06.359 Samuel Roberts: I wonder what we got? 10.03, I wonder…
52 00:04:11.290 ⇒ 00:04:12.049 Samuel Roberts: Oh my goodness.
53 00:04:12.800 ⇒ 00:04:15.719 Samuel Roberts: So… Casey let us know…
54 00:04:26.480 ⇒ 00:04:33.359 Samuel Roberts: Anyone else’s… Then none… I haven’t heard from anyone else today, so I don’t…
55 00:04:36.480 ⇒ 00:04:42.679 Mustafa Raja: I guess if it’s only us, then… we could just parking lot right now.
56 00:04:42.680 ⇒ 00:04:51.119 Samuel Roberts: I know, I know, I don’t… I don’t want to do that if we don’t have to, but it might just be… let’s… we can talk about whatever we need to talk about until anyone gets here, so yeah, is there stuff to discuss?
57 00:04:51.900 ⇒ 00:04:54.100 Mustafa Raja: Yeah, so,
58 00:04:54.500 ⇒ 00:05:14.130 Mustafa Raja: For the logging part, right? so Mastra does… so we have a storage attached with Mastra, right? And it’s actually a… what’s it called? An SQLite database, right? So, whenever a workflow runs, all of its metadata gets stored in there.
59 00:05:14.130 ⇒ 00:05:15.040 Samuel Roberts: About the top.
60 00:05:15.040 ⇒ 00:05:25.640 Mustafa Raja: other things also, right? So we can calculate, execution time, we do have input and output, we do have a run ID, which could serve as a record ID,
61 00:05:27.030 ⇒ 00:05:37.839 Mustafa Raja: I guess for… for things like conversation ID and other… some other things, we could… that’s just going to come from Google Chat, right? So, we don’t have to worry about that right now.
62 00:05:38.070 ⇒ 00:05:48.009 Mustafa Raja: Apart from that, for the quality score, I built a scorer that, that is directly attached to, with the agent.
63 00:05:48.200 ⇒ 00:05:53.589 Mustafa Raja: And it’s a relevancy score, right? So, if the answer was relevant to the question at all or not.
64 00:05:53.710 ⇒ 00:05:56.929 Mustafa Raja: Right? So that’s going to replace quality score. Perfect.
65 00:05:56.930 ⇒ 00:05:59.850 Samuel Roberts: Okay, yes, relevancy is a good one. Good. Okay.
66 00:06:01.570 ⇒ 00:06:26.379 Mustafa Raja: And I was wondering, so there’s one caveat, so there’s one caveat. So, my thought process is, okay, we can batch this, batch this data in our warehouse, every 5 hours or so, or whatever we feel would be a good interval. The only caveat here is, if the server turns off and it restarts.
67 00:06:26.600 ⇒ 00:06:39.470 Mustafa Raja: SQLite does not have its data in it anymore, right? The database refreshes. Now, we do have other options. We could hook up Postgres with it.
68 00:06:41.030 ⇒ 00:06:41.630 Mustafa Raja: So…
69 00:06:41.630 ⇒ 00:06:42.260 Samuel Roberts: Yeah.
70 00:06:42.840 ⇒ 00:06:45.550 Mustafa Raja: Yeah, this is something that I would want to talk to you about.
71 00:06:46.160 ⇒ 00:06:50.359 Samuel Roberts: Yeah, so… Do you have any documentation on… on that?
72 00:06:50.360 ⇒ 00:06:51.970 Mustafa Raja: Yeah, I do have that.
73 00:06:52.180 ⇒ 00:06:53.510 Samuel Roberts: Okay, so I’m thinking, yeah.
74 00:06:53.510 ⇒ 00:06:54.110 Mustafa Raja: Oh, dude.
75 00:06:54.110 ⇒ 00:06:56.340 Samuel Roberts: I’m just gonna be writing to this database anyway.
76 00:06:56.890 ⇒ 00:06:58.119 Samuel Roberts: I just want to set that up.
77 00:06:58.560 ⇒ 00:07:02.459 Samuel Roberts: Like, if it’s gonna be writing to this database anyway.
78 00:07:02.460 ⇒ 00:07:03.449 Mustafa Raja: Yeah, yeah, yeah.
79 00:07:04.100 ⇒ 00:07:09.480 Samuel Roberts: that could just be our source of truth, and I think, yeah, if we just set it up to be something more persistent than the SQLite…
80 00:07:09.840 ⇒ 00:07:11.189 Samuel Roberts: Or SQLite, whatever.
81 00:07:12.750 ⇒ 00:07:14.589 Mustafa Raja: Yeah, let me, let me share this.
82 00:07:14.850 ⇒ 00:07:16.340 Mustafa Raja: So this is the stage.
83 00:07:16.340 ⇒ 00:07:18.019 Samuel Roberts: Handle and see if anyone else is here.
84 00:07:18.840 ⇒ 00:07:22.190 Mustafa Raja: So this is the storage, and then…
85 00:07:22.480 ⇒ 00:07:26.629 Mustafa Raja: This is the core schema for all of the things it stores.
86 00:07:27.190 ⇒ 00:07:39.530 Mustafa Raja: Now, it doesn’t store anything for agents, but if our step is returning everything that the agent has done, it will get stored as metadata in the workflow.
87 00:07:41.910 ⇒ 00:07:42.860 Samuel Roberts: Okay, so…
88 00:07:42.860 ⇒ 00:07:43.560 Mustafa Raja: withdrawing…
89 00:07:47.220 ⇒ 00:07:50.859 Samuel Roberts: Postgres, MySQL, Mongo, DynamoDB.
90 00:07:51.530 ⇒ 00:07:53.690 Samuel Roberts: Man, it really doesn’t want to play well with Google, does it?
91 00:07:54.590 ⇒ 00:07:58.140 Mustafa Raja: I don’t know. If we…
92 00:07:58.140 ⇒ 00:08:01.950 Samuel Roberts: Yeah, well, I just noticed they have a lot of deployment stuff that’s not Google, so…
93 00:08:01.950 ⇒ 00:08:07.739 Mustafa Raja: Yeah, one more thing here I would want to add is, I don’t know if we can host Postgres on Google.
94 00:08:09.600 ⇒ 00:08:13.209 Samuel Roberts: That’s what I mean, I feel like we have to figure out whatever the right.
95 00:08:13.950 ⇒ 00:08:20.369 Samuel Roberts: Connection is… Okay, we may have to spike our hands.
96 00:08:20.780 ⇒ 00:08:25.180 Mustafa Raja: I haven’t looked into if Postgres can be hosted on… Google Dome.
97 00:08:26.480 ⇒ 00:08:29.989 Samuel Roberts: Yeah, well, there’s other… there’s other storage options here.
98 00:08:30.780 ⇒ 00:08:34.510 Mustafa Raja: Yeah, I didn’t, I don’t think I found anything…
99 00:08:35.340 ⇒ 00:08:36.520 Samuel Roberts: Yeah, I know.
100 00:08:36.710 ⇒ 00:08:37.579 Samuel Roberts: Let me…
101 00:08:43.370 ⇒ 00:08:46.439 Samuel Roberts: Cloud SQL for… yeah, it looks like they have something for.
102 00:08:46.440 ⇒ 00:08:49.899 Mustafa Raja: Yeah, Google has progress. GCP has.
103 00:08:51.480 ⇒ 00:08:56.040 Samuel Roberts: Cool, okay, so that might be the best path forward, then. Like, if we just do that, and then that’s base…
104 00:08:59.260 ⇒ 00:09:00.100 Mustafa Raja: Pardon?
105 00:09:00.970 ⇒ 00:09:04.350 Samuel Roberts: I need to dump it then, it’ll just be… updating that.
106 00:09:04.880 ⇒ 00:09:05.550 Mustafa Raja: Yeah, yeah, yeah.
107 00:09:07.280 ⇒ 00:09:08.770 Samuel Roberts: I like that. Okay, that’s great.
108 00:09:09.840 ⇒ 00:09:14.510 Mustafa Raja: Yeah, I think… I still think we might want to, you know, transform all of this data back into…
109 00:09:14.680 ⇒ 00:09:19.340 Mustafa Raja: BigQuery, since it’s going to be… Oh…
110 00:09:19.470 ⇒ 00:09:25.560 Mustafa Raja: a lot of JSON, a lot of the JSON… a lot of… a lot of these feeds in the schema are just JSON, you know?
111 00:09:26.180 ⇒ 00:09:29.069 Samuel Roberts: Yeah, let me… let me dig into that. I was looking at the,
112 00:09:31.090 ⇒ 00:09:33.789 Samuel Roberts: The connectors, I didn’t really look at the schema yet.
113 00:09:35.150 ⇒ 00:09:37.060 Samuel Roberts: Oh, I see, yes, yes, yes.
114 00:09:38.300 ⇒ 00:09:46.300 Mustafa Raja: So, in the workflow, there is a snapshot, which is going to be all JSON, and this is where all of our good stuff is going to be.
115 00:09:46.660 ⇒ 00:09:51.580 Mustafa Raja: So, one more caveat here is… hmm…
116 00:09:53.190 ⇒ 00:09:56.759 Mustafa Raja: This course schema does not have scoders, right?
117 00:09:57.030 ⇒ 00:10:03.169 Mustafa Raja: I don’t know where scorers are coming from, but we do have access to those also.
118 00:10:03.300 ⇒ 00:10:09.060 Mustafa Raja: I will look into that if this, if, if the schema has that or not.
119 00:10:10.240 ⇒ 00:10:10.800 Samuel Roberts: Mmm.
120 00:10:10.800 ⇒ 00:10:18.200 Mustafa Raja: I do see that the scores also get stored in, in the master as… what’s it called?
121 00:10:18.610 ⇒ 00:10:19.970 Mustafa Raja: SQLite.
122 00:10:20.890 ⇒ 00:10:22.910 Samuel Roberts: Okay, yeah, there’s an eval schema here.
123 00:10:23.610 ⇒ 00:10:28.650 Mustafa Raja: Oh, sorry, I didn’t… I didn’t see that. Yeah, it’s exactly what we need. Yeah, this is the one.
124 00:10:28.650 ⇒ 00:10:29.500 Samuel Roberts: Perfect, okay.
125 00:10:29.690 ⇒ 00:10:31.569 Samuel Roberts: Yeah, I would say,
126 00:10:33.090 ⇒ 00:10:37.819 Samuel Roberts: Alright, well, let’s think about this. So if this… if… I would say try to maybe set up a Postgres
127 00:10:39.320 ⇒ 00:10:40.440 Mustafa Raja: On GCP, right?
128 00:10:41.350 ⇒ 00:10:44.040 Samuel Roberts: Or even just test it locally and see how it looks, you know?
129 00:10:44.820 ⇒ 00:10:47.290 Mustafa Raja: Okay, yeah, yeah, that’s a good idea, yeah.
130 00:10:47.820 ⇒ 00:10:55.509 Samuel Roberts: Yeah, just to, like, dump, like, run a few things, and then take a look at the data, make sure everything’s there. Like, if that’s the case, then yeah, I think we probably want to set up a…
131 00:10:55.510 ⇒ 00:10:56.120 Mustafa Raja: Yeah.
132 00:10:56.330 ⇒ 00:11:00.859 Mustafa Raja: Yeah, one thing I noticed is that, what’s it called?
133 00:11:01.740 ⇒ 00:11:09.930 Mustafa Raja: There’s no direct relation between scorers, scorer’s output, and the workflow, right?
134 00:11:09.930 ⇒ 00:11:13.139 Samuel Roberts: I was just trying to see what… what… run… I see run ID…
135 00:11:13.750 ⇒ 00:11:16.540 Mustafa Raja: Is there Yeah, that’s not…
136 00:11:16.540 ⇒ 00:11:17.290 Samuel Roberts: The best story.
137 00:11:17.290 ⇒ 00:11:34.860 Mustafa Raja: Totally not related. So what I did find, like, workflow would have its own run ID, and eval would have its own run ID, and even the timestamps wouldn’t be common, they would be a few seconds apart, right? Oh, interesting. But what did I found is…
138 00:11:36.690 ⇒ 00:11:54.350 Mustafa Raja: we can… we can ask, what’s it called? We can ask the agent to return the scorer’s output also, right? So, from the score… from the scorer’s output, we do not get, the RAN ID, but we… what we get is, the input…
139 00:11:54.370 ⇒ 00:12:02.620 Mustafa Raja: input messages ID, right? Which is going to be common, between the scorers and the workflow.
140 00:12:05.680 ⇒ 00:12:06.750 Mustafa Raja: Does that make sense?
141 00:12:07.200 ⇒ 00:12:10.490 Samuel Roberts: But we have to rely on the agent to output that? Is that what you’re saying?
142 00:12:10.490 ⇒ 00:12:18.590 Mustafa Raja: Yes. And, the, what’s it called? It does get stored in, what’s it called?
143 00:12:20.310 ⇒ 00:12:22.200 Mustafa Raja: In the snapshot, JSON.
144 00:12:25.000 ⇒ 00:12:28.989 Samuel Roberts: Okay. Yeah, I think that could work.
145 00:12:29.380 ⇒ 00:12:32.440 Mustafa Raja: Yeah, that’s the only way I could find to switch these two together.
146 00:12:33.010 ⇒ 00:12:34.030 Samuel Roberts: Yeah, that’s…
147 00:12:34.030 ⇒ 00:12:38.930 Mustafa Raja: I spent, like, an hour and an hour and a hour and a half.
148 00:12:40.550 ⇒ 00:12:55.240 Mustafa Raja: Figuring this out. Okay. Because, they have this, they have this field named, return, Scorer Output, which makes us feel like, okay, it’s going to return everything, but it does not return everything.
149 00:12:56.530 ⇒ 00:12:57.570 Samuel Roberts: That’s so frustrating.
150 00:12:58.230 ⇒ 00:13:07.040 Mustafa Raja: It only returns the input, And whatever, the output agent generated, and not what the output scorer generated.
151 00:13:07.640 ⇒ 00:13:15.520 Samuel Roberts: Okay, there’s nothing in the test info metadata or anything like that? Global run ID? That’s probably the other one. Group-related evaluation? Okay.
152 00:13:15.620 ⇒ 00:13:20.670 Samuel Roberts: I’m just looking at the schema, still trying to understand everything, but I think you probably have it already under…
153 00:13:20.670 ⇒ 00:13:30.420 Mustafa Raja: What I’m seeing is, this is actually… so we are still at, beta, right? I mean, we are still using the beta, what’s it called?
154 00:13:31.710 ⇒ 00:13:32.520 Samuel Roberts: Oh, wait, we could.
155 00:13:32.520 ⇒ 00:13:34.570 Mustafa Raja: And this is…
156 00:13:34.570 ⇒ 00:13:35.709 Samuel Roberts: No is out now.
157 00:13:35.710 ⇒ 00:13:43.569 Mustafa Raja: Yeah, yeah, yeah, Master 1.0 is now available, and this schema is for that, and I’m seeing that Eva now has this result also.
158 00:13:43.970 ⇒ 00:13:48.909 Mustafa Raja: So, it makes me feel that… I need to upgrade.
159 00:13:49.700 ⇒ 00:13:56.300 Mustafa Raja: Because this might be… because we might just be able to get, the scorer in the workflow then.
160 00:13:56.410 ⇒ 00:13:57.239 Mustafa Raja: We might not need.
161 00:13:57.240 ⇒ 00:13:58.770 Samuel Roberts: Yeah, it might be worth trying.
162 00:13:59.370 ⇒ 00:14:02.500 Mustafa Raja: Okay, I will do that too… then. Okay.
163 00:14:03.580 ⇒ 00:14:08.260 Samuel Roberts: Let’s, so this is all eval logging in Mosra?
164 00:14:08.850 ⇒ 00:14:18.230 Mustafa Raja: Yes, eval logging, and in, in general… Implement evals. Yeah, I’d say this is generally logging, all of the stuff.
165 00:14:18.230 ⇒ 00:14:23.939 Samuel Roberts: Yeah. Okay, I would just say, let’s make sure to update the ticket with that information.
166 00:14:24.110 ⇒ 00:14:26.710 Samuel Roberts: That we just discussed, so the odds all there.
167 00:14:28.190 ⇒ 00:14:29.389 Samuel Roberts: Like.
168 00:14:29.390 ⇒ 00:14:29.819 Mustafa Raja: Oh, I can’.
169 00:14:29.820 ⇒ 00:14:37.790 Samuel Roberts: or, yeah, I would say share that link, and then just explain a little bit what you explained here, and then the next step that we’re doing, and keep that ticket up to date.
170 00:14:38.240 ⇒ 00:14:39.429 Samuel Roberts: I think we’re in. Okay.
171 00:14:39.430 ⇒ 00:14:44.139 Mustafa Raja: Okay, I will… I will be doing this in the ticket only then, right? In the linear…
172 00:14:45.310 ⇒ 00:14:49.810 Samuel Roberts: Yeah, I would just update the eval logging, just with some… Some of this one.
173 00:14:49.810 ⇒ 00:14:50.290 Mustafa Raja: context.
174 00:14:51.200 ⇒ 00:14:53.040 Samuel Roberts: Yeah, contact, thank you.
175 00:14:53.290 ⇒ 00:14:56.369 Samuel Roberts: And then, yeah, put that into, like, in progress, probably.
176 00:14:58.240 ⇒ 00:14:58.910 Mustafa Raja: Okay.
177 00:15:00.360 ⇒ 00:15:02.769 Samuel Roberts: Other, other things today? .
178 00:15:03.900 ⇒ 00:15:06.110 Mustafa Raja: Apart from this, I’ll be working on default.
179 00:15:06.600 ⇒ 00:15:07.420 Mustafa Raja: That’s pretty much.
180 00:15:07.420 ⇒ 00:15:07.980 Samuel Roberts: Cool.
181 00:15:09.590 ⇒ 00:15:16.870 Samuel Roberts: Alright, yeah, I guess, keep me updated with this. Did you run the conversations overnight?
182 00:15:17.660 ⇒ 00:15:19.000 Mustafa Raja: Oh, I forgot, though.
183 00:15:19.530 ⇒ 00:15:24.660 Samuel Roberts: Okay, that’s fine. I wasn’t sure, but I think, yeah, I just am curious. Don’t worry about it, we’ll run that tonight, I guess.
184 00:15:25.390 ⇒ 00:15:28.060 Mustafa Raja: Yeah, I’ll definitely run it.
185 00:15:28.360 ⇒ 00:15:29.330 Mustafa Raja: No.
186 00:15:30.710 ⇒ 00:15:31.769 Samuel Roberts: Okay, yeah, as long as I’m not gonna.
187 00:15:31.770 ⇒ 00:15:36.520 Mustafa Raja: I paid a ticket for that, because, by end of day, I didn’t see it.
188 00:15:37.180 ⇒ 00:15:38.219 Samuel Roberts: Yeah, no, definitely creative.
189 00:15:38.220 ⇒ 00:15:39.909 Mustafa Raja: I might have done that.
190 00:15:40.280 ⇒ 00:15:43.280 Mustafa Raja: Yeah. I’ll just quickly create that for me.
191 00:15:46.310 ⇒ 00:15:47.030 Samuel Roberts: Great.
192 00:15:49.710 ⇒ 00:15:55.040 Samuel Roberts: Okay, I’ll try to get off this from other people later, but this was not… this was not the stand-up I was expecting this morning.
193 00:15:55.040 ⇒ 00:15:55.940 Mustafa Raja: Yeah.
194 00:15:56.370 ⇒ 00:15:57.149 Mustafa Raja: How was your day?
195 00:15:57.150 ⇒ 00:15:59.740 Samuel Roberts: Well, I think we’re… Yesterday?
196 00:16:00.050 ⇒ 00:16:00.670 Mustafa Raja: Yep.
197 00:16:01.230 ⇒ 00:16:07.250 Samuel Roberts: Yeah, it was pretty good. I hit a few weird roadblocks with cursor, like, prettier, that took a while.
198 00:16:08.200 ⇒ 00:16:13.200 Samuel Roberts: out of my day that I didn’t even fix, but I got some stuff launched for Lilo,
199 00:16:14.320 ⇒ 00:16:20.170 Samuel Roberts: Yeah, I gotta get on top of some of this linear stuff today. Yesterday wasn’t bad, my… my… What?
200 00:16:20.360 ⇒ 00:16:30.879 Mustafa Raja: One more thing, for me, I looked into the… what’s it called? The AI Foundry, where we are, we are hosting our… what’s it called?
201 00:16:31.020 ⇒ 00:16:32.979 Mustafa Raja: the OpenAIM.
202 00:16:32.980 ⇒ 00:16:33.820 Samuel Roberts: Oh, yeah.
203 00:16:33.820 ⇒ 00:16:53.320 Mustafa Raja: Yes. And I saw that GPT-40 that we have hosted… we have hosted two instances of GPT-4.0. One’s named GPT-40, and the other one is named GPT-40 Zoom, right? And the Zoom one has a rate limit of 29 million tokens per minute.
204 00:16:53.320 ⇒ 00:17:03.489 Mustafa Raja: And the other one, the GPT-4, which is widely being used in our workflows and in this setup, only has 250,000 tokens per minute.
205 00:17:04.040 ⇒ 00:17:04.780 Samuel Roberts: Whoa.
206 00:17:05.050 ⇒ 00:17:05.900 Samuel Roberts: Okay.
207 00:17:06.180 ⇒ 00:17:09.530 Mustafa Raja: So, I’ll get back to Casey, see if we can.
208 00:17:09.530 ⇒ 00:17:10.190 Samuel Roberts: Yeah.
209 00:17:10.849 ⇒ 00:17:12.960 Samuel Roberts: Definitely. Okay, that’s a good catch.
210 00:17:15.220 ⇒ 00:17:15.770 Samuel Roberts: Thank you.
211 00:17:15.770 ⇒ 00:17:22.040 Mustafa Raja: it’s a lot older model, it does… Master doesn’t fully support it. So, I couldn’t.
212 00:17:22.040 ⇒ 00:17:22.760 Samuel Roberts: Oh, no way.
213 00:17:22.760 ⇒ 00:17:36.009 Mustafa Raja: Yeah, I couldn’t get the scoder working with the GPT-40 simple one. I had to change the model to the Zoom one that has a lot more… what’s it called?
214 00:17:36.280 ⇒ 00:17:37.340 Mustafa Raja: Regenerate.
215 00:17:39.320 ⇒ 00:17:43.799 Samuel Roberts: Okay, that’s good. Well, at least that’s working then. We gotta figure out getting them on,
216 00:17:45.610 ⇒ 00:17:52.279 Samuel Roberts: onto their GCP eventually. Maybe we even want to spin up another one that’s just for this, with a higher rate limit, but we’ll figure that out.
217 00:17:52.450 ⇒ 00:17:53.150 Mustafa Raja: Yep.
218 00:17:53.400 ⇒ 00:17:56.530 Samuel Roberts: Yeah, okay, great. Where can we put that update?
219 00:17:57.170 ⇒ 00:17:59.460 Samuel Roberts: No, I’m trying to make sure everything in literary is good.
220 00:17:59.950 ⇒ 00:18:04.469 Mustafa Raja: I was just going… I was just going to, DMKC.
221 00:18:04.640 ⇒ 00:18:05.520 Mustafa Raja: For the… Yeah.
222 00:18:05.520 ⇒ 00:18:10.619 Samuel Roberts: That’s fine. No, that I agree with, I just want to make sure that something… Ends up here.
223 00:18:10.620 ⇒ 00:18:12.770 Mustafa Raja: Oh… Hmm.
224 00:18:14.430 ⇒ 00:18:15.030 Samuel Roberts: Canadian information?
225 00:18:15.030 ⇒ 00:18:16.940 Mustafa Raja: Do you want me to just create a ticket for this?
226 00:18:18.620 ⇒ 00:18:23.630 Samuel Roberts: Talk to Casey, and make sure that… yeah, yeah, go ahead, go ahead and make a ticket for upping the…
227 00:18:24.020 ⇒ 00:18:25.189 Samuel Roberts: Right looking at that.
228 00:18:25.190 ⇒ 00:18:25.850 Mustafa Raja: to that.
229 00:18:26.070 ⇒ 00:18:30.420 Mustafa Raja: So, I’ll create two tickets, update 1 ticket. Okay.
230 00:18:30.930 ⇒ 00:18:31.770 Samuel Roberts: Thank you.
231 00:18:31.930 ⇒ 00:18:32.840 Mustafa Raja: Okay, thank you.
232 00:18:32.840 ⇒ 00:18:36.180 Samuel Roberts: Alright, cool. Alright, yeah, I will, talk to you later, then.
233 00:18:36.370 ⇒ 00:18:37.889 Mustafa Raja: Yep, yep, have a good day.
234 00:18:38.490 ⇒ 00:18:39.619 Mustafa Raja: Yep. Alright, thanks.
235 00:18:39.730 ⇒ 00:18:40.260 Mustafa Raja: Bye.