Meeting Title: AI-Data Platform Team Standup Date: 2025-09-16 Meeting participants: Samuel Roberts, Casie Aviles, Mustafa Raja


WEBVTT

1 00:00:16.700 00:00:17.740 Samuel Roberts: Hello.

2 00:00:23.320 00:00:24.170 Samuel Roberts: How’s it going?

3 00:00:26.280 00:00:30.129 Casie Aviles: Yeah, doing good, just doing the usual…

4 00:00:31.000 00:00:34.779 Casie Aviles: Spreadsheet thing for insomnia every day.

5 00:00:34.780 00:00:35.789 Samuel Roberts: Oh, yeah.

6 00:00:38.230 00:00:40.330 Samuel Roberts: How long does that take you to do every day?

7 00:00:42.010 00:00:46.530 Casie Aviles: Yeah, it takes me around… Takes me around an hour to do it.

8 00:00:46.530 00:00:47.180 Samuel Roberts: at that.

9 00:00:47.850 00:00:49.350 Samuel Roberts: Oh, wow, okay.

10 00:00:52.340 00:00:53.270 Samuel Roberts: Okay.

11 00:00:56.180 00:01:01.760 Samuel Roberts: I didn’t realize how long that was. Okay.

12 00:01:02.560 00:01:04.410 Samuel Roberts: How are you, Mustafa?

13 00:01:06.770 00:01:08.250 Mustafa Raja: Yeah, doing good.

14 00:01:11.440 00:01:12.150 Mustafa Raja: Can you do that?

15 00:01:13.090 00:01:14.190 Samuel Roberts: Yeah, can you hear me?

16 00:01:15.750 00:01:16.680 Mustafa Raja: Boom.

17 00:01:17.070 00:01:17.590 Samuel Roberts: Okay.

18 00:01:17.590 00:01:18.900 Mustafa Raja: My, my question was…

19 00:01:19.320 00:01:20.569 Samuel Roberts: No, no, you’re good, you’re good.

20 00:01:20.770 00:01:22.710 Samuel Roberts: Alright, let’s jump right in.

21 00:01:24.880 00:01:25.750 Samuel Roberts: 2…

22 00:01:30.390 00:01:31.600 Samuel Roberts: Fair…

23 00:01:35.770 00:01:45.390 Samuel Roberts: So, BBC… Here we got? So… Go ahead.

24 00:01:46.430 00:01:49.130 Casie Aviles: Yeah, for ABC, I just…

25 00:01:49.910 00:01:51.870 Casie Aviles: I have this in progress, so…

26 00:01:52.070 00:01:56.520 Casie Aviles: I guess yesterday, what I was able to do was I was able to create

27 00:01:56.710 00:02:03.750 Casie Aviles: a tool, the tool that Andy will be calling that, you know, handles the… querying for…

28 00:02:03.750 00:02:04.430 Samuel Roberts: Okay.

29 00:02:04.590 00:02:10.010 Casie Aviles: to the database, so I also added, like, a screenshot there in the ticket, how it looks like.

30 00:02:11.370 00:02:13.250 Casie Aviles: If you want to take a look, yeah.

31 00:02:13.840 00:02:14.480 Samuel Roberts: Okay.

32 00:02:15.600 00:02:19.279 Casie Aviles: Yeah, it’s that, QueryDB tool over there, and then…

33 00:02:19.370 00:02:22.980 Samuel Roberts: So, when we ask questions here to the left in the chat.

34 00:02:23.060 00:02:25.230 Casie Aviles: This is what will be returned.

35 00:02:25.740 00:02:27.750 Samuel Roberts: Okay, and so it has to use windmill?

36 00:02:28.560 00:02:33.199 Casie Aviles: Yeah, for now it uses windmill, because that’s how I could…

37 00:02:33.310 00:02:37.340 Casie Aviles: You know, write it as code, and then it’s gonna…

38 00:02:37.480 00:02:40.749 Casie Aviles: Call that as, you know, via webhook, yeah.

39 00:02:41.160 00:02:48.839 Samuel Roberts: Oh, okay, okay, I guess I didn’t know if there was a way to connect Supabase so it knows how to make queries, but I guess it needs to make the SQL to make the query, right?

40 00:02:49.440 00:02:53.780 Casie Aviles: Yeah, it has to translate the user input to SQL, you know.

41 00:02:54.630 00:02:57.169 Samuel Roberts: Okay, alright, makes sense now. Thank you.

42 00:02:57.940 00:02:59.260 Casie Aviles: And then.

43 00:02:59.350 00:03:06.959 Samuel Roberts: For me, I was hitting roadblocks with 8x8. I thought I made some progress, but I think I gotta wait till the meeting with them tomorrow.

44 00:03:07.140 00:03:11.929 Samuel Roberts: Where they can explain some more of the API stuff, because it doesn’t seem like it can filter by

45 00:03:12.050 00:03:18.240 Samuel Roberts: user, or, like, agent, and timestamp, so I’m having a really hard time matching things up.

46 00:03:18.920 00:03:19.790 Samuel Roberts: So…

47 00:03:20.320 00:03:22.330 Casie Aviles: Yeah, the API is tricky.

48 00:03:22.620 00:03:23.490 Samuel Roberts: Yeah.

49 00:03:23.700 00:03:28.640 Samuel Roberts: And I had Cursor figure out that, like, some of the things are just wrong in the documentation, but…

50 00:03:29.000 00:03:34.769 Samuel Roberts: Like the… Start time and time is, like, a different phrasing than what they had, and…

51 00:03:35.030 00:03:42.700 Samuel Roberts: It’s annoying, but… Anyway, is that it on… ABC.

52 00:03:43.960 00:03:48.820 Casie Aviles: Yeah, that’s, that’s it. I just also did close one triage ticket.

53 00:03:48.820 00:03:52.509 Samuel Roberts: Oh, okay, good, yeah. Okay, that’s good to know.

54 00:03:52.920 00:03:54.420 Samuel Roberts: Come to default.

55 00:03:56.510 00:04:07.240 Mustafa Raja: Yeah, so for default, yesterday I worked on the dashboard, and Caitlin did say that we have the fields that I would need to work.

56 00:04:07.240 00:04:08.850 Samuel Roberts: Okay. With the…

57 00:04:09.130 00:04:12.219 Mustafa Raja: signals, so I will be… I’ll be doing that today.

58 00:04:12.640 00:04:16.220 Mustafa Raja: Oh, yeah, I’ll be, I’ll be working on signals.

59 00:04:16.709 00:04:18.720 Mustafa Raja: Okay.

60 00:04:19.440 00:04:20.149 Samuel Roberts: Great.

61 00:04:22.580 00:04:24.560 Samuel Roberts: Insomnia?

62 00:04:26.750 00:04:31.970 Casie Aviles: Okay, yeah, for insomnia, I just finished the spike yesterday that I.

63 00:04:31.970 00:04:32.440 Samuel Roberts: Okay.

64 00:04:32.440 00:04:37.750 Casie Aviles: did for the SharePoint, well, so I just… there’s just this bug.

65 00:04:38.310 00:04:40.379 Casie Aviles: On Bra… for Braze?

66 00:04:40.750 00:04:49.309 Casie Aviles: Which was from last week. I did get… I did hear back from support, so I’m going to respond from them, but…

67 00:04:49.600 00:04:56.960 Casie Aviles: They’re just asking stuff from me, so it’s not yet really resolved, but it’s just a very minor… bug.

68 00:04:57.690 00:04:58.300 Samuel Roberts: Okay.

69 00:04:59.220 00:05:07.390 Casie Aviles: What else? I think there’s one here. Oh, this one, the automation, or SOP, I mean, to the left, I think, yeah.

70 00:05:07.670 00:05:08.020 Samuel Roberts: Oh, yeah.

71 00:05:08.020 00:05:08.890 Casie Aviles: Yeah, this one.

72 00:05:09.270 00:05:13.150 Casie Aviles: This is just when, if I ever am out, I cannot…

73 00:05:13.150 00:05:13.929 Samuel Roberts: Oh, yeah.

74 00:05:13.930 00:05:16.379 Casie Aviles: Hand it over to someone, so they don’t.

75 00:05:16.380 00:05:17.090 Samuel Roberts: Okay.

76 00:05:17.090 00:05:17.750 Casie Aviles: You know?

77 00:05:18.390 00:05:20.650 Casie Aviles: So they have an idea how I do it.

78 00:05:21.450 00:05:22.140 Samuel Roberts: Okay, so…

79 00:05:22.140 00:05:22.890 Casie Aviles: this.

80 00:05:23.660 00:05:26.250 Samuel Roberts: So this is the manual fill stuff.

81 00:05:26.970 00:05:33.929 Samuel Roberts: So, what is… what is… I guess I would love to learn a little bit more about this, but as you do the SOP, I’ll learn it, so that’s fine.

82 00:05:34.580 00:05:39.849 Casie Aviles: Yeah, it’s… mmm… it may be a bit confusing, but basically, it’s,

83 00:05:40.150 00:05:50.630 Casie Aviles: What I’m doing is, it’s a mix of manual and the automated steps, so I’m just going to… we have an SOP, but that was a completely manual process.

84 00:05:50.630 00:05:51.220 Samuel Roberts: Yeah.

85 00:05:51.220 00:05:56.730 Casie Aviles: Okay, so this one, I’m going to make this, which is, like, the updated one with the automations.

86 00:05:57.180 00:05:57.850 Samuel Roberts: Okay.

87 00:05:58.010 00:05:58.990 Samuel Roberts: Okay, good.

88 00:06:00.280 00:06:02.620 Samuel Roberts: Alright, then in… Interlude?

89 00:06:03.700 00:06:12.649 Mustafa Raja: Yeah, so for interlude, the evals got fixed, and then, I also did, work on the format that we.

90 00:06:12.650 00:06:13.020 Samuel Roberts: Okay.

91 00:06:13.020 00:06:13.700 Mustafa Raja: listed.

92 00:06:13.970 00:06:14.779 Mustafa Raja: So if we go.

93 00:06:14.780 00:06:15.180 Samuel Roberts: Okay.

94 00:06:15.180 00:06:30.269 Mustafa Raja: So this is, what we are, where we are right now. Okay. I noticed that, I cannot give background color to call out, via the API. It doesn’t support that.

95 00:06:30.870 00:06:32.569 Samuel Roberts: Oh, that’s probably fine, yeah.

96 00:06:32.570 00:06:34.509 Mustafa Raja: Holdouts are going to be like this.

97 00:06:34.720 00:06:51.960 Mustafa Raja: Yeah, for the… for the bullets that we have… have under the headline, Mika also has a copy keyword for them. Do we want to add that? Because in no way did we discuss that, so I don’t know about that.

98 00:06:51.960 00:06:56.649 Samuel Roberts: I don’t know… I’m wondering if it’s just, like, the copy and all the stuff.

99 00:06:56.820 00:06:59.000 Samuel Roberts: So it might just be how he labeled it.

100 00:06:59.290 00:07:00.160 Mustafa Raja: Yeah, yeah, yeah.

101 00:07:00.430 00:07:04.069 Samuel Roberts: Oh, I wouldn’t worry about that yet. Yeah, if he says something, we can change it, but…

102 00:07:04.520 00:07:15.939 Mustafa Raja: Yeah, I guess we can present them, present this one as a V1, and then ask him even if he wants a very small change, we can make it whatever he wants, right?

103 00:07:15.940 00:07:18.910 Samuel Roberts: Definitely, this is gonna be pretty iterative with them, which is good.

104 00:07:19.210 00:07:20.470 Mustafa Raja: Okay, great.

105 00:07:21.830 00:07:29.609 Mustafa Raja: Yeah, so today what I’m going to do is I’m going to work on a rubric-based directory.

106 00:07:29.610 00:07:32.330 Samuel Roberts: I’m hoping to work on this a little bit today, too.

107 00:07:32.610 00:07:34.650 Samuel Roberts: Oh, yeah, so…

108 00:07:34.650 00:07:36.620 Mustafa Raja: Yeah, the UI thing, right?

109 00:07:36.910 00:07:39.439 Samuel Roberts: Yeah, I’m gonna put this in progress for the…

110 00:07:40.520 00:07:51.760 Mustafa Raja: Okay, so for the rubric-based grading, do we want to keep our ones, or do we want to discard them that we, created for the EVATs?

111 00:07:56.420 00:07:58.510 Samuel Roberts: He shared what he’s using, right?

112 00:07:58.710 00:08:12.949 Mustafa Raja: Yeah, he shared what he’s using, and I’m going to make it, the number of rubrics, whatever rubrics he’s, creating the deck on.

113 00:08:13.100 00:08:24.390 Mustafa Raja: Because I’m thinking if we could keep all of these, ours and then Mika’s, we will have a lot of rubrics then, you know?

114 00:08:24.390 00:08:24.990 Samuel Roberts: Yeah.

115 00:08:24.990 00:08:31.230 Mustafa Raja: We already have 3 of our own, and I guess Mika will be using 3 or 4 to…

116 00:08:32.090 00:08:35.480 Samuel Roberts: I guess I’m wondering, what do ours add that his don’t have, you know?

117 00:08:36.100 00:08:39.530 Mustafa Raja: I haven’t taken a look at… Yeah.

118 00:08:39.929 00:08:43.300 Mustafa Raja: were decent, so I… for now.

119 00:08:43.309 00:08:43.689 Samuel Roberts: migrate.

120 00:08:43.690 00:08:44.070 Mustafa Raja: I don’t know.

121 00:08:44.070 00:08:48.529 Samuel Roberts: Go ahead. My gut is that we wanted to use what he sent as the rubric.

122 00:08:48.850 00:08:49.990 Mustafa Raja: Hmm.

123 00:08:50.160 00:08:57.980 Samuel Roberts: And then what we made was kind of just a placeholder, but, definitely take a look and let me know if there’s, like, things that we did that he didn’t, or vice versa.

124 00:08:58.900 00:08:59.670 Mustafa Raja: Okay.

125 00:09:00.240 00:09:09.289 Mustafa Raja: Yeah, I guess I’ll, because, whatever I created is, is created as a scorer, in the Brain Trust.

126 00:09:09.290 00:09:20.810 Mustafa Raja: I can just, for now, create the ones that Mika is using, and then we can decide on which ones of ours do we want to keep, and which ones don’t.

127 00:09:20.810 00:09:21.670 Mustafa Raja: Perfect.

128 00:09:21.820 00:09:22.850 Samuel Roberts: Okay, great.

129 00:09:25.060 00:09:28.099 Samuel Roberts: And then that’s it for clients.

130 00:09:28.570 00:09:33.640 Samuel Roberts: We’ll jump back up here. So, how are the… have you guys had any chance to work on the client hub stuff?

131 00:09:33.970 00:09:38.249 Mustafa Raja: For the client, on my side, Casey’s.

132 00:09:38.250 00:09:39.139 Casie Aviles: Yeah, I was.

133 00:09:39.140 00:09:40.720 Mustafa Raja: Loom?

134 00:09:41.280 00:09:47.110 Casie Aviles: Okay. Yeah, yeah, I was going to send you… I’m going to send you a link, but, what I did here is I just…

135 00:09:47.820 00:09:51.220 Casie Aviles: added the… what do you call this? The embedding, so…

136 00:09:51.630 00:09:54.639 Casie Aviles: Okay. They’re, they’re in parallel, so…

137 00:09:54.990 00:09:59.510 Casie Aviles: I also included the one that you have for Interlude.

138 00:09:59.800 00:10:00.230 Mustafa Raja: Okay.

139 00:10:00.230 00:10:08.729 Casie Aviles: So… but yeah, it’s… the next thing that I need to work on… that we need to work on here, is to actually set up the workflows

140 00:10:09.090 00:10:19.039 Casie Aviles: And have the agent pull from the data, but right now, for Interlude, we have the Zoom embeddings, and for Ellie, we have the Slack embeddings.

141 00:10:19.250 00:10:23.639 Casie Aviles: So I’m just completing that and working on the Dagstrap pipelines.

142 00:10:23.820 00:10:24.460 Casie Aviles: So…

143 00:10:24.460 00:10:25.040 Mustafa Raja: Okay.

144 00:10:25.240 00:10:25.790 Casie Aviles: Yeah.

145 00:10:27.570 00:10:28.170 Samuel Roberts: Okay.

146 00:10:28.290 00:10:39.739 Samuel Roberts: Great. If I get a chance today, I’m gonna try to go through that SOP that’s already there, so I can understand what you guys are doing with the client hubs, so we can try to make a plan, maybe, to make this a different process, but we’ll see what happens.

147 00:10:39.740 00:10:40.060 Casie Aviles: Okay.

148 00:10:40.060 00:10:46.940 Samuel Roberts: Okay, alright, anything else? Just a question, yeah? Yeah, of course.

149 00:10:46.940 00:10:49.920 Casie Aviles: Question, for internal.

150 00:10:50.150 00:10:56.590 Casie Aviles: Do you have any, what do you call this? Any work that we need to do for the monorepo?

151 00:10:58.310 00:11:06.610 Samuel Roberts: I had some QA stuff that I think they found that I had to look at, but then I just want to get it live and get people playing with it, and then,

152 00:11:06.760 00:11:10.490 Samuel Roberts: I don’t know if there’s any specific thing that we had to update yet.

153 00:11:10.710 00:11:15.460 Samuel Roberts: But there will be, once we get it going.

154 00:11:15.950 00:11:22.610 Samuel Roberts: So, I don’t think there’s anything here that’s, like, a good one to start with, but… Yeah.

155 00:11:23.480 00:11:26.440 Samuel Roberts: Not yet, but we will, we will, so…

156 00:11:27.370 00:11:31.660 Samuel Roberts: I definitely say focus on the client hubs for now, because those will affect the new one as well, so…

157 00:11:33.110 00:11:34.439 Casie Aviles: I see, yes, sure.

158 00:11:35.130 00:11:35.800 Samuel Roberts: Okay.

159 00:11:37.980 00:11:38.720 Samuel Roberts: Alright.

160 00:11:39.220 00:11:40.339 Samuel Roberts: Anything else?

161 00:11:42.030 00:11:44.899 Mustafa Raja: Because, from my side, this is it.

162 00:11:48.290 00:11:49.349 Samuel Roberts: Okay, great.

163 00:11:50.030 00:11:56.419 Samuel Roberts: Alright, well, I’ll be around, if you guys need anything from me, ping me. Otherwise, I’ll be probably jumping into,

164 00:11:56.810 00:11:59.570 Samuel Roberts: the interlude… Prompt.

165 00:12:00.080 00:12:06.719 Samuel Roberts: library, and maybe the AI internal stuff, so we’ll see. But yeah, ping me if you need anything.

166 00:12:07.000 00:12:09.210 Samuel Roberts: And, yeah, I’ll see you guys later.

167 00:12:10.430 00:12:11.130 Mustafa Raja: Alright.

168 00:12:11.130 00:12:11.580 Casie Aviles: Thank you.

169 00:12:11.580 00:12:11.970 Mustafa Raja: Thank you.

170 00:12:11.970 00:12:13.279 Samuel Roberts: Alright, thanks guys.

171 00:12:13.990 00:12:14.360 Mustafa Raja: Bye.