Meeting Title: AI Team Retro Date: 2025-10-03 Meeting participants: Samuel Roberts, Mustafa Raja, Casie Aviles


WEBVTT

1 00:00:12.890 00:00:14.609 Mustafa Raja: Oh, hey, how are you?

2 00:00:16.340 00:00:20.149 Samuel Roberts: I’m good, I figured I’d have the morning a little bit, even though I’m technically out, so…

3 00:00:20.350 00:00:24.900 Mustafa Raja: I was thinking that, we’re going to have a retro without you.

4 00:00:24.900 00:00:28.679 Samuel Roberts: Yeah, well, I figured it might happen, but I got some time today in the morning.

5 00:00:28.680 00:00:29.660 Mustafa Raja: Oh, that’s amazing.

6 00:00:29.660 00:00:31.749 Samuel Roberts: I wasn’t sure, you know, technically I’m…

7 00:00:31.990 00:00:37.270 Samuel Roberts: I’m not at home, I have my laptop, though, so I figured I can check in with y’all.

8 00:00:38.680 00:00:40.480 Samuel Roberts: I guess, how was yesterday?

9 00:00:40.930 00:00:44.520 Mustafa Raja: Yeah, yesterday, it was good.

10 00:00:44.890 00:00:54.420 Mustafa Raja: Worked on, I didn’t have much to do on Interlude, I needed your review on the…

11 00:00:54.570 00:00:55.440 Mustafa Raja: Ticket.

12 00:00:55.780 00:01:05.299 Samuel Roberts: Yes, I had thoughts, and I meant to message them, but, can you share the code for the master agent somehow? I’d love to, like, test it out myself first.

13 00:01:05.740 00:01:06.819 Mustafa Raja: I can, I can.

14 00:01:07.140 00:01:08.669 Samuel Roberts: I would say just,

15 00:01:09.190 00:01:13.760 Samuel Roberts: I don’t know what the best way is, because I don’t necessarily want to make a whole repo for it. Is it one file, or is it multiple files?

16 00:01:15.250 00:01:18.789 Mustafa Raja: It is multiple files, because it’s a monster project, no?

17 00:01:19.220 00:01:29.359 Samuel Roberts: Okay, no, I just wasn’t sure, because I’m sure there’s a way to do it as one, but if it’s a project, it probably scaffolds it all out. Yeah, just make a quick repo for a test, and just share me the link so I can pull it down.

18 00:01:29.880 00:01:31.350 Mustafa Raja: Yeah, yeah, I can do that.

19 00:01:31.350 00:01:34.639 Samuel Roberts: I just wanted to see how it went. I mean, it looked okay, so we can probably

20 00:01:35.110 00:01:37.820 Samuel Roberts: using it, but I’m curious to see it before I…

21 00:01:38.040 00:01:49.409 Mustafa Raja: Yeah, the only issue it had was it couldn’t take the whole SVG, so I had to extract the text elements. I tried to keep as much content as I could, but…

22 00:01:49.850 00:01:53.489 Mustafa Raja: Yeah, it was always too much, so…

23 00:01:53.490 00:02:00.060 Samuel Roberts: I had to do a lot of scraping from the SVGs, and then it was able to…

24 00:02:00.620 00:02:03.320 Mustafa Raja: Pull out some of the text.

25 00:02:03.550 00:02:06.489 Samuel Roberts: Okay. Yeah, no, I’d definitely love to see it,

26 00:02:06.680 00:02:11.429 Samuel Roberts: And then, yeah, I mean, it’s definitely good… how long does that take to run on one,

27 00:02:11.660 00:02:12.890 Samuel Roberts: One slide.

28 00:02:13.150 00:02:17.800 Mustafa Raja: One, one whole deck, or one… one image?

29 00:02:17.800 00:02:20.030 Samuel Roberts: Oh, no, one whole deck is good, actually.

30 00:02:20.280 00:02:23.079 Mustafa Raja: I haven’t run it on the hold.

31 00:02:23.080 00:02:24.169 Samuel Roberts: Oh, okay, okay, yeah.

32 00:02:24.170 00:02:28.800 Mustafa Raja: So per image, it takes about 2-3 seconds, I guess?

33 00:02:29.010 00:02:31.420 Samuel Roberts: Okay, that’s not bad. So if we, if we…

34 00:02:31.630 00:02:34.879 Samuel Roberts: I guess it would be worth running on the whole deck.

35 00:02:35.080 00:02:39.219 Mustafa Raja: Yeah, it’s not… it doesn’t cost much. Also, I’m running.

36 00:02:39.220 00:02:39.640 Samuel Roberts: Oh, yeah.

37 00:02:39.640 00:02:43.799 Mustafa Raja: running it on my personal, key, so I’ve been monitoring it.

38 00:02:43.970 00:02:47.920 Samuel Roberts: Oh, yeah, I was trying to figure out how to get it set up with, our Azure. I can send you…

39 00:02:47.920 00:02:48.470 Mustafa Raja: Yeah.

40 00:02:48.470 00:02:49.659 Samuel Roberts: The way I got that set up.

41 00:02:50.410 00:02:53.120 Mustafa Raja: Yeah, oh, did you get- did you get it set up?

42 00:02:53.280 00:03:03.849 Samuel Roberts: Yeah, I was testing it with Copilot Kit, and just to get Monster running on my machine, and I think I figured out how to do it. It was not trivial, though.

43 00:03:04.010 00:03:08.339 Samuel Roberts: But it… once you… once I show it to you, it will be easy to implement, I think.

44 00:03:08.820 00:03:13.090 Mustafa Raja: Okay, okay, yeah, that’ll be good, because currently I’m doing it on my personal gig.

45 00:03:13.090 00:03:27.720 Samuel Roberts: Yeah, yeah, let me send you that then, because, yeah, you have to import Azure from the AI SDK, and then you have to make sure the base URL is right. It was… I tried a few different ways, but I’ll send it to you. Or I’ll put it in the, send me that repo, I’ll put it in the repo.

46 00:03:28.220 00:03:29.880 Mustafa Raja: Yeah, yeah, that’ll be great, that’ll be great.

47 00:03:29.880 00:03:30.590 Samuel Roberts: Perfect. Okay.

48 00:03:30.590 00:03:33.339 Mustafa Raja: Yeah, I’ll do that right after.

49 00:03:33.640 00:03:35.189 Mustafa Raja: our meeting with Mika.

50 00:03:35.590 00:03:37.119 Samuel Roberts: Perfect. Sounds good.

51 00:03:37.720 00:03:41.380 Mustafa Raja: Yeah, I should be able to make that, too, this morning, so… Yeah.

52 00:03:42.010 00:03:46.660 Mustafa Raja: And for default, it was the same case, I didn’t have much, I had already…

53 00:03:47.090 00:03:51.700 Mustafa Raja: done whatever needed to be done for the meeting, so I’m going to meet with…

54 00:03:51.860 00:03:55.509 Mustafa Raja: Justin today, and see,

55 00:03:56.060 00:03:59.909 Mustafa Raja: What new feedback do we have from them, and work on it?

56 00:04:00.760 00:04:01.680 Samuel Roberts: Okay, perfect.

57 00:04:02.980 00:04:09.130 Mustafa Raja: Worked on ABC on a ticket… And some giances.

58 00:04:09.130 00:04:09.780 Samuel Roberts: Okay.

59 00:04:09.780 00:04:12.710 Mustafa Raja: And built the Zoom tool also.

60 00:04:12.980 00:04:14.619 Mustafa Raja: For high press access.

61 00:04:14.620 00:04:22.519 Samuel Roberts: Yes, I saw that. It looked good to me, I think I approved it. Yeah, yeah, I’m going to merge it, and then I’m going to manually run it on Dagster.

62 00:04:22.520 00:04:23.820 Mustafa Raja: And see how it comes out.

63 00:04:24.260 00:04:24.840 Samuel Roberts: Great.

64 00:04:26.130 00:04:29.979 Samuel Roberts: How was your first death case? Oh, yeah, sorry, yeah, okay.

65 00:04:30.470 00:04:31.220 Samuel Roberts: Cool.

66 00:04:31.630 00:04:37.739 Samuel Roberts: Casey, how about you? How was your… your… I guess your week was yesterday, so yeah, your whole week.

67 00:04:38.210 00:04:41.550 Casie Aviles: Yeah, certainly just, catching up on this stuff.

68 00:04:41.790 00:04:47.310 Casie Aviles: For ABC yesterday, so I had a bunch of, tickets that Amber

69 00:04:48.190 00:04:55.419 Casie Aviles: Created based on, like, the client’s feedback. So yeah, I just worked on those. I still have a couple open.

70 00:04:55.870 00:04:59.370 Casie Aviles: So, I’m also gonna keep working on that today.

71 00:05:00.040 00:05:04.580 Casie Aviles: It’s mostly just, involving, like, the data.

72 00:05:05.580 00:05:07.840 Casie Aviles: Inside the DB, so…

73 00:05:08.410 00:05:15.199 Casie Aviles: Just updating, like, which inspectors should be in which SIPs, you know, and then making sure…

74 00:05:15.410 00:05:18.560 Casie Aviles: Yeah. Yeah, and then just making sure that the SQL…

75 00:05:19.400 00:05:32.019 Casie Aviles: or, like, you know, the tool is querying correctly with, you know, there are some… sometimes there are some inspectors that are not being queried correctly, and that’s because of the SQL

76 00:05:32.680 00:05:36.469 Casie Aviles: Query not being correct, so for that…

77 00:05:36.990 00:05:44.359 Casie Aviles: What I do is I just adjust the prompt that we have, but right now it’s living in wind bill, so…

78 00:05:44.960 00:05:45.830 Samuel Roberts: Okay.

79 00:05:46.200 00:05:51.009 Samuel Roberts: There was something I saw, was it contextual, had an SQL, or a text.

80 00:05:51.010 00:05:51.390 Casie Aviles: Yeah.

81 00:05:51.390 00:05:53.049 Samuel Roberts: Have you looked at that?

82 00:05:53.050 00:05:53.900 Casie Aviles: Yeah, yeah.

83 00:05:54.740 00:06:04.430 Casie Aviles: Oh, no, not yet. I haven’t really tested that for, for this use case, but it is something that, Utam also,

84 00:06:04.830 00:06:06.500 Casie Aviles: Brought to my attention.

85 00:06:06.710 00:06:10.110 Samuel Roberts: Okay, cool. Yeah, I don’t know how it works, but it might be better than…

86 00:06:10.580 00:06:12.960 Samuel Roberts: Just a, you know, prompt we have to tweak.

87 00:06:13.740 00:06:16.369 Samuel Roberts: But yeah, take a look, take a look at that if you…

88 00:06:16.650 00:06:18.900 Samuel Roberts: If it looks like it can be helpful,

89 00:06:19.490 00:06:23.560 Samuel Roberts: then yeah, if not, keep going the way you’re going, I think, and… Maybe.

90 00:06:23.560 00:06:23.950 Casie Aviles: Yeah.

91 00:06:23.950 00:06:24.790 Samuel Roberts: later.

92 00:06:25.280 00:06:30.359 Casie Aviles: Yeah, right now, I think it’s… it’s just… it’s… it’s not too bad, it’s just…

93 00:06:30.610 00:06:35.620 Casie Aviles: I guess the only things would be that we have to, you know.

94 00:06:35.720 00:06:37.960 Casie Aviles: Tweak the prompt to make sure that

95 00:06:39.070 00:06:46.259 Casie Aviles: it’s querying correctly based on, like, you know, the questions that the CSRs are asking, because

96 00:06:46.840 00:06:49.539 Casie Aviles: It’s not going to, you know…

97 00:06:49.660 00:06:53.449 Casie Aviles: Know immediately, like, how it’s supposed to query, but…

98 00:06:53.860 00:06:54.440 Samuel Roberts: Right.

99 00:06:54.440 00:06:55.200 Casie Aviles: Yes.

100 00:06:55.460 00:07:04.870 Casie Aviles: I think, yeah, so far that’s… that’s… it’s working well, and I guess the only thing that can be improved would be the speed, because sometimes it’s not…

101 00:07:05.330 00:07:08.229 Casie Aviles: As instantaneous as we want it, but…

102 00:07:10.500 00:07:13.840 Samuel Roberts: That’s the speed of the AI column, the prompt, and everything.

103 00:07:14.470 00:07:17.860 Casie Aviles: Yeah, like, with the tool itself, the db querying tool.

104 00:07:17.860 00:07:20.319 Samuel Roberts: Oh, oh, okay, yeah, yeah, okay.

105 00:07:21.130 00:07:23.559 Samuel Roberts: Oh, well, if I can help at all, I mean…

106 00:07:23.800 00:07:27.529 Samuel Roberts: Let me know. Today might not be the most helpful day, but Monday,

107 00:07:27.940 00:07:29.519 Samuel Roberts: Happy to take a look with you.

108 00:07:30.290 00:07:30.910 Casie Aviles: Yeah.

109 00:07:31.480 00:07:32.470 Casie Aviles: Sure, sure.

110 00:07:32.900 00:07:36.079 Samuel Roberts: Okay, cool. Anything else today?

111 00:07:36.640 00:07:37.440 Samuel Roberts: Thoughts?

112 00:07:39.520 00:07:47.440 Casie Aviles: Yeah, that’s pretty much it for me. I’m just gonna keep working on the open tickets that I have.

113 00:07:48.880 00:07:56.559 Casie Aviles: And… yeah. There’s just, I guess, like, an access issue that we have on Somnia, but…

114 00:07:57.020 00:07:59.410 Casie Aviles: I’ll have to… I’ll resolve it with…

115 00:07:59.650 00:08:02.650 Casie Aviles: It’s just, you know, a matter of resetting the password.

116 00:08:02.910 00:08:13.320 Samuel Roberts: Okay, yeah, I think I saw your post. Yeah, a special email would definitely be a better way to do this, but I don’t know how much that would take to push them for, I don’t know.

117 00:08:13.320 00:08:14.660 Casie Aviles: But… Yeah, I think…

118 00:08:15.150 00:08:20.170 Casie Aviles: I think that’s… that’s kind of on the client, and it’s kind of hard to push.

119 00:08:20.620 00:08:21.200 Samuel Roberts: Yeah.

120 00:08:21.200 00:08:23.180 Casie Aviles: Yeah, provision those.

121 00:08:23.730 00:08:29.809 Samuel Roberts: either get Justin to keep pushing, or eventually get Robert to keep pushing, maybe. But…

122 00:08:29.990 00:08:31.810 Samuel Roberts: Do what you can for now, you know?

123 00:08:32.210 00:08:32.760 Casie Aviles: Hmm.

124 00:08:32.760 00:08:33.240 Samuel Roberts: I think you’re already.

125 00:08:33.240 00:08:34.030 Casie Aviles: Yeah, paths.

126 00:08:34.270 00:08:35.369 Samuel Roberts: Alright, cool.

127 00:08:35.659 00:08:39.309 Samuel Roberts: Yeah.

128 00:08:40.179 00:08:43.090 Samuel Roberts: On my end, I was just doing some,

129 00:08:43.190 00:08:54.330 Samuel Roberts: updates for the, the marketing asset page, adding that… I got all the metadata stuff set up in Supabase, and I was just tweaking the UI a little bit, because

130 00:08:55.210 00:09:00.200 Samuel Roberts: We want ways to select the text, so for the context here, if you missed it…

131 00:09:00.360 00:09:06.510 Samuel Roberts: We were only doing a few tickets this week, and one of them handed last week and specifically asked us to update that page, because it’s hard to work with.

132 00:09:06.610 00:09:09.880 Samuel Roberts: And adding titles and metadata. So we did that.

133 00:09:10.320 00:09:15.539 Samuel Roberts: I added the Superbase table and all the metadata. Right now, it kind of pulls from

134 00:09:15.860 00:09:21.180 Samuel Roberts: GitHub still, eventually we might move to, like, storing them in S3, and they can just upload right to that page.

135 00:09:22.130 00:09:24.069 Samuel Roberts: Because, like…

136 00:09:24.760 00:09:30.299 Samuel Roberts: Hannah kind of knows what she’s doing, because she has a tech background, but not everyone feels comfortable, like, uploading to Git and stuff.

137 00:09:30.830 00:09:31.630 Samuel Roberts: So…

138 00:09:31.890 00:09:40.430 Samuel Roberts: But for now, it pulls from GitHub, it matches the URL in the table, finds the metadata. If there’s no metadata, it just creates a title based on the

139 00:09:41.290 00:09:45.360 Samuel Roberts: title of the file by removing, like, underscores and the word Brainforge and stuff.

140 00:09:45.970 00:09:58.199 Samuel Roberts: And then they can click on each one and edit it. I didn’t create the bulk editing yet, because that was a little more complicated, and I don’t want to spend too much time on this yet, but, I also got it live on Heroku, running as a review app.

141 00:09:58.430 00:10:00.880 Samuel Roberts: in the pipeline,

142 00:10:01.080 00:10:09.800 Samuel Roberts: And so now, like, in the future, when we make changes to the platform, we can get a review app, and it… it was a little bit of a pain, because it didn’t set the environment variables right.

143 00:10:10.130 00:10:15.610 Samuel Roberts: And Heroku, you can’t just, like, paste in a .env file, you have to, like, do each one individually.

144 00:10:15.610 00:10:17.220 Casie Aviles: Yeah, yeah, you have to.

145 00:10:17.630 00:10:19.420 Casie Aviles: Input each manually.

146 00:10:19.420 00:10:27.219 Samuel Roberts: Yeah, so I found a… for the production app, I found a way to run a little script that would just go through the .env file and set each one.

147 00:10:28.640 00:10:48.290 Samuel Roberts: But I had a really hard time getting that to work for the whole pipeline, so now it should be set that every review app gets the environment variables that are set on the pipeline. So, moving forward, unless we add environment variables, we should just be able to, like, run some new code, you know, push it to a branch, and Heroku will set it up, so…

148 00:10:49.630 00:10:50.310 Casie Aviles: Oh, nice.

149 00:10:50.310 00:10:51.190 Mustafa Raja: It’s nice.

150 00:10:51.190 00:11:06.190 Samuel Roberts: I figured that was worth setting up, so I spent a little more time, because I was able to get it where I could set it on that one review app, but then when I pushed another change, it made a new one, and didn’t have them, and I wanted to set it on the pipeline, and the way Kirscher didn’t know how to do it, so eventually I found someone online that explained.

151 00:11:06.370 00:11:09.879 Samuel Roberts: how to use it… how to use the API to set it, but…

152 00:11:10.270 00:11:24.209 Samuel Roberts: Hopefully that’s better, because I, you know, it’s just… developer experience stuff like that is… is small sometimes, but very annoying, especially, like, if you can’t just paste it in, you have to go one by one. We have a lot of environment variables on that… on that right now.

153 00:11:26.030 00:11:33.150 Samuel Roberts: That actually brings up a question. I was wondering, as I’m looking at some of the Superbase stuff, the Zoom and the Slack as separate.

154 00:11:34.930 00:11:38.849 Samuel Roberts: Was that… And, like, why did we go that way, do you guys know?

155 00:11:40.760 00:11:42.210 Casie Aviles: Is it for the client hub?

156 00:11:42.680 00:11:50.059 Samuel Roberts: For the client hub, yeah, I’m just wondering if, like… because I realize that’s why we need, like, 3 different, Supabase credentials in the environment variables.

157 00:11:52.280 00:11:53.459 Casie Aviles: Oh, I think…

158 00:11:54.220 00:11:54.780 Samuel Roberts: Go ahead.

159 00:11:55.200 00:12:00.399 Casie Aviles: We were kind of restructuring our superbase before, and we wanted to keep

160 00:12:00.570 00:12:04.660 Casie Aviles: a Slack… a Slack project separate from the Zoom project.

161 00:12:05.430 00:12:05.920 Samuel Roberts: Okay.

162 00:12:06.190 00:12:09.970 Casie Aviles: But… Yeah, I think if, if… and, and…

163 00:12:10.600 00:12:15.060 Casie Aviles: Yeah, yeah, that’s why we did it, but if…

164 00:12:15.410 00:12:20.469 Casie Aviles: makes more sense to, consolidate that, then I guess it’s worth.

165 00:12:20.470 00:12:20.910 Samuel Roberts: Yes.

166 00:12:20.910 00:12:24.900 Casie Aviles: creating… Like, one project for…

167 00:12:25.640 00:12:33.980 Casie Aviles: For the client hubs, so we don’t have to, like, create… have multiple, you know, credentials for Superbase.

168 00:12:33.980 00:12:52.049 Samuel Roberts: Yeah, eventually it might be. I think right now that it works, I don’t want to mess with it. But I did put together some diagrams as I was understand… I read through the SOP, that was another ticket I had this week, was really trying to dig into the client hub SOP, not only setting it up, but understanding, like, how it works a little bit more.

169 00:12:52.050 00:13:02.839 Samuel Roberts: So I was digging into the N8N a little bit. I threw some diagrams together for my own understanding, they’re in the bottom of the SOP. Just trying to understand what can we move, potentially, to code, eventually.

170 00:13:03.520 00:13:08.369 Samuel Roberts: And what can we abstract so that we don’t have to duplicate a lot for each client?

171 00:13:09.670 00:13:10.580 Samuel Roberts: like…

172 00:13:11.100 00:13:23.980 Samuel Roberts: like, I feel like the N8N… I don’t know exactly here, because I didn’t dig in so much, but I feel like all the N8N logic for the lookups and stuff, for the chat, we could probably do more dynamically, right?

173 00:13:24.930 00:13:38.070 Samuel Roberts: especially if we move it to code on the platform, you know, we could have it know which client it is, and then do all the lookup stuff, as long as we have the clients correctly named and Superbase and everything, so there’s a lot of moving pieces here.

174 00:13:38.070 00:13:42.470 Mustafa Raja: Yeah, this… we could do this with the metadata filters, I guess.

175 00:13:43.420 00:13:53.940 Samuel Roberts: Yeah, potentially. But again, there’s more work to do there than is necessary right now, but that’s kind of one of the big things I want to worry about, because if we’re going to add more clients.

176 00:13:54.210 00:13:56.209 Samuel Roberts: Over time, like.

177 00:13:56.210 00:13:57.250 Casie Aviles: Yeah…

178 00:13:57.250 00:14:03.710 Samuel Roberts: it just becomes a time sink for us, at least, and it slows everyone down if we don’t get it done, so… but… Yes.

179 00:14:03.830 00:14:10.680 Samuel Roberts: We’re kind of deprioritizing internal stuff to focus on clients right now anyway, so that’s okay, but that might be what we start to, like.

180 00:14:10.840 00:14:26.429 Samuel Roberts: take off, maybe, every week, you know, if we have a few points we can do. Maybe it is, like, setting up the client table that makes sure that that gets updated, using that table to maybe do the Dagster stuff, you know, like, break it down into pieces,

181 00:14:27.820 00:14:35.470 Samuel Roberts: But I don’t want to stress about it too much, because it does work, and I don’t want to break it. So I was just curious if there was a reason they were separated like that, but

182 00:14:35.630 00:14:39.459 Samuel Roberts: Again, multiple credentials isn’t a huge problem once it’s set up, but…

183 00:14:40.200 00:14:43.400 Samuel Roberts: I just wasn’t sure if there was another reason I wasn’t aware of, but… Alright, cool.

184 00:14:43.400 00:14:48.699 Casie Aviles: It’s just more on separating, like, I guess, you know, Slack from Zoom.

185 00:14:48.700 00:14:51.570 Samuel Roberts: That’s… yeah, no, that makes a little bit of sense to me, I just…

186 00:14:51.750 00:14:56.830 Samuel Roberts: I mean, especially because there’s a lot of tables there. I don’t know, does Superbase have a way to, like, group tables at all?

187 00:14:57.120 00:14:59.059 Samuel Roberts: I don’t know if Postgres even has that.

188 00:14:59.530 00:15:01.530 Casie Aviles: Hmm, I don’t know.

189 00:15:01.700 00:15:08.249 Samuel Roberts: I guess there’s gonna be different schemas. I don’t know. That might be worth looking into, but I’ll not worry about it now. Like I said, it works.

190 00:15:08.800 00:15:12.419 Samuel Roberts: But… That’s good for now.

191 00:15:12.900 00:15:15.389 Samuel Roberts: Yeah, any other thoughts on the week?

192 00:15:16.380 00:15:19.140 Samuel Roberts: Or, you know, Casey yesterday, I guess.

193 00:15:19.860 00:15:23.300 Casie Aviles: Hmm… Yeah, not much, but I do…

194 00:15:23.580 00:15:30.819 Casie Aviles: I am kind of, you know, thinking about if I can take on, like, more internal stuff probably next week, because I think

195 00:15:31.640 00:15:36.190 Casie Aviles: For the past few weeks, so… like, even just one ticket, I guess, or…

196 00:15:36.420 00:15:38.749 Casie Aviles: I don’t know, depends on what we have lined up.

197 00:15:39.970 00:15:40.640 Samuel Roberts: Yeah.

198 00:15:41.390 00:15:43.400 Casie Aviles: Yeah, I’d be down to, like.

199 00:15:43.550 00:15:47.560 Casie Aviles: do some internal work, and I also kind of want to

200 00:15:48.350 00:15:55.030 Casie Aviles: finally get around to understanding the whole, you know, the new platform. Like, I haven’t really…

201 00:15:55.030 00:15:55.810 Samuel Roberts: Oh, yeah.

202 00:15:55.810 00:15:58.149 Casie Aviles: delved much into that yet.

203 00:15:58.350 00:16:01.230 Casie Aviles: But yeah, I want to find some time.

204 00:16:01.800 00:16:02.180 Samuel Roberts: Okay.

205 00:16:02.180 00:16:02.580 Casie Aviles: do that.

206 00:16:02.580 00:16:06.599 Samuel Roberts: Yeah, this… There’s lots of little things we can do to improve, because, like.

207 00:16:07.150 00:16:12.150 Samuel Roberts: I think things are duplicated, and logic is, you know, we can probably refine it a little bit, even as it is.

208 00:16:13.930 00:16:21.220 Samuel Roberts: But, yeah, the other thing is that I think the word coming down is that we’re not gonna focus… we’re gonna have fewer

209 00:16:21.540 00:16:26.420 Samuel Roberts: hours spent on internal stuff, so it might be, like, a few tickets a week, if not any… if any, you know.

210 00:16:26.420 00:16:26.950 Casie Aviles: Yeah.

211 00:16:27.070 00:16:28.749 Samuel Roberts: So we’ll see. Okay.

212 00:16:29.070 00:16:40.589 Samuel Roberts: I think the focus is going to be… the focus seems to be client work, again, with less internal, but a little bit of internal, because we want to keep it moving, and if people need stuff. We also have a whole new,

213 00:16:41.530 00:16:42.510 Samuel Roberts: ad hoc.

214 00:16:42.920 00:16:46.590 Samuel Roberts: SOP that I think Rico put together.

215 00:16:47.810 00:16:48.150 Casie Aviles: Yes.

216 00:16:48.150 00:16:54.950 Samuel Roberts: So, like, I don’t know if you saw… okay, I remember exactly when that was, but, so, like, requests coming in should be, like.

217 00:16:55.110 00:17:00.330 Samuel Roberts: you know, passed through that process, so we’re not just, like, someone has something, we work on it.

218 00:17:00.520 00:17:03.939 Samuel Roberts: That’ll probably be really rigid starting next week, where…

219 00:17:04.099 00:17:08.349 Samuel Roberts: even if Uten’s asking for something, we go through that process and make sure that it’s, like.

220 00:17:09.130 00:17:11.249 Samuel Roberts: The right thing to work on, you know?

221 00:17:12.220 00:17:18.740 Casie Aviles: Yeah, that makes sense, because… Before, I’m just kind of creating tickets every time for…

222 00:17:18.740 00:17:19.800 Samuel Roberts: Yeah, well, this is the.

223 00:17:19.800 00:17:20.739 Casie Aviles: that comes in.

224 00:17:21.310 00:17:23.900 Samuel Roberts: Kids are okay, I think. It’s like,

225 00:17:24.440 00:17:28.859 Samuel Roberts: Tickets are fine, it’s with a priority, and where we’re gonna fit them in, and when, you know? Yeah.

226 00:17:29.180 00:17:35.009 Samuel Roberts: And I sifted through the backlog, I think Uten finished going through the stuff I didn’t understand as much, because they were older.

227 00:17:35.150 00:17:39.130 Samuel Roberts: So the backlog is… is… mostly, like…

228 00:17:39.250 00:17:42.119 Samuel Roberts: Things that we still want to happen,

229 00:17:43.400 00:17:46.230 Samuel Roberts: But obviously, the priority is not there, necessarily, so…

230 00:17:47.190 00:17:57.670 Samuel Roberts: But we’ll start to pull things out of there, we’ll start to add things to there, we’ll start to… but we’ll see. We’ll see how it goes. I have some ideas of if there’s not ad hoc work where we can maybe make moves on the client hub stuff.

231 00:17:57.970 00:18:02.829 Samuel Roberts: Okay. Especially now that Mr. Alpha tried out, Master, he’ll have a little bit of a…

232 00:18:02.970 00:18:03.440 Mustafa Raja: Not yet.

233 00:18:04.120 00:18:05.440 Samuel Roberts: Because I was trying to play…

234 00:18:05.440 00:18:06.400 Mustafa Raja: She’s nice.

235 00:18:06.560 00:18:07.719 Samuel Roberts: Is it? Okay, good.

236 00:18:08.060 00:18:08.440 Mustafa Raja: That’s good.

237 00:18:08.440 00:18:11.960 Samuel Roberts: I just want to make sure it actually is, like, capable of doing what we want, and I think it is.

238 00:18:13.170 00:18:23.979 Mustafa Raja: Yeah, the interface that we get out of it, it’s really good, because I’ve worked with, Lemadex on Amazon, and,

239 00:18:24.040 00:18:42.760 Mustafa Raja: we really don’t have any sort of interface. If you want to interact with it, I guess we’ll have to wrap it up in some, fast API stuff to get at least Swagger UI to be able to call some endpoints, but since this is, this is… this already comes with a UI that’s really good.

240 00:18:43.250 00:18:47.129 Mustafa Raja: It makes it intuitive, too, so that’s not…

241 00:18:47.130 00:19:06.119 Samuel Roberts: That’s great. Yeah, I think the combination of that, like, debugging UI that they provide out of the box, and the fact that it can run, like, right next to our platform code, and not have to be, like, a separate Python library, or Python project that we have to hit, is… is gonna be helpful for us, so…

242 00:19:06.120 00:19:06.720 Mustafa Raja: Yes.

243 00:19:07.670 00:19:09.060 Samuel Roberts: Cool. Alright.

244 00:19:09.290 00:19:13.470 Samuel Roberts: And yeah, like I said, I figured out how to finally get Azure working with it, so we can.

245 00:19:13.470 00:19:15.480 Mustafa Raja: Oh, yeah, that’ll be nice, because.

246 00:19:15.480 00:19:15.920 Samuel Roberts: Yeah.

247 00:19:15.920 00:19:18.600 Mustafa Raja: Yesterday I was trying to figure it out, and…

248 00:19:18.790 00:19:23.600 Mustafa Raja: I gave… I gave up on it and just threw in my own.

249 00:19:23.600 00:19:29.050 Samuel Roberts: Yeah, I spent maybe, like, an hour over several days, like, not… not an hour each day, but, like, combined time.

250 00:19:29.050 00:19:30.000 Mustafa Raja: I’m just…

251 00:19:30.000 00:19:33.259 Samuel Roberts: Debugging that, because it… they didn’t have a good way to set it up.

252 00:19:33.260 00:19:38.959 Mustafa Raja: Yeah, yeah, yeah. They don’t have any protocol for that. They have to do, like, the basic things.

253 00:19:39.310 00:19:46.230 Samuel Roberts: Yeah, I knew… I knew the Azure stuff should be doable, because we use it, it’s just an OpenAI interface, but the settings were…

254 00:19:46.680 00:20:00.930 Samuel Roberts: it just wasn’t working, but I got it, I got it, and we’ll use that going forward. So, I’ll put that in the repo when you share it, but then, yeah, I think we can start maybe moving, like, little pieces, because, like, the NNN workflows for the client hub

255 00:20:01.340 00:20:09.120 Samuel Roberts: again, I think it can be, like, one big flow, and as long as we’re passing the client name around, or the client slug, maybe, whatever we want to call it.

256 00:20:09.440 00:20:10.700 Samuel Roberts: Should be good.

257 00:20:10.820 00:20:22.809 Samuel Roberts: And Monster obviously can handle tool calling, and it can handle agent stuff, and then all the kind of logic and stuff that is in NAN is just gonna be code at that point, so… I think it’ll be…

258 00:20:23.870 00:20:33.900 Samuel Roberts: worth at least trying out, maybe migrating some things at pieces at a time, and then slowly, as we add new clients, putting them there, and then maybe migrating old clients over. So we’ll see.

259 00:20:36.220 00:20:42.019 Samuel Roberts: But yeah, I’m excited to try it out. I’m glad it worked for the interlude stuff, because that was a good… good test case.

260 00:20:42.020 00:20:46.669 Mustafa Raja: Yeah, I guess, for that, I guess we can improve the system prompt.

261 00:20:46.810 00:20:55.309 Mustafa Raja: For it to be able to allocate the text correctly. It’s doing it, it’s not perfectly doing it, but it’s doing it.

262 00:20:55.760 00:20:56.300 Samuel Roberts: Right, right.

263 00:20:56.300 00:21:01.450 Mustafa Raja: That’s the nice thing, because… Yeah, we can always adjust the system from,

264 00:21:01.450 00:21:02.440 Samuel Roberts: Yeah, yeah.

265 00:21:02.440 00:21:03.659 Mustafa Raja: the way it’s too many.

266 00:21:03.660 00:21:08.209 Samuel Roberts: I think even pulling out the text from the SVG, like, it has the location information.

267 00:21:08.380 00:21:09.370 Mustafa Raja: Yeah, yeah.

268 00:21:09.370 00:21:21.219 Samuel Roberts: and, like, the size and stuff, so… if it… I don’t know exactly what prompt you have already, but if it knows it’s a slide, it might… we can maybe pass in the size of it so it knows where things are.

269 00:21:21.990 00:21:23.809 Samuel Roberts: Might be helpful.

270 00:21:23.810 00:21:24.440 Mustafa Raja: Mmm.

271 00:21:26.620 00:21:35.559 Samuel Roberts: But yeah, I want to take a look at it, but it looked… it looked pretty good as a first pass, at least, if not, you know, it’s pulling off the text right, it’s labeling things right, it seemed like it was good, so…

272 00:21:36.790 00:21:40.160 Samuel Roberts: Cool. Alright, anything else, today?

273 00:21:42.760 00:21:44.330 Mustafa Raja: Yeah, I don’t think I have much.

274 00:21:45.230 00:21:46.330 Casie Aviles: Yeah, that should be it.

275 00:21:46.470 00:21:53.920 Samuel Roberts: Alright, cool. I’m… yeah, so, Mustafa, I’m gonna definitely be on the call, because it’s only, like, 10 minutes.

276 00:21:53.920 00:21:55.199 Mustafa Raja: Yeah, with Mika, right?

277 00:21:55.370 00:22:01.609 Samuel Roberts: Yeah, I wasn’t sure how busy my morning was gonna be. And then I don’t think I’ll be online

278 00:22:01.730 00:22:07.789 Samuel Roberts: much of the day after that. I’ll be, like, available on Slack, but I also have a wedding later to go to, so…

279 00:22:07.790 00:22:08.720 Mustafa Raja: Oh, yen.

280 00:22:08.950 00:22:14.470 Samuel Roberts: But yeah, if you need me, ping me on Slack, but I probably won’t be in many meetings through the day, so…

281 00:22:15.320 00:22:16.660 Mustafa Raja: Yeah, that’s fine, that’s fine.

282 00:22:16.890 00:22:30.989 Samuel Roberts: All right, cool. Yeah, I guess that’s all… that’s all. I’m trying to think if there’s anything else I had. Oh, I sent you… I moved the… I think you both responded, but I just want to double… double confirm. The monthly reviews, Monday…

283 00:22:31.260 00:22:32.600 Casie Aviles: Hmm.

284 00:22:32.970 00:22:45.489 Samuel Roberts: And then I sent you each a feedback for each other. I also sent those for your information, I sent those feedback to, like, all the PMs, and Utam, and Awash, I think, for him to share it and stuff, so I probably won’t…

285 00:22:45.510 00:22:54.490 Samuel Roberts: I will not give you, like, explicitly what people say unless they tell me to, but I will aggregate it and get, like, team feedback kind of thing, so…

286 00:22:54.580 00:22:58.579 Samuel Roberts: You know, it’s gonna be fully anonymous that way for the most part, but,

287 00:22:58.800 00:23:02.530 Samuel Roberts: I just think it’s helpful to get more than just my opinion, you know?

288 00:23:02.530 00:23:04.910 Mustafa Raja: So the team is reviewing us.

289 00:23:05.880 00:23:16.890 Samuel Roberts: Yeah, yeah, so we have a whole… I can… I’ll probably show it to you when we do the review, but yeah, I just wanted other inputs, because, like, you know, I have…

290 00:23:17.310 00:23:21.070 Samuel Roberts: I’ll have things to say, I’m gonna get feedback from you guys about,

291 00:23:21.430 00:23:24.570 Samuel Roberts: Like, work and company stuff as well, so come prepared with that.

292 00:23:25.050 00:23:34.809 Samuel Roberts: And then, there’s also, like, some team, and I think it also said client feedback, but I didn’t reach out to clients yet, and I wanted to kind of just get the team input first this round.

293 00:23:35.620 00:23:42.050 Samuel Roberts: But… yeah, there’ll be, like, some of that. I’m pulling some numbers and stuff, too, like, hours and tickets and stuff, but…

294 00:23:42.170 00:23:47.509 Samuel Roberts: I don’t know how accurate some of those have been for the past month anyway, but as those get more accurate, it’ll be…

295 00:23:47.670 00:23:50.740 Samuel Roberts: A good, like, check to make sure we’re…

296 00:23:51.000 00:24:03.099 Samuel Roberts: you know, doing enough, or not doing too much, and things like that, so… And then, yeah, we’ll just chat, I’ll give you some feedback, and then, you know, I’m gonna… it’s gonna be a conversation back and forth,

297 00:24:03.320 00:24:05.449 Samuel Roberts: But I just wanted to, you know…

298 00:24:06.120 00:24:16.630 Samuel Roberts: get feedback from everyone else, but, you know, because you work… it’s not like we’re just the team and you guys only talk to me kind of thing, so, I want to make sure everyone has…

299 00:24:16.880 00:24:22.970 Samuel Roberts: good or bad or constructive, whatever, things to say, and, you know, the whole point is to, like.

300 00:24:23.140 00:24:29.499 Samuel Roberts: for you guys to get feedback in general, and to provide feedback to me and, like, about company stuff, so, you know.

301 00:24:29.640 00:24:38.310 Samuel Roberts: don’t be scared or anything, listen, don’t worry about it, like, it’s just a, you know, a feedback mechanism, which is very important, I think, overall, so…

302 00:24:39.650 00:24:42.480 Samuel Roberts: A structured feedback mechanism, I should say, so…

303 00:24:43.480 00:24:46.900 Samuel Roberts: But yeah, I’m looking forward to it.

304 00:24:47.160 00:25:04.599 Samuel Roberts: And then, yeah. Hopefully we’ll do those on a monthly… monthly cadence. They might be, like, more or less helpful certain months than others, but at least it’s, like, a… a time to do that, rather than, like, letting months go by and nothing’s happened, you know, so…

305 00:25:06.000 00:25:07.079 Samuel Roberts: That’s the plan.

306 00:25:07.850 00:25:08.360 Mustafa Raja: Yeah.

307 00:25:08.360 00:25:11.990 Samuel Roberts: Any questions or anything about those? Any other questions?

308 00:25:15.530 00:25:16.400 Mustafa Raja: Boom.

309 00:25:16.690 00:25:18.339 Casie Aviles: No questions for me.

310 00:25:18.340 00:25:29.959 Samuel Roberts: Okay, alright. Then in that case, yeah, I’ll, we can hop off. Mustaf, I’ll see you with Micah in a minute, and then, yeah, like I said, if you need me, Slack me.

311 00:25:30.750 00:25:34.579 Samuel Roberts: But at, like, what time is it now? It’s 10 o’clock my time, almost.

312 00:25:34.710 00:25:41.489 Samuel Roberts: So I will probably be at a wedding in, like, 4 hours, so I gotta get ready and stuff, but I’ll… I’ll try to be checking Slack as much as possible, so…

313 00:25:42.110 00:25:44.060 Samuel Roberts: Alright. Thanks, guys.

314 00:25:44.520 00:25:45.540 Mustafa Raja: thinking, but…

315 00:25:46.240 00:25:46.630 Casie Aviles: Thank you.

316 00:25:46.630 00:25:47.230 Samuel Roberts: Like, ”…