Meeting Title: ABC Team Weekly Sync Date: 2026-04-10 Meeting participants: Casie Aviles, Pranav


WEBVTT

1 00:00:23.300 00:00:24.510 Pranav: Hey, Casey!

2 00:00:26.240 00:00:27.640 Casie Aviles: Hey. Hey, Branov.

3 00:00:29.040 00:00:29.990 Pranav: How’s it going?

4 00:00:31.170 00:00:35.579 Casie Aviles: Yeah, doing alright. There’s just,

5 00:00:35.700 00:00:39.970 Casie Aviles: So, I’m just testing, like, the… Automation, so…

6 00:00:43.670 00:00:49.709 Pranav: Cool. Yeah, I just wanted to sync up with you, you know, I’ve mostly been focused on Eden stuff this week, so we didn’t get to, like.

7 00:00:49.910 00:00:52.340 Pranav: touch base that often.

8 00:00:52.630 00:00:58.439 Pranav: Yeah, one thing that I would… I think we could do, probably just at the beginning of this call, is just trigger the…

9 00:00:58.800 00:01:04.779 Pranav: The automation or the script that populates the real dashboard for the weekly categorization?

10 00:01:06.600 00:01:10.799 Casie Aviles: Oh, right, yeah, yeah, okay. Yeah, I almost forgot about that one.

11 00:01:11.480 00:01:20.139 Pranav: Cool, yeah, I mean, I think if you could maybe even share your screen, just show me how you do that, just so, like, in the future, I can also do that in case, you know, you’re not here on a Friday.

12 00:01:21.790 00:01:24.230 Casie Aviles: Sure, yeah. Let’s see…

13 00:01:29.140 00:01:30.189 Casie Aviles: Hold on time.

14 00:01:37.360 00:01:40.480 Casie Aviles: Okay, so… Expansioning.

15 00:01:46.210 00:01:51.390 Casie Aviles: So yeah, I remember I made a scale here for, like…

16 00:01:51.390 00:01:55.850 Pranav: Oh, okay. You know what? If it’s just as simple as a skill, let me just,

17 00:01:55.970 00:01:59.200 Pranav: Let me pull the latest changes, because that’s on main, right?

18 00:02:00.180 00:02:03.199 Casie Aviles: It’s in the Migration Progress branch branch.

19 00:02:03.810 00:02:05.609 Pranav: Migration, progress, okay.

20 00:02:28.210 00:02:33.360 Casie Aviles: I’m thinking, like, if maybe we could even have this scheduled instead.

21 00:02:33.600 00:02:37.379 Casie Aviles: Like, we have Google anyway, so we may be able to do that.

22 00:02:38.430 00:02:43.000 Pranav: Yeah, we can probably work on that. Yeah, if you… maybe next week?

23 00:02:44.700 00:02:50.100 Pranav: So the skill just does everything end-to-end, right? You just say… you just run the skill, do you have to give it any additional context?

24 00:02:50.780 00:02:53.830 Casie Aviles: I think you have to just… Make sure that…

25 00:02:54.250 00:02:58.189 Casie Aviles: The… the dates are… the date range is the correct one.

26 00:03:00.560 00:03:01.150 Pranav: logic.

27 00:03:02.540 00:03:03.170 Casie Aviles: Yeah.

28 00:03:05.560 00:03:11.829 Casie Aviles: So let’s see which dates… I think last week, that was for… since last week, so we’re just going to,

29 00:03:12.280 00:03:13.910 Casie Aviles: specify…

30 00:03:17.720 00:03:20.940 Casie Aviles: Which dates we’re missing, and then up to today.

31 00:03:23.850 00:03:28.199 Pranav: Okay, yeah, I think I have some other things in this branch right now, which…

32 00:03:28.910 00:03:31.109 Pranav: Yeah, maybe you can just run it for today.

33 00:03:31.790 00:03:33.090 Casie Aviles: Sure.

34 00:03:45.620 00:03:52.640 Pranav: Oh, does the… The skill… can’t you just, like, backslash and then it’ll pop up?

35 00:03:54.340 00:04:01.020 Casie Aviles: Oh, let’s see… Okay. That works, too.

36 00:04:01.880 00:04:04.330 Pranav: Yeah, just wasn’t sure. I mean, either works, I guess.

37 00:04:04.950 00:04:05.520 Casie Aviles: Yeah.

38 00:04:05.710 00:04:06.750 Casie Aviles: Okay, cool.

39 00:04:21.510 00:04:24.739 Casie Aviles: Let me just make sure what the start date is.

40 00:04:31.010 00:04:31.810 Casie Aviles: That’s…

41 00:04:55.320 00:04:58.939 Pranav: Yeah, and while this is running, unless there’s something you need to monitor here.

42 00:04:58.940 00:05:00.610 Casie Aviles: Oh, okay, yeah.

43 00:05:00.990 00:05:08.780 Pranav: Yeah, I was just gonna ask about, like, okay, so what are some, like, updates for this week? I think the main one was,

44 00:05:09.810 00:05:13.820 Pranav: The… where in the central dock we’re going to be adding

45 00:05:14.080 00:05:17.109 Pranav: certain information. I think that’s something you worked on, right?

46 00:05:17.400 00:05:19.749 Pranav: The placement automation? Yeah.

47 00:05:20.950 00:05:22.109 Pranav: Okay. Right. Cool.

48 00:05:22.110 00:05:25.510 Casie Aviles: So, that’s… that’s what we have here on Linear.

49 00:05:25.940 00:05:32.559 Casie Aviles: So… For the past few hours, I was just trying to… to,

50 00:05:32.980 00:05:41.830 Casie Aviles: Understand there’s just something that… It’s pro- it’s… it might be a timing thing, but…

51 00:05:41.960 00:05:54.560 Casie Aviles: it’s not returning, like, the… for all of the tests that I did. Sometimes there are, long intervals, you know, like, for example, this one, 32 minutes, and this one is 21 minutes.

52 00:05:55.050 00:05:58.710 Casie Aviles: So there’s just, like, something we have to be… we have to…

53 00:05:59.370 00:06:07.850 Casie Aviles: take a deeper look into. I’m not entirely sure why it’s doing that, so I’ve been spending the time earlier to figure out why, but…

54 00:06:08.380 00:06:11.979 Casie Aviles: We can test right now with just one of these.

55 00:06:13.510 00:06:16.709 Casie Aviles: But yeah, that’s just something I want to do.

56 00:06:18.470 00:06:21.070 Pranav: Oh, so it automatically runs its comma.

57 00:06:21.810 00:06:27.619 Casie Aviles: Yeah, so it should, it should automatically run, and whenever we send, like, a comment or submit

58 00:06:28.220 00:06:31.009 Casie Aviles: A comment here, it’s gonna reply.

59 00:06:31.450 00:06:38.470 Casie Aviles: But, yeah, sometimes it’s random where it doesn’t reply at all for, like, A couple of minutes.

60 00:06:38.630 00:06:40.939 Casie Aviles: Right now, it’s working fine, though, but…

61 00:06:42.250 00:06:48.270 Casie Aviles: It might catch us by surprise, where sometimes it would just take so long to run.

62 00:06:49.360 00:06:59.539 Pranav: Does it have to be added into… or is it based on the label? So if it has the workflow automation label, is that what, triggers… is that what allows for the automation to run?

63 00:07:00.370 00:07:11.039 Casie Aviles: No, no. So, what happens is we have a linear webhook set up, and that listens to all new comments, basically. And that’s as far as we can…

64 00:07:11.450 00:07:12.320 Casie Aviles: tweak.

65 00:07:12.580 00:07:14.760 Casie Aviles: Or, like, configure, but…

66 00:07:15.180 00:07:21.860 Casie Aviles: What else? So, I think we can also scope it to, like, a specific team, so that should… so I had, like.

67 00:07:22.010 00:07:32.460 Casie Aviles: The ops team helped me with that, so… it’s scoped to, like, ABC… the ABC team for, only. So it’s not gonna listen to other comments in other teams.

68 00:07:32.700 00:07:33.620 Casie Aviles: But then…

69 00:07:34.070 00:07:39.130 Pranav: And, like, for our, like, Regular dev tickets from this automation from running.

70 00:07:40.100 00:07:49.570 Casie Aviles: Yeah, it works on our tickets here. It should also work in, like, the triage tickets, so any tickets under ABC Team.

71 00:07:50.790 00:08:05.860 Pranav: Well, I guess my question is, like, for our, let’s say, just for your development tickets, right, to, like, work on these type of, automations, if you added a comment into one of those, are you gonna get, like, a random Brainforge AI automation response?

72 00:08:07.450 00:08:10.850 Casie Aviles: Oh, like, if I do any comment that’s not structured.

73 00:08:11.670 00:08:17.339 Pranav: Yeah, that too, I guess. Maybe not structured… structured is okay. I guess my question is, like…

74 00:08:17.680 00:08:20.990 Pranav: Say you just go to any other… random…

75 00:08:20.990 00:08:22.520 Casie Aviles: Any ticket.

76 00:08:22.520 00:08:24.230 Pranav: Always in a triage ticket, yeah.

77 00:08:25.080 00:08:32.240 Casie Aviles: Well, yeah, these aren’t triage tickets, but I can… I can make a new one for… just to illustrate,

78 00:08:41.470 00:08:48.019 Casie Aviles: So it does… it’s not reliant on, like, the labels or, like, Whatever properties we set.

79 00:08:49.090 00:08:53.900 Casie Aviles: If I… yeah, that should be listening to, like, all the.

80 00:08:53.900 00:08:54.320 Pranav: Right.

81 00:08:54.320 00:08:54.830 Casie Aviles: remake.

82 00:08:55.070 00:08:59.379 Pranav: My concern isn’t that it’s not going to work, my concern is that it’s going to…

83 00:08:59.570 00:09:04.699 Pranav: This is going to be… Running, even for our tickets that are internal.

84 00:09:04.810 00:09:06.690 Pranav: Does that make sense?

85 00:09:07.460 00:09:11.720 Casie Aviles: Yeah, yeah, well, there is a filter that we have.

86 00:09:11.720 00:09:12.210 Pranav: Oh, okay.

87 00:09:12.210 00:09:12.850 Casie Aviles: purchase.

88 00:09:13.190 00:09:20.100 Casie Aviles: And… Yeah, because on linear side, we can’t really… we don’t have a lot of options to filter it.

89 00:09:20.210 00:09:21.690 Casie Aviles: To just.

90 00:09:21.740 00:09:25.660 Pranav: That makes sense. So there’s, like, a filter based on if it’s, like, a triage ticket.

91 00:09:25.780 00:09:38.659 Pranav: To… so, like, say if it’s just a regular dev ticket, and someone adds a comment, like, say you just put a status update comment in there, it’ll read the comment, it’ll also read the ticket and know, okay, we don’t need to run the placement automation for this.

92 00:09:39.320 00:09:41.430 Casie Aviles: Yes, so we’re just… Perfect.

93 00:09:41.930 00:09:45.520 Casie Aviles: It only runs if we have this specific format.

94 00:09:46.790 00:09:48.320 Pranav: Oh, okay, that’s even better.

95 00:09:49.030 00:09:54.500 Casie Aviles: Yeah, so if it’s not in this format, it’s gonna… Return, like…

96 00:09:55.250 00:09:59.999 Casie Aviles: Let’s see, like, for example, or, like, it’s not even gonna listen at all, so this is sort of…

97 00:10:00.290 00:10:03.320 Casie Aviles: Test comment, so it’s not gonna respond to that.

98 00:10:04.040 00:10:05.560 Casie Aviles: Or if we…

99 00:10:05.600 00:10:06.290 Pranav: Okay.

100 00:10:06.420 00:10:08.259 Casie Aviles: Yeah, if we, if we have, like…

101 00:10:08.680 00:10:14.809 Casie Aviles: incomplete fields, even. So, for example, this one is just… 3 of the fields.

102 00:10:15.660 00:10:22.740 Casie Aviles: We’re not gonna get, yeah, it’s gonna say validation parse failed, as you can see here.

103 00:10:22.740 00:10:27.689 Pranav: Oh, okay, nice. So it does… it does listen to it, but it does… it’ll just give a…

104 00:10:28.060 00:10:36.950 Pranav: A status validation parse failed. Okay, that’s perfect. I was gonna say, if as long as we’re… if we’re not giving any response back, then it might be confusing, but…

105 00:10:37.110 00:10:41.929 Pranav: Okay, this is really good. So now, if you put in the correct response.

106 00:10:42.310 00:10:45.280 Pranav: Will it change the label?

107 00:10:49.120 00:10:55.639 Casie Aviles: So… Yeah, it goes to triage right now.

108 00:10:56.630 00:10:58.130 Pranav: Nice, nice, nice.

109 00:10:58.580 00:11:15.840 Pranav: And so, yeah, I think I never really fully synced with you to talk about what is a triage process. I have an understanding of it, which I think is probably, like, 90% of the way there, but I know when you’re talking to Janiece, like, you’re actually, like, working through these tickets. Is the…

110 00:11:16.320 00:11:19.029 Pranav: Is the filter that label, triage.

111 00:11:19.130 00:11:23.520 Pranav: Colon, or status colon, state colon triage.

112 00:11:23.660 00:11:27.769 Pranav: Or is it just, like, the triage being in, like, the ticket name?

113 00:11:28.840 00:11:36.060 Casie Aviles: Oh, this is just for, I think that was what I got from, like, the document that Sam shared, so…

114 00:11:36.060 00:11:37.279 Pranav: Oh, okay, cool.

115 00:11:37.750 00:11:38.360 Casie Aviles: This is just…

116 00:11:38.360 00:11:39.729 Pranav: in the process now.

117 00:11:40.060 00:11:46.799 Casie Aviles: Yeah, this is part of that, so it’s not to be confused with, like, the actual triage

118 00:11:47.230 00:11:50.010 Casie Aviles: Label that we have here, right?

119 00:11:52.790 00:11:56.340 Casie Aviles: So this is a different property, but it’s a… this one is…

120 00:11:56.340 00:12:05.879 Pranav: This new process is gonna be whole of… everything is gonna just be state colon triage, right? Like, even for, like, feedback that comes through the…

121 00:12:06.940 00:12:10.610 Pranav: feedback that comes through the… through Andy?

122 00:12:11.030 00:12:14.850 Pranav: Will that just kind of automate to this new… this new flow?

123 00:12:16.800 00:12:20.009 Casie Aviles: It’s not… yeah, it’s not gonna get this label yet.

124 00:12:20.200 00:12:24.000 Casie Aviles: It… it… this only… this label gets assigned only when…

125 00:12:24.450 00:12:27.659 Casie Aviles: The, the automation response to…

126 00:12:27.940 00:12:30.660 Casie Aviles: This comment here that we submitted.

127 00:12:32.480 00:12:36.629 Pranav: Okay. We probably want to have it set to state…

128 00:12:36.840 00:12:40.400 Pranav: Or I guess I’m curious, why is it being set?

129 00:12:40.500 00:12:43.570 Pranav: At that point, and not just when the ticket’s created.

130 00:12:44.980 00:12:51.390 Casie Aviles: I believe there’s, like, another state which is just… state new.

131 00:12:52.330 00:12:59.400 Casie Aviles: And we didn’t really, like… Rename this yet, but we can probably rename this.

132 00:12:59.590 00:13:05.540 Casie Aviles: Or, like… That’s what we discussed around last Wednesday with,

133 00:13:05.840 00:13:12.079 Casie Aviles: With the state machine, right? Like… Let’s see, where’s that?

134 00:13:20.690 00:13:24.200 Casie Aviles: Oh, okay, nevermind. But yeah, like…

135 00:13:24.710 00:13:31.930 Casie Aviles: I think that’s something we could do, because I just followed, like, the state machine that was outlined there in the doc, and

136 00:13:32.480 00:13:36.779 Casie Aviles: So it’s, yeah, I understand, like, it’s a little confusing as well, like, if it’s…

137 00:13:37.530 00:13:44.840 Casie Aviles: Just whenever this comment is… submitted, so I think we can… Change.

138 00:13:44.840 00:13:45.759 Pranav: I guess,

139 00:13:46.100 00:13:56.040 Pranav: Yeah, it is the… was the state machine a little bit, like, ambiguous there? Because I’m not… I’m not fully sure, to be honest. Like, maybe it wasn’t…

140 00:13:56.200 00:13:57.810 Pranav: It wasn’t clear in that.

141 00:13:58.590 00:14:01.639 Pranav: I don’t remember mentioning anything about labels, to be honest.

142 00:14:03.280 00:14:07.889 Casie Aviles: I think that it’s just that there’s a lot of states there that…

143 00:14:07.890 00:14:08.460 Pranav: Right.

144 00:14:08.690 00:14:13.390 Pranav: Yeah, I think the States itself was what… so the States is what we…

145 00:14:13.900 00:14:16.889 Pranav: are defining as labels within linear, right?

146 00:14:17.250 00:14:19.840 Casie Aviles: Yeah, yeah, exactly. So they’re, they’re labels.

147 00:14:21.110 00:14:24.140 Pranav: Perfect, okay. Yeah, let me… let’s just pull that up real quick.

148 00:14:36.280 00:14:37.750 Pranav: Let me see if I can find it.

149 00:14:39.420 00:14:42.890 Casie Aviles: I think it’s… I think John shared the ear as well.

150 00:14:54.360 00:14:55.370 Pranav: This is the new one?

151 00:14:56.350 00:15:01.860 Casie Aviles: That was just, like, for the high-level flow, like, everything, the entire project.

152 00:15:02.620 00:15:03.640 Pranav: Gotcha, gotcha.

153 00:15:03.640 00:15:06.140 Casie Aviles: This is the one that I was following, so…

154 00:15:06.940 00:15:09.779 Casie Aviles: There was supposed to be, like, a new label.

155 00:15:10.430 00:15:14.719 Casie Aviles: And then… it gets assigned to, like, triage here, right?

156 00:15:19.270 00:15:21.240 Pranav: Yeah, so it probably just needs to s-

157 00:15:23.800 00:15:26.459 Pranav: So it should probably be at Needs Info.

158 00:15:27.200 00:15:30.830 Pranav: Or at new, whatever, I feel like that needs info.

159 00:15:31.750 00:15:37.070 Pranav: can be bypassed unless it gets rejected, then needs info makes more sense.

160 00:15:37.230 00:15:43.759 Pranav: But, you know, it doesn’t matter. We can go from new to needs info, and that automatically brings it to triage.

161 00:15:45.290 00:15:52.719 Pranav: I think triage makes… Yeah, I guess it makes sense. You know, we have it as a triage after…

162 00:15:53.970 00:15:56.010 Pranav: We add the information?

163 00:15:56.560 00:15:57.329 Pranav: Hmm, oh.

164 00:15:58.260 00:15:59.790 Pranav: Yeah, I’m okay with that.

165 00:16:01.390 00:16:07.570 Pranav: Yeah, I’m okay with that. And so, I guess what’s also interesting here is who is…

166 00:16:08.070 00:16:10.900 Pranav: Responsible for which statuses?

167 00:16:11.220 00:16:24.259 Pranav: So… I guess for all of these things, like, only when things are, let’s see… Applied, right?

168 00:16:25.630 00:16:28.439 Pranav: Or for apply failed, we need to be monitoring that.

169 00:16:30.290 00:16:32.869 Pranav: That’s something we need to monitor,

170 00:16:35.040 00:16:38.870 Pranav: Applying is also something we need to monitor, because that’s going to be…

171 00:16:40.180 00:16:42.120 Pranav: That’s going to be a manual.

172 00:16:42.670 00:16:49.870 Pranav: From the beginning, right? Because we’re just going to manually apply these, we’re not going to focus on an automation that automatically adds it to the central doc.

173 00:16:50.090 00:16:51.680 Casie Aviles: Yeah, we don’t have that yet.

174 00:16:52.260 00:16:53.490 Pranav: Yeah, yeah.

175 00:16:54.880 00:16:55.720 Pranav: Okay.

176 00:16:58.890 00:17:03.650 Casie Aviles: So, yeah, that’s… that’s… those are the labels for now.

177 00:17:04.589 00:17:08.009 Pranav: Gotcha. So needs info is basically… it should…

178 00:17:09.159 00:17:12.889 Pranav: See, you added, like, there was some other status that happened when you…

179 00:17:13.479 00:17:16.439 Pranav: Gave the wrong formatted comment, right?

180 00:17:17.540 00:17:20.990 Casie Aviles: Yeah, needs, info, yeah, validate.

181 00:17:20.990 00:17:26.870 Pranav: Okay, perfect. That’s good that it added both. As long as it added the needs info, then we’re good.

182 00:17:27.730 00:17:28.440 Casie Aviles: Okay.

183 00:17:29.000 00:17:29.640 Pranav: Yeah.

184 00:17:30.310 00:17:31.290 Pranav: Okay, cool.

185 00:17:31.640 00:17:34.620 Pranav: Yeah, what else from this week?

186 00:17:36.580 00:17:37.489 Pranav: He’s just amazing.

187 00:17:38.290 00:17:44.580 Casie Aviles: Yeah, this took up a lot of my time, but I know we have some other tickets as well, like, for…

188 00:17:44.830 00:17:46.359 Casie Aviles: The zips and the…

189 00:17:47.340 00:17:56.059 Casie Aviles: the inconsistent answer, so those ones I’m… now that I’ve… now that we’ve synced, I think I’ll work on that.

190 00:17:56.460 00:17:59.330 Casie Aviles: For today, yeah, I’ll try to finish those today.

191 00:17:59.990 00:18:00.340 Pranav: Cool.

192 00:18:00.340 00:18:01.390 Casie Aviles: Both no south.

193 00:18:02.100 00:18:11.299 Pranav: Awesome. Yeah, if you want to also pull from my transcript with Ashley and Janiece from yesterday, I think you’ll get a little bit more information on the…

194 00:18:12.340 00:18:19.250 Pranav: the conflicting answers. So, I think you already have enough context on that, really. Does that one make sense?

195 00:18:19.970 00:18:20.550 Pranav: Like…

196 00:18:20.550 00:18:22.020 Casie Aviles: Yeah, don’t worry.

197 00:18:22.290 00:18:23.510 Pranav: What happened there.

198 00:18:24.210 00:18:29.629 Casie Aviles: I… I still need to, like, check what exactly caused that, but…

199 00:18:29.870 00:18:34.759 Casie Aviles: I see that there are different, you know, answers for each, like.

200 00:18:35.380 00:18:38.140 Casie Aviles: CSR, and that could be, like.

201 00:18:38.530 00:18:43.329 Casie Aviles: In terms of just the thread that they have, or maybe even the tool itself.

202 00:18:43.710 00:18:44.640 Pranav: Yeah, so…

203 00:18:44.640 00:18:45.490 Casie Aviles: figure out…

204 00:18:45.750 00:18:58.339 Pranav: I think there’s two things. The thread itself is interesting, because what context is it bringing in per response? I actually don’t know that. So, yeah, maybe you can answer… you can answer that for me, like…

205 00:18:58.540 00:19:04.490 Pranav: For a question that’s in a thread, does it always take all of the history?

206 00:19:05.230 00:19:10.349 Casie Aviles: Oh, no, no, I believe we set a number for that,

207 00:19:10.500 00:19:14.539 Casie Aviles: Just have to recall if it’s the… whether it’s 3 or 5.

208 00:19:15.430 00:19:18.919 Casie Aviles: But, yeah, we set a number here, let’s see.

209 00:19:30.760 00:19:36.310 Casie Aviles: It’s either 3 or 5, so it…

210 00:19:36.310 00:19:38.990 Pranav: So it’ll always take the last 3 or 5, right?

211 00:19:38.990 00:19:40.370 Casie Aviles: Yes. Yeah.

212 00:19:40.750 00:19:43.590 Pranav: So it’s not even max, it’s just number of history.

213 00:19:45.190 00:19:47.049 Casie Aviles: Oh, yeah, yeah, that’s… that’s correct.

214 00:19:47.430 00:19:51.680 Pranav: Okay So, I think sometimes that can be problematic.

215 00:19:51.790 00:19:58.559 Pranav: And also with Andy, you can only ever have just one conversation, right?

216 00:19:59.800 00:20:05.820 Casie Aviles: Yeah, we don’t have, like… we can’t start, like, mute chats the same way, like, we do in…

217 00:20:05.940 00:20:08.060 Casie Aviles: ChatGPT or Inversor?

218 00:20:08.060 00:20:10.480 Pranav: Yeah, okay, that’s,

219 00:20:10.650 00:20:15.769 Pranav: That could also be causing the issue, right? Like, your chat isn’t having… storing the proper context.

220 00:20:16.210 00:20:17.150 Casie Aviles: Yeah.

221 00:20:17.800 00:20:24.540 Pranav: So, okay, that’s one thing that it could be. Another thing that it could be is just that it’s duplicate or conflicting information.

222 00:20:24.670 00:20:27.670 Pranav: So… Oh, yeah. So, yeah.

223 00:20:27.670 00:20:28.690 Casie Aviles: the document.

224 00:20:29.180 00:20:37.060 Pranav: Yeah, in the document, because, like, I think that’s what’s really gonna bring in the most inconsistency. I’m thinking what’s happening here is that it’s,

225 00:20:37.820 00:20:46.379 Pranav: There’s duplicate information. Which is causing the retrieval to be, inconsistent.

226 00:20:48.460 00:20:55.650 Pranav: So, I mean, it’s… I think it’s always wrong, to be honest, so for whatever reason, it’s mapping a different…

227 00:20:56.040 00:21:11.290 Pranav: different content to be the right answer for that specific question. So, I think what we need to do is just… and this will probably become more of, like, a systematic approach going forward, because I want to get more of this type of feedback, but every time this happens, we will…

228 00:21:11.390 00:21:22.430 Pranav: We’ll find what that question was, and this is what kind of the triage system is for. We’ll find what that question was, what was the correct response, and then, as part of this, we’ll…

229 00:21:22.620 00:21:25.450 Pranav: We will see, okay, what was the actual retrieval?

230 00:21:25.750 00:21:27.160 Pranav: For that question.

231 00:21:28.520 00:21:29.380 Casie Aviles: Yeah.

232 00:21:30.260 00:21:39.970 Pranav: what is the… compare that to the proper response, see where that differs in the… in the document itself, and then what we need to do is we need to analyze why that happened.

233 00:21:41.240 00:21:41.820 Pranav: Does that make.

234 00:21:41.820 00:21:42.340 Casie Aviles: Hmm.

235 00:21:43.320 00:21:44.560 Casie Aviles: Yes, yeah.

236 00:21:44.740 00:21:56.420 Pranav: Okay. Yeah, I just want to make sure, like, that makes sense, because it should be a pretty simple process, like, you can just go into Andy, ask it a question, look at what the top 5 retrievals were from the central dock.

237 00:21:56.600 00:22:02.200 Pranav: And then see if any one of those were the information that they provided.

238 00:22:02.360 00:22:05.380 Pranav: As the, you know, the source of truth answer.

239 00:22:05.620 00:22:11.100 Pranav: And if it is, then we figure out why it wasn’t ranked number 1 to then give that to the user.

240 00:22:11.270 00:22:14.919 Pranav: If it wasn’t, then we see, okay, this is missing content.

241 00:22:15.090 00:22:16.270 Pranav: Most likely.

242 00:22:17.020 00:22:19.090 Casie Aviles: Hmm, yeah, yeah, that makes sense.

243 00:22:19.470 00:22:31.230 Pranav: Yeah. Well, actually, in this situation, I know for sure it’s in the central dock, like, and you… I think, yeah, take a look at that, that meeting. I can… I can link it to you, or I’ll link it to that ticket right now.

244 00:22:32.240 00:22:33.420 Casie Aviles: Oh, okay, sure.

245 00:22:33.990 00:22:34.650 Pranav: Yeah.

246 00:22:37.980 00:22:42.869 Pranav: Besides that, how has, things been going, like, on the project itself? How you been feeling?

247 00:22:45.330 00:22:53.350 Casie Aviles: I think, yeah, it’s… it’s good. I think just when I was starting out with the new process, like.

248 00:22:53.850 00:22:56.249 Casie Aviles: I think I also shared this to somewhere.

249 00:22:56.470 00:23:02.350 Casie Aviles: I was a bit… a bit lost, with, like, what, what the actual,

250 00:23:03.130 00:23:05.190 Casie Aviles: What the high-level flow was.

251 00:23:05.400 00:23:10.570 Casie Aviles: And, like, what I needed to, like, accomplish, you know, by… by Friday.

252 00:23:11.550 00:23:12.100 Casie Aviles: Got it.

253 00:23:12.970 00:23:22.349 Pranav: Yeah, that’s fair. I think things have been kind of like, you know, we’re learning new processes here. What I’m trying to get from…

254 00:23:23.420 00:23:24.839 Pranav: Hey, sorry, can you still hear me?

255 00:23:25.130 00:23:26.010 Casie Aviles: Yeah, yeah.

256 00:23:26.190 00:23:30.219 Pranav: Perfect. Yeah, what I’m trying to get from, like, Sam is to, like.

257 00:23:30.620 00:23:46.290 Pranav: have him kind of fill in the gaps on, like, the technical approach. So, I will probably, like, reach out to you in terms of, like, hey, how are we doing on, like, certain milestones, certain tickets? Like, if there are certain blockers, of course, like, we’re a small team, like, bring it up to anybody.

258 00:23:46.520 00:23:47.440 Pranav: But…

259 00:23:47.610 00:24:00.110 Pranav: Yeah, also, if, you know, for whatever reason, if Sam is busy or he’s not getting back to you, like, yeah, just reach out to me, ping me in, the channel or directly, and then I’ll make sure to get assistance for you.

260 00:24:00.110 00:24:01.100 Casie Aviles: Okay.

261 00:24:01.100 00:24:03.829 Pranav: Try to keep me in the loop on things,

262 00:24:03.930 00:24:07.000 Pranav: If you feel like you’re not getting, like, immediate attention from Sam.

263 00:24:07.810 00:24:13.359 Casie Aviles: Sure, sure, yeah, I think he’s been… yeah, he’s been helping me a lot. It’s… yeah.

264 00:24:16.140 00:24:18.940 Pranav: Okay, let me find this, meeting.

265 00:25:00.990 00:25:02.930 Pranav: Okay, just added that to the ticket.

266 00:25:04.370 00:25:09.630 Pranav: Okay, cool. Let’s, can we double-check that skill and see if it ran?

267 00:25:11.440 00:25:16.310 Casie Aviles: Yeah, it did. I was just, like, refreshing, like, the sources that…

268 00:25:16.890 00:25:20.989 Casie Aviles: BigQuery… oh, sorry, I mean Reel has… Real has.

269 00:25:20.990 00:25:21.580 Pranav: Okay.

270 00:25:22.880 00:25:27.400 Casie Aviles: Because it ran, but I didn’t see, like, they’re still uncategorized right now.

271 00:25:28.680 00:25:30.249 Casie Aviles: Okay, I’m just joking.

272 00:25:32.980 00:25:35.589 Casie Aviles: Oh, okay, did not write BAP.

273 00:25:42.010 00:25:43.119 Pranav: Oh, okay, okay.

274 00:25:53.010 00:25:59.610 Pranav: I think we should build out more processes like this, like, just through… Through, like, cursor skills.

275 00:25:59.960 00:26:01.409 Pranav: I feel like this is pretty neat.

276 00:26:02.690 00:26:03.830 Casie Aviles: Yeah.

277 00:26:08.260 00:26:11.340 Pranav: Wait, what are some other processes we can run through like this?

278 00:26:12.250 00:26:15.820 Casie Aviles: I… yeah, some… I just added a few, but…

279 00:26:16.200 00:26:21.079 Casie Aviles: These were, like, for when I was developing, like, or, like, doing the migration.

280 00:26:22.790 00:26:25.070 Casie Aviles: Or whenever I have to update

281 00:26:25.170 00:26:29.300 Casie Aviles: rail, there are also some skills here, like, with the setup.

282 00:26:30.060 00:26:31.380 Casie Aviles: that I created.

283 00:26:33.320 00:26:35.900 Pranav: Okay, cool. Yeah, I mean…

284 00:26:37.900 00:26:48.949 Pranav: I think with the triage tickets, we’re gonna wanna send them a daily report on, hey, what got rejected today, what got added into the central dock?

285 00:26:49.280 00:26:50.420 Pranav: And…

286 00:26:51.260 00:26:57.770 Pranav: It’ll also just be, like, a summary of, hey, these are the new… this is the new content. You can ask these questions now.

287 00:26:57.960 00:27:01.909 Pranav: And these are the topics of questions that should be better supported.

288 00:27:02.290 00:27:09.289 Pranav: So, having all 3 of those things, like, in a report, or just all of those things in general, like, in a report, I think…

289 00:27:09.610 00:27:21.680 Pranav: we could easily just, like, kick off in a skill, because the good thing about a skill is, like, things like that that you just showed. If there was a gap in what was accomplished, we can fill in that gap by, like, doing an additional prompt, or just.

290 00:27:21.680 00:27:22.080 Casie Aviles: Yeah.

291 00:27:22.080 00:27:28.330 Pranav: letting it… We can also, like, go stepwise as well, right? If things are not working, yeah.

292 00:27:34.290 00:27:38.080 Pranav: Yeah, like, end-to-end automations are a little bit more cumbersome, I feel.

293 00:27:39.020 00:27:42.750 Pranav: Like, if you’re just fully out of the loop, like, let’s say we made this, like, a scheduler.

294 00:27:44.560 00:27:50.580 Pranav: we’re just, like, less aware of, like, if things are breaking or not. So…

295 00:27:50.580 00:27:51.150 Casie Aviles: Boom.

296 00:27:51.380 00:27:52.869 Pranav: Yeah, so I just think if…

297 00:27:53.570 00:28:09.030 Pranav: we have this manual at first a little bit. Maybe what you can do is, now that you notice that it didn’t upload immediately, you can update the skill to just make… to, like, add it to the prompt and be like, hey, always upload it immediately. This should just be, like, a… this should be a one-shot.

298 00:28:10.340 00:28:15.190 Pranav: Analysis of the weekly… Prompts.

299 00:28:15.560 00:28:19.199 Casie Aviles: Yeah, definitely, you know, be sure to add the… Inc.

300 00:28:20.240 00:28:24.300 Casie Aviles: Yeah, I was just doing the dry run, so I guess, yeah, okay.

301 00:28:29.360 00:28:31.000 Pranav: Cool.

302 00:28:37.000 00:28:37.860 Pranav: Nice.

303 00:28:39.610 00:28:42.499 Casie Aviles: This just takes a few minutes.

304 00:28:47.370 00:28:48.069 Pranav: Oh, cool.

305 00:28:50.260 00:29:03.070 Pranav: And then, can you send me… I think you’ve already done this before, but… or maybe just, like, show me Unreal, I’ll just share my screen real quick, on, like, how to navigate from, like, usage to then also…

306 00:29:03.240 00:29:04.530 Pranav: That dashboard.

307 00:29:06.120 00:29:06.780 Casie Aviles: Okay.

308 00:29:08.240 00:29:08.860 Pranav: Cool.

309 00:29:22.510 00:29:28.500 Pranav: Okay, so, yeah, this is the… Just a usage.

310 00:29:31.630 00:29:32.100 Casie Aviles: Wow.

311 00:29:32.100 00:29:32.520 Pranav: Yes.

312 00:29:32.520 00:29:33.100 Casie Aviles: to…

313 00:29:33.800 00:29:34.380 Pranav: Yep.

314 00:29:35.100 00:29:41.510 Casie Aviles: Well, when I go to the dashboard, I… you have to click here first, you have to go back.

315 00:29:41.660 00:29:44.530 Casie Aviles: I guess I think you’re in a different view.

316 00:29:45.900 00:29:48.319 Pranav: Oh, okay, so I had to click where? I can’t see her.

317 00:29:48.910 00:29:50.689 Casie Aviles: Oh, you can’t see the drawing?

318 00:29:51.130 00:29:52.989 Pranav: No, I can’t see the annotation.

319 00:29:52.990 00:29:57.539 Casie Aviles: Oh, yeah, just go to ABC Home and Commercial, real.

320 00:29:58.150 00:29:59.339 Casie Aviles: There you go.

321 00:29:59.830 00:30:00.260 Pranav: Okay, cool.

322 00:30:00.260 00:30:00.810 Casie Aviles: I know.

323 00:30:00.810 00:30:01.750 Pranav: I know, right here.

324 00:30:01.950 00:30:03.190 Pranav: Oh, sorry.

325 00:30:03.190 00:30:05.609 Casie Aviles: So it’s the same. Yeah.

326 00:30:07.230 00:30:09.350 Casie Aviles: And that’s where you can see, like…

327 00:30:10.810 00:30:11.740 Pranav: This one right here.

328 00:30:13.890 00:30:16.679 Casie Aviles: Oh, we have them now, okay.

329 00:30:17.480 00:30:18.200 Casie Aviles: Nice.

330 00:30:18.860 00:30:19.830 Pranav: Did it load in?

331 00:30:20.140 00:30:26.049 Casie Aviles: Yeah, those are the… that’s for… if you could see the date here, last 7 days, April 4 to 10.

332 00:30:26.890 00:30:27.710 Pranav: Oh, nice.

333 00:30:28.150 00:30:29.630 Casie Aviles: And I should be building this.

334 00:30:30.770 00:30:33.860 Pranav: Sick. Okay, cool.

335 00:30:36.920 00:30:41.830 Pranav: Percentage needs escalation. So this is, like, percentage of thumbs down.

336 00:30:43.470 00:30:50.700 Casie Aviles: Let’s see… what… what’s this, label here? Cancellation slash change. Can we…

337 00:30:53.740 00:30:59.590 Casie Aviles: Can we see that in full? Like, can you extend, like, the name, or the… yeah, the label?

338 00:31:02.040 00:31:02.830 Casie Aviles: Yes.

339 00:31:03.480 00:31:04.549 Pranav: Oh, this one right here.

340 00:31:05.880 00:31:06.960 Casie Aviles: Yeah, okay.

341 00:31:09.870 00:31:14.829 Casie Aviles: And… that’s what’s causing cancellation change, Han Doom.

342 00:31:15.300 00:31:16.620 Casie Aviles: Oh, okay.

343 00:31:18.220 00:31:20.170 Casie Aviles: And then we can also, like.

344 00:31:20.320 00:31:25.780 Casie Aviles: Take a look at what kind of questions are being… asked.

345 00:31:27.430 00:31:34.010 Pranav: Yeah, well, I guess I just want to make sure that we’re… I’m reading this right, like, this percent needs escalation is the number of

346 00:31:34.160 00:31:38.709 Pranav: Is the percentage of these total tickets that are,

347 00:31:39.240 00:31:43.809 Pranav: getting a thumbs down, right? We’re not wiring that to both… to also be thumbs up.

348 00:31:44.340 00:31:51.110 Casie Aviles: Oh, I think it’s a different definition. It’s… yeah, it was a long time ago when we…

349 00:31:51.760 00:31:56.920 Casie Aviles: defined what needs escalation is. I’m… I don’t remember exactly.

350 00:31:57.390 00:31:58.800 Pranav: Okay, that’s fine.

351 00:31:58.800 00:31:59.530 Casie Aviles: bad.

352 00:31:59.940 00:32:00.920 Casie Aviles: Yeah.

353 00:32:02.400 00:32:06.059 Pranav: Yeah, what we should do here is… this is… that would be a really good…

354 00:32:06.450 00:32:12.270 Pranav: like, filter, though. Needs escalation. I guess it’s basically just thumbs down count, though.

355 00:32:12.440 00:32:14.699 Pranav: But the percentage is nice.

356 00:32:16.740 00:32:19.160 Casie Aviles: Yeah, thumbs down rate. Thumbs down rate, yeah.

357 00:32:19.160 00:32:21.269 Pranav: Yeah, yeah. Okay. That’s just as good.

358 00:32:23.370 00:32:25.220 Pranav: And what is OBTY?

359 00:32:26.070 00:32:29.749 Casie Aviles: Oh, that should be their upsell, which is, oh, by the way.

360 00:32:31.140 00:32:35.279 Casie Aviles: We have… we have to check and make sure, like…

361 00:32:35.400 00:32:40.110 Casie Aviles: Yeah, I have to double-check these. I think these might be stale or…

362 00:32:40.520 00:32:42.530 Casie Aviles: I’m not sure how we’re doing it now.

363 00:32:44.200 00:32:47.749 Casie Aviles: But it’s every time someone clicks on the…

364 00:32:48.300 00:32:53.850 Casie Aviles: the bullseye button in the handy chat. That’s… basically, like.

365 00:32:54.580 00:32:58.899 Casie Aviles: That’s where we… I believe that’s how we track whenever they use, oh, by the way.

366 00:33:00.710 00:33:02.980 Pranav: God, and what is O, by the way, supposed to be?

367 00:33:03.790 00:33:09.529 Casie Aviles: It’s, like, their promos, I believe, and if they want… if they could upsell something.

368 00:33:10.610 00:33:13.219 Pranav: Oh, I see. Okay, okay.

369 00:33:13.540 00:33:17.690 Pranav: So, you would click, oh, by the way, in the middle of a conversation, and then…

370 00:33:18.240 00:33:23.360 Pranav: that’s when you would just bring up… like, if the CSR feels like it’s a good opportunity to upsell, like, it’s just.

371 00:33:23.360 00:33:23.840 Casie Aviles: Yes.

372 00:33:23.840 00:33:25.579 Pranav: conversation. They can.

373 00:33:25.580 00:33:26.480 Casie Aviles: Yeah, exactly.

374 00:33:27.290 00:33:33.250 Pranav: Gotcha. So I haven’t heard about that in a while. I don’t know if they’re using it that much, but it’s good to know.

375 00:33:35.310 00:33:42.569 Pranav: Okay, cool. So yeah, and last week, there was… 881 exchanges.

376 00:33:46.280 00:33:46.980 Pranav: Okay.

377 00:33:47.610 00:33:50.119 Casie Aviles: Yeah. For, yeah, for this week.

378 00:33:51.560 00:34:02.029 Pranav: Okay, this looks pretty good to me. Yeah, I’ll give them the update on, like, the central doc triage. I guess one other thing is, is there anything on transcripts that we were able to research this week?

379 00:34:03.180 00:34:05.130 Casie Aviles: That kind of got pushed.

380 00:34:05.520 00:34:11.509 Casie Aviles: And yeah, we kind of pushed that back, since we were… there was, like, some issues with

381 00:34:12.040 00:34:17.800 Casie Aviles: The filters, and we were just focused on, like, getting the automation done first.

382 00:34:18.320 00:34:19.480 Casie Aviles: Gotcha.

383 00:34:19.480 00:34:21.889 Pranav: Is there anything that I can ask them?

384 00:34:22.199 00:34:28.409 Pranav: to… Basically, just, like, help you out on transcripts.

385 00:34:29.659 00:34:39.259 Casie Aviles: I… I… I don’t think there’s… like, with the problem that we were… that I was facing there when I tried to pull, it’s mostly, like, the 8x8

386 00:34:39.449 00:34:43.849 Casie Aviles: API, which is… Which is not the best.

387 00:34:44.309 00:34:44.849 Casie Aviles: So…

388 00:34:44.850 00:34:45.250 Pranav: Okay.

389 00:34:45.250 00:34:49.050 Casie Aviles: We’re kind of, like, I don’t think they can help much there.

390 00:34:49.050 00:34:58.050 Pranav: Yeah, we probably won’t be able to help much. I think. Just let me know, like, later today or tomorrow on Monday, if, there’s…

391 00:34:58.470 00:35:17.220 Pranav: like, if you’re having issues with, like, the API 8x8 team, or, you know, just with, like, API in general, or maybe the GCP access, like, feel free to just, like, hit me up, and then I can have the conversation with whoever to then get that knowledge back over to you. Or, like, in terms of just, like, escalating things that are, like, blocking us.

392 00:35:18.640 00:35:26.240 Pranav: I think for me, like, I’m realizing, like, my kind of role is to just try to keep the team as unblocked as possible.

393 00:35:26.250 00:35:26.970 Casie Aviles: Okay.

394 00:35:27.370 00:35:35.370 Pranav: Yeah, that’s also, like, Sam, too, like, he should try to do his best to keep y’all unblocked as possible, but, like, we’ll be, like, a team effort in that.

395 00:35:35.530 00:35:41.700 Pranav: So, yeah, just want to keep you aware of, like, you know, all the resources that you have in terms of, like, me, Sam, and then…

396 00:35:41.930 00:35:47.439 Pranav: Yeah, even if, like, we need to bring Utam in to kind of, like, really get ABC’s attention, we could do that.

397 00:35:48.410 00:35:50.689 Casie Aviles: Okay, okay, yeah, I’ll keep that in mind.

398 00:35:51.600 00:35:52.210 Pranav: Cool.

399 00:35:52.560 00:35:56.910 Pranav: Alright, cool, so I’m gonna meet with Janiece in just a few minutes, so let me just get prepped for that.

400 00:35:57.930 00:36:01.119 Casie Aviles: Alright, I guess my question is, will you be…

401 00:36:01.230 00:36:08.490 Casie Aviles: Demoing the automation live, or will it be just showing the comments that we have right now?

402 00:36:09.320 00:36:11.829 Pranav: I’m gonna also demo it live.

403 00:36:13.080 00:36:13.850 Casie Aviles: Okay.

404 00:36:14.280 00:36:16.219 Pranav: Yeah, that’s fine, right?

405 00:36:17.130 00:36:27.110 Casie Aviles: Yeah, like, I was just mentioning earlier, like, the delay, you know, there was a delay that’s happening at randomly, so I wasn’t sure, like, when that would happen or not.

406 00:36:27.540 00:36:30.579 Pranav: Yeah, that’s totally fine. I’m just gonna run it, and then I’m just…

407 00:36:30.720 00:36:43.010 Pranav: as I run it, I’m just gonna scroll up to show them all the other, automations that ran, and then I’ll scroll down, it ran, then I’ll be like, hey, look, it ran. If it didn’t, then I’ll just be like, yeah, it usually takes a few minutes.

408 00:36:43.260 00:36:45.509 Pranav: And then, we’ll just move on to the next thing.

409 00:36:45.940 00:36:49.060 Casie Aviles: Okay, yeah, I just wanted to give you the heads up.

410 00:36:49.330 00:36:50.590 Pranav: Yeah, no, that’s perfect.

411 00:36:50.710 00:36:56.640 Pranav: Can you also just send me that link, since you have it up, of the state machine?

412 00:36:57.650 00:36:58.540 Casie Aviles: Sure, sure.

413 00:36:58.920 00:36:59.540 Casie Aviles: Perfect.

414 00:37:02.910 00:37:05.209 Pranav: And did we also write out the SOP?

415 00:37:06.150 00:37:06.880 Casie Aviles: Sorry?

416 00:37:07.280 00:37:09.890 Pranav: Did we write out the SOP for,

417 00:37:10.630 00:37:12.890 Pranav: Kind of for Janice to, like, read.

418 00:37:15.250 00:37:19.929 Casie Aviles: I don’t have any write-ups for Janice right now.

419 00:37:20.150 00:37:23.830 Casie Aviles: I wasn’t, like, aware that I had to… developed.

420 00:37:23.830 00:37:24.290 Pranav: Yeah.

421 00:37:24.290 00:37:25.090 Casie Aviles: like that.

422 00:37:25.940 00:37:29.269 Pranav: Let me see, maybe that was on Sam’s plate to do?

423 00:37:29.470 00:37:31.320 Pranav: I’ll look into that, no worries.

424 00:37:31.690 00:37:32.460 Casie Aviles: Okay.

425 00:37:33.310 00:37:33.930 Pranav: Yeah.

426 00:37:34.230 00:37:36.290 Casie Aviles: Yeah, I might have missed it, though, but…

427 00:37:36.900 00:37:39.960 Pranav: No, that’s totally fine. That’s totally fine. I’ll figure that out.

428 00:37:40.800 00:37:41.430 Casie Aviles: Okay.

429 00:37:43.390 00:37:46.510 Pranav: Alright. Cool, Casey. I’ll talk to you soon, man. Have a good weekend.

430 00:37:46.870 00:37:48.729 Casie Aviles: Okay, yeah, thank you, Bernov.

431 00:37:49.370 00:37:50.620 Pranav: Yeah, no problem. See ya.

432 00:37:51.010 00:37:51.740 Casie Aviles: See you.