Meeting Title: AI Service Daily Recap - Blockers + Realign Date: 2026-04-28 Meeting participants: Mustafa Raja, Samuel Roberts, Casie Aviles, Pranav
WEBVTT
1 00:00:32.689 ⇒ 00:00:33.590 Mustafa Raja: Hey.
2 00:00:33.710 ⇒ 00:00:34.620 Mustafa Raja: How are you?
3 00:00:40.340 ⇒ 00:00:42.009 Samuel Roberts: Hey guys, how’s it going?
4 00:00:42.650 ⇒ 00:00:44.159 Mustafa Raja: Good. How are you?
5 00:00:44.970 ⇒ 00:00:47.769 Samuel Roberts: Doing alright. I’m trying to get,
6 00:00:50.850 ⇒ 00:00:52.280 Samuel Roberts: Trying to get…
7 00:00:52.680 ⇒ 00:00:57.860 Samuel Roberts: I realized I was… I don’t know, I was just changing my Orca setup a little bit, but, it’s…
8 00:00:58.890 ⇒ 00:01:06.890 Samuel Roberts: I… I was… on their docs, it says that there’s a way to do version control and, like, emit and push from there, but…
9 00:01:07.290 ⇒ 00:01:11.729 Samuel Roberts: I don’t see it. And then I finally found there’s a PR for it, so hopefully that’s coming soon, but…
10 00:01:15.310 ⇒ 00:01:16.029 Samuel Roberts: I think, mate.
11 00:01:16.680 ⇒ 00:01:19.549 Samuel Roberts: What are you guys using right now? Are you guys in Orca with OpenCode right now?
12 00:01:20.750 ⇒ 00:01:25.429 Mustafa Raja: Yes, I am using, Orca with open code, yeah.
13 00:01:25.640 ⇒ 00:01:28.010 Casie Aviles: I’m using just the TUI.
14 00:01:28.740 ⇒ 00:01:29.420 Samuel Roberts: Okay.
15 00:01:30.280 ⇒ 00:01:31.580 Samuel Roberts: Yeah, the.
16 00:01:31.580 ⇒ 00:01:32.469 Mustafa Raja: Are you using Keystone.
17 00:01:32.470 ⇒ 00:01:33.030 Samuel Roberts: I wouldn’t…
18 00:01:33.570 ⇒ 00:01:35.389 Casie Aviles: Just the terminal UI.
19 00:01:35.390 ⇒ 00:01:38.620 Mustafa Raja: Oh, yeah, I’m using this tool, but in, in Orca, you know?
20 00:01:39.260 ⇒ 00:01:44.669 Samuel Roberts: Yeah, you might want to check out Orca Casey. It’s kind of… it’s nice, it’s kind of like a…
21 00:01:45.310 ⇒ 00:01:47.139 Samuel Roberts: Somewhat like a multiplexer.
22 00:01:47.290 ⇒ 00:01:50.880 Samuel Roberts: Where you can have, like, multiple windows and things.
23 00:01:51.310 ⇒ 00:01:54.680 Samuel Roberts: But it also is focused on work trees.
24 00:01:54.790 ⇒ 00:01:59.790 Samuel Roberts: So, each little workspace spins up a new Git work tree for you.
25 00:02:00.940 ⇒ 00:02:02.040 Casie Aviles: I see, yeah.
26 00:02:02.040 ⇒ 00:02:04.069 Samuel Roberts: So it kind of keeps things isolated.
27 00:02:04.900 ⇒ 00:02:09.990 Casie Aviles: Yeah, okay, I’ll give that a try, yeah, because I’m also kind of missing the IDE, but…
28 00:02:10.630 ⇒ 00:02:25.030 Samuel Roberts: Yeah, it has a little bit of a viewer. I keep having to, like, open things in some other editor, but it’s not a bad IDE, but it’s definitely more focused on, like, viewing changes and suggesting things to the AI, which I think makes sense. But you can edit files there, yeah.
29 00:02:26.770 ⇒ 00:02:34.649 Samuel Roberts: Yeah, I think Uten posted about it probably on… The main, team channel a while back.
30 00:02:36.060 ⇒ 00:02:40.169 Samuel Roberts: But yeah, take a look at it. I’m trying to see… there’s a link, let me grab this for you.
31 00:02:40.880 ⇒ 00:02:44.580 Samuel Roberts: It’s been… it’s been nice, it’s not perfect yet, but
32 00:02:45.250 ⇒ 00:02:53.729 Samuel Roberts: they’re definitely working on it a lot, so it’s definitely, like, worth trying out, but, you know. Okay. As with other new tools, you know, your mileage may vary, so we’ll see.
33 00:02:53.870 ⇒ 00:02:58.130 Samuel Roberts: But definitely give it a shot. It’s been… I think it’s been helpful to bounce around, especially.
34 00:02:59.090 ⇒ 00:03:05.570 Casie Aviles: Okay, and were you guys able to set up the… OpenAI there with, with, orca.
35 00:03:06.540 ⇒ 00:03:10.830 Samuel Roberts: So it’s just… you can just run open code in, like, a terminal in Orca, and it’s the…
36 00:03:10.830 ⇒ 00:03:12.489 Casie Aviles: Oh, okay, oh god, no.
37 00:03:12.490 ⇒ 00:03:19.309 Samuel Roberts: Yeah, yeah. Why do you have OpenAI? Do you have that set up for OpenAI? Because I’m just using the, Open Code Zen.
38 00:03:19.630 ⇒ 00:03:22.180 Casie Aviles: Yeah, me too. I’m using the…
39 00:03:22.670 ⇒ 00:03:24.989 Casie Aviles: API key that we were provided.
40 00:03:25.370 ⇒ 00:03:31.180 Samuel Roberts: Yeah, yeah, that’s what I’ve been doing. But, yeah, they shouldn’t… Orca shouldn’t affect that, it just runs your… your agent.
41 00:03:31.310 ⇒ 00:03:33.040 Samuel Roberts: TUI for you.
42 00:03:33.610 ⇒ 00:03:34.350 Casie Aviles: Okay, okay.
43 00:03:34.350 ⇒ 00:03:35.090 Samuel Roberts: enough.
44 00:03:35.850 ⇒ 00:03:36.610 Pranav: Hey, guys.
45 00:03:38.520 ⇒ 00:03:39.270 Samuel Roberts: How’s it going?
46 00:03:40.210 ⇒ 00:03:41.690 Pranav: Pretty good, so…
47 00:03:41.900 ⇒ 00:03:47.109 Pranav: Just looking at the linear board right now. Casey, how is some of the ABC stuff going?
48 00:03:48.440 ⇒ 00:03:52.170 Casie Aviles: Yeah, so I did then invest… I did some digging into…
49 00:03:52.440 ⇒ 00:03:58.220 Casie Aviles: the numbers, and I was just doing a lot of cleanup for the tickets, specifically.
50 00:04:00.290 ⇒ 00:04:02.099 Casie Aviles: I can share my screen.
51 00:04:07.910 ⇒ 00:04:09.440 Casie Aviles: Yeah, so…
52 00:04:09.780 ⇒ 00:04:15.849 Casie Aviles: That’s really what I’m doing right now. I’m doing a lot of cleanup, because a lot of the tickets that were…
53 00:04:18.209 ⇒ 00:04:22.599 Casie Aviles: They were labeled as state new, and they really weren’t moving
54 00:04:23.050 ⇒ 00:04:26.950 Casie Aviles: past that state. That’s why it all kind of piled up.
55 00:04:27.760 ⇒ 00:04:28.829 Casie Aviles: Gotcha. And…
56 00:04:29.320 ⇒ 00:04:31.070 Pranav: They were all assigned to you, right?
57 00:04:32.380 ⇒ 00:04:33.630 Casie Aviles: And… Yeah.
58 00:04:34.560 ⇒ 00:04:37.349 Casie Aviles: That’s what I’ve been doing, so I’ve… I’m…
59 00:04:37.700 ⇒ 00:04:42.890 Casie Aviles: Changing, like, the labels for some of them, so now we should be seeing more.
60 00:04:43.460 ⇒ 00:04:48.160 Casie Aviles: More tickets with different labels, you know, so…
61 00:04:48.310 ⇒ 00:04:50.369 Casie Aviles: That’s really what I’ve been doing here.
62 00:04:50.490 ⇒ 00:04:54.489 Casie Aviles: And I’m just making sure that I’ve got everything right, and I…
63 00:04:54.980 ⇒ 00:04:57.189 Casie Aviles: And it makes sense, you know, like, with the…
64 00:04:57.540 ⇒ 00:05:03.820 Casie Aviles: with the daily memos that we get, or that’s posted. So I want… I’m just making sure that that’s…
65 00:05:04.490 ⇒ 00:05:11.040 Casie Aviles: in line now. But yeah, I have some… I just wrote some stuff here, just in case you guys wanted to check.
66 00:05:12.140 ⇒ 00:05:14.569 Pranav: Perfect. Yeah, that makes sense to me.
67 00:05:14.930 ⇒ 00:05:24.119 Pranav: Okay, so, yeah, for the high volume of triage tickets, that linear task, you’re…
68 00:05:24.220 ⇒ 00:05:31.750 Pranav: Seems like we’re in a pretty good spot. It seems like we kind of fully understand why there was that huge queue of, like, 90 tickets.
69 00:05:32.150 ⇒ 00:05:39.460 Casie Aviles: And… yeah, that’s right. And majority of them… of them were just unassigned tickets, really. You know, these ones.
70 00:05:39.780 ⇒ 00:05:41.590 Casie Aviles: That are just fresh, so…
71 00:05:42.110 ⇒ 00:05:43.530 Pranav: Yep. Yep.
72 00:05:44.730 ⇒ 00:05:47.269 Pranav: Okay, cool, sounds good.
73 00:05:47.400 ⇒ 00:05:55.790 Pranav: How about on just, like, splitting up that SOP? Do you need any help with that? I see that one’s still, like, in Todo, but I’m not sure.
74 00:05:55.790 ⇒ 00:05:56.160 Casie Aviles: Gosh.
75 00:05:56.470 ⇒ 00:05:57.669 Pranav: Gonna move that.
76 00:05:58.100 ⇒ 00:06:04.160 Casie Aviles: Yeah, those are still in to-do, so the only two tickets that I’ve been working on are…
77 00:06:04.850 ⇒ 00:06:08.880 Casie Aviles: That, and yeah, this one. The phone number one.
78 00:06:09.540 ⇒ 00:06:10.140 Pranav: Okay.
79 00:06:10.460 ⇒ 00:06:12.340 Pranav: Cool.
80 00:06:12.340 ⇒ 00:06:16.670 Mustafa Raja: Yeah, I can, I can chip in, ABC, you know.
81 00:06:16.870 ⇒ 00:06:20.650 Mustafa Raja: Eden, I don’t think we have much tasks.
82 00:06:22.050 ⇒ 00:06:25.890 Pranav: Yeah, so, for Eden, I think,
83 00:06:26.320 ⇒ 00:06:29.880 Pranav: the things that I was saying in the channel about setting up that instance.
84 00:06:29.990 ⇒ 00:06:32.489 Pranav: I think we can start working on that now.
85 00:06:32.700 ⇒ 00:06:33.430 Pranav: Yeah, I don’.
86 00:06:33.430 ⇒ 00:06:34.689 Samuel Roberts: Just opened a workspace for that.
87 00:06:37.580 ⇒ 00:06:39.090 Pranav: A workspace for that?
88 00:06:39.220 ⇒ 00:06:40.230 Mustafa Raja: What do you mean? Oh, sorry.
89 00:06:40.230 ⇒ 00:06:42.510 Samuel Roberts: Yeah, I just I spun up another side
90 00:06:42.920 ⇒ 00:06:46.210 Samuel Roberts: Yeah, we were just talking about Orca. But yeah, it’s… I’m… I’m working on that now.
91 00:06:46.420 ⇒ 00:06:48.510 Samuel Roberts: Putting a plan together and letting it execute.
92 00:06:48.650 ⇒ 00:06:53.550 Samuel Roberts: I think… what I said is probably how it’ll go, where I’ll,
93 00:06:53.740 ⇒ 00:06:56.169 Samuel Roberts: Add another agent that’s, like, Danny-specific.
94 00:06:56.420 ⇒ 00:06:59.550 Samuel Roberts: And then we can run the questions through both of them.
95 00:07:01.500 ⇒ 00:07:05.959 Pranav: Okay, cool. Is there a way to set that up so Mustafa can help you with that?
96 00:07:06.900 ⇒ 00:07:07.430 Pranav: And if not.
97 00:07:08.410 ⇒ 00:07:09.460 Pranav: other stuff.
98 00:07:09.460 ⇒ 00:07:15.699 Samuel Roberts: Yeah, I think it’s… I mean, I’m just gonna… I’m… it’s not really, like, a multiple-piece thing right now, I’m just putting the plan together, but,
99 00:07:16.100 ⇒ 00:07:18.969 Samuel Roberts: I think we’re probably pretty good. Yeah, I think so.
100 00:07:18.970 ⇒ 00:07:23.379 Pranav: Yeah, so then, Mustafa, maybe what you can work on then is just the co-pilot kit?
101 00:07:23.930 ⇒ 00:07:24.450 Mustafa Raja: Yeah.
102 00:07:24.860 ⇒ 00:07:27.269 Pranav: Wherever we’re at with that, let’s just try to close that out.
103 00:07:27.400 ⇒ 00:07:29.040 Mustafa Raja: Okay, yeah, that works.
104 00:07:30.530 ⇒ 00:07:36.100 Samuel Roberts: Yeah, Copilot Kit, I think, the pass I did was really… did you look at it yet?
105 00:07:36.440 ⇒ 00:07:41.329 Mustafa Raja: I see the PR, I haven’t taken a deeper look into that, but I can, you know…
106 00:07:41.480 ⇒ 00:07:43.169 Mustafa Raja: I’ll take over that from there.
107 00:07:43.880 ⇒ 00:07:52.160 Samuel Roberts: Yeah, I ran it, I got it, I made sure that it was, like, working. I think one thing that’ll be nice is some of those suggestions at the bottom. It’ll give you, like, little,
108 00:07:52.720 ⇒ 00:07:57.459 Samuel Roberts: you know, things you can press to ask follow-up questions and things. There might be some other things to explore, because it…
109 00:07:58.070 ⇒ 00:07:59.790 Samuel Roberts: excuse me, I haven’t, like, looked at…
110 00:08:00.050 ⇒ 00:08:02.340 Samuel Roberts: Any new features that they’ve added, but…
111 00:08:02.720 ⇒ 00:08:04.859 Samuel Roberts: Take a look at that, too. And then, yeah.
112 00:08:04.860 ⇒ 00:08:06.949 Pranav: Gotcha. And also,
113 00:08:08.030 ⇒ 00:08:16.709 Pranav: for the… getting the email message context in the tool, Mustafa, I assigned that one to you.
114 00:08:17.630 ⇒ 00:08:20.400 Pranav: I’m not sure, Sam, if you were working on that or what.
115 00:08:20.940 ⇒ 00:08:24.499 Samuel Roberts: Yeah, that was part of the same… I just tweaked the…
116 00:08:24.600 ⇒ 00:08:31.460 Samuel Roberts: instructions for it, because we already had the scope, it was just limiting it because of the PII stuff, so I have that kind of in there now.
117 00:08:32.559 ⇒ 00:08:34.529 Pranav: Okay, so is that done?
118 00:08:36.250 ⇒ 00:08:44.160 Samuel Roberts: Yeah. Yeah, the tool… the tool calls emails now. I ran a few evals against it. It… it… it’s still, like, not getting everything.
119 00:08:44.820 ⇒ 00:08:45.240 Pranav: Right, right.
120 00:08:45.240 ⇒ 00:08:45.580 Samuel Roberts: the…
121 00:08:45.580 ⇒ 00:08:45.970 Pranav: fair.
122 00:08:45.970 ⇒ 00:08:50.160 Samuel Roberts: But yeah, it’s getting more, and I think now that I can add the Danny,
123 00:08:50.370 ⇒ 00:08:52.920 Samuel Roberts: the Danny-specific agent, we’ll see.
124 00:08:53.070 ⇒ 00:08:57.670 Samuel Roberts: what’s coming from where. I did have a script that I threw in there, too, to actually just, like.
125 00:08:58.100 ⇒ 00:09:00.040 Samuel Roberts: have the…
126 00:09:00.470 ⇒ 00:09:14.419 Samuel Roberts: have open code go through a bunch of stuff and look to make sure that the sources actually mention some of those things, in case there were, like, other sources that they were using. And so it seems like it’s there somewhere, it’s just kind of directing the command center agent to find those, at runtime, so…
127 00:09:14.920 ⇒ 00:09:15.580 Samuel Roberts: That’s awesome.
128 00:09:15.580 ⇒ 00:09:16.260 Pranav: So then…
129 00:09:16.260 ⇒ 00:09:16.770 Samuel Roberts: Yeah.
130 00:09:17.300 ⇒ 00:09:22.630 Pranav: Okay, that sounds good. What about for just, like, pulling Google Drive?
131 00:09:23.030 ⇒ 00:09:25.430 Pranav: Data.
132 00:09:26.520 ⇒ 00:09:32.280 Samuel Roberts: Yeah, that was, that permission was already there, because we needed that for the meeting notes.
133 00:09:32.890 ⇒ 00:09:45.750 Samuel Roberts: They’re just drive documents, so that, same thing, I updated the agent, or the tool, and the instructions so that the agent now gets context, or gets content to add to the context for that, so…
134 00:09:46.200 ⇒ 00:09:54.009 Pranav: Okay, cool. And is that just basically updating, like, a prompt somewhere, or is there… what is kind of, like, the complexity of updating these tools?
135 00:09:54.510 ⇒ 00:10:04.640 Samuel Roberts: Yeah, so, I mean, the tools have, like, a definition, and they have some logic. The definition is what the agent gets exposed to initially, and then that is,
136 00:10:05.440 ⇒ 00:10:10.360 Samuel Roberts: You know, passed in so it knows how to call them properly and what, what inputs it needs.
137 00:10:10.590 ⇒ 00:10:17.669 Samuel Roberts: And so, it… there’s a little bit of tuning I think we’re gonna have to do there, where, like, sometimes it’ll just do a search for…
138 00:10:17.900 ⇒ 00:10:22.960 Samuel Roberts: what I was working on before, after I did that, was updating the,
139 00:10:23.510 ⇒ 00:10:28.309 Samuel Roberts: the system prompt for it to not just search for, like.
140 00:10:28.600 ⇒ 00:10:35.660 Samuel Roberts: you know, initiatives or something, like, to do a bigger query initially to, like, identify initiatives and then search for them, kind of thing.
141 00:10:36.260 ⇒ 00:10:36.880 Pranav: Yeah.
142 00:10:36.880 ⇒ 00:10:42.469 Samuel Roberts: But yeah, it’s really just updating the tool description, and then making sure that it returns the right content.
143 00:10:42.590 ⇒ 00:10:48.119 Samuel Roberts: And that was, you know, the… because the scope was already there, it was easy to just update that.
144 00:10:49.860 ⇒ 00:10:53.329 Pranav: Okay, so both of these should I just put in done? Are they already in production?
145 00:10:53.330 ⇒ 00:11:01.559 Samuel Roberts: They are not in production yet, they’re not in dev yet either, but I would say, like, internal review, for now.
146 00:11:01.760 ⇒ 00:11:14.609 Samuel Roberts: I think I… I would say internal review, and I’ll mark them as done once I, like, get this Danny-specific one up and running, and we can run some tests and see if we need to, but effectively, they’re… the tools are done, they’re just not merged in yet, because I’m still iterating.
147 00:11:15.390 ⇒ 00:11:16.679 Pranav: Okay, sounds good.
148 00:11:20.270 ⇒ 00:11:29.439 Pranav: Okay, yeah, we’ll figure out what we want to define these statuses at later. Internal review, I kind of think, is the same as PR review.
149 00:11:30.500 ⇒ 00:11:37.869 Samuel Roberts: Yeah, I guess it’s kind of more PR review, right? I haven’t… I think there might be a PR there, I’m not sure what I did, but I was just… I… the other side of it is, like, I’m kind of…
150 00:11:38.280 ⇒ 00:11:43.190 Samuel Roberts: Building off of the other branches, because I don’t want to wait for those to get in, in order to keep moving.
151 00:11:43.600 ⇒ 00:11:45.340 Pranav: Yeah, that’s fine.
152 00:11:45.340 ⇒ 00:11:46.850 Samuel Roberts: They’re a little bit like stacked ifs, but…
153 00:11:46.850 ⇒ 00:11:48.820 Pranav: What they should be later, yeah.
154 00:11:48.820 ⇒ 00:11:49.300 Samuel Roberts: Okay.
155 00:11:49.300 ⇒ 00:11:56.439 Pranav: Okay, cool. So then, let’s see… where is the task that I made a little bit earlier today?
156 00:12:06.390 ⇒ 00:12:11.109 Pranav: Okay, so Mustafa, how… I see that you made a ticket for, the URL mapping.
157 00:12:11.470 ⇒ 00:12:12.540 Pranav: Yeah, that’s.
158 00:12:12.690 ⇒ 00:12:13.390 Mustafa Raja: That is optional.
159 00:12:13.390 ⇒ 00:12:14.830 Samuel Roberts: That’s good. Yep.
160 00:12:14.970 ⇒ 00:12:16.030 Pranav: Oh, that’s already done.
161 00:12:16.210 ⇒ 00:12:16.850 Mustafa Raja: Yeah.
162 00:12:18.430 ⇒ 00:12:22.230 Samuel Roberts: Yeah, because when you shared that link, I wasn’t sure if it was the most recent chat or not, and I realized we just needed to…
163 00:12:22.230 ⇒ 00:12:22.610 Pranav: Yeah.
164 00:12:22.610 ⇒ 00:12:23.000 Samuel Roberts: an app that.
165 00:12:23.000 ⇒ 00:12:29.819 Pranav: I noticed… I saw that it didn’t, like, show, like, for a specific thread either, so I was just like, okay, you guys will figure that out.
166 00:12:29.820 ⇒ 00:12:35.759 Samuel Roberts: Yeah, that’s what… it was easy to tell which one you meant, but I realized, like, if we’re gonna be sharing things, you know, it makes a lot more sense to have it.
167 00:12:36.110 ⇒ 00:12:39.210 Mustafa Raja: That is actually in, dev right now, let me know if…
168 00:12:40.030 ⇒ 00:12:41.029 Mustafa Raja: Let me know if I should…
169 00:12:41.390 ⇒ 00:12:42.969 Pranav: Production yet, right?
170 00:12:42.970 ⇒ 00:12:47.479 Mustafa Raja: No, it’s in Dev. Right now, so let me know if I should, you know…
171 00:12:48.140 ⇒ 00:12:51.850 Mustafa Raja: Push it through dev… oh, sorry, push it through prod also.
172 00:12:52.430 ⇒ 00:12:54.930 Pranav: Yeah, I’ll just put it in internal review as well.
173 00:12:56.630 ⇒ 00:13:04.580 Samuel Roberts: Yeah, I think this is one of the things where we can probably, like, even, like, end of the day, move everything up through, or, you know, early tomorrow, do the same thing.
174 00:13:04.580 ⇒ 00:13:06.000 Pranav: Period. So we can test.
175 00:13:06.000 ⇒ 00:13:06.630 Samuel Roberts: Yeah.
176 00:13:06.630 ⇒ 00:13:07.240 Pranav: Yeah.
177 00:13:07.990 ⇒ 00:13:08.870 Pranav: Okay.
178 00:13:11.690 ⇒ 00:13:20.220 Samuel Roberts: Yeah, I don’t think we necessarily need to be, like, continuously pushing everything out, because it just takes a while to build, and it’s not necessarily worth the downtime, or not the downtime, but the waiting around, but,
179 00:13:22.710 ⇒ 00:13:28.330 Samuel Roberts: Yeah, like a… Release kind of thing, on, like, a… Daily.
180 00:13:28.910 ⇒ 00:13:33.380 Samuel Roberts: Or, you know, whatever, however, whenever we get a few more updates like that, I think it’s worth it.
181 00:13:36.510 ⇒ 00:13:37.210 Pranav: Yo.
182 00:13:40.160 ⇒ 00:13:46.110 Pranav: Okay, that’s why… created a ticket, but I went into the…
183 00:13:46.420 ⇒ 00:13:48.329 Pranav: Went into Eden and not Eden AI.
184 00:13:48.650 ⇒ 00:13:55.209 Samuel Roberts: I don’t know why it keeps doing… like, it does ABC sometimes, it does… yeah, it’s not… I don’t know what linear’s up to there, but…
185 00:14:32.990 ⇒ 00:14:37.379 Casie Aviles: Oh, sorry, while I have you guys here, I guess I have a question,
186 00:14:38.300 ⇒ 00:14:45.419 Casie Aviles: This is… I already asked this in the channel, but I guess just to show you guys what I mean.
187 00:14:46.290 ⇒ 00:14:53.350 Casie Aviles: So there’s… so I mentioned that they… some of the tickets, they’ve already, like, suggested it in the central doc, so…
188 00:14:53.930 ⇒ 00:15:01.069 Casie Aviles: I would just run it myself, or should the trainers be running the automation? I mean…
189 00:15:01.570 ⇒ 00:15:09.750 Pranav: Yeah, you can just run it yourself, just so you can just run them all right now, and then essentially create a report to assess
190 00:15:10.350 ⇒ 00:15:19.029 Pranav: What was the trainer’s feedback? And then we can basically be the human in the loop to say, okay, the trainer said this, automation said this.
191 00:15:19.840 ⇒ 00:15:24.869 Pranav: Is the automation right, or is this trainer right? Are they both saying the same thing, and they’re both right?
192 00:15:25.400 ⇒ 00:15:29.520 Pranav: Yeah, so to answer your question, let’s just run it ourselves.
193 00:15:30.730 ⇒ 00:15:31.430 Casie Aviles: Okay.
194 00:15:31.800 ⇒ 00:15:37.590 Pranav: Yeah, and then at the end of this, you said there’s, like, 13 tickets, right? If you can just generate a…
195 00:15:38.050 ⇒ 00:15:49.629 Pranav: or just… it doesn’t need to generate any, like, you can just create, like, a… just, like, update us in Slack, saying, okay, this is kind of what the breakdown was of these 13 tickets, like, how the automation performed.
196 00:15:50.110 ⇒ 00:15:54.450 Pranav: Just so we can… Have a little bit more information about how these
197 00:15:54.780 ⇒ 00:15:58.960 Pranav: Automations are actually doing for real triage tickets.
198 00:16:00.350 ⇒ 00:16:01.569 Casie Aviles: Okay, okay, yeah.
199 00:16:02.110 ⇒ 00:16:10.380 Casie Aviles: That’s cool. Yeah, because I was thinking if the trainers should be the ones doing, like, the comments, right, submitting them, but…
200 00:16:10.980 ⇒ 00:16:11.790 Casie Aviles: Okay.
201 00:16:12.360 ⇒ 00:16:19.039 Pranav: Yeah, I mean, they technically should, but this is for, like, those 13 tickets that you noticed,
202 00:16:20.060 ⇒ 00:16:24.040 Pranav: Right, that they just, like, put a comment like this, right?
203 00:16:24.460 ⇒ 00:16:25.270 Casie Aviles: Yeah.
204 00:16:25.270 ⇒ 00:16:33.920 Pranav: Yeah. So… There’s also other… so, of the other tickets.
205 00:16:35.010 ⇒ 00:16:39.339 Pranav: that aren’t… that aren’t these 13. What is kind of going on with those?
206 00:16:40.820 ⇒ 00:16:48.570 Casie Aviles: They’re, they’re in… Some of them I already closed, actually, since they’ve already been…
207 00:16:49.130 ⇒ 00:16:56.260 Casie Aviles: Added in the central dock, so I think that what they were… what the trainers were just asking of me was to check if…
208 00:16:56.870 ⇒ 00:17:05.649 Casie Aviles: You know, if they’ve been added, and if Andy is able to query that, and I was able to check those, so I marked those as done.
209 00:17:07.020 ⇒ 00:17:12.520 Pranav: Okay, interesting. They all have access to the central dock, so they should be able to see themselves.
210 00:17:12.970 ⇒ 00:17:14.480 Pranav: But, okay, that’s a…
211 00:17:14.900 ⇒ 00:17:21.270 Casie Aviles: There were some… Suggestions made, yeah, like… yeah, like these ones, for example.
212 00:17:22.520 ⇒ 00:17:27.260 Casie Aviles: And then some of them were already added, where there’s only, like, 4 of those.
213 00:17:27.680 ⇒ 00:17:30.489 Casie Aviles: And then there’s more, like, under to-do.
214 00:17:30.970 ⇒ 00:17:32.570 Casie Aviles: Which are…
215 00:17:32.780 ⇒ 00:17:37.259 Pranav: So, what that’s telling me, too, is we should just turn off comments in the central docs.
216 00:17:40.280 ⇒ 00:17:42.729 Samuel Roberts: Can we just lock it down so that, like…
217 00:17:43.020 ⇒ 00:17:46.910 Samuel Roberts: They can view, but not edit, or suggest, even.
218 00:17:47.910 ⇒ 00:17:53.360 Pranav: Yeah, there’s a viewer, permission that I can give everybody, I’m just gonna…
219 00:17:53.360 ⇒ 00:17:53.830 Samuel Roberts: Yeah.
220 00:17:53.830 ⇒ 00:17:54.609 Pranav: Put it to that.
221 00:17:55.180 ⇒ 00:17:59.050 Samuel Roberts: Yeah, I just keep the, I guess, our account to be the one that doesn’t…
222 00:18:00.150 ⇒ 00:18:00.740 Pranav: Yup.
223 00:18:26.050 ⇒ 00:18:34.279 Casie Aviles: Okay, yeah, and the other tickets are in Todo, and most of them are zip code related. That’s why they’re in To Do for me.
224 00:18:37.890 ⇒ 00:18:39.320 Pranav: Okay, gotcha.
225 00:18:41.960 ⇒ 00:18:46.770 Casie Aviles: So, ideally, this should be batched in, if I understand correctly.
226 00:18:47.940 ⇒ 00:18:52.979 Casie Aviles: If they’re in to do, then… Yeah, I’m clear.
227 00:19:30.130 ⇒ 00:19:32.099 Pranav: This is shared with so many people.
228 00:19:40.710 ⇒ 00:19:44.020 Pranav: I didn’t even know Zoran, Ashwini were ever even on this project.
229 00:20:06.260 ⇒ 00:20:08.379 Pranav: Okay, just updated that.
230 00:20:11.100 ⇒ 00:20:11.540 Casie Aviles: Okay.
231 00:20:11.540 ⇒ 00:20:16.530 Pranav: So, yeah, there’s a few tickets that are in progress,
232 00:20:18.480 ⇒ 00:20:24.550 Pranav: So, Sam, you said you’re gonna work on the… The agent for evals.
233 00:20:25.040 ⇒ 00:20:33.990 Pranav: Let me update… the… Copilot kit ticket to… assign that to Mustafa.
234 00:20:37.090 ⇒ 00:20:47.459 Pranav: And then, there’s also just this PR ticket. Mustafa, if you just want to take a look at this, let us know if there’s anything pending here. It was assigned to Uten before, but…
235 00:20:47.870 ⇒ 00:20:49.580 Pranav: I think let’s just.
236 00:20:49.720 ⇒ 00:20:53.600 Mustafa Raja: That is one of our… Yeah, let me take a look, which one…
237 00:20:54.590 ⇒ 00:20:55.960 Pranav: I just assigned it to you.
238 00:20:56.450 ⇒ 00:20:57.100 Mustafa Raja: Okay.
239 00:20:58.620 ⇒ 00:21:00.479 Samuel Roberts: I’ll review apps for new PRs.
240 00:21:01.820 ⇒ 00:21:02.660 Samuel Roberts: Is that the one you’re talking about.
241 00:21:02.660 ⇒ 00:21:10.349 Pranav: Yeah, it’s probably, like, very old, nothing for us to adjust there, but… before I close it out, you guys…
242 00:21:11.560 ⇒ 00:21:13.589 Samuel Roberts: Yeah, I wonder…
243 00:21:23.380 ⇒ 00:21:28.680 Samuel Roberts: Yeah, I think the idea here was, like, like Railway, where it just spins up instances for every PR.
244 00:21:28.860 ⇒ 00:21:30.260 Samuel Roberts: How do we set that up on…
245 00:21:30.830 ⇒ 00:21:33.319 Mustafa Raja: Yes, this should be fully viewed.
246 00:21:37.060 ⇒ 00:21:39.279 Samuel Roberts: Is it already set up, is that what you’re saying?
247 00:21:39.590 ⇒ 00:21:42.999 Mustafa Raja: No, Utam wanted to set this up, I know that.
248 00:21:43.230 ⇒ 00:21:46.340 Mustafa Raja: Automoter to set up, review apps.
249 00:21:46.620 ⇒ 00:21:47.319 Mustafa Raja: For beers.
250 00:21:47.320 ⇒ 00:21:47.830 Samuel Roberts: app.
251 00:21:48.090 ⇒ 00:21:54.449 Samuel Roberts: Yeah, yeah. Oh, that’s what you meant by review, yeah, I see, yeah, I see. Yeah, I mean, it’s worth exploring, especially if we can…
252 00:21:54.700 ⇒ 00:21:55.550 Samuel Roberts: you know.
253 00:21:55.980 ⇒ 00:22:01.209 Samuel Roberts: I don’t know if, you know, how easy it is to get Cloud Run to do that automatically, but we may have to just set up some…
254 00:22:01.210 ⇒ 00:22:03.469 Mustafa Raja: Yeah, I’d like to jump in.
255 00:22:04.460 ⇒ 00:22:09.720 Samuel Roberts: Yeah, I think, yeah, that’d be good.
256 00:22:11.700 ⇒ 00:22:17.889 Pranav: Okay, cool. Yeah, I feel like for Eden, all the stuff that’s in progress, internal review, PR review.
257 00:22:18.540 ⇒ 00:22:25.099 Pranav: We can probably close those out pretty soon. I think that should try to be our goal.
258 00:22:25.250 ⇒ 00:22:32.990 Pranav: To at least make progress on a lot of these by end of day, and then probably, like, end of tomorrow, we’ll be able to just, like, completely close them.
259 00:22:36.100 ⇒ 00:22:37.220 Pranav: How does that sound? It’s like…
260 00:22:37.220 ⇒ 00:22:37.580 Samuel Roberts: Yeah.
261 00:22:37.580 ⇒ 00:22:39.000 Pranav: V7s that are in there.
262 00:22:40.150 ⇒ 00:22:42.510 Samuel Roberts: Yeah, I’m looking… yeah, that would make sense.
263 00:22:42.630 ⇒ 00:22:44.840 Samuel Roberts: Yeah, yeah, I think so.
264 00:22:49.820 ⇒ 00:22:57.679 Pranav: Okay. Design Identity Mapping Schema… This one that’s in PR review, I think, is done.
265 00:23:01.000 ⇒ 00:23:02.029 Pranav: Yeah, I’m just gonna move this.
266 00:23:02.030 ⇒ 00:23:05.890 Samuel Roberts: Yeah… Oh, yeah, this goes way back. This is… yeah, yeah, yeah.
267 00:23:07.180 ⇒ 00:23:09.579 Pranav: Yeah, so it’s just these 6 tickets. Okay.
268 00:23:10.330 ⇒ 00:23:19.160 Pranav: Cool, guys. One other thing, and I should just create a… probably a ticket for…
269 00:23:20.640 ⇒ 00:23:23.569 Pranav: maybe Sam, if you want to…
270 00:23:23.810 ⇒ 00:23:28.979 Pranav: Or actually, yeah, maybe Mustafa, this would be good for you, actually. If you can just do a quick, like…
271 00:23:30.740 ⇒ 00:23:40.749 Pranav: Zoom… Zoom recording of… Basically, I just want to show the evaluations.
272 00:23:44.930 ⇒ 00:24:00.930 Pranav: Okay, actually, on second thought, that’s probably a better thing to do tomorrow. So, I’ll create the ticket, but once we have the new agent set up and the automation to run evals based on… probably it’s gonna be connected to QA. Whenever we add a… ask a question into the QA,
273 00:24:00.930 ⇒ 00:24:09.049 Pranav: like Master Studio, it runs probably two agents simultaneously, one in the background, one in the UI, I guess.
274 00:24:09.140 ⇒ 00:24:12.449 Pranav: And there’ll be an evaluation based on the output of both.
275 00:24:12.700 ⇒ 00:24:13.690 Pranav: Does that sound about right?
276 00:24:13.690 ⇒ 00:24:19.820 Samuel Roberts: Yeah, I’m trying to figure out the best way to, like, architect it within Mastra, but that’s effectively what I’m trying to do.
277 00:24:20.600 ⇒ 00:24:22.360 Pranav: Okay, cool.
278 00:24:24.710 ⇒ 00:24:29.090 Pranav: Yeah, I think you two can probably figure out, like.
279 00:24:29.360 ⇒ 00:24:35.940 Pranav: Once that’s done, creating just a Loom recording, or a Zoom recording of that should be pretty straightforward.
280 00:24:37.530 ⇒ 00:24:40.970 Samuel Roberts: Yeah, yeah, we can do that tomorrow once this is ideally up and running, so…
281 00:24:42.000 ⇒ 00:24:55.059 Pranav: Cool, cool. Okay. Yeah, I think we’re, all set then. Tomorrow, I’ll have more information on transcripts. I have a meeting set up. I’m talking to Yvette right now. I’ll have a meeting set up with her tomorrow, hopefully.
282 00:24:58.460 ⇒ 00:25:00.849 Pranav: Okay. Cool, guys. I think we’re all set then.
283 00:25:01.880 ⇒ 00:25:02.440 Samuel Roberts: Funny.
284 00:25:03.450 ⇒ 00:25:04.130 Pranav: Yep.
285 00:25:04.130 ⇒ 00:25:04.920 Casie Aviles: Thank you.
286 00:25:05.690 ⇒ 00:25:06.639 Pranav: Yup, see you guys.
287 00:25:07.310 ⇒ 00:25:07.730 Samuel Roberts: Thank you.