Meeting Title: AI Service Morning Huddle Date: 2026-05-04 Meeting participants: Mustafa Raja, Casie Aviles, Samuel Roberts, Pranav Narahari
WEBVTT
1 00:00:21.170 ⇒ 00:00:22.189 Samuel Roberts: Hey guys.
2 00:00:22.980 ⇒ 00:00:23.700 Mustafa Raja: P.
3 00:00:25.740 ⇒ 00:00:27.080 Samuel Roberts: How we doing today?
4 00:00:27.650 ⇒ 00:00:28.680 Mustafa Raja: Good, how are you?
5 00:00:29.350 ⇒ 00:00:32.359 Samuel Roberts: Doing alright, doing alright. How was everyone’s weekend?
6 00:00:33.730 ⇒ 00:00:36.989 Mustafa Raja: I had some guests over for the weekend.
7 00:00:37.440 ⇒ 00:00:38.280 Samuel Roberts: Oh, nice.
8 00:00:38.280 ⇒ 00:00:39.580 Mustafa Raja: Family, yeah.
9 00:00:40.020 ⇒ 00:00:40.910 Samuel Roberts: Good, good.
10 00:00:41.890 ⇒ 00:00:42.830 Mustafa Raja: How about you?
11 00:00:43.730 ⇒ 00:00:48.919 Samuel Roberts: Yeah, I’m actually at my parents’ house, in Boston, this week.
12 00:00:49.220 ⇒ 00:01:00.699 Samuel Roberts: So, it was… I drove out, I had a, like, a birthday party this weekend, and a, like, reception at my high school for an old teacher of mine, and it was nice. It was a good weekend.
13 00:01:01.690 ⇒ 00:01:02.699 Mustafa Raja: Yeah, that’s nice.
14 00:01:02.870 ⇒ 00:01:04.459 Samuel Roberts: Yeah, yeah, yeah. How about you, Casey?
15 00:01:06.190 ⇒ 00:01:06.980 Casie Aviles: Hey guys.
16 00:01:07.360 ⇒ 00:01:08.460 Casie Aviles: Can you hear me?
17 00:01:08.620 ⇒ 00:01:09.420 Casie Aviles: Yep.
18 00:01:09.420 ⇒ 00:01:09.980 Mustafa Raja: Yep.
19 00:01:11.050 ⇒ 00:01:16.480 Casie Aviles: For the weekend, we just had our dog, spayed, so…
20 00:01:19.020 ⇒ 00:01:20.219 Samuel Roberts: You have what? Sorry?
21 00:01:20.420 ⇒ 00:01:28.220 Casie Aviles: I think it’s the… it’s so… so the dog doesn’t, you know, get pregnant anymore. I mean…
22 00:01:28.620 ⇒ 00:01:32.319 Samuel Roberts: Oh, yeah, yeah, yep, yep, you had a space. Oh, okay, yeah, how is… how was the party doing?
23 00:01:32.910 ⇒ 00:01:35.060 Casie Aviles: Yeah, they’re healing up.
24 00:01:35.260 ⇒ 00:01:37.930 Casie Aviles: The surgery just finished, but…
25 00:01:38.590 ⇒ 00:01:41.390 Samuel Roberts: Wow, okay. Yeah, that’s never fun for the animal.
26 00:01:41.500 ⇒ 00:01:42.639 Casie Aviles: That’s true.
27 00:01:42.930 ⇒ 00:01:44.420 Samuel Roberts: Yeah. Super known.
28 00:01:45.640 ⇒ 00:01:46.669 Mustafa Raja: I didn’t know you had a dog.
29 00:01:47.450 ⇒ 00:01:52.680 Casie Aviles: Oh, we do. I’m not sure if you guys would hear them. They would bark all the way.
30 00:01:53.270 ⇒ 00:01:55.909 Samuel Roberts: Yeah, Zoom’s pretty good at canceling that out, because my.
31 00:01:55.910 ⇒ 00:01:56.290 Pranav Narahari: Yeah.
32 00:01:56.290 ⇒ 00:01:57.890 Samuel Roberts: The same thing in the background.
33 00:02:02.120 ⇒ 00:02:04.150 Pranav Narahari: How was, Friday for you, Casey?
34 00:02:04.450 ⇒ 00:02:05.029 Pranav Narahari: I’m doing pretty.
35 00:02:05.030 ⇒ 00:02:05.820 Samuel Roberts: Oh, yeah.
36 00:02:07.840 ⇒ 00:02:16.009 Casie Aviles: Hello? Oh, yeah, I was just talking about my dog… our dog getting spayed, so… so, yeah.
37 00:02:16.600 ⇒ 00:02:17.110 Pranav Narahari: Okay.
38 00:02:17.540 ⇒ 00:02:20.079 Pranav Narahari: You said Friday was, like, a holiday, right?
39 00:02:20.500 ⇒ 00:02:24.230 Casie Aviles: Oh, for… yeah, I mean, we did that over the weekend.
40 00:02:24.630 ⇒ 00:02:25.180 Casie Aviles: Okay.
41 00:02:25.180 ⇒ 00:02:26.390 Pranav Narahari: Cool. Nice.
42 00:02:26.390 ⇒ 00:02:30.760 Casie Aviles: itself was just… I just chilled, because it was, you know…
43 00:02:31.440 ⇒ 00:02:32.070 Samuel Roberts: Yeah.
44 00:02:32.070 ⇒ 00:02:32.770 Pranav Narahari: Yes.
45 00:02:34.110 ⇒ 00:02:34.970 Samuel Roberts: Good, good.
46 00:02:35.170 ⇒ 00:02:35.770 Samuel Roberts: How you doing?
47 00:02:35.770 ⇒ 00:02:36.410 Pranav Narahari: move.
48 00:02:36.910 ⇒ 00:02:42.570 Pranav Narahari: I’m doing pretty good. I’m doing pretty good. Yeah, I feel like last week just, like.
49 00:02:42.730 ⇒ 00:02:48.110 Pranav Narahari: everything just caught up on Friday. Oh yeah, you guys weren’t in on Friday. I ended up taking the day off.
50 00:02:48.310 ⇒ 00:02:51.389 Samuel Roberts: Yeah, I saw the messages when I was… and I got on this morning, that’s why I was wondering how you’re feeling.
51 00:02:51.390 ⇒ 00:02:52.100 Pranav Narahari: Yeah.
52 00:02:52.350 ⇒ 00:02:57.500 Pranav Narahari: Yeah, no, I’m feeling good. But,
53 00:02:58.000 ⇒ 00:03:05.589 Pranav Narahari: Yeah, yeah, yeah, I just ended up taking it off. Mostly just because, too, like, it was a pretty open day, there wasn’t much.
54 00:03:05.590 ⇒ 00:03:05.999 Samuel Roberts: What’s going on?
55 00:03:06.000 ⇒ 00:03:13.690 Pranav Narahari: You know, you two are out, and so I was just like, okay, this is a good opportunity for me to take a break.
56 00:03:13.690 ⇒ 00:03:15.789 Samuel Roberts: Yeah, a little recovery is always good when it’s…
57 00:03:15.790 ⇒ 00:03:16.190 Pranav Narahari: Yeah.
58 00:03:16.190 ⇒ 00:03:17.360 Samuel Roberts: I’m pour in.
59 00:03:17.360 ⇒ 00:03:18.990 Pranav Narahari: Exactly, yeah.
60 00:03:19.180 ⇒ 00:03:30.189 Pranav Narahari: So, okay, cool. Today, I have my ABC meeting, and then Eden meeting.
61 00:03:30.610 ⇒ 00:03:37.650 Pranav Narahari: I’m not sure. We’ll see. I have a meeting with Robert tomorrow to hopefully discuss that further. But
62 00:03:37.880 ⇒ 00:03:41.879 Pranav Narahari: Let’s, start with ABC. So…
63 00:03:44.720 ⇒ 00:03:47.529 Pranav Narahari: Let me… let me take a look at Linear real quick.
64 00:04:09.730 ⇒ 00:04:16.940 Pranav Narahari: Okay, yeah, Casey, I see that you… you probably created this to investigate and propose solution for resolving manager roles in Andy’s knowledge.
65 00:04:17.990 ⇒ 00:04:19.659 Casie Aviles: Oh, yeah, yeah, this was from…
66 00:04:19.899 ⇒ 00:04:22.360 Casie Aviles: The feedback that we got from them.
67 00:04:23.110 ⇒ 00:04:23.540 Pranav Narahari: Gotcha.
68 00:04:23.700 ⇒ 00:04:25.520 Casie Aviles: So this is still in to-do.
69 00:04:28.000 ⇒ 00:04:28.560 Pranav Narahari: Okay.
70 00:04:30.700 ⇒ 00:04:32.810 Pranav Narahari: So this is feedback from…
71 00:04:35.410 ⇒ 00:04:35.920 Casie Aviles: Trust me.
72 00:04:35.920 ⇒ 00:04:37.519 Pranav Narahari: internal channel. Yeah.
73 00:04:37.520 ⇒ 00:04:43.660 Casie Aviles: And then also from the users, you know, the ones we get from the thumbs down.
74 00:04:45.160 ⇒ 00:04:53.350 Pranav Narahari: Oh, okay, okay. Gotcha. So, from the thumbs down, did you, like, categorize a bunch of them to fall under this ticket?
75 00:04:54.760 ⇒ 00:04:58.050 Casie Aviles: Yes, although I would like to do another pass.
76 00:04:58.500 ⇒ 00:05:02.000 Casie Aviles: added. So, since there are new… a bunch of new…
77 00:05:02.240 ⇒ 00:05:08.920 Casie Aviles: Thumbs down, so I just wanna take a look since Friday, so… Yeah, I’ll do that.
78 00:05:09.930 ⇒ 00:05:10.720 Pranav Narahari: Gotcha.
79 00:05:10.920 ⇒ 00:05:15.770 Pranav Narahari: Yeah, there’s still, like, a lot in the state new, I’m noticing.
80 00:05:15.770 ⇒ 00:05:16.430 Casie Aviles: Yeah.
81 00:05:17.350 ⇒ 00:05:21.870 Pranav Narahari: So… Those are getting auto-assigned to Janiece now, right?
82 00:05:27.750 ⇒ 00:05:30.770 Casie Aviles: Something may have failed with the assignment.
83 00:05:31.240 ⇒ 00:05:37.039 Pranav Narahari: Oh, yeah, it looks like that, because I still see them assigned to ABC Home App, I believe.
84 00:05:37.690 ⇒ 00:05:40.559 Casie Aviles: Okay, yeah, yeah, I’ll take a look at this, and then…
85 00:05:40.560 ⇒ 00:05:45.109 Pranav Narahari: Actually, no, it does look like they’re assigned to Janiece.
86 00:05:45.370 ⇒ 00:05:46.509 Casie Aviles: No, they are? Okay.
87 00:05:46.970 ⇒ 00:05:47.520 Pranav Narahari: Yeah.
88 00:05:47.520 ⇒ 00:05:48.430 Casie Aviles: Oh, yeah, okay.
89 00:05:51.260 ⇒ 00:05:51.620 Pranav Narahari: Yeah, okay.
90 00:05:51.620 ⇒ 00:05:52.909 Casie Aviles: I got other signs,
91 00:05:55.370 ⇒ 00:05:56.550 Pranav Narahari: Yeah, okay.
92 00:06:02.780 ⇒ 00:06:09.260 Pranav Narahari: Okay, interesting. So… I’ll just message Denise about this, I guess, like, hey, there’s, like…
93 00:06:09.680 ⇒ 00:06:12.899 Pranav Narahari: Quite a few tickets in your backlog.
94 00:06:13.150 ⇒ 00:06:20.950 Pranav Narahari: I just want to make sure that she sees this, so… Okay, that’s good to know that they’re at least signed to a Janice now.
95 00:06:20.950 ⇒ 00:06:21.430 Casie Aviles: Okay.
96 00:06:21.430 ⇒ 00:06:27.669 Pranav Narahari: And, yeah, Casey, keep us in the loop with anything you notice in terms of the…
97 00:06:28.550 ⇒ 00:06:44.170 Pranav Narahari: the triage process, like, if you’re noticing, you know, last week you did a good job of just, like, letting us know that people weren’t using it. I had a couple good conversations with the trainers to kind of help them up in that direction, to, like, hey, this is all you need to do.
98 00:06:44.650 ⇒ 00:06:49.200 Pranav Narahari: And so, yeah, there’s a lot of buy-in on it, just because it’s very, very simple.
99 00:06:50.860 ⇒ 00:07:01.170 Pranav Narahari: So, I think we just need to let them know. Janice, I think, forgot to give them the SOP, so that’s why they were all just kind of like, hey, what’s different? Yeah.
100 00:07:01.170 ⇒ 00:07:01.920 Casie Aviles: Okay.
101 00:07:02.220 ⇒ 00:07:02.940 Pranav Narahari: Yeah.
102 00:07:04.420 ⇒ 00:07:16.099 Pranav Narahari: So, okay, cool. And then, so transcripts-wise, Sam, I think where we landed last time was we’re sourcing in all the transcripts based on a tag, right?
103 00:07:16.250 ⇒ 00:07:17.269 Samuel Roberts: A queue, yeah.
104 00:07:17.270 ⇒ 00:07:30.300 Pranav Narahari: Our queue, right, right. So, I think… so what I’m gonna give you information on in my call later today is I will figure out which queue we should be tagging for specifically, or if we need to be using a different parameter.
105 00:07:30.500 ⇒ 00:07:37.530 Pranav Narahari: Yeah. But what I think we can still work on is just the categorization that,
106 00:07:38.090 ⇒ 00:07:45.619 Pranav Narahari: pulls in these transcripts and then assesses if they are a cancellation or a non-cancellation. I don’t think we’ve gotten to that yet, right?
107 00:07:46.130 ⇒ 00:07:53.000 Samuel Roberts: No, I have a little bit of that. I tested it on a few of those. That was what those screenshots were on Thursday.
108 00:07:53.210 ⇒ 00:07:59.380 Samuel Roberts: So I’m actually chatting with it now to flush that out a little bit more.
109 00:07:59.890 ⇒ 00:08:00.240 Pranav Narahari: Oh, God.
110 00:08:00.240 ⇒ 00:08:01.889 Samuel Roberts: So it, it, it kind of did…
111 00:08:01.890 ⇒ 00:08:02.209 Pranav Narahari: Cool, yeah.
112 00:08:02.470 ⇒ 00:08:12.269 Samuel Roberts: it did a first pass of just, like, does it say the word cancellation in there? And then I built a little monster agent that also now takes the transcripts and,
113 00:08:12.330 ⇒ 00:08:29.279 Samuel Roberts: classifies it, and so I kind of compared those, found a few different ones, but I’m kind of generalizing it a little more now. The only thing I have about today is that I have four interviews today, so, okay. It’s a packed day, I’m not sure how much progress will be made on this. I’m going to try to keep things running.
114 00:08:29.280 ⇒ 00:08:29.740 Pranav Narahari: All the time.
115 00:08:29.740 ⇒ 00:08:34.629 Samuel Roberts: But, yeah, I’m gonna keep moving, I’ll let you know where it gets. I’m trying to get…
116 00:08:34.630 ⇒ 00:08:35.159 Pranav Narahari: Totally fine.
117 00:08:35.169 ⇒ 00:08:42.979 Samuel Roberts: context in, so I can just kind of let the agent run, and check in on it, but it’s… it’s a very packed day, so…
118 00:08:42.980 ⇒ 00:08:45.799 Pranav Narahari: Yep. Okay, that sounds good. I mean.
119 00:08:46.440 ⇒ 00:08:47.130 Samuel Roberts: Definitely let me know when.
120 00:08:47.130 ⇒ 00:08:58.269 Pranav Narahari: This is good progress, and, like, what I can… there’s a lot that I can do for you as well, which is just bringing in more information to kind of fully, define the problem that we’re trying to fix, so…
121 00:08:58.270 ⇒ 00:09:11.139 Samuel Roberts: Yeah, that’ll be… that’ll be good, the queues will be good, and then I guess the… another thing I’m not 100% sure on is if we should be… the next step of, like, classifying the types of cancellations?
122 00:09:12.060 ⇒ 00:09:16.380 Samuel Roberts: Which I haven’t quite gotten to yet, but I’m curious if they have…
123 00:09:16.710 ⇒ 00:09:21.970 Samuel Roberts: like, pre… predefined ideas, or if I should just let the LM go crazy and find them first.
124 00:09:22.330 ⇒ 00:09:22.720 Pranav Narahari: Yeah.
125 00:09:22.720 ⇒ 00:09:26.280 Samuel Roberts: That’s just another, you know, bit of context from them, so…
126 00:09:26.590 ⇒ 00:09:27.979 Pranav Narahari: Yeah, I think,
127 00:09:28.100 ⇒ 00:09:42.089 Pranav Narahari: I’ll try to… those are the two things I’m gonna ask them, is like, okay, how do we navigate 8x8 specifically for the group that we want to look into starting off, and then also, how should we define cancellations?
128 00:09:42.250 ⇒ 00:09:46.119 Pranav Narahari: And how should we further, you know, define cancellations, I guess?
129 00:09:46.460 ⇒ 00:09:47.030 Samuel Roberts: Yeah.
130 00:09:47.130 ⇒ 00:09:49.499 Samuel Roberts: Yeah, like, subcategories of them and stuff.
131 00:09:49.610 ⇒ 00:10:05.190 Samuel Roberts: If they, like, if they know there’s certain reasons that they think of already, or do any kind of classification, or even, you know, unofficial stuff that they’re just aware of, would be helpful, because I don’t love just letting the LLM make its own decisions about the reasons, if we don’t have anything to feed it initially, so…
132 00:10:05.790 ⇒ 00:10:07.010 Pranav Narahari: Yep.
133 00:10:07.010 ⇒ 00:10:13.890 Samuel Roberts: But we can also do that and compare and see how it looks, but there’s not a ton of data to go off right now based on the, like, 2 weeks of window, for example, so…
134 00:10:16.190 ⇒ 00:10:16.850 Pranav Narahari: Yup.
135 00:10:16.950 ⇒ 00:10:29.769 Pranav Narahari: Okay, cool. So I think, ABC were pretty good. Yeah, like you said, Sam, you’re probably gonna be packed with interviews today, so, you know, not expecting a ton of progress on this, and also, not a big deal. Yeah, yeah, totally.
136 00:10:30.230 ⇒ 00:10:31.630 Pranav Narahari: And then,
137 00:10:32.510 ⇒ 00:10:46.879 Pranav Narahari: Now, moving on to Eden. Casey, I know you were working on the produce theme discovery. You showed, like, how it kind of created some, like, summaries. And then we talked a little bit about how can we,
138 00:10:46.920 ⇒ 00:11:00.570 Pranav Narahari: direct it further, based on exactly what Danny has talked about in the past, which are, like, bottlenecks, bandwidth things, friction indicators, I’m just looking at the notes also that you wrote here,
139 00:11:01.120 ⇒ 00:11:02.190 Pranav Narahari: So…
140 00:11:02.570 ⇒ 00:11:09.109 Pranav Narahari: Should I move this back into in progress, since I think we… unless you already kind of completed some of this stuff?
141 00:11:09.860 ⇒ 00:11:12.999 Casie Aviles: Oh, yeah, okay, yeah, let’s move that back to in progress.
142 00:11:13.930 ⇒ 00:11:15.380 Pranav Narahari: Okay. Yeah.
143 00:11:18.330 ⇒ 00:11:26.320 Pranav Narahari: Just because I think that is kind of in scope of this ticket, too, unless you were thinking something differently, because I know you just kind of moved it into internal review.
144 00:11:27.970 ⇒ 00:11:32.399 Casie Aviles: No, no, yeah, you’re right. That should be part of it.
145 00:11:32.800 ⇒ 00:11:34.300 Pranav Narahari: Okay, perfect.
146 00:11:34.460 ⇒ 00:11:39.949 Pranav Narahari: Alright, let me take a look at what else…
147 00:11:40.360 ⇒ 00:11:45.500 Pranav Narahari: So, Mustafa, the PR, is that, good to go?
148 00:11:49.900 ⇒ 00:11:56.329 Pranav Narahari: EDE3-23. It’s like, it says, tracking PR number 6.
149 00:11:57.550 ⇒ 00:11:59.729 Mustafa Raja: Let me just, quickly take a look at that.
150 00:12:13.880 ⇒ 00:12:17.610 Mustafa Raja: There’s no open PR, though. Are you talking about the linear ticket?
151 00:12:18.180 ⇒ 00:12:19.500 Pranav Narahari: Yeah, there’s a linear ticket.
152 00:12:19.650 ⇒ 00:12:22.110 Mustafa Raja: Yeah, I need to work on that a little bit more.
153 00:12:23.880 ⇒ 00:12:24.280 Pranav Narahari: Okay.
154 00:12:24.280 ⇒ 00:12:24.899 Samuel Roberts: Which ticket?
155 00:12:24.900 ⇒ 00:12:26.000 Pranav Narahari: about.
156 00:12:26.000 ⇒ 00:12:29.580 Mustafa Raja: It’s, it’s about the, review apps.
157 00:12:30.170 ⇒ 00:12:31.290 Samuel Roberts: Oh, yeah, okay.
158 00:12:32.160 ⇒ 00:12:32.870 Pranav Narahari: Yo.
159 00:12:33.100 ⇒ 00:12:35.110 Pranav Narahari: Okay, let’s try to close this one today.
160 00:12:35.260 ⇒ 00:12:37.450 Pranav Narahari: Yep. Okay, cool.
161 00:12:37.780 ⇒ 00:12:46.999 Pranav Narahari: And then, end-to-end validation, production, deploy. I don’t think there’s anything blocking this?
162 00:12:47.990 ⇒ 00:12:54.249 Pranav Narahari: Build cross-platform… okay, no, this is blocking something else. Okay.
163 00:12:54.660 ⇒ 00:12:59.690 Pranav Narahari: Yeah, Mustafa, how do you feel about this one, end-to-end validation and production deploy?
164 00:13:04.190 ⇒ 00:13:05.500 Mustafa Raja: I’m taking a look at it.
165 00:13:06.380 ⇒ 00:13:06.970 Pranav Narahari: Okay.
166 00:13:07.600 ⇒ 00:13:09.819 Pranav Narahari: Okay, take a look at this,
167 00:13:10.380 ⇒ 00:13:13.330 Pranav Narahari: And then, you know, message in the chat if there’s any issues.
168 00:13:16.330 ⇒ 00:13:23.170 Pranav Narahari: K… And then, yeah, I think, Casey, you could probably work on your ticket here after.
169 00:13:24.590 ⇒ 00:13:30.010 Pranav Narahari: It seems like it’s, it might be blocked by what Mustafa’s working on.
170 00:13:37.120 ⇒ 00:13:38.960 Pranav Narahari: Okay, cool.
171 00:13:40.760 ⇒ 00:13:44.389 Mustafa Raja: What’s the role of end-to-end validation and production deploy?
172 00:13:48.970 ⇒ 00:13:49.780 Pranav Narahari: You’re following me.
173 00:13:49.780 ⇒ 00:13:57.119 Mustafa Raja: Have the, did Danny send us the, messages for us to, put in emails?
174 00:14:00.910 ⇒ 00:14:04.009 Pranav Narahari: Yeah, he highlighted those ones, right? In the Google Doc?
175 00:14:05.020 ⇒ 00:14:06.999 Mustafa Raja: Yeah, but we needed the new data, no?
176 00:14:08.720 ⇒ 00:14:13.910 Pranav Narahari: No, no, so Sam now has… has set up the new instance that simulates his…
177 00:14:15.150 ⇒ 00:14:15.670 Mustafa Raja: Oh, okay.
178 00:14:15.670 ⇒ 00:14:20.109 Pranav Narahari: his, claude Co-work, so we can… we can use that.
179 00:14:20.550 ⇒ 00:14:21.280 Mustafa Raja: Okay, okay.
180 00:14:22.130 ⇒ 00:14:28.920 Samuel Roberts: Yeah, I’m curious how close that simulation is, because it, you know, it all does just have the access that I think he has in Cloud Code, but,
181 00:14:29.200 ⇒ 00:14:31.700 Samuel Roberts: You know, I don’t know exactly how close that comes yet, but…
182 00:14:32.170 ⇒ 00:14:35.290 Pranav Narahari: Yeah, I mean, not much we can do there, unfortunately.
183 00:14:35.290 ⇒ 00:14:38.539 Samuel Roberts: Exactly, exactly, it’s progress, you know, it’s something we can lean on, at least, to see how it.
184 00:14:38.540 ⇒ 00:14:39.030 Pranav Narahari: Yeah.
185 00:14:39.590 ⇒ 00:14:45.829 Pranav Narahari: It’s actually a good point, though, that you bring that up, thank you for reminding me. We do have Claude co-work now, internally, and so…
186 00:14:45.830 ⇒ 00:14:46.300 Samuel Roberts: That’s right, yeah.
187 00:14:46.300 ⇒ 00:14:52.450 Pranav Narahari: Another… and… I’m just gonna create a ticket, and then we can figure out who to assign it to. But,
188 00:14:53.540 ⇒ 00:14:56.180 Pranav Narahari: Here, let me just do voice-to-text real quick.
189 00:15:00.020 ⇒ 00:15:08.300 Pranav Narahari: Create a ticket to set up Claude Co-work with Pranav’s Eden.health account.
190 00:15:08.540 ⇒ 00:15:09.210 Samuel Roberts: Yeah.
191 00:15:09.210 ⇒ 00:15:17.239 Pranav Narahari: And the setup evolves to compare our service account, with this agent account.
192 00:15:19.970 ⇒ 00:15:20.480 Samuel Roberts: Yeah.
193 00:15:21.260 ⇒ 00:15:22.180 Pranav Narahari: Okay, cool.
194 00:15:33.060 ⇒ 00:15:34.110 Samuel Roberts: Black, please.
195 00:15:49.130 ⇒ 00:15:51.190 Pranav Narahari: Okay. Yeah, so…
196 00:15:51.410 ⇒ 00:16:04.829 Pranav Narahari: that should honestly be a priority for today, too, and then… because what I’ll do is just give us a little bit more context for if there’s any gaps between the instance that we set up and what, Claude Kowork is giving, so…
197 00:16:09.790 ⇒ 00:16:19.259 Pranav Narahari: Maybe, Sam, this would actually be good if there’s any, like, handoff that you need to do to Mustafa to kind of get him up to speed on that, that new instance that you created?
198 00:16:19.860 ⇒ 00:16:26.549 Pranav Narahari: you could… you guys can set up that meeting, as well as… and then, Mustafa, you can probably take on this Claude Co-work ticket.
199 00:16:30.730 ⇒ 00:16:38.339 Samuel Roberts: Yeah, let me see… maybe just right after this, because I think I… I jump into interviews starting at… what time are we at?
200 00:16:38.920 ⇒ 00:16:44.479 Samuel Roberts: Sorry, oh, we have reserved office hours, okay, no, we’re good, yeah, let’s definitely chat then.
201 00:16:46.050 ⇒ 00:16:47.020 Pranav Narahari: Perfect, okay.
202 00:16:47.260 ⇒ 00:16:49.190 Pranav Narahari: Let me see…
203 00:16:49.350 ⇒ 00:16:53.760 Pranav Narahari: How does everybody feel? Do they have… do they feel like they have the right amount of stuff on their plate?
204 00:16:56.240 ⇒ 00:16:56.750 Mustafa Raja: Yes.
205 00:16:58.030 ⇒ 00:17:00.359 Pranav Narahari: Okay. Cool, cool.
206 00:17:02.410 ⇒ 00:17:06.389 Pranav Narahari: Okay. Awesome, guys. Yeah, let me know if anything comes up and you need me.
207 00:17:07.450 ⇒ 00:17:08.180 Samuel Roberts: It’s good.
208 00:17:08.770 ⇒ 00:17:10.729 Pranav Narahari: Alright. Talk later, guys. See ya.
209 00:17:10.920 ⇒ 00:17:11.480 Samuel Roberts: Alright.
210 00:17:12.060 ⇒ 00:17:15.479 Samuel Roberts: Gustava, do you want to talk now, or do you want to wait till office hours? I don’t know what you’re…
211 00:17:15.480 ⇒ 00:17:17.060 Mustafa Raja: Oh, no, I don’t mind.
212 00:17:17.060 ⇒ 00:17:17.700 Samuel Roberts: Okay.
213 00:17:18.369 ⇒ 00:17:21.590 Samuel Roberts: Yeah, let’s just… you wanna just hold on here, then? We can… I can walk you through it real quick.
214 00:17:21.760 ⇒ 00:17:22.359 Mustafa Raja: Yep.
215 00:17:22.869 ⇒ 00:17:23.619 Samuel Roberts: Okay, cool.
216 00:17:23.939 ⇒ 00:17:24.679 Samuel Roberts: Perfect.
217 00:17:25.749 ⇒ 00:17:27.659 Samuel Roberts: Alright.
218 00:17:28.049 ⇒ 00:17:29.459 Samuel Roberts: So,
219 00:17:35.419 ⇒ 00:17:36.399 Samuel Roberts: One sec, let me just finish.
220 00:17:36.400 ⇒ 00:17:44.780 Mustafa Raja: So, we just need to set up a few tools on Cloud Crow work, right? And then, same question should give us the latest data, right?
221 00:17:45.250 ⇒ 00:17:50.930 Samuel Roberts: Yeah, so the Claude Co-work, you know, you’ll start with Pranav. The problem is that Pranav,
222 00:17:51.100 ⇒ 00:17:54.319 Samuel Roberts: Doesn’t have the same access that Danny has?
223 00:17:54.480 ⇒ 00:17:59.240 Samuel Roberts: So, like, The… we may have to do a little bit of…
224 00:18:00.400 ⇒ 00:18:06.089 Samuel Roberts: I don’t know, creative thinking here about how to compare, but the Eden deployment now should have the…
225 00:18:06.550 ⇒ 00:18:15.570 Samuel Roberts: At least the dev, I don’t remember how far it got pushed through the pipeline, but there’s slash Eden, right, which is the main chat now, with CopilotKit.
226 00:18:16.240 ⇒ 00:18:20.689 Samuel Roberts: And then there’s, slash Eden dash compare, I believe.
227 00:18:21.050 ⇒ 00:18:21.890 Samuel Roberts: So…
228 00:18:24.030 ⇒ 00:18:31.229 Samuel Roberts: If you want to pull that locally, or you want to test on dev, like, you should be able to see… basically what it does is you can feed it a question, and it’ll run it through
229 00:18:31.460 ⇒ 00:18:38.290 Samuel Roberts: the… The full, full agent with all the tools and the impersonation and everything.
230 00:18:39.800 ⇒ 00:18:44.299 Samuel Roberts: And also the Danny-specific one that is just locked down to Danny’s user.
231 00:18:46.470 ⇒ 00:18:49.220 Samuel Roberts: So, I don’t know if you’ve seen that,
232 00:18:49.220 ⇒ 00:18:56.199 Mustafa Raja: I haven’t, I haven’t… I know that there, there is an Eden Compare, route, but I didn’t check it out.
233 00:18:56.720 ⇒ 00:19:02.979 Samuel Roberts: Yeah, I would say play with that a little bit and see how it goes. You’ll probably just play with it on the dev deployment for a minute.
234 00:19:03.730 ⇒ 00:19:10.639 Samuel Roberts: And if you want to pull it locally, I don’t know if there was much more setup that has to change for the environment, but you should be able to even run it locally.
235 00:19:10.810 ⇒ 00:19:15.029 Samuel Roberts: And then, yeah, the Claude co-work, I think…
236 00:19:15.300 ⇒ 00:19:22.570 Mustafa Raja: What’s the difference between slash Eden slash Eden compared, if they have the same, tools.
237 00:19:23.560 ⇒ 00:19:28.500 Samuel Roberts: So, the Eden Compare has two agents that it runs for each query.
238 00:19:29.370 ⇒ 00:19:32.290 Samuel Roberts: Let me… let me see if I can get it up here real quick,
239 00:19:33.760 ⇒ 00:19:41.225 Samuel Roberts: What is the… the URL for… I don’t have it here, let me see… Hmm…
240 00:19:42.140 ⇒ 00:19:45.910 Samuel Roberts: Let me just go to the console real quick. Let me share my screen in a second.
241 00:19:48.430 ⇒ 00:19:51.230 Samuel Roberts: Gotta log in… Damn.
242 00:19:52.650 ⇒ 00:19:56.910 Samuel Roberts: Alright, and then we’re gonna go to Cloud Run.
243 00:19:57.400 ⇒ 00:20:01.380 Samuel Roberts: I’m gonna go to dev, and then we’re gonna go to the URL, okay?
244 00:20:03.520 ⇒ 00:20:06.439 Samuel Roberts: I think we’re gonna go to the aura. We’re gonna try to go to the aura.
245 00:20:08.850 ⇒ 00:20:13.470 Samuel Roberts: Okay, let me… Share this once it loads.
246 00:20:16.830 ⇒ 00:20:19.850 Samuel Roberts: It’s still loading, what’s going on here?
247 00:20:20.770 ⇒ 00:20:23.100 Samuel Roberts: It might be a cold start or something.
248 00:20:24.650 ⇒ 00:20:26.679 Samuel Roberts: Or it’s just my browser, yeah, there.
249 00:20:27.140 ⇒ 00:20:35.870 Samuel Roberts: So, this is the dev deployment, right? So, if we go to Eden, We should see… Login is Pranav.
250 00:20:38.790 ⇒ 00:20:45.760 Samuel Roberts: Okay, so… Eden is just the regular chat agent, right? With CopilotKit, all the work you did for that.
251 00:20:47.250 ⇒ 00:20:58.419 Samuel Roberts: So, what I did was… this… this is gonna operate, like, this is what Danny will use and everything. What I do then… what I did to… to add a little… another agent is, I think it’s…
252 00:20:58.700 ⇒ 00:21:00.229 Samuel Roberts: dash compare, I hope?
253 00:21:00.610 ⇒ 00:21:07.580 Samuel Roberts: Yeah, okay. So what this is, is a little different. It’s got the baseline Eden agent, which is the same as the other URL.
254 00:21:08.780 ⇒ 00:21:14.689 Samuel Roberts: And then it’s got a variant that’s Danny only. So, like, I can say… I can give it, like, one of our example questions.
255 00:21:16.750 ⇒ 00:21:19.350 Samuel Roberts: And when I send it, it’s gonna run both agents.
256 00:21:20.310 ⇒ 00:21:21.150 Mustafa Raja: Whoa.
257 00:21:21.740 ⇒ 00:21:27.330 Samuel Roberts: And so, it’s a little annoying because of the way it was streaming back and everything, but it should…
258 00:21:27.810 ⇒ 00:21:33.010 Samuel Roberts: These are all… these are… we probably don’t need to display them fully out like that, but we’ll see.
259 00:21:34.010 ⇒ 00:21:36.249 Samuel Roberts: Maybe we can change that as the default, but…
260 00:21:36.460 ⇒ 00:21:43.280 Samuel Roberts: once it returns, I think it displays it a little different, but it shows, like, how they operate differently, because this one is supposed to simulate
261 00:21:43.540 ⇒ 00:21:46.119 Samuel Roberts: what his Claude co-work is capable of.
262 00:21:47.740 ⇒ 00:21:54.389 Samuel Roberts: in that it only has his access. So the idea here… Is that,
263 00:21:55.610 ⇒ 00:21:59.410 Samuel Roberts: These are… this is… we may need to fix that a little bit, but, okay, cool.
264 00:21:59.690 ⇒ 00:22:11.879 Samuel Roberts: So once this is done, you’ll see, like, this one took 32 seconds, this one took 45 seconds, this one made 16 tool calls, this one made 12, but this one can only impersonate Danny, okay?
265 00:22:13.370 ⇒ 00:22:19.060 Samuel Roberts: So, it doesn’t have access to all the meetings, or… Gmail, or everything like that.
266 00:22:19.620 ⇒ 00:22:25.039 Samuel Roberts: So, the idea here is that this should be more similar to, like, the golden dataset that we have.
267 00:22:25.500 ⇒ 00:22:27.539 Samuel Roberts: And where he ran things through Claude?
268 00:22:29.340 ⇒ 00:22:33.679 Samuel Roberts: And this should be our, our improved full-view version.
269 00:22:34.060 ⇒ 00:22:43.469 Samuel Roberts: And what I did was I put it so all the past conversations will be here, the main two questions that we had the answers for are here, and then all the other samples were here.
270 00:22:44.900 ⇒ 00:22:46.839 Samuel Roberts: And so I think…
271 00:22:47.100 ⇒ 00:22:51.460 Samuel Roberts: what Pranat was thinking is that, like, we can… now that we have Claude co-work.
272 00:22:51.890 ⇒ 00:22:59.040 Samuel Roberts: we can run some of these questions through there as Pranav, at least, and see how it… does.
273 00:23:00.550 ⇒ 00:23:07.809 Samuel Roberts: I don’t know if that’s gonna help as much without Danny’s access, but we can at least see how it does it, and maybe learn a little bit about
274 00:23:08.230 ⇒ 00:23:13.670 Samuel Roberts: what… They might be prompting for, and what access and things like that it actually has.
275 00:23:15.030 ⇒ 00:23:15.790 Mustafa Raja: Yeah.
276 00:23:17.530 ⇒ 00:23:24.610 Samuel Roberts: And this, like I said, should be able to run locally as well, if you need. I don’t think I added any… it’s just the agent here is… let me…
277 00:23:25.870 ⇒ 00:23:28.449 Samuel Roberts: go back here, I think I gotta do…
278 00:23:29.830 ⇒ 00:23:30.160 Mustafa Raja: agent.
279 00:23:30.160 ⇒ 00:23:31.070 Samuel Roberts: Jesus.
280 00:23:31.390 ⇒ 00:23:31.970 Mustafa Raja: So.
281 00:23:33.620 ⇒ 00:23:37.960 Samuel Roberts: Yeah, so… so this agent, you can see, like, it just has one less tool, basically.
282 00:23:38.850 ⇒ 00:23:39.719 Mustafa Raja: Yes.
283 00:23:40.040 ⇒ 00:23:42.400 Samuel Roberts: And it’s just the impersonation tool, effectively.
284 00:23:43.490 ⇒ 00:23:45.030 Mustafa Raja: Impersonation doing okay.
285 00:23:45.490 ⇒ 00:23:50.149 Samuel Roberts: So, the prompt’s a little bit different, but it’s hard to tell, because it’s, you know.
286 00:23:50.800 ⇒ 00:23:54.699 Samuel Roberts: It’s the impersonation part that it doesn’t have, but that’s what it’s effectively doing there.
287 00:23:55.980 ⇒ 00:23:56.640 Mustafa Raja: Okay.
288 00:23:57.270 ⇒ 00:23:58.220 Samuel Roberts: Alright.
289 00:24:01.170 ⇒ 00:24:09.570 Mustafa Raja: And then for the cloud cover, we are going to just compare, compare the output with our Eden agent, right?
290 00:24:09.570 ⇒ 00:24:16.399 Samuel Roberts: Yeah, I’m trying to think, there might be a way… what you… you may want to experiment with is, like, duplicating this agent.
291 00:24:16.670 ⇒ 00:24:18.650 Samuel Roberts: As Pranav, maybe?
292 00:24:18.920 ⇒ 00:24:31.780 Samuel Roberts: And so, instead of being Danny’s email hard-coded, it would be Pranav’s hard-coded, and then you can kind of compare and get a sense of what Claude is doing, maybe, and, you know, just generate some insights from that.
293 00:24:32.180 ⇒ 00:24:39.620 Samuel Roberts: Because without Danny’s access and Claude, we’re not gonna know exactly what good answers, or what he expects good answers to look like, so…
294 00:24:40.710 ⇒ 00:24:52.150 Mustafa Raja: Yes, this is a good way to compare if our… if our thing is closer to… or… or better… Exactly. …than, Claude Co-work or not.
295 00:24:52.450 ⇒ 00:24:53.230 Mustafa Raja: Yeah.
296 00:24:53.230 ⇒ 00:24:54.080 Samuel Roberts: I think, I think…
297 00:24:54.080 ⇒ 00:24:54.810 Mustafa Raja: Yeah.
298 00:24:54.810 ⇒ 00:25:00.999 Samuel Roberts: Yeah. I would say try that out, and that I would say you can probably do locally. You don’t necessarily need to deploy a Pranav
299 00:25:01.180 ⇒ 00:25:20.830 Samuel Roberts: version, but at least try it out, and then, you know, see how it looks, see how it compares, see what it finds that we might not find, and we can learn from that. So, I think that would be a good, you know, like, kind of generate a report from there about things it sees, things we see, things it’s missing, things we’re missing, that kind of stuff.
300 00:25:21.990 ⇒ 00:25:22.590 Mustafa Raja: Yep.
301 00:25:27.660 ⇒ 00:25:28.280 Samuel Roberts: Cool.
302 00:25:34.320 ⇒ 00:25:40.520 Samuel Roberts: Alright, any other questions there? I don’t know what the ticket has exactly in it that he made, but.
303 00:25:42.090 ⇒ 00:25:46.190 Mustafa Raja: I guess, this is all. I’ll just headline.
304 00:25:46.630 ⇒ 00:25:50.580 Mustafa Raja: And this, and then come back to the channel.
305 00:25:51.590 ⇒ 00:25:53.319 Samuel Roberts: Yeah, that sounds good.
306 00:25:54.190 ⇒ 00:25:55.139 Mustafa Raja: Okay, thank you.
307 00:25:56.030 ⇒ 00:25:57.040 Samuel Roberts: Alright, great.
308 00:25:57.510 ⇒ 00:25:58.459 Samuel Roberts: Talk to you later.
309 00:25:59.110 ⇒ 00:25:59.860 Mustafa Raja: My…
310 00:26:00.310 ⇒ 00:26:01.000 Samuel Roberts: Bye.