Meeting Title: Interlude Planning & Retro Date: 2025-08-15 Meeting participants: Mustafa Raja, Rico Rejoso, Samuel Roberts
WEBVTT
1 00:00:16.219 ⇒ 00:00:17.629 Rico Rejoso: Hi, Mustafa.
2 00:00:19.140 ⇒ 00:00:20.189 Mustafa Raja: Hey, how are you?
3 00:00:20.640 ⇒ 00:00:21.639 Rico Rejoso: I’m good, how are you?
4 00:00:21.830 ⇒ 00:00:22.870 Mustafa Raja: Yeah, doing good.
5 00:00:23.160 ⇒ 00:00:31.599 Rico Rejoso: Wonderful. Staff, I don’t know if Sam will be joining us, but can you help me out as well in regards to planning and for next week?
6 00:00:31.710 ⇒ 00:00:36.820 Rico Rejoso: I believe next week will be the last week for Interlude, correct me if I’m wrong.
7 00:00:37.360 ⇒ 00:00:40.550 Mustafa Raja: Yeah, hopefully we’ll win them.
8 00:00:41.480 ⇒ 00:00:44.600 Rico Rejoso: Definitely, so… SSM, Monsieur.
9 00:00:44.710 ⇒ 00:00:46.409 Rico Rejoso: Hey, San, how are you?
10 00:00:47.320 ⇒ 00:00:48.840 Samuel Roberts: Good, how are you guys?
11 00:00:49.350 ⇒ 00:00:49.960 Rico Rejoso: Good.
12 00:00:49.960 ⇒ 00:00:50.780 Mustafa Raja: Doing good.
13 00:00:51.200 ⇒ 00:00:51.900 Rico Rejoso: Wonderful.
14 00:00:52.180 ⇒ 00:01:05.439 Rico Rejoso: So yeah, I was talking to my staff in regards to helping me out with the tickets that we have for InferLid. You know, I started this week, so I try to learn as much as possible, not having any background into, you know…
15 00:01:05.610 ⇒ 00:01:13.630 Rico Rejoso: the automation and stuff in regards to the project that we have for Interlude. So I’m just assisting with Tom as well, on the PM side, along with Sam.
16 00:01:13.780 ⇒ 00:01:23.410 Rico Rejoso: So I have these tickets that we have for Interlude, and I basically listed out all the tickets that we currently have, so I… let me just share my screen real quick.
17 00:01:25.410 ⇒ 00:01:26.750 Rico Rejoso: 20 seconds.
18 00:01:28.480 ⇒ 00:01:36.229 Rico Rejoso: So this planning and retro, let’s make it more of a planning for next week, since next week will be the last week for, interview.
19 00:01:39.500 ⇒ 00:01:43.730 Rico Rejoso: So I have this, we have these tickets on Interlude and…
20 00:01:44.080 ⇒ 00:01:58.570 Rico Rejoso: I tried to get it to AI, ChatGPT, to, you know, learn how many tickets we still have for this, cycle, or before we end the project with interview, and we have, like, a lot yet.
21 00:01:58.750 ⇒ 00:02:06.480 Rico Rejoso: That needs to be finished. Let me, let me just confirm if we still need other tickets here for backlog and for next cycle.
22 00:02:06.950 ⇒ 00:02:11.640 Mustafa Raja: Hmm, Inter-15, I think, in backlog.
23 00:02:11.960 ⇒ 00:02:15.400 Mustafa Raja: … I don’t think we need this, no?
24 00:02:15.690 ⇒ 00:02:17.900 Mustafa Raja: Notion integration for AI outputs.
25 00:02:18.430 ⇒ 00:02:20.010 Rico Rejoso: Okay, so we can cancel.
26 00:02:20.010 ⇒ 00:02:22.469 Samuel Roberts: Yeah, I think… I think we’re good now with that, yeah.
27 00:02:22.470 ⇒ 00:02:23.260 Mustafa Raja: Yeah.
28 00:02:23.610 ⇒ 00:02:24.480 Rico Rejoso: So, is it done?
29 00:02:24.480 ⇒ 00:02:25.280 Mustafa Raja: Everything canceled.
30 00:02:25.280 ⇒ 00:02:25.980 Rico Rejoso: this.
31 00:02:26.540 ⇒ 00:02:31.970 Samuel Roberts: I think it… Integrate Notion API for Deckstore, Enter 3, I think. I’m not sure, is there anything more in that ticket?
32 00:02:32.950 ⇒ 00:02:34.589 Mustafa Raja: three, into… yeah.
33 00:02:34.590 ⇒ 00:02:35.279 Samuel Roberts: No, I mean….
34 00:02:35.280 ⇒ 00:02:38.110 Mustafa Raja: There isn’t. I mean, it’s done.
35 00:02:38.400 ⇒ 00:02:41.869 Samuel Roberts: Yeah, I just didn’t know if, you know, did Inter 18 have anything more in it?
36 00:02:41.870 ⇒ 00:02:43.790 Mustafa Raja: Oh, that was different. Oh, in 2018.
37 00:02:44.150 ⇒ 00:02:46.650 Mustafa Raja: Yeah. No, no, no. Inter-18 is also good to go.
38 00:02:46.650 ⇒ 00:02:48.440 Samuel Roberts: It’s probably duplicate, yeah, that…
39 00:02:49.540 ⇒ 00:02:54.439 Samuel Roberts: Wait, hold on, am I missing… no, sorry, I’m mixing… I’m reading them wrong. Inter 15 myself, I’m sorry.
40 00:02:54.440 ⇒ 00:02:59.130 Mustafa Raja: into 15… Yeah, yeah, this, I don’t think we need this.
41 00:02:59.130 ⇒ 00:03:00.719 Samuel Roberts: I think it’s a duplicate, yeah.
42 00:03:00.720 ⇒ 00:03:03.340 Mustafa Raja: Yeah. Yeah, let’s put it as duplicate.
43 00:03:03.910 ⇒ 00:03:05.040 Rico Rejoso: Difficult guy.
44 00:03:07.520 ⇒ 00:03:10.780 Mustafa Raja: Or to meet task dependencies in Notion.
45 00:03:11.190 ⇒ 00:03:23.439 Mustafa Raja: Yeah, this is what their team member wanted, so let’s keep it in the backlog, and let’s ask Khutam what he wants to do with this.
46 00:03:24.820 ⇒ 00:03:27.159 Rico Rejoso: Okay, that is for interporting, right?
47 00:03:27.470 ⇒ 00:03:28.860 Mustafa Raja: Yeah, into 14.
48 00:03:28.860 ⇒ 00:03:29.470 Rico Rejoso: Got it.
49 00:03:35.350 ⇒ 00:03:36.540 Rico Rejoso: Any other than that?
50 00:03:36.850 ⇒ 00:03:44.429 Mustafa Raja: Yeah, improve AI, agent for output formatting in Notion, …
51 00:03:48.330 ⇒ 00:03:51.889 Mustafa Raja: And inter-16 and 17 seems related to me.
52 00:03:52.720 ⇒ 00:03:53.440 Rico Rejoso: I’m sorry?
53 00:03:53.800 ⇒ 00:03:57.700 Mustafa Raja: Inter-16 and inter 17 seems related to me.
54 00:03:58.510 ⇒ 00:04:00.769 Rico Rejoso: Okay, so this is… we still need this, right?
55 00:04:01.650 ⇒ 00:04:03.429 Mustafa Raja: One of them.
56 00:04:03.570 ⇒ 00:04:07.619 Mustafa Raja: Let’s keep 17. 16 is a little vague.
57 00:04:08.340 ⇒ 00:04:09.960 Rico Rejoso: 16 is duplicate, right?
58 00:04:10.920 ⇒ 00:04:12.170 Mustafa Raja: …
59 00:04:13.010 ⇒ 00:04:26.749 Mustafa Raja: Yeah, we can say it’s duplicate. Sam, have you got the chance to look into the loom that I sent for, this, integration for Notion? Or I can show.
60 00:04:26.750 ⇒ 00:04:27.120 Samuel Roberts: I was….
61 00:04:27.120 ⇒ 00:04:28.439 Mustafa Raja: And….
62 00:04:28.440 ⇒ 00:04:31.509 Samuel Roberts: Yeah, no, I was just getting to it now, I was just getting back at my computer, but….
63 00:04:31.510 ⇒ 00:04:35.500 Mustafa Raja: Yeah, yeah, how the output is looking in Notion.
64 00:04:35.840 ⇒ 00:04:38.240 Mustafa Raja: I can just quickly share my screen and….
65 00:04:38.240 ⇒ 00:04:39.869 Samuel Roberts: quick, share quick, and I can….
66 00:04:40.140 ⇒ 00:04:41.309 Rico Rejoso: Okay. Go ahead.
67 00:04:42.830 ⇒ 00:04:43.770 Mustafa Raja: …
68 00:04:47.550 ⇒ 00:04:49.160 Mustafa Raja: Yeah, so….
69 00:04:50.470 ⇒ 00:04:54.129 Samuel Roberts: So this is how it’s looking, right now. Damn.
70 00:04:54.500 ⇒ 00:05:00.669 Mustafa Raja: What we need to do is we need to improve the rationale, and that is with, …
71 00:05:01.800 ⇒ 00:05:06.469 Mustafa Raja: what’s it called? The AI agent. We need to improve it over there.
72 00:05:07.040 ⇒ 00:05:07.820 Samuel Roberts: Okay.
73 00:05:07.820 ⇒ 00:05:18.290 Mustafa Raja: And it’ll be improved, in Ocean, automatically, since, we are, only pushing what the AI is generating.
74 00:05:18.800 ⇒ 00:05:19.690 Samuel Roberts: Right.
75 00:05:19.930 ⇒ 00:05:20.560 Mustafa Raja: Yep.
76 00:05:20.560 ⇒ 00:05:27.739 Samuel Roberts: Yeah, I’m wondering if there’s a way to… I mean, I don’t know too much about, like, what they’re gonna want. Is this, like, stylized?
77 00:05:27.950 ⇒ 00:05:30.229 Samuel Roberts: the way they want it? Can we go through that briefly?
78 00:05:30.230 ⇒ 00:05:30.990 Mustafa Raja: will want.
79 00:05:31.300 ⇒ 00:05:33.539 Samuel Roberts: Okay, okay, I’m just making sure, because it’s just, it’s….
80 00:05:33.540 ⇒ 00:05:34.110 Mustafa Raja: is what.
81 00:05:34.110 ⇒ 00:05:37.049 Samuel Roberts: I didn’t know if we wanted to break it up more or not, but if that’s good, then it’s good.
82 00:05:37.050 ⇒ 00:05:49.489 Mustafa Raja: Before moving to the formatting, I’m going to also take a look again at the meeting, if I’m not missing anything, because I don’t want to miss anything. Okay. Yeah.
83 00:05:49.590 ⇒ 00:06:01.060 Mustafa Raja: But this is sort of what they want, they want… they just want some improved rationale. That’s right, okay. And at the bottom, they want a summary of everything, why… why…
84 00:06:01.280 ⇒ 00:06:05.700 Mustafa Raja: Why is it structured this way? Why is this flow…
85 00:06:05.970 ⇒ 00:06:12.490 Mustafa Raja: flow decided to be this way, and that sort of thing. I feel the…
86 00:06:12.580 ⇒ 00:06:28.440 Mustafa Raja: the facts, that are being mentioned over here, that logic is pretty good. The AI doesn’t put anything, by itself, it doesn’t, … what’s it called? …
87 00:06:30.100 ⇒ 00:06:30.870 Mustafa Raja: Yeah.
88 00:06:30.870 ⇒ 00:06:31.740 Samuel Roberts: Hallucinate anything?
89 00:06:31.740 ⇒ 00:06:41.170 Mustafa Raja: Yeah, yeah, yeah, it doesn’t hallucinate any value itself, it only takes the facts from the questionnaires and from the transcripts.
90 00:06:41.710 ⇒ 00:06:42.410 Samuel Roberts: Okay.
91 00:06:42.650 ⇒ 00:06:47.110 Mustafa Raja: Yeah, so… this is what the Notion integration is so far.
92 00:06:47.660 ⇒ 00:06:48.300 Samuel Roberts: Great.
93 00:06:49.140 ⇒ 00:06:54.809 Samuel Roberts: I think it looks pretty good. I mean, it seems that, yeah, as long as everything’s accurate and, like, I think it’s fine, ….
94 00:06:55.160 ⇒ 00:06:55.600 Mustafa Raja: Yep.
95 00:06:55.600 ⇒ 00:06:57.830 Samuel Roberts: Yeah, adding the… yeah, you’re good.
96 00:06:58.110 ⇒ 00:07:07.100 Mustafa Raja: Yeah, let’s take a look at, tickets, Rico, so we can, … see what… Yup.
97 00:07:10.280 ⇒ 00:07:10.900 Samuel Roberts: Okay.
98 00:07:11.230 ⇒ 00:07:17.209 Rico Rejoso: Yes, other than the backlogs, 14, 7 is good. How about for next cycle?
99 00:07:18.170 ⇒ 00:07:22.099 Rico Rejoso: Basically, we don’t have next cycle, it’s for next week as well.
100 00:07:22.230 ⇒ 00:07:22.800 Mustafa Raja: Yep.
101 00:07:23.450 ⇒ 00:07:24.000 Rico Rejoso: How about A?
102 00:07:24.000 ⇒ 00:07:27.619 Mustafa Raja: What’s the… What’s the Slack agent?
103 00:07:28.680 ⇒ 00:07:31.299 Rico Rejoso: There’s no description. I think UTAM created an issue.
104 00:07:33.150 ⇒ 00:07:33.810 Mustafa Raja: Hmm.
105 00:07:34.530 ⇒ 00:07:35.480 Mustafa Raja: I think this, like….
106 00:07:35.480 ⇒ 00:07:36.339 Samuel Roberts: I think this is what we are.
107 00:07:36.340 ⇒ 00:07:36.940 Mustafa Raja: read the….
108 00:07:36.940 ⇒ 00:07:37.290 Samuel Roberts: Oh, God.
109 00:07:37.290 ⇒ 00:07:42.129 Mustafa Raja: And the looping that is already in, cycle.
110 00:07:42.840 ⇒ 00:07:48.270 Samuel Roberts: Yeah, jump back to the, … Jump back to….
111 00:07:48.950 ⇒ 00:07:51.249 Mustafa Raja: to the interview board, come back to the interview.
112 00:07:51.250 ⇒ 00:07:52.240 Samuel Roberts: Yeah, yeah.
113 00:07:53.470 ⇒ 00:07:53.970 Rico Rejoso: They’re done?
114 00:07:53.970 ⇒ 00:07:58.190 Samuel Roberts: Where’s… yeah, click on the Slack bot for Deck Creation and human in the Loop.
115 00:07:58.430 ⇒ 00:07:59.890 Samuel Roberts: Enter two.
116 00:08:00.650 ⇒ 00:08:01.740 Mustafa Raja: Yeah, into Zoom.
117 00:08:02.970 ⇒ 00:08:04.309 Rico Rejoso: Okay, this one, right?
118 00:08:04.790 ⇒ 00:08:05.140 Samuel Roberts: I think….
119 00:08:05.140 ⇒ 00:08:05.650 Rico Rejoso: Yeah.
120 00:08:05.650 ⇒ 00:08:06.120 Samuel Roberts: Yeah.
121 00:08:06.120 ⇒ 00:08:08.819 Mustafa Raja: I think, I think we’re referring to this one.
122 00:08:09.270 ⇒ 00:08:09.750 Rico Rejoso: Yes.
123 00:08:09.750 ⇒ 00:08:11.500 Samuel Roberts: That must be a duplicate as well.
124 00:08:12.390 ⇒ 00:08:13.870 Rico Rejoso: That is difficult.
125 00:08:14.710 ⇒ 00:08:18.930 Rico Rejoso: Alright, other than that, for the next cycle, 9, 8, 9, 10.
126 00:08:20.290 ⇒ 00:08:22.099 Mustafa Raja: 8, 9, 10….
127 00:08:22.340 ⇒ 00:08:24.180 Samuel Roberts: What is Deck Agent? Is that….
128 00:08:24.350 ⇒ 00:08:27.150 Mustafa Raja: Migrate Slack, but yeah, yeah, we need that.
129 00:08:27.460 ⇒ 00:08:28.480 Mustafa Raja: What?
130 00:08:29.100 ⇒ 00:08:29.719 Mustafa Raja: Oh, my goodness.
131 00:08:29.720 ⇒ 00:08:30.180 Samuel Roberts: notion.
132 00:08:31.930 ⇒ 00:08:43.139 Mustafa Raja: What this really is, I feel the, this is for the improvements that they asked for. And that includes the format,
133 00:08:43.650 ⇒ 00:08:47.409 Mustafa Raja: And everything that I just explained, what needs to be….
134 00:08:47.410 ⇒ 00:08:49.100 Rico Rejoso: interloop, right?
135 00:08:49.330 ⇒ 00:08:50.390 Mustafa Raja: What?
136 00:08:50.760 ⇒ 00:08:53.960 Rico Rejoso: Is this the human interloop? No, I think it’s.
137 00:08:53.960 ⇒ 00:08:58.849 Mustafa Raja: No, no, no, the human in the loop thing is for the Slack into two tickets.
138 00:08:59.050 ⇒ 00:08:59.530 Rico Rejoso: Oh.
139 00:08:59.530 ⇒ 00:09:01.600 Mustafa Raja: going to be included in there.
140 00:09:01.600 ⇒ 00:09:04.989 Rico Rejoso: Should we have this for, this cycle as well?
141 00:09:05.320 ⇒ 00:09:07.000 Rico Rejoso: Or is it a duplicate?
142 00:09:09.030 ⇒ 00:09:10.100 Mustafa Raja: Let’s have it.
143 00:09:10.780 ⇒ 00:09:15.339 Rico Rejoso: And the other one, migrates that bot to Interviews Workspace.
144 00:09:16.170 ⇒ 00:09:22.559 Mustafa Raja: Yeah, we need that, because the first version is going to be on our workspace.
145 00:09:22.560 ⇒ 00:09:29.060 Samuel Roberts: Yeah, so yeah, it’ll set up on ours, and then we’ll have to move it to theirs, so… it’s dependent on Enter2, I believe, right? Yeah.
146 00:09:29.410 ⇒ 00:09:33.910 Rico Rejoso: Okay, and the credit spend for observable… observability per agent?
147 00:09:35.140 ⇒ 00:09:37.860 Mustafa Raja: Credit spend observability.
148 00:09:37.970 ⇒ 00:09:49.520 Mustafa Raja: I did send along to Matt, on how, how he can see how many credits, this workflow, is spending.
149 00:09:49.830 ⇒ 00:09:54.560 Mustafa Raja: … I don’t think I’ve… met with Utam.
150 00:09:54.950 ⇒ 00:09:56.700 Mustafa Raja: Regardless.
151 00:09:56.700 ⇒ 00:09:59.339 Samuel Roberts: Is there anything else… any other details in there?
152 00:09:59.590 ⇒ 00:10:01.110 Mustafa Raja: Yeah, yeah, let’s open this up.
153 00:10:01.110 ⇒ 00:10:02.580 Samuel Roberts: Open, open, entertainment.
154 00:10:02.580 ⇒ 00:10:04.800 Rico Rejoso: Can we do it in BT, and the film has a….
155 00:10:06.520 ⇒ 00:10:07.670 Samuel Roberts: Hmm….
156 00:10:08.290 ⇒ 00:10:18.209 Mustafa Raja: Yeah, credit spend… yeah, we, we do know… there’s, NN lets us know how many, tokens we have consumed per run.
157 00:10:18.810 ⇒ 00:10:22.970 Mustafa Raja: But it doesn’t, it doesn’t tell us the cost of it.
158 00:10:23.810 ⇒ 00:10:24.510 Samuel Roberts: Okay.
159 00:10:25.090 ⇒ 00:10:31.150 Samuel Roberts: Yeah, let’s leave that for, what is it, in next cycle? We can sort… we can hash that out, …
160 00:10:31.640 ⇒ 00:10:33.279 Samuel Roberts: And figure out if they need a better way in.
161 00:10:33.280 ⇒ 00:10:39.610 Mustafa Raja: One question. Are we running one-week cycles or two-week cycles?
162 00:10:41.440 ⇒ 00:10:50.509 Rico Rejoso: I believe this is a two-week cycle, so I have to change that, because it’s ending next week, so basically we’re just gonna move everything for next week, or for within the cycle.
163 00:10:51.040 ⇒ 00:10:51.810 Mustafa Raja: Okay.
164 00:10:53.580 ⇒ 00:10:55.259 Samuel Roberts: Yeah, just think it was the one we said.
165 00:10:55.260 ⇒ 00:11:04.379 Mustafa Raja: steps… the next steps for me is to set up a bot, the Slack bot, and improve the format based on the previous meeting that we had with Interlude.
166 00:11:05.630 ⇒ 00:11:17.990 Rico Rejoso: Yeah, I was about to say that. I mean, we have another draft of tickets that are not yet on, Linear, and I need to confirm that with you guys for Sam and…
167 00:11:18.790 ⇒ 00:11:20.150 Rico Rejoso: Okay, where….
168 00:11:20.280 ⇒ 00:11:21.579 Samuel Roberts: Where are those right now?
169 00:11:22.350 ⇒ 00:11:26.130 Rico Rejoso: Here it is. So, these are the other tickets. Oh, can you see my screen, guys?
170 00:11:26.580 ⇒ 00:11:28.070 Samuel Roberts: … Yes, now I can.
171 00:11:28.550 ⇒ 00:11:33.179 Rico Rejoso: So, this is the project milestone and ticket that we need to create, so we have…
172 00:11:33.970 ⇒ 00:11:35.140 Rico Rejoso: For the first spot.
173 00:11:36.230 ⇒ 00:11:37.969 Rico Rejoso: Do we need any of this?
174 00:11:41.380 ⇒ 00:11:44.260 Mustafa Raja: Validate and function…
175 00:11:49.770 ⇒ 00:11:53.230 Mustafa Raja: Bad noise.
176 00:11:54.160 ⇒ 00:11:57.719 Samuel Roberts: Are these deliverables for them, or is this just for us for….
177 00:11:58.530 ⇒ 00:12:09.139 Mustafa Raja: The architecture diagram, I think, the TDD, technical design document Utam wants, wants it for, new clients.
178 00:12:10.250 ⇒ 00:12:13.280 Rico Rejoso: Okay, so we’ll have this as well, the second one.
179 00:12:13.860 ⇒ 00:12:18.979 Rico Rejoso: Because I’ll be adding the rest, the needed tickets on, linear as well.
180 00:12:19.450 ⇒ 00:12:20.620 Rico Rejoso: For tracking of data.
181 00:12:20.620 ⇒ 00:12:27.709 Mustafa Raja: I’d say these tickets are not so much of a priority, because the client isn’t going to see them, I think.
182 00:12:28.290 ⇒ 00:12:31.039 Rico Rejoso: Okay, but internally, you’re gonna need those.
183 00:12:31.200 ⇒ 00:12:41.240 Mustafa Raja: Yeah, internally, we might need those. The client might see this, but what they would want, really, is their thing to work.
184 00:12:41.590 ⇒ 00:12:42.680 Rico Rejoso: Yeah, got it.
185 00:12:42.680 ⇒ 00:12:46.409 Samuel Roberts: Yeah, I would say you can make the tickets, but I wouldn’t… yeah, don’t prioritize them over the….
186 00:12:46.410 ⇒ 00:12:47.599 Mustafa Raja: Yeah. Slack bot.
187 00:12:47.850 ⇒ 00:12:53.149 Rico Rejoso: Definitely. I’ll have to create these tickets, I mean, especially for documentation.
188 00:12:53.150 ⇒ 00:13:00.100 Mustafa Raja: Yeah, I just want some, clarification on the third one, resolve open questions on brand voice.
189 00:13:00.340 ⇒ 00:13:03.259 Mustafa Raja: I think the brand, …
190 00:13:03.590 ⇒ 00:13:10.280 Mustafa Raja: the way it communicated did resonate with, interlude people last meeting, I think.
191 00:13:12.450 ⇒ 00:13:15.550 Samuel Roberts: Yeah, I think so too, based on what I… what I saw.
192 00:13:15.550 ⇒ 00:13:16.010 Mustafa Raja: Yeah.
193 00:13:16.010 ⇒ 00:13:19.760 Samuel Roberts: I mean, they had some feedback on certain things, but I think we’ve addressed that.
194 00:13:19.760 ⇒ 00:13:20.510 Mustafa Raja: Yeah.
195 00:13:22.060 ⇒ 00:13:24.500 Rico Rejoso: Okay. … So, for this one.
196 00:13:26.100 ⇒ 00:13:29.079 Mustafa Raja: We can create it, and we can talk about it later.
197 00:13:29.430 ⇒ 00:13:30.830 Samuel Roberts: Yeah, exactly.
198 00:13:30.830 ⇒ 00:13:31.620 Rico Rejoso: Notice.
199 00:13:31.890 ⇒ 00:13:32.580 Rico Rejoso: Okay.
200 00:13:32.730 ⇒ 00:13:36.410 Rico Rejoso: for milestone 2 for any workflow.
201 00:13:38.490 ⇒ 00:13:41.569 Mustafa Raja: Yeah, the questionnaire scoring step.
202 00:13:42.410 ⇒ 00:13:46.049 Rico Rejoso: Is this… is this done? Is this the score, BrainTrust score?
203 00:13:46.050 ⇒ 00:13:48.220 Mustafa Raja: Okay.
204 00:13:49.960 ⇒ 00:13:52.740 Samuel Roberts: Is that what… what is questionnaire scoring step? I’m not sure.
205 00:13:52.740 ⇒ 00:14:05.060 Mustafa Raja: So the, so we have two inputs, that we take in to generate the, deck. One is the transcript, and one is questionnaire.
206 00:14:05.320 ⇒ 00:14:06.070 Mustafa Raja: No.
207 00:14:06.070 ⇒ 00:14:07.200 Samuel Roberts: Okay.
208 00:14:07.720 ⇒ 00:14:19.909 Mustafa Raja: We are not scoring questionnaire, though. We are scoring the deck based on, the decks that they have produced, and the deck that our AI is producing.
209 00:14:21.350 ⇒ 00:14:22.030 Samuel Roberts: Right.
210 00:14:23.330 ⇒ 00:14:25.880 Mustafa Raja: Yeah, so this could be some miswords.
211 00:14:26.930 ⇒ 00:14:27.530 Mustafa Raja: -Oh.
212 00:14:27.530 ⇒ 00:14:30.820 Samuel Roberts: Yeah, I hadn’t heard anything about this exactly, so I don’t know what…
213 00:14:32.480 ⇒ 00:14:34.079 Samuel Roberts: I would hold off on that one.
214 00:14:34.490 ⇒ 00:14:37.199 Rico Rejoso: Okay, so I won’t be uploading this one in linear.
215 00:14:37.450 ⇒ 00:14:39.990 Mustafa Raja: Yeah. The second one is important, though.
216 00:14:40.290 ⇒ 00:14:40.690 Rico Rejoso: Okay.
217 00:14:40.690 ⇒ 00:14:41.340 Samuel Roberts: Yes.
218 00:14:41.340 ⇒ 00:14:42.360 Rico Rejoso: No worries.
219 00:14:42.360 ⇒ 00:14:47.659 Mustafa Raja: Yeah, because they would want, retries on the deck.
220 00:14:49.330 ⇒ 00:14:50.020 Rico Rejoso: Got him.
221 00:14:50.850 ⇒ 00:14:51.630 Mustafa Raja: So….
222 00:14:52.070 ⇒ 00:14:54.880 Rico Rejoso: For desk workflow with synthetic inputs?
223 00:14:55.340 ⇒ 00:14:56.909 Mustafa Raja: Yeah, we’re already doing it.
224 00:14:57.040 ⇒ 00:14:58.960 Samuel Roberts: Yeah, I think that’s fine.
225 00:14:59.210 ⇒ 00:14:59.590 Rico Rejoso: Got it.
226 00:14:59.590 ⇒ 00:15:01.580 Mustafa Raja: The second one is important, too.
227 00:15:01.720 ⇒ 00:15:03.080 Samuel Roberts: Definitely. Definitely. I put it.
228 00:15:04.560 ⇒ 00:15:10.439 Rico Rejoso: And for the milestone 3, Notion Publishing, mark down the Notion conversion formatting rules.
229 00:15:11.180 ⇒ 00:15:16.580 Mustafa Raja: Markdown to Notion con… this is done, with the Notion integration, no?
230 00:15:17.370 ⇒ 00:15:18.320 Samuel Roberts: Yeah, I think that… yeah.
231 00:15:18.320 ⇒ 00:15:25.000 Mustafa Raja: because the AI is generating Markdown, and it’s being converted to Notion, …
232 00:15:25.250 ⇒ 00:15:28.960 Mustafa Raja: a Notion integration… well, a Notion format, we’d say.
233 00:15:29.510 ⇒ 00:15:31.240 Rico Rejoso: Yeah, I.
234 00:15:31.870 ⇒ 00:15:32.660 Mustafa Raja: What?
235 00:15:32.990 ⇒ 00:15:34.559 Samuel Roberts: Do we have the retry handling done?
236 00:15:35.040 ⇒ 00:15:39.639 Mustafa Raja: Retry handling for Notion push failures. …
237 00:15:39.950 ⇒ 00:15:44.279 Mustafa Raja: I really haven’t had any Notion Push failures, but I can look into this.
238 00:15:44.790 ⇒ 00:15:48.550 Samuel Roberts: Yeah, I mean, just make a ticket so we have it there, but it’s probably not crazy.
239 00:15:48.550 ⇒ 00:15:49.089 Rico Rejoso: Got it.
240 00:15:49.530 ⇒ 00:15:50.660 Rico Rejoso: Thank you.
241 00:15:50.860 ⇒ 00:15:59.290 Mustafa Raja: Yeah, I feel that since it’s going to be the last week, so, focusing on what they can use would be the best.
242 00:16:00.360 ⇒ 00:16:03.589 Rico Rejoso: Definitely. So that’s part of the testing as well, right?
243 00:16:03.590 ⇒ 00:16:05.100 Mustafa Raja: Yeah, yeah, yeah, yeah.
244 00:16:05.590 ⇒ 00:16:08.700 Rico Rejoso: Yep, and for, the human inter, human inter….
245 00:16:08.700 ⇒ 00:16:18.379 Mustafa Raja: Yeah, human in the loop, add detailed rationale, and then, okay, capture division notes, and pass into LLM iteration. Yeah, we need this.
246 00:16:18.830 ⇒ 00:16:24.400 Mustafa Raja: … Yeah, I feel, I feel there was a… there was one ticket, above.
247 00:16:24.400 ⇒ 00:16:24.720 Samuel Roberts: Yeah.
248 00:16:24.720 ⇒ 00:16:26.260 Mustafa Raja: related to this, too.
249 00:16:26.870 ⇒ 00:16:28.949 Samuel Roberts: Yeah, I think this is probably just, like, a sub….
250 00:16:29.150 ⇒ 00:16:29.510 Mustafa Raja: Yeah.
251 00:16:29.510 ⇒ 00:16:30.230 Samuel Roberts: task of that.
252 00:16:30.230 ⇒ 00:16:32.079 Mustafa Raja: And we have….
253 00:16:33.540 ⇒ 00:16:35.140 Samuel Roberts: Yeah, let me jump back.
254 00:16:35.140 ⇒ 00:16:42.889 Mustafa Raja: Decision logs. Approval rece… yeah, we… the second one is good. Second one is good. We’re storing logs.
255 00:16:43.190 ⇒ 00:16:45.620 Mustafa Raja: Where… where are we storing them, though?
256 00:16:48.270 ⇒ 00:16:50.039 Rico Rejoso: Where are we gonna sort it in?
257 00:16:50.040 ⇒ 00:16:50.890 Mustafa Raja: Yeah.
258 00:16:51.710 ⇒ 00:16:52.410 Rico Rejoso: Hmm.
259 00:16:53.320 ⇒ 00:16:56.069 Mustafa Raja: We can show them in Superbase, and let’s see….
260 00:16:58.470 ⇒ 00:17:00.810 Samuel Roberts: Yeah, we could just make a table for them for now.
261 00:17:01.260 ⇒ 00:17:05.339 Mustafa Raja: Human in the loop, getting before nation push, notion push. …
262 00:17:08.680 ⇒ 00:17:09.460 Mustafa Raja: I mean….
263 00:17:13.260 ⇒ 00:17:13.930 Rico Rejoso: Okay.
264 00:17:14.699 ⇒ 00:17:18.929 Mustafa Raja: I feel, I feel the third one might, overlap somewhat.
265 00:17:22.339 ⇒ 00:17:26.129 Rico Rejoso: H, even in the loop, getting before Notion Push.
266 00:17:26.130 ⇒ 00:17:32.000 Mustafa Raja: Yeah, because, if we go up to maybe, milestone 2,
267 00:17:32.570 ⇒ 00:17:34.629 Mustafa Raja: We see that there’s a…
268 00:17:35.560 ⇒ 00:17:38.349 Mustafa Raja: Yeah, implement, retry and queuing logic.
269 00:17:38.570 ⇒ 00:17:39.679 Rico Rejoso: So it’s the same word.
270 00:17:41.970 ⇒ 00:17:42.700 Rico Rejoso: make them.
271 00:17:43.210 ⇒ 00:17:46.230 Samuel Roberts: But is retrying queuing for, like, multiple?
272 00:17:46.750 ⇒ 00:17:47.510 Mustafa Raja: The other one is….
273 00:17:47.510 ⇒ 00:17:49.030 Samuel Roberts: It’s more for, like, last….
274 00:17:49.230 ⇒ 00:17:55.140 Mustafa Raja: Yeah, so the idea is that until they approve a deck, we should not push it to Notion.
275 00:17:56.240 ⇒ 00:17:57.250 Rico Rejoso: Oh, okay.
276 00:17:58.200 ⇒ 00:17:58.870 Mustafa Raja: Yeah.
277 00:17:58.870 ⇒ 00:17:59.360 Samuel Roberts: Yeah.
278 00:17:59.380 ⇒ 00:18:08.440 Mustafa Raja: We try and queuing, and then human in the loop gating, it’s the same thing. The new thing is do not push to Notion until approved.
279 00:18:08.900 ⇒ 00:18:11.729 Rico Rejoso: Okay, so you can, this is….
280 00:18:11.730 ⇒ 00:18:14.510 Mustafa Raja: It could be merged into a single ticket.
281 00:18:14.810 ⇒ 00:18:15.380 Rico Rejoso: Got it.
282 00:18:15.760 ⇒ 00:18:22.929 Rico Rejoso: I’ll think that’ll be noted. I think that’s part as well on milestone 2, right, with the queuing logic, or implement we try.
283 00:18:23.320 ⇒ 00:18:34.180 Mustafa Raja: Yeah, it’s… It’s individual step. It’s individual… is the same ticket spread into individual steps?
284 00:18:34.700 ⇒ 00:18:38.409 Samuel Roberts: Yeah, yeah, they’re all subtasks of each other, or subtasks are the main thing, yeah.
285 00:18:38.710 ⇒ 00:18:41.360 Rico Rejoso: I got it, no worries, I just want to check it out with you guys.
286 00:18:41.670 ⇒ 00:18:43.420 Mustafa Raja: Yeah, totally, it’s good, it’s good.
287 00:18:43.420 ⇒ 00:18:48.759 Rico Rejoso: Okay, for the Slackbot development, the one you were discussing a while ago, as Slack inter…
288 00:18:48.940 ⇒ 00:18:50.500 Rico Rejoso: Give approval buttons.
289 00:18:50.790 ⇒ 00:18:51.630 Mustafa Raja: Hmm.
290 00:18:53.470 ⇒ 00:18:56.839 Rico Rejoso: This is the human-in-the-loop process, right? The approval.
291 00:18:56.840 ⇒ 00:18:58.680 Samuel Roberts: Yeah, it’s part of that too, I think.
292 00:19:00.260 ⇒ 00:19:01.060 Rico Rejoso: Okay.
293 00:19:01.060 ⇒ 00:19:04.850 Mustafa Raja: Message tracking, yeah, we need this for a human in the loop.
294 00:19:05.450 ⇒ 00:19:06.410 Samuel Roberts: Yeah, it’s all part of that.
295 00:19:07.270 ⇒ 00:19:10.470 Rico Rejoso: Role and build alerts for no front push failures.
296 00:19:11.380 ⇒ 00:19:15.260 Mustafa Raja: Observability… Hmm.
297 00:19:16.310 ⇒ 00:19:17.190 Mustafa Raja: Okay.
298 00:19:18.400 ⇒ 00:19:19.379 Rico Rejoso: We can add this.
299 00:19:20.340 ⇒ 00:19:21.849 Mustafa Raja: Yeah, we can add this.
300 00:19:21.850 ⇒ 00:19:25.609 Samuel Roberts: Yeah, definitely, yeah, make a ticket for that first one, the second one….
301 00:19:25.610 ⇒ 00:19:28.830 Mustafa Raja: dataset and automated grader.
302 00:19:29.090 ⇒ 00:19:33.350 Mustafa Raja: I think this is the, brain trust dataset, right?
303 00:19:33.510 ⇒ 00:19:34.910 Samuel Roberts: Yeah, that’s what’s grading it, right?
304 00:19:34.910 ⇒ 00:19:38.580 Mustafa Raja: Yeah, that’s pretty good. So, for that, ….
305 00:19:38.580 ⇒ 00:19:38.940 Rico Rejoso: consistent.
306 00:19:38.940 ⇒ 00:19:41.559 Mustafa Raja: I only have 3… what?
307 00:19:42.120 ⇒ 00:19:43.170 Rico Rejoso: Yeah, go ahead, I’m sorry.
308 00:19:43.170 ⇒ 00:19:51.830 Mustafa Raja: I only have 3, 3 records in that dataset, and the reason is, … Let me….
309 00:19:53.950 ⇒ 00:19:59.490 Samuel Roberts: Well, is this for automated grading of new ones as they start using it?
310 00:20:00.160 ⇒ 00:20:05.310 Mustafa Raja: Yeah, yeah, so we have a dataset, and we see that
311 00:20:05.640 ⇒ 00:20:19.990 Mustafa Raja: automated grid. Actually, what we grade is, the logic of our AI agent, right? So, it’s only going to run the ones that are in the dataset. It’s not going to run the new ones, no.
312 00:20:20.480 ⇒ 00:20:25.769 Samuel Roberts: Right, I think this… the whole point of the automated grader is that, like, we’re seeing how good it is over time.
313 00:20:25.770 ⇒ 00:20:34.330 Mustafa Raja: Yeah, yeah, how good our AI agent… Yeah, yeah, how are… how good, how close… how close, our AI agent is to the expectation.
314 00:20:34.330 ⇒ 00:20:38.100 Samuel Roberts: So I think, yeah, so I think… I think that’s kind of the brain trust already, right?
315 00:20:38.100 ⇒ 00:20:39.099 Mustafa Raja: Yeah, yeah, yeah.
316 00:20:39.710 ⇒ 00:20:43.899 Rico Rejoso: Yeah, I got it. So this is, like, part of the… so this is either done.
317 00:20:44.590 ⇒ 00:20:46.899 Rico Rejoso: Since you mentioned Inter-18 is done, right?
318 00:20:47.290 ⇒ 00:20:48.050 Mustafa Raja: Yep.
319 00:20:48.460 ⇒ 00:20:51.040 Rico Rejoso: Okay, so I can have the smart. How about the other.
320 00:20:51.040 ⇒ 00:20:51.950 Samuel Roberts: Yeah.
321 00:20:51.950 ⇒ 00:20:52.630 Rico Rejoso: I think this is.
322 00:20:52.630 ⇒ 00:20:56.389 Mustafa Raja: Benchmark is, so we have only 3 rows currently.
323 00:20:56.390 ⇒ 00:20:58.380 Samuel Roberts: Yeah, we wouldn’t… we would need more….
324 00:20:58.380 ⇒ 00:21:03.149 Mustafa Raja: The reason why we have only that sort of data coming from them.
325 00:21:03.330 ⇒ 00:21:09.250 Rico Rejoso: Got it, no worries, thank you so much. And lastly, for the pilot rollout, I think…
326 00:21:10.540 ⇒ 00:21:13.199 Rico Rejoso: What do you say about this one? Or the ticket, sir? Should we create that?
327 00:21:13.200 ⇒ 00:21:18.190 Mustafa Raja: I mean, the conduct human-in-the-loop thing would be covered in the meeting, no?
328 00:21:18.430 ⇒ 00:21:19.480 Samuel Roberts: Yeah, I think so.
329 00:21:20.070 ⇒ 00:21:23.240 Rico Rejoso: feedback, so I think this is fine, we don’t have to create any of this.
330 00:21:23.240 ⇒ 00:21:24.599 Mustafa Raja: Yeah, yeah, this is good.
331 00:21:24.600 ⇒ 00:21:25.530 Samuel Roberts: No.
332 00:21:25.530 ⇒ 00:21:27.970 Mustafa Raja: This would be the agenda of the meeting.
333 00:21:28.430 ⇒ 00:21:29.919 Samuel Roberts: Yeah, that’s true, yeah.
334 00:21:29.920 ⇒ 00:21:45.449 Rico Rejoso: No worries. So, I’ll create the other tickets that we have discussed on linear, and assign it for next week. We can set the priority for it as well. Since you mentioned, the only priority that we have is to get the flow going, or the Slack… a Slack bot.
335 00:21:45.800 ⇒ 00:21:46.600 Mustafa Raja: Yeah.
336 00:21:47.080 ⇒ 00:21:50.659 Rico Rejoso: Okay, got it. Let me just finalize that one and put it in.
337 00:21:51.990 ⇒ 00:21:55.610 Rico Rejoso: And all of this is… will be assigned to you, Mustafa, right?
338 00:21:56.190 ⇒ 00:21:57.070 Mustafa Raja: Yep.
339 00:21:57.070 ⇒ 00:21:58.370 Rico Rejoso: Got it. And….
340 00:21:58.370 ⇒ 00:21:58.970 Samuel Roberts: Yeah.
341 00:21:58.970 ⇒ 00:22:00.820 Rico Rejoso: This will be, …
342 00:22:01.050 ⇒ 00:22:07.700 Rico Rejoso: presentation will be next week, correct? As long… along with, next week will be the due date.
343 00:22:08.660 ⇒ 00:22:13.740 Mustafa Raja: Oh, yeah, yeah. But when, do we have a meeting scheduled already?
344 00:22:14.160 ⇒ 00:22:20.579 Rico Rejoso: None yet. Tom is confirming with Matthew. We’re just waiting for the go signal.
345 00:22:20.700 ⇒ 00:22:29.329 Rico Rejoso: And also, Safa, I think Odom requested a work session for next week, around Monday, late Monday or Tuesday.
346 00:22:29.330 ⇒ 00:22:32.479 Mustafa Raja: Yeah, whenever, even today, I’m good with it.
347 00:22:33.140 ⇒ 00:22:34.050 Rico Rejoso: Yeah, I think he’s busy.
348 00:22:34.050 ⇒ 00:22:35.430 Mustafa Raja: Yeah, whenever, whenever is good.
349 00:22:35.430 ⇒ 00:22:36.110 Samuel Roberts: Yeah, yeah.
350 00:22:36.110 ⇒ 00:22:38.940 Rico Rejoso: Got it. I’ll set up the meeting for you guys, and let you know.
351 00:22:39.190 ⇒ 00:22:43.139 Rico Rejoso: Alright, that’s it for me. Thank you so much. Do you guys have any questions?
352 00:22:43.760 ⇒ 00:22:51.870 Samuel Roberts: I would just say, let me know when the Lanier tickets are in, and I just want to make sure that everything’s, like, prioritized the way it is, and then, yeah, let us both know, I guess, so we can check them.
353 00:22:52.100 ⇒ 00:22:53.589 Mustafa Raja: Yeah, that’d be good.
354 00:22:54.050 ⇒ 00:22:58.160 Rico Rejoso: Definitely. I’ll create a ticket, and I’ll message you, Sam, once those are done, okay?
355 00:22:58.430 ⇒ 00:22:59.120 Samuel Roberts: Perfect.
356 00:22:59.360 ⇒ 00:23:03.500 Rico Rejoso: Wonderful. Thank you guys for attending, and… Have a great weekend, guys.
357 00:23:03.560 ⇒ 00:23:04.259 Mustafa Raja: Thank you.
358 00:23:04.920 ⇒ 00:23:05.630 Mustafa Raja: YouTube.
359 00:23:05.690 ⇒ 00:23:06.620 Rico Rejoso: Thank you.