Meeting Title: Default Team Stand-up Date: 2025-09-18 Meeting participants: Rico Rejoso, Mustafa Raja, Samuel Roberts, Uttam Kumaran, Henry Zhao


WEBVTT

1 00:00:13.770 00:00:14.790 Samuel Roberts: No.

2 00:00:15.870 00:00:16.670 Mustafa Raja: Hey…

3 00:00:16.950 00:00:17.880 Rico Rejoso: Hey guys.

4 00:00:19.360 00:00:21.449 Samuel Roberts: Welcome back, everyone.

5 00:00:24.470 00:00:25.100 Rico Rejoso: Right.

6 00:00:26.100 00:00:26.740 Rico Rejoso: the switch.

7 00:00:26.740 00:00:28.470 Samuel Roberts: I don’t know.

8 00:00:30.870 00:00:31.600 Samuel Roberts: Who are we waiting for?

9 00:00:31.600 00:00:32.250 Mustafa Raja: Jenny?

10 00:00:34.730 00:00:40.209 Rico Rejoso: Yeah, I think, Utam will be joining to review, the loom that Mustafa submitted yesterday.

11 00:00:41.750 00:00:42.480 Mustafa Raja: Okay.

12 00:00:50.420 00:00:54.750 Mustafa Raja: For Interlude, I don’t… I don’t think we have much to discuss, right?

13 00:00:54.750 00:00:57.740 Rico Rejoso: Yeah, I mean, you’re still working on 3 to 6, which…

14 00:00:57.740 00:00:58.480 Mustafa Raja: Yeah…

15 00:00:58.480 00:00:59.260 Rico Rejoso: you today.

16 00:00:59.640 00:01:00.330 Mustafa Raja: Yeah.

17 00:01:00.690 00:01:01.240 Rico Rejoso: Okay.

18 00:01:03.990 00:01:06.800 Rico Rejoso: They, hey, Tom.

19 00:01:11.900 00:01:13.950 Rico Rejoso: Great, let me share my screen.

20 00:01:23.250 00:01:31.670 Rico Rejoso: Okay, so maybe we can start off by, going through the updates from Mustafa regarding 8788, the one you just finalized yesterday.

21 00:01:35.640 00:01:36.770 Rico Rejoso: Step up.

22 00:01:37.920 00:01:44.329 Mustafa Raja: Yeah, these are all, in the loom. Apart from that, I can go through the dashboard.

23 00:01:45.960 00:01:48.210 Rico Rejoso: Sure, let me… you can share your screen.

24 00:01:49.380 00:01:50.090 Mustafa Raja: Yep.

25 00:01:50.200 00:01:51.769 Mustafa Raja: A moment only.

26 00:02:22.100 00:02:27.389 Mustafa Raja: Okay, so, let me also open the linear board.

27 00:02:42.110 00:02:44.949 Uttam Kumaran: Yeah, so if I can take a look at the,

28 00:02:45.740 00:02:49.710 Uttam Kumaran: Can take a look at the dashboard, today and give it a review.

29 00:02:50.010 00:02:50.630 Mustafa Raja: Okay.

30 00:02:52.500 00:02:53.779 Uttam Kumaran: It looks really great.

31 00:02:54.220 00:03:02.210 Mustafa Raja: Okay, let me know if you… if you want to go through this dashboard then in this meeting, or should we wait for your review then, before going.

32 00:03:02.210 00:03:05.880 Uttam Kumaran: Yeah, maybe we can just do a quick overview for everybody.

33 00:03:06.210 00:03:07.070 Mustafa Raja: Yeah.

34 00:03:07.670 00:03:26.340 Mustafa Raja: So, this ticket outlines that we need, meetings per active team, and then forms submitted per member. So here we have the meetings by top 100 active teams, and here we have forms submitted by, top 100 members.

35 00:03:26.530 00:03:37.500 Mustafa Raja: Most of this was, developed using, AI. Omnias struggled a lot with submission.

36 00:03:39.180 00:03:52.649 Mustafa Raja: attributed to top 100 members. The reason is that the members table and the submissions table do not have any link together directly. It goes through forms. So forms, forms are linked with members, and forms are also linked with sub…

37 00:04:04.280 00:04:05.290 Rico Rejoso: Sappho?

38 00:04:07.070 00:04:09.100 Uttam Kumaran: Oh, okay, I thought it was… I thought it was me.

39 00:04:09.100 00:04:11.690 Samuel Roberts: I thought it was me, too.

40 00:04:13.510 00:04:14.559 Rico Rejoso: I’m just thinking.

41 00:04:17.570 00:04:18.809 Uttam Kumaran: It’ll give it a sec.

42 00:04:24.830 00:04:29.670 Uttam Kumaran: Okay, maybe Rico, we’ll let him come back. Maybe we can just continue through your stand-up stuff.

43 00:04:30.130 00:04:30.660 Rico Rejoso: Yep.

44 00:04:37.930 00:04:41.000 Rico Rejoso: Yeah, for the tickets that we have, for default.

45 00:04:41.450 00:04:43.310 Rico Rejoso: Can you see my screen?

46 00:04:47.840 00:04:48.520 Rico Rejoso: Alright.

47 00:04:48.980 00:04:52.870 Mustafa Raja: Sorry, my internet went bad. Let me share again.

48 00:04:54.320 00:04:54.960 Rico Rejoso: Okay.

49 00:04:59.330 00:05:01.389 Mustafa Raja: I’ll send requests to share.

50 00:05:06.780 00:05:07.320 Rico Rejoso: Yep.

51 00:05:07.980 00:05:08.789 Rico Rejoso: Allowed it.

52 00:05:10.680 00:05:14.390 Mustafa Raja: Okay, so…

53 00:05:14.720 00:05:30.119 Mustafa Raja: For, for this top 100 environment admissions, what this really is, is a cleanup for this one. So you can see that, all of these form names here have untitled form, and then copy of copy of untitled form.

54 00:05:30.120 00:05:36.469 Mustafa Raja: So this some… this is some sort of noise, so to reduce all of this, I…

55 00:05:36.580 00:05:49.960 Mustafa Raja: I hit those rules, and those accounted for 76% of the, total submissions, and then, the rest 23 are, what we can drive some analytics from.

56 00:05:51.200 00:05:56.659 Mustafa Raja: And then for this, let’s look into what we are doing over here.

57 00:05:59.170 00:06:01.090 Mustafa Raja: Oh, yeah.

58 00:06:01.200 00:06:04.330 Mustafa Raja: Okay, should…

59 00:06:09.640 00:06:33.860 Mustafa Raja: So what this essentially is, is we have all of these form names now, and we can now categorize them based on, their names, and, identify the purpose of, these forms. So, we can say, okay, if a form name contains demo, or booking, or primary sign, or

60 00:06:34.410 00:06:36.370 Mustafa Raja: Try for free.

61 00:06:36.370 00:06:48.899 Mustafa Raja: Or things like that. We can say it’s, we can categorize it as demo and trial booking. Similarly, if a form name has sales or contact.

62 00:06:48.900 00:06:59.670 Mustafa Raja: or lead, or similar. We can… we are categorizing it as sales and lead generation, and similar… similarly for other categories also.

63 00:07:01.300 00:07:06.349 Mustafa Raja: Let’s go to the next ticket…

64 00:07:10.490 00:07:19.840 Mustafa Raja: Highlighter option. Okay, so… hmm, this actually are… Two funnels, let me…

65 00:07:22.600 00:07:37.150 Mustafa Raja: Yeah, this highlight, this highlights two funnels. One is members to teams, to meetings, to submissions, and then to revenue touchpoint, and the other one is percentage of members who create a form, percentage of,

66 00:07:37.150 00:07:43.209 Mustafa Raja: Team booking meetings, and percentage of workflows leading to successful triggers.

67 00:07:46.970 00:07:54.800 Mustafa Raja: Yeah, so, so these are just, essentially, KPIs, that Tom AI helped me to craft.

68 00:07:55.710 00:08:05.590 Mustafa Raja: Pretty simple counts. The only thing that’s, mentionable over here is the revenue touchpoints. What this really is, we…

69 00:08:17.370 00:08:19.109 Uttam Kumaran: Yeah, I think it was cutting in and out.

70 00:08:19.110 00:08:19.770 Rico Rejoso: Yep.

71 00:08:21.170 00:08:26.030 Uttam Kumaran: Okay, maybe we’ll just… we’ll just let him send an update in Slack, we can just continue their stand-up.

72 00:08:26.460 00:08:27.920 Rico Rejoso: Let me share my screen.

73 00:08:29.730 00:08:30.480 Rico Rejoso: Okay.

74 00:08:32.380 00:08:38.440 Rico Rejoso: So, apart from the updates from Mustafa in regards to, 88 and 87 to 90 pickup.

75 00:08:38.530 00:08:55.040 Rico Rejoso: The blocked ones, we’re aiming to discuss this one during the, meeting with default team later on. And same issue, these are all missing keys, as per Mustafa, so plan to discuss this one later during the meeting. And for 76 and 72,

76 00:08:55.560 00:09:01.180 Rico Rejoso: This is boss, as per default, okay, team, so, planning to

77 00:09:01.290 00:09:04.099 Rico Rejoso: I’ll get updates regarding this one during the meeting as well.

78 00:09:05.790 00:09:11.560 Rico Rejoso: So, we haven’t made any progress aside from the updates from staff for 88 tonight.

79 00:09:12.290 00:09:20.420 Rico Rejoso: And Henry, for the discussion, CDP discussion, I believe, since it’ll be canceled yesterday’s meeting, it’s been moved to next week, right?

80 00:09:21.010 00:09:26.829 Henry Zhao: Yeah, I just want to know from Utam, Utam, do you think we should leave this for the upsell, or should we talk about it next week in the sync?

81 00:09:28.710 00:09:31.159 Uttam Kumaran: This is for… which one?

82 00:09:31.160 00:09:40.729 Henry Zhao: Just talking about, like, should they, like, make their CDP more robust by bringing in UTM tracking and, any other things that we can do to use CDP for?

83 00:09:41.730 00:09:44.899 Uttam Kumaran: I think it’s worth just talking to them about, that’s fine.

84 00:09:46.520 00:09:51.229 Uttam Kumaran: I think we can leave it for this week, it’s just… I think we can just inform Caitlin on, like, what the decisions are.

85 00:09:51.400 00:09:51.890 Uttam Kumaran: Like.

86 00:09:51.890 00:09:52.940 Henry Zhao: Okay, unless you…

87 00:09:52.940 00:09:53.480 Uttam Kumaran: Yeah.

88 00:09:54.360 00:09:59.049 Henry Zhao: be there to give context of, like, if our contract ends this month, like, this is a long-term project.

89 00:09:59.370 00:10:01.440 Henry Zhao: That it would fit into, like…

90 00:10:01.440 00:10:07.950 Uttam Kumaran: Definitely, yeah, I’m already working with, sort of, Justin and Rico on putting that together, so that’s perfect.

91 00:10:09.920 00:10:11.180 Henry Zhao: Alright, then that’s perfect.

92 00:10:11.410 00:10:12.460 Henry Zhao: That’s what we’ll do.

93 00:10:14.720 00:10:26.960 Rico Rejoso: Alright, so yeah, for default, I guess, that sums up, all for this setup. Aside from the tickets that we have created, based from staff suggestions and recommendations, we, on the current cycle.

94 00:10:27.250 00:10:34.370 Rico Rejoso: That’s what we have. We will be discussing the other tickets that are paused and blocked, and blocked during our,

95 00:10:34.680 00:10:35.989 Rico Rejoso: During the meeting later.

96 00:10:37.090 00:10:41.110 Rico Rejoso: And also present the updates on the dashboard from Mustafa.

97 00:10:45.270 00:10:48.480 Rico Rejoso: Anything you, you wanted to add, Sam?

98 00:10:51.730 00:10:53.220 Samuel Roberts: No, they’re not for default.

99 00:10:54.130 00:10:59.180 Rico Rejoso: Okay, that covers it, everything for default for, up to this day.

100 00:10:59.380 00:11:00.790 Rico Rejoso: for Interlude.

101 00:11:01.310 00:11:16.999 Rico Rejoso: Currently, staff is working on the 36th ticket to our prior, this is a prior ticket, that we’re looking to finalize within today for your meeting with Matthew tomorrow, and we’ll provide updates within today, if there’s anything. I think,

102 00:11:17.370 00:11:20.219 Rico Rejoso: The sub-ticket is done.

103 00:11:20.440 00:11:23.900 Rico Rejoso: As for Sam, and working on to finalizing this one.

104 00:11:25.860 00:11:36.100 Samuel Roberts: Yeah, BlankFuse has a N8N node that you can use to pull prompts directly, so there’s no weird hacks we have to do in N8N, so that seems like the best one for this

105 00:11:36.280 00:11:38.599 Samuel Roberts: They also have a community one.

106 00:11:38.750 00:11:44.660 Samuel Roberts: But apparently we can’t use community nodes in the hosted… NN, but,

107 00:11:44.980 00:11:57.389 Samuel Roberts: that’s a future problem, but for… for what Mika was asking about, like, tweaking prompts and everything, this should work. And so Mustafa should have access to the LangFuse now that I set up for Interlude, so we can start moving prompts into there.

108 00:11:58.240 00:12:05.059 Uttam Kumaran: And the goal of that is that they edit the prompts from Slack, or, like, I guess the alternative was go into N8N and edit it?

109 00:12:05.820 00:12:08.030 Samuel Roberts: Yeah, so the idea was,

110 00:12:08.080 00:12:27.200 Samuel Roberts: you know, we have a number of different prompts for different parts of the… like, there’s different sub-agents in there, and so, you know, we… or Mustafa really, like, probably worked on those prompts based on, Matthew’s, like, previous chats and everything, right? But if Mika wants to, like, tweak those a little bit.

111 00:12:27.470 00:12:35.500 Samuel Roberts: you would have to go into N8N into each one. This is gonna make it so that they can just do it in length views, and they can then track changes over time.

112 00:12:37.050 00:12:48.609 Uttam Kumaran: And then link, but is it gonna be another tool, or what is… what is LinkViews? Like, it… I think we… we tried link views for observability, but I guess, like, talk… talk me through, like, investing in another tool.

113 00:12:49.650 00:12:53.809 Samuel Roberts: Yeah, this is for the prompt management for the different agents, so as they want to change that over time.

114 00:12:54.050 00:12:55.569 Samuel Roberts: They’ll be able.

115 00:12:55.570 00:12:56.180 Uttam Kumaran: attractive change.

116 00:12:56.180 00:12:59.149 Samuel Roberts: They could go into any n and do it, but there’s not a lot of…

117 00:12:59.570 00:13:05.769 Samuel Roberts: historical records of what changes there for the, like, specific prompts.

118 00:13:05.770 00:13:12.249 Uttam Kumaran: screenshot, or is there any way I can just poke at that? I didn’t know that, LinkView’s had for prompt management and stuff.

119 00:13:12.250 00:13:20.329 Samuel Roberts: Yeah, I can add you. I was actually just playing around with it for the platform as well, trying to get some traceability stuff. But yeah, I can invite you to the prompt management stuff. I haven’t…

120 00:13:20.450 00:13:26.220 Samuel Roberts: dug into it too much, but I just saw that they have it, and they have an innate end node that lets you pull them right in, so…

121 00:13:26.220 00:13:27.410 Uttam Kumaran: Cool.

122 00:13:27.410 00:13:28.370 Samuel Roberts: What about you, though?

123 00:13:28.630 00:13:36.490 Uttam Kumaran: Yeah, I think… Well, we tried to use language maybe a year ago. We evaluated them for observability.

124 00:13:36.590 00:13:38.809 Uttam Kumaran: And actually for evals.

125 00:13:39.480 00:13:39.860 Samuel Roberts: And so…

126 00:13:39.860 00:13:45.330 Uttam Kumaran: they weren’t that good with evals back then. And, like, again, a lot of our stuff was N8N, so…

127 00:13:45.510 00:13:46.889 Samuel Roberts: They have, like, you know…

128 00:13:47.150 00:13:48.700 Uttam Kumaran: Yeah, so I think that’s…

129 00:13:49.230 00:13:53.090 Uttam Kumaran: that’s one thing, but yeah, I would love to see that, and yeah, I don’t know, we…

130 00:13:53.540 00:13:59.209 Uttam Kumaran: I guess it’s a bigger conversation for the AI team about how we do prop management. I mean, we were talking about…

131 00:13:59.600 00:14:05.160 Uttam Kumaran: just putting it all in Supabase or something, or it ends up in code, but yeah, ideally.

132 00:14:05.540 00:14:08.820 Uttam Kumaran: It would be great that it doesn’t end up in code, so that… Exactly.

133 00:14:08.820 00:14:09.220 Samuel Roberts: Yeah.

134 00:14:09.220 00:14:13.510 Uttam Kumaran: I’m part of the thing that Non-tech users can tweak.

135 00:14:13.870 00:14:14.940 Samuel Roberts: Totally.

136 00:14:15.060 00:14:22.560 Uttam Kumaran: Similarly, I think people in that sort of editing phase will want to, like, replay session and see the impact.

137 00:14:22.740 00:14:30.710 Uttam Kumaran: So I wonder if that’s something, too, that can be possible. It’s because if you put yourself in their shoes, if they’re just like, okay, I want to tweak

138 00:14:30.940 00:14:33.820 Uttam Kumaran: This prompt, they’re gonna immediately want to test it.

139 00:14:33.970 00:14:37.740 Uttam Kumaran: Like, see whether the outcome is as expected, so…

140 00:14:38.450 00:14:40.630 Uttam Kumaran: I wonder, like, as part of

141 00:14:41.030 00:14:49.109 Uttam Kumaran: making this decision, we consider that as well. Like, how does it make it easy for a non-business user to test the outcomes?

142 00:14:49.210 00:14:56.699 Uttam Kumaran: I know in NIDN you can go replay, but, like, again, it replays the whole thing. Instead, you just kind of want to see the…

143 00:14:56.820 00:15:00.150 Uttam Kumaran: immediate LLM output at that step, basically.

144 00:15:00.890 00:15:01.710 Samuel Roberts: Yeah.

145 00:15:02.350 00:15:02.920 Uttam Kumaran: Yeah.

146 00:15:02.920 00:15:05.420 Samuel Roberts: NHN might be the limiting factor here.

147 00:15:05.420 00:15:06.040 Uttam Kumaran: Okay.

148 00:15:06.410 00:15:13.849 Samuel Roberts: like, I think… I haven’t dug into all the… all the features into Langviews, I was kind of playing around just before this about the traceability stuff.

149 00:15:14.070 00:15:15.359 Samuel Roberts: Because it’s using…

150 00:15:15.860 00:15:24.620 Samuel Roberts: open telemetry, which seems like it can be brought into a few different things, but getting to work with CopilotKit’s a little weird. So I’m trying to, like, wrap the OpenAI calls, at least.

151 00:15:24.990 00:15:37.829 Samuel Roberts: But it still doesn’t know about the N8N usage yet, so I’m trying to figure that out. But, they have the prompt management, which is kind of what I was excited about for this specific thing, because Mika asked about it last Friday.

152 00:15:38.250 00:15:47.299 Samuel Roberts: for the rerunning and, like, for evals and stuff, I think it… more of the functionality would have to move into code for that, probably?

153 00:15:47.750 00:15:51.430 Samuel Roberts: Like, right now, I think the… the general…

154 00:15:52.120 00:15:55.339 Samuel Roberts: use is, you know, Mika uses it in Slack.

155 00:15:55.590 00:16:05.599 Samuel Roberts: He… to, like, test changes, I think you’re right. Like, there’s not a, oh, I just made a change to the narrative flow, what would that have generated for me? I think it would just be…

156 00:16:05.600 00:16:15.779 Samuel Roberts: oh, okay, I reworked the prompt, let me regenerate it back, which is not ideal overall, but is better than probably jumping into N8N and not knowing what changes you made over time.

157 00:16:15.830 00:16:20.339 Samuel Roberts: But I think to do that kind of quick.

158 00:16:21.530 00:16:27.569 Samuel Roberts: You know, non-technical kind of prompt Tweaking or prompt, refinement.

159 00:16:27.720 00:16:31.579 Samuel Roberts: I think we need to move a little bit further away from N8N for some of that stuff.

160 00:16:31.750 00:16:32.320 Samuel Roberts: Oh.

161 00:16:32.320 00:16:33.140 Uttam Kumaran: Okay, stop.

162 00:16:33.810 00:16:37.179 Samuel Roberts: But that’s just my gut based on what I’ve seen so far, so yeah.

163 00:16:37.180 00:16:44.159 Uttam Kumaran: Yeah, while you’re poking at this problem, I think just consider the… Like, the testing aspect?

164 00:16:44.260 00:16:45.580 Samuel Roberts: Yes.

165 00:16:46.970 00:16:52.560 Samuel Roberts: I’ll look at the eval specifically now and see what it’s like. Was there, like, a spike from this last year or anything?

166 00:16:53.080 00:16:54.220 Samuel Roberts: Like a dock?

167 00:16:54.220 00:17:00.410 Uttam Kumaran: There was, yeah. I think search for length views in Notion? Yeah.

168 00:17:00.410 00:17:01.520 Samuel Roberts: Totally will now, yeah.

169 00:17:01.710 00:17:08.460 Uttam Kumaran: Search it in Notion, but again, we were looking at it, that’s why we ended up with Brain Trust, because we were looking at eval providers.

170 00:17:08.790 00:17:13.210 Uttam Kumaran: So we didn’t necessarily use it for prompt management.

171 00:17:13.520 00:17:16.930 Uttam Kumaran: But I would also, again, I would have a look at if…

172 00:17:17.130 00:17:22.980 Uttam Kumaran: like, Brain Trust has anything, if Arise has anything,

173 00:17:24.410 00:17:28.220 Uttam Kumaran: Yeah, and maybe just do a quick, like, spike on…

174 00:17:28.620 00:17:35.439 Uttam Kumaran: basically prompt management. I mean, my assumption… I thought this was all gonna end up in code, so it’s actually really nice that

175 00:17:36.060 00:17:40.219 Uttam Kumaran: It’s not ending up in code, but my… my feeling with everybody who…

176 00:17:40.460 00:17:47.599 Uttam Kumaran: does prompt management would add some sort of, like, testing loop, right? Because… but, again, you can let me know what you find out.

177 00:17:48.290 00:17:55.919 Samuel Roberts: Yeah, no, I can… I can spend a little more time on this. I was just trying to get something into N8N quick for this, but, I can spend a little more time.

178 00:17:56.040 00:17:57.859 Samuel Roberts: Digging into some of the other ones, too.

179 00:17:58.290 00:17:58.880 Uttam Kumaran: Great.

180 00:17:59.900 00:18:01.190 Samuel Roberts: Totally. Cool.

181 00:18:03.630 00:18:05.430 Rico Rejoso: Yeah, and also.

182 00:18:06.010 00:18:24.749 Rico Rejoso: Sam Mousap, and I met yesterday to discuss some of the tickets that we should have for Interlude, and decided that we will be creating the tickets tomorrow, Friday after the meeting with Micah, and also consider some of the discussion that you will be having with Matthew to finalize the tickets that we have planning on for next week.

183 00:18:25.840 00:18:26.480 Uttam Kumaran: Okay.

184 00:18:26.960 00:18:31.540 Rico Rejoso: Alright, and also for default, any feedback regarding the,

185 00:18:31.670 00:18:37.889 Rico Rejoso: dashboard that Mustafa created, so we can revise at the same time. If there’s none, we’ll be closing out the tickets here.

186 00:18:38.380 00:18:41.419 Uttam Kumaran: Yeah, I’ll send it, today, in the next, like, hour or so.

187 00:18:41.760 00:18:50.509 Rico Rejoso: Got it, thank you so much. I think that covers everything for default and interrog as of now. Anything else, we’ll be communicating through Slack.

188 00:18:51.410 00:18:51.970 Uttam Kumaran: Okay.

189 00:18:52.570 00:18:57.239 Rico Rejoso: Alrighty. Thank you guys for joining the meeting on the stand-up today. Have a great day.

190 00:18:57.600 00:18:58.320 Uttam Kumaran: Thanks.

191 00:18:58.320 00:18:59.169 Henry Zhao: Thank you, guys.

192 00:18:59.520 00:19:00.700 Samuel Roberts: Thanks, you do.