Meeting Title: ABC Standup Date: 2025-09-18 Meeting participants: Mustafa Raja, Casie Aviles, Samuel Roberts, Amber Lin
WEBVTT
1 00:00:14.630 ⇒ 00:00:15.730 Mustafa Raja: Hey, Casey.
2 00:00:16.970 ⇒ 00:00:18.630 Casie Aviles: Hey, hey, how are you?
3 00:00:19.820 ⇒ 00:00:20.940 Mustafa Raja: Yeah, doing good.
4 00:00:22.460 ⇒ 00:00:23.260 Casie Aviles: Nice.
5 00:00:24.160 ⇒ 00:00:32.920 Mustafa Raja: Yeah, looks like we can, we can now install nodes in the cloud environment, too. Did you see the screenshot that I sent in?
6 00:00:33.390 ⇒ 00:00:33.830 Mustafa Raja: Oh, really?
7 00:00:34.420 ⇒ 00:00:35.390 Mustafa Raja: Yeah…
8 00:00:35.580 ⇒ 00:00:37.530 Casie Aviles: So you can install community nodes.
9 00:00:38.770 ⇒ 00:00:42.129 Mustafa Raja: It looks like this, because, if you go to…
10 00:00:43.590 ⇒ 00:00:49.029 Mustafa Raja: AI team channel, this is the… this is the message that I am getting from, LangFuse node.
11 00:00:49.210 ⇒ 00:00:58.020 Mustafa Raja: So it’s in, it’s a community node, and they are asking me to ask in engineering at Brainforge to get it installed.
12 00:00:59.040 ⇒ 00:01:01.609 Casie Aviles: So this, it looks like that we can now.
13 00:01:03.150 ⇒ 00:01:03.970 Casie Aviles: I see.
14 00:01:03.970 ⇒ 00:01:05.040 Samuel Roberts: certain ones, yeah.
15 00:01:09.110 ⇒ 00:01:11.839 Mustafa Raja: Yeah, I just need approval if I can install.
16 00:01:11.970 ⇒ 00:01:12.799 Mustafa Raja: Or not.
17 00:01:15.270 ⇒ 00:01:23.600 Samuel Roberts: Yeah, I think we’re gonna do that. Sorry, one sec. So, I’m thinking that…
18 00:01:24.780 ⇒ 00:01:30.960 Samuel Roberts: Well, actually, okay, so, I don’t know what happened. You were in and out of the call earlier in the shop. I don’t know if you heard what we were talking about with you, Tom.
19 00:01:31.140 ⇒ 00:01:35.570 Samuel Roberts: about… looking at… the…
20 00:01:36.430 ⇒ 00:01:41.170 Samuel Roberts: Well, I was looking at tracing and stuff, and that’s how I kind of ended up onlinefuse, and saw that they also had
21 00:01:41.380 ⇒ 00:01:44.610 Samuel Roberts: The prompt management?
22 00:01:44.730 ⇒ 00:01:53.920 Samuel Roberts: And then I saw they had the N8N. He was suggesting doing a little more of a spike, because, like, we’re already using brain trust for the evals, because I guess we had looked at
23 00:01:54.220 ⇒ 00:01:56.759 Samuel Roberts: LangFuse in the past, and their evals weren’t good.
24 00:01:58.000 ⇒ 00:01:58.860 Mustafa Raja: Oh, okay.
25 00:01:59.200 ⇒ 00:02:01.009 Samuel Roberts: So I’m… I’m now, I think…
26 00:02:01.500 ⇒ 00:02:05.480 Samuel Roberts: My thought is, for Interlude, we still want to… sorry, Amber, just one sec.
27 00:02:05.860 ⇒ 00:02:18.249 Samuel Roberts: We probably still want to use LangFuse, just because otherwise there’s not really a good way to integrate it with N8N right now, but whether or not that’s kind of the long-term decision for usual cases like this remains to be seen, but I think
28 00:02:18.630 ⇒ 00:02:19.780 Samuel Roberts: It’s good to go ahead and add it.
29 00:02:20.580 ⇒ 00:02:28.389 Mustafa Raja: Yeah, I guess even if we cannot install the node itself, we should be able to make HTTP requests if they have an API, no?
30 00:02:29.330 ⇒ 00:02:37.330 Samuel Roberts: Yeah, that’s… I mean, I figure we’ll probably have to end up doing that with some… if we’re gonna use Brain Trust or something anyway, but I want to do a little more exploration of that.
31 00:02:37.440 ⇒ 00:02:41.570 Samuel Roberts: But I was hoping to get it done by tomorrow, so I don’t know. But we can… we can jump to…
32 00:02:42.050 ⇒ 00:02:43.779 Samuel Roberts: Into this meeting, we can talk later.
33 00:02:43.930 ⇒ 00:02:46.620 Samuel Roberts: I just saw your post, so that’s why I was like, yeah. Okay.
34 00:02:46.740 ⇒ 00:02:47.260 Samuel Roberts: Thank you very much.
35 00:02:47.720 ⇒ 00:02:48.300 Mustafa Raja: Okay.
36 00:02:48.300 ⇒ 00:02:49.969 Amber Lin: Hello!
37 00:02:50.470 ⇒ 00:02:57.630 Amber Lin: There’s all two things, I’m good. One on the database, and one on the plan for the transcripts and expansion.
38 00:02:57.630 ⇒ 00:02:58.219 Samuel Roberts: And so on.
39 00:02:59.360 ⇒ 00:03:02.679 Casie Aviles: Yeah, I can give an update first on the…
40 00:03:03.370 ⇒ 00:03:08.840 Casie Aviles: Yeah, on the form stuff, so I already have an A10 workflow for that.
41 00:03:09.550 ⇒ 00:03:18.870 Casie Aviles: I can send you a loon later, I’m just finishing up something. Should be able to send it before, before the meeting later with them.
42 00:03:21.910 ⇒ 00:03:26.950 Casie Aviles: But yeah, it’s, it’s just the insert thing. I showed it earlier to the team, how it works.
43 00:03:27.680 ⇒ 00:03:32.709 Casie Aviles: So, yeah, we have at least a minimum working version for that.
44 00:03:34.630 ⇒ 00:03:45.619 Samuel Roberts: Yeah, I actually had a couple questions about that. So, right now, Amber, they have a sheet, or a form that they use, and there’s approval process before it actually gets changed on their Google Sheets, is that correct?
45 00:03:46.600 ⇒ 00:03:47.460 Amber Lin: Yes.
46 00:03:47.950 ⇒ 00:03:48.580 Samuel Roberts: Okay.
47 00:03:48.740 ⇒ 00:03:50.430 Samuel Roberts: So, I think, and we talked about this.
48 00:03:50.430 ⇒ 00:03:54.299 Amber Lin: Customers are the same people that make the changes, so they just do it.
49 00:03:55.030 ⇒ 00:03:58.779 Samuel Roberts: Oh, it is, it’s not like someone else has to approve it, they’re just… this is that extra step for them?
50 00:03:59.050 ⇒ 00:04:03.979 Amber Lin: Yeah, but if we do it, then, say, Yvette or Janiece will have to approve it.
51 00:04:04.290 ⇒ 00:04:05.960 Amber Lin: That’s okay, that’s fine. Well, so…
52 00:04:06.340 ⇒ 00:04:10.029 Amber Lin: I was just talking earlier about adding a little bit of a human-in-the-loop step.
53 00:04:10.120 ⇒ 00:04:16.829 Samuel Roberts: So, the idea right now, the way, Casey’s implemented it, is this N8N form
54 00:04:17.160 ⇒ 00:04:20.500 Samuel Roberts: We’ll make a superbase request to update the database.
55 00:04:21.329 ⇒ 00:04:25.019 Samuel Roberts: We need an approval step in there, though, I’m assuming, because we wanted to…
56 00:04:25.020 ⇒ 00:04:29.759 Amber Lin: Let me… let me confirm today, because if we don’t, then it’ll be easier.
57 00:04:29.760 ⇒ 00:04:33.919 Samuel Roberts: Definitely. Okay, that’s a good… this is kind of… I just… I don’t have great context on, like, the…
58 00:04:34.160 ⇒ 00:04:38.930 Samuel Roberts: the way they used to do it, and exactly what we’re trying to replace or implement here, but I just wanted to make sure that.
59 00:04:38.930 ⇒ 00:04:39.580 Amber Lin: All good.
60 00:04:39.580 ⇒ 00:04:45.619 Samuel Roberts: Because, before we finish that, because I, yeah, theoretically this lets them just, like, change anything in the database directly.
61 00:04:46.020 ⇒ 00:04:52.799 Samuel Roberts: is… Okay, if that’s what they’re looking for, but it’s also, like… Very powerful, so.
62 00:04:53.490 ⇒ 00:04:54.140 Samuel Roberts: Approvals problem.
63 00:04:54.140 ⇒ 00:04:54.660 Amber Lin: Yeah.
64 00:04:54.660 ⇒ 00:04:56.179 Samuel Roberts: Okay step to have anyway.
65 00:04:56.540 ⇒ 00:04:57.140 Amber Lin: Yeah.
66 00:04:57.930 ⇒ 00:05:04.510 Amber Lin: So… Sounds good. I’ll wait for the video, and I’ll take some…
67 00:05:04.770 ⇒ 00:05:12.749 Amber Lin: I’ll take some screenshots, or if you can, just send some screenshots to me, and then I can show them during the presentation later.
68 00:05:13.420 ⇒ 00:05:15.739 Amber Lin: What about…
69 00:05:15.780 ⇒ 00:05:19.200 Casie Aviles: Sam, on your side. Did Utam…
70 00:05:19.200 ⇒ 00:05:22.039 Amber Lin: Get the, updated hours.
71 00:05:22.800 ⇒ 00:05:32.560 Samuel Roberts: I made one change to that thing, which is just that I don’t think the real-time stuff is possible based on what I’ve seen. The other side of it, I…
72 00:05:32.820 ⇒ 00:05:36.149 Samuel Roberts: I actually didn’t look at the rest of it, to be honest. I kind of…
73 00:05:36.490 ⇒ 00:05:46.610 Samuel Roberts: that. But yeah, for… for the proposal, I can finish the hours probably now, because I… I now see how we can do it. The…
74 00:05:46.800 ⇒ 00:05:48.610 Samuel Roberts: The guy yesterday was very helpful.
75 00:05:48.930 ⇒ 00:05:53.430 Samuel Roberts: Because basically, I was hitting the wrong endpoint.
76 00:05:53.870 ⇒ 00:05:58.950 Samuel Roberts: Where you can get some transcripts, but not everything, but we don’t actually have access to the full transcripts right now.
77 00:05:59.830 ⇒ 00:06:00.800 Amber Lin: Hmm.
78 00:06:00.800 ⇒ 00:06:05.859 Samuel Roberts: So I, Yvette sent an email to Tim, I believe?
79 00:06:06.530 ⇒ 00:06:09.779 Samuel Roberts: To try to update that API key’s access.
80 00:06:10.660 ⇒ 00:06:11.330 Amber Lin: Okay.
81 00:06:11.770 ⇒ 00:06:24.659 Samuel Roberts: So, I can try to… I’ll make an estimate on the hours there, but now that I kind of see how it works, it’s not as bad, but getting that demo is still kind of not happening, because I just can’t get the transcripts yet,
82 00:06:24.660 ⇒ 00:06:29.600 Amber Lin: Okay, gotcha. Update, transcript, API.
83 00:06:29.820 ⇒ 00:06:31.240 Amber Lin: Credentials…
84 00:06:31.560 ⇒ 00:06:42.609 Amber Lin: Alright, I’ll note that down as well. Any input you’re… any of my input you need on the… on the proposal or plan, or should we… are we good to send to Utam?
85 00:06:42.610 ⇒ 00:06:45.149 Samuel Roberts: I mean, did you see some of Utam’s comments in there?
86 00:06:45.620 ⇒ 00:06:48.809 Amber Lin: Nope, not yet. Let me…
87 00:06:48.810 ⇒ 00:06:49.140 Samuel Roberts: Okay.
88 00:06:49.140 ⇒ 00:06:50.870 Amber Lin: Check…
89 00:06:51.100 ⇒ 00:06:55.009 Samuel Roberts: Yeah, a couple of his things were, like, it seemed very LM-generated, which…
90 00:06:55.010 ⇒ 00:06:56.539 Amber Lin: Yeah…
91 00:06:56.540 ⇒ 00:07:05.369 Samuel Roberts: I think was… but it also, like, one of his comments… one of his comments was, like, who asked for this? And it was actually something that was in there when he put the thing together, so I’m not sure, like…
92 00:07:05.820 ⇒ 00:07:07.440 Samuel Roberts: You know, where it all came from.
93 00:07:07.440 ⇒ 00:07:11.459 Amber Lin: Well, his part is most likely AI-generated as well.
94 00:07:11.460 ⇒ 00:07:16.340 Samuel Roberts: Yeah, that’s why I just think we need to do a… probably a tighter pass on it.
95 00:07:16.410 ⇒ 00:07:17.510 Amber Lin: Yeah.
96 00:07:17.660 ⇒ 00:07:27.520 Samuel Roberts: Because there are a few things there, and then… yeah, the 8x8 stuff, I can… I’ll probably just buffer a little bit extra, because there’s still some uncertainty around the API, but there’s a little bit more…
97 00:07:27.660 ⇒ 00:07:28.899 Samuel Roberts: Clarity on that?
98 00:07:29.050 ⇒ 00:07:36.200 Samuel Roberts: But I kind of just commented that the whole real-time thing seems not feasible at this point, based on my understanding of their API.
99 00:07:36.660 ⇒ 00:07:37.330 Amber Lin: Hmm.
100 00:07:38.110 ⇒ 00:07:42.059 Samuel Roberts: So… That eliminates a whole chunk, potentially, which is probably.
101 00:07:42.060 ⇒ 00:07:42.760 Amber Lin: Okay.
102 00:07:43.300 ⇒ 00:07:46.560 Amber Lin: Yeah. Let me know after you…
103 00:07:47.070 ⇒ 00:07:53.429 Amber Lin: change the main hour estimates or contents, and I can go in and help edit the wording, and then…
104 00:07:53.760 ⇒ 00:07:54.730 Amber Lin: Okay.
105 00:07:55.090 ⇒ 00:07:56.570 Amber Lin: Help with that.
106 00:07:58.790 ⇒ 00:08:00.160 Samuel Roberts: Cool.
107 00:08:00.510 ⇒ 00:08:04.580 Samuel Roberts: You… my Notion is not loading, right? I don’t have the slide bar, there we go, okay.
108 00:08:05.630 ⇒ 00:08:10.760 Samuel Roberts: Yeah, okay, I can take a swing at that. Yeah, the real-time stuff, enhanced features…
109 00:08:11.020 ⇒ 00:08:13.659 Samuel Roberts: We’ll probably kill that a little bit, but…
110 00:08:15.230 ⇒ 00:08:18.959 Samuel Roberts: Okay, yeah, I’ll take care of that and paint you as soon as I’ve got it.
111 00:08:19.350 ⇒ 00:08:19.960 Amber Lin: Alright.
112 00:08:20.290 ⇒ 00:08:21.360 Amber Lin: Sounds good.
113 00:08:22.200 ⇒ 00:08:25.630 Amber Lin: Okay.
114 00:08:27.360 ⇒ 00:08:32.500 Amber Lin: Sounds good, that’s all. I’m going to go do the slides, and then we can meet… we can meet tomorrow.
115 00:08:32.500 ⇒ 00:08:33.110 Samuel Roberts: Okay.
116 00:08:33.960 ⇒ 00:08:35.500 Amber Lin: Alright, thanks all.
117 00:08:35.510 ⇒ 00:08:36.339 Mustafa Raja: Bye.
118 00:08:36.340 ⇒ 00:08:36.960 Samuel Roberts: Thanks.
119 00:08:36.960 ⇒ 00:08:38.070 Amber Lin: Yeah. Oh, yep.
120 00:08:38.590 ⇒ 00:08:41.090 Mustafa Raja: Am I good to install the node?
121 00:08:42.280 ⇒ 00:08:48.179 Mustafa Raja: That I’m mentioning. Do you guys want… do you guys want to use this meeting room? I have, like, another 10 minutes.
122 00:08:48.730 ⇒ 00:08:52.539 Samuel Roberts: Yeah, it won’t take that long, so yeah, you’re good to go, but yeah, we’ll just finish up in a second. Thank you.
123 00:08:52.820 ⇒ 00:08:53.170 Amber Lin: I’ll do it.
124 00:08:53.170 ⇒ 00:08:54.070 Mustafa Raja: Thank you, thank you.
125 00:08:56.160 ⇒ 00:09:02.750 Samuel Roberts: Yeah, I think you’re good to install it. I don’t see why there’s any reason not to, at least to just test this out and see how it works.
126 00:09:02.750 ⇒ 00:09:03.480 Mustafa Raja: Okay.
127 00:09:03.480 ⇒ 00:09:08.969 Samuel Roberts: Because, like, if it… if it is much simpler than doing, like, an API call.
128 00:09:09.090 ⇒ 00:09:11.750 Samuel Roberts: then that’s a point for LangFuse, and if it’s…
129 00:09:12.250 ⇒ 00:09:13.700 Mustafa Raja: If not, then…
130 00:09:13.840 ⇒ 00:09:19.670 Samuel Roberts: Yeah. Maybe we still go with Brain Trust, because Uten’s point was that eventually we’re going to want to do more
131 00:09:19.800 ⇒ 00:09:25.100 Samuel Roberts: like… Eval loops with this prompt changing?
132 00:09:25.530 ⇒ 00:09:26.260 Mustafa Raja: Hmm.
133 00:09:26.450 ⇒ 00:09:35.929 Samuel Roberts: So, like, if Mika’s going in and changing something, like, we’d like to be able to potentially rerun what he did, or… or he’d like to be able to probably rerun what he did and see how it would change the output.
134 00:09:36.230 ⇒ 00:09:41.089 Samuel Roberts: I think that’s a little bit… hard right now with N8M?
135 00:09:41.480 ⇒ 00:09:42.250 Mustafa Raja: Yeah.
136 00:09:42.630 ⇒ 00:09:44.249 Samuel Roberts: So, that might have to be a…
137 00:09:44.520 ⇒ 00:09:48.210 Mustafa Raja: Yeah, we do get versions with it too, so that’s really good.
138 00:09:48.980 ⇒ 00:09:50.460 Samuel Roberts: With, the prompts?
139 00:09:50.460 ⇒ 00:09:54.290 Mustafa Raja: So, yeah, we… it does give us the versions.
140 00:09:54.520 ⇒ 00:09:55.759 Mustafa Raja: Of the pond.
141 00:09:56.560 ⇒ 00:09:57.760 Samuel Roberts: Yeah, so I think,
142 00:09:57.760 ⇒ 00:09:58.360 Mustafa Raja: Hmm.
143 00:09:59.200 ⇒ 00:10:06.520 Samuel Roberts: I say go ahead and install it, at least test it out and see how it works, and then… then we can reconvene. I’m gonna do a little… I was doing a little bit of a spike on…
144 00:10:06.660 ⇒ 00:10:11.619 Samuel Roberts: LangFuse versus Brain Trust versus Arise, who we spoke with a while back.
145 00:10:11.620 ⇒ 00:10:12.790 Casie Aviles: Okay.
146 00:10:13.270 ⇒ 00:10:17.000 Samuel Roberts: But I think Arise seems like overkill for our needs, because we’re not really.
147 00:10:17.000 ⇒ 00:10:17.960 Casie Aviles: Oh my god.
148 00:10:18.260 ⇒ 00:10:21.000 Samuel Roberts: Massive production kind of systems.
149 00:10:21.700 ⇒ 00:10:29.680 Samuel Roberts: And then, so then LangFuse and Braintrust have, like, slightly different, focuses, I guess?
150 00:10:30.700 ⇒ 00:10:31.069 Mustafa Raja: Like, yeah.
151 00:10:31.070 ⇒ 00:10:39.910 Samuel Roberts: Like, if you started as more traceability and observability, which I was looking at it for, and BrainTrust is more eval, but they both have… seem to have both things, so, you know, they’re all… they’re all doing the same stuff.
152 00:10:40.010 ⇒ 00:10:44.779 Samuel Roberts: But, yeah, go ahead and install it, test it out, let me know how it looks.
153 00:10:45.150 ⇒ 00:10:49.810 Samuel Roberts: Okay. And that might influence my spike a little bit, how I commented. Okay.
154 00:10:49.810 ⇒ 00:10:50.400 Mustafa Raja: Yeah.
155 00:10:50.880 ⇒ 00:10:52.010 Mustafa Raja: Okay, thank you.
156 00:10:52.330 ⇒ 00:10:53.370 Samuel Roberts: Yeah, thank you both.
157 00:10:53.490 ⇒ 00:10:54.270 Mustafa Raja: Bye.
158 00:10:54.270 ⇒ 00:10:55.099 Casie Aviles: Thank you.