Meeting Title: Robert Tseng’s Personal Meeting Room Date: 2025-06-16 Meeting participants: Cutter, Josh, Annie Yu, Robert Tseng, Demilade Agboola
WEBVTT
1 00:00:40.910 ⇒ 00:00:41.970 Robert Tseng: Hey Eddie.
2 00:00:43.410 ⇒ 00:00:44.400 Annie Yu: Hello, Barbara!
3 00:00:47.700 ⇒ 00:00:50.828 Robert Tseng: Oh, okay. Well, brace yourself.
4 00:00:52.756 ⇒ 00:00:59.489 Annie Yu: Well, I’m I’m now working on the adding in that new number. I don’t think it will take too long.
5 00:00:59.810 ⇒ 00:01:06.710 Robert Tseng: Okay, wait, is it? Do we know the impact like it’s gonna go like.
6 00:01:06.990 ⇒ 00:01:09.370 Robert Tseng: it helps. It’s not gonna yeah. I don’t know.
7 00:01:10.159 ⇒ 00:01:14.110 Annie Yu: No cause. I I have a I have a like a
8 00:01:14.370 ⇒ 00:01:20.159 Annie Yu: non join product sales summary side by side to make sure that change.
9 00:01:20.810 ⇒ 00:01:21.480 Robert Tseng: Got it.
10 00:01:25.000 ⇒ 00:01:27.490 Robert Tseng: and and I, as we pushed.
11 00:01:27.630 ⇒ 00:01:28.100 cutter: There are.
12 00:01:28.100 ⇒ 00:01:28.870 Robert Tseng: Hey!
13 00:01:28.870 ⇒ 00:01:29.420 cutter: Underneath.
14 00:01:29.420 ⇒ 00:01:31.119 Robert Tseng: Got her sorry about.
15 00:01:31.120 ⇒ 00:01:32.629 cutter: I do share a few minutes.
16 00:01:32.630 ⇒ 00:01:35.399 cutter: That’s right, that’s all. Good.
17 00:01:35.630 ⇒ 00:01:36.639 Robert Tseng: Just got.
18 00:01:37.000 ⇒ 00:01:42.850 cutter: Eaten alive by Adam. Why are we reporting on these? If it’s not right? And I said, months away.
19 00:01:42.850 ⇒ 00:01:53.980 Robert Tseng: No, that that’s that’s that’s our. But I mean well, I mean, I’m sure Josh is gonna come in here and wanna chew me out more on that, too. But I mean we can. We can just show you what happened like I’ll I’ll be quick.
20 00:01:55.060 ⇒ 00:01:56.680 Robert Tseng: So
21 00:02:00.130 ⇒ 00:02:04.800 Robert Tseng: you see things around.
22 00:02:07.200 ⇒ 00:02:07.530 Josh : Hello!
23 00:02:07.530 ⇒ 00:02:08.139 Robert Tseng: So.
24 00:02:08.380 ⇒ 00:02:09.080 Josh : Hello!
25 00:02:09.080 ⇒ 00:02:13.950 Robert Tseng: Basically, hey, Jeff, I’ll just.
26 00:02:14.260 ⇒ 00:02:20.120 Robert Tseng: I’ll just do a quick retro on like what happened, I mean. And then we can talk. I mean, it’s being fixed right now, it’ll be
27 00:02:20.280 ⇒ 00:02:26.220 Robert Tseng: fixed. I mean, the model is fixed. It’s just the visualization just needs to be refreshed. So you guys can see it?
28 00:02:28.230 ⇒ 00:02:41.149 Robert Tseng: yeah, I mean, basically, I mean you, I can share this doc with you. But we kind of went. We went line by line, went through all the Prs looked at kind of like timelines and see like what you know, where where errors were. And you know, I think
29 00:02:41.270 ⇒ 00:02:48.419 Robert Tseng: at a high level. Basically, this was like a late kind of thing that happened on Friday. I think we just
30 00:02:48.500 ⇒ 00:03:03.559 Robert Tseng: we circumvented our usual Qa process. We didn’t run the we didn’t run the same test because it felt like an urgent request from from Qatar. And so once we made the change, and just changing, not just moving some
31 00:03:03.560 ⇒ 00:03:19.650 Robert Tseng: products into different categories. But we, we change. We updated definitions of metrics. And these metrics, unfortunately, just have a lot of dependencies. And so it just, you know, had a big big impact across across reports and made it look like everything broke.
32 00:03:20.820 ⇒ 00:03:27.700 Robert Tseng: I mean the under. The the change that we pushed basically caused this fan out that I guess Josh noticed on Sunday.
33 00:03:28.520 ⇒ 00:03:38.840 Robert Tseng: And then, yeah, I mean, it’s it’s patched. But yeah, we just. We circumvented the tests that we normally set up whenever we make a model change, to try to get it out faster.
34 00:03:40.130 ⇒ 00:03:42.369 Robert Tseng: I think the takeaway here is like.
35 00:03:42.500 ⇒ 00:03:53.719 Robert Tseng: if we could just make. We understand last minute changes or requests come in on on Fridays, and we can make the model change. But if we can just send the raw data instead of trying to
36 00:03:53.830 ⇒ 00:04:04.930 Robert Tseng: push it all the way through to the to the dashboard until like a Monday, I think that would that would help, because we wouldn’t have had to take the shortcut and miss this. This mistake.
37 00:04:07.200 ⇒ 00:04:10.000 cutter: 1st or March 11, th so
38 00:04:11.010 ⇒ 00:04:26.519 cutter: I like the when it broke. It broke on Thursday, and that’s when the the ad spend was like 55 million from that 1st screenshot. So I don’t know if this happened on Monday or before that. That’s beside the point. But.
39 00:04:26.951 ⇒ 00:04:36.010 Robert Tseng: The change we push was on Friday. So yeah, I know that the You- you called it out on Thursday. Yeah.
40 00:04:36.700 ⇒ 00:04:40.810 cutter: Alright. So this board, which is new product, row as dashboard.
41 00:04:41.370 ⇒ 00:04:42.190 cutter: This.
42 00:04:42.450 ⇒ 00:04:55.220 cutter: like the the identity of these people for the metrics, it’s usually 1st time purchase is this product, and it’s the 1st time purchase of
43 00:04:55.470 ⇒ 00:04:56.140 cutter: we
44 00:04:56.300 ⇒ 00:05:05.380 cutter: from that person as a client. Right? But the way that I’m tracking new products is 1st time purchase of that product.
45 00:05:06.340 ⇒ 00:05:15.680 cutter: irrespective of whether or not it’s their 1st purchase as an Eden patient, because I’m sending millions of emails to cross sell.
46 00:05:16.300 ⇒ 00:05:17.020 Robert Tseng: To.
47 00:05:17.020 ⇒ 00:05:22.610 Robert Tseng: Yeah, we we talked about that the product sequence model was pushed on Thursday. That should have fixed it then wanted.
48 00:05:22.610 ⇒ 00:05:23.639 cutter: There’s a problem.
49 00:05:24.050 ⇒ 00:05:26.439 Demilade Agboola: Yeah. So that model was pushed.
50 00:05:27.700 ⇒ 00:05:28.420 Demilade Agboola: But that was.
51 00:05:28.420 ⇒ 00:05:32.129 Robert Tseng: And that to me is not what broke this so, but you can go ahead and bought it. Yeah.
52 00:05:32.130 ⇒ 00:05:48.949 Demilade Agboola: Yeah. So that’s not what broke this. So the product sequence model was built on Thursday and was pushed into production on Thursday. That model went through our regular Qa process. If you have any issues with that that was to be used to see people like when people get on different models on different products.
53 00:05:49.200 ⇒ 00:05:50.460 Demilade Agboola: For the 1st time.
54 00:05:50.930 ⇒ 00:06:01.439 Demilade Agboola: Friday’s request was, we need to update the new product dashboard. So we can see the new customers based on like not just new customers, but 1st time products users.
55 00:06:01.550 ⇒ 00:06:03.590 Demilade Agboola: 1st time products revenue.
56 00:06:03.590 ⇒ 00:06:04.160 cutter: You know.
57 00:06:04.160 ⇒ 00:06:07.919 Demilade Agboola: As well as like that would cascade to like any any of the
58 00:06:08.470 ⇒ 00:06:10.119 Demilade Agboola: and Ross and all of that.
59 00:06:10.280 ⇒ 00:06:15.900 Demilade Agboola: So that was like an entirely like revamped dashboard Friday like that.
60 00:06:15.900 ⇒ 00:06:17.499 Demilade Agboola: So that was like the process.
61 00:06:17.500 ⇒ 00:06:19.449 cutter: I mean trying to a test one.
62 00:06:19.855 ⇒ 00:06:20.260 Demilade Agboola: Yes.
63 00:06:20.260 ⇒ 00:06:20.780 cutter: Yeah, we’ll do.
64 00:06:20.780 ⇒ 00:06:21.340 Demilade Agboola: Climbing.
65 00:06:21.340 ⇒ 00:06:22.820 cutter: A little bit. Yeah.
66 00:06:22.820 ⇒ 00:06:26.780 Demilade Agboola: An inflation offsetting values. And that also.
67 00:06:27.140 ⇒ 00:06:36.649 Demilade Agboola: That’s also why, on Saturday you saw the numbers and spend also increase as well. And that’s why Josh also saw the numbers increase on
68 00:06:36.800 ⇒ 00:06:38.280 Demilade Agboola: on Sunday.
69 00:06:38.280 ⇒ 00:06:38.700 cutter: That was.
70 00:06:39.001 ⇒ 00:06:43.519 Demilade Agboola: So now things have been rolled back to the previous state. The numbers are there.
71 00:06:43.520 ⇒ 00:06:43.860 cutter: Kind of.
72 00:06:43.860 ⇒ 00:06:46.209 Demilade Agboola: But for the the request for the dashboard.
73 00:06:46.210 ⇒ 00:06:46.789 cutter: To follow up.
74 00:06:46.790 ⇒ 00:06:50.350 Demilade Agboola: And he’s working on that today. So then the numbers will be.
75 00:06:50.350 ⇒ 00:06:50.839 cutter: And a lot.
76 00:06:50.840 ⇒ 00:07:01.430 Demilade Agboola: 1st time users as you expect to see it, so the 1st time users will be different from the new custom account, so this will be slightly higher, because we’re looking at. Not just exactly so when looking at, not just the
77 00:07:01.880 ⇒ 00:07:04.189 Demilade Agboola: new customers, but also the 1st time product users.
78 00:07:04.190 ⇒ 00:07:19.740 cutter: Awesome. Great cause I’m I’ve as long as it’s just the visualization portion of it cool. But just to be clear, the fucking the numbers broke on Thursday, right where we had like from my screenshot, where was 55 million. So that broke on Thursday.
79 00:07:20.360 ⇒ 00:07:34.690 Robert Tseng: Yeah. So what you said already fixed that same day, and so that the whole sequencing thing like that was already pushed it just I guess it got hidden behind this other thing that broke so. But yeah, I mean we did. We did fix what you mentioned on Thursday immediately. So.
80 00:07:34.690 ⇒ 00:07:50.890 cutter: Cool. So when but now going forward, the new product row as dashboard, it will show new order. Count and new customer count, and theoretically new customer count will be lower than new order count. If that person was already a member.
81 00:07:53.180 ⇒ 00:07:54.759 Robert Tseng: They were already a member. Yeah.
82 00:07:54.760 ⇒ 00:07:55.370 Demilade Agboola: So I’m.
83 00:07:55.940 ⇒ 00:07:57.409 cutter: Awesome, so cool.
84 00:07:57.650 ⇒ 00:08:02.699 Demilade Agboola: We’re going to be adding, so I’m not sure like just to. So on the same page we’re going to be adding a new column
85 00:08:02.820 ⇒ 00:08:25.189 Demilade Agboola: called 1st Time 1st Time product user. So that’s the count of the people who are using the product for the 1st time. Well, and that includes both new customers, so like people who join it, and for the 1st time through that purchase, as well as the people who are just using that product. So they might have been old customers, but they’re using that product for the 1st time, like buying the purchase for the the product. For the 1st time.
86 00:08:25.410 ⇒ 00:08:45.399 Robert Tseng: Yeah. So so, cutter, it’s like it is what you’re saying. But we’re just because, rather than changing new customer count definition just for your dashboard. We’re just at creating another column that we think better represents what you’re describing. They’re not a new customer necessarily. They may just be the 1st time product purchaser of that. Yeah. So, yeah.
87 00:08:46.700 ⇒ 00:08:50.320 Demilade Agboola: Your music. You seem like you’re in agreement. So.
88 00:08:50.320 ⇒ 00:08:55.479 cutter: Yeah, that’s great. And then you can tabulate and row as off that column for this dashboard.
89 00:08:57.880 ⇒ 00:09:04.320 Demilade Agboola: Yeah. So that would, yeah, that. So the idea, what we’re going for, what we’re going for is everything would be based off the 1st time.
90 00:09:04.440 ⇒ 00:09:09.520 Demilade Agboola: 1st time product user count as well as the 1st time product user revenue.
91 00:09:09.690 ⇒ 00:09:12.389 Demilade Agboola: So it wouldn’t be like new customer anymore. Exactly.
92 00:09:13.170 ⇒ 00:09:17.309 cutter: No, it’ll just be new product revenue, which is fine.
93 00:09:18.204 ⇒ 00:09:18.550 Demilade Agboola: Right.
94 00:09:19.870 ⇒ 00:09:21.900 cutter: Cool, alright. Thank you.
95 00:09:22.170 ⇒ 00:09:24.219 Robert Tseng: So. Yes, that is coming.
96 00:09:24.460 ⇒ 00:09:27.120 Robert Tseng: I mean, that’s the first.st That’s the main priority. Everyone’s working on.
97 00:09:27.120 ⇒ 00:09:31.879 Josh : So did Carter have 300 net new sales across the new products last week?
98 00:09:32.200 ⇒ 00:09:34.440 Josh : I need to know that answer today.
99 00:09:34.950 ⇒ 00:09:37.720 Robert Tseng: Yeah, okay, we’ll we’ll we’ll confirm that answer with you.
100 00:09:40.320 ⇒ 00:09:41.010 cutter: Some.
101 00:09:44.200 ⇒ 00:09:50.630 Josh : And then did Natash 800 semi new customers here. I’ve lost people.
102 00:09:53.290 ⇒ 00:10:01.190 Robert Tseng: Right? Right? Yeah, I mean, this is, yes, you’re basically, yeah. Same- same question, different products. Yeah, I mean what we will, we’ll we’ll be able to answer that hopefully within an hour.
103 00:10:02.650 ⇒ 00:10:03.420 Josh : Cool.
104 00:10:05.240 ⇒ 00:10:10.969 Josh : So whatever process we have to put in place
105 00:10:11.879 ⇒ 00:10:15.969 Josh : that’s painful to go to a company wide Kpi meeting.
106 00:10:16.210 ⇒ 00:10:22.949 Josh : and then, I have 2 of my people show up and say, I can’t use the numbers that can’t happen again. It just can’t.
107 00:10:23.330 ⇒ 00:10:33.509 Josh : So you guys gotta put in hard rails, processes, duplicative efforts. I don’t give a shit, but I can’t show up to another company wide meeting and have
108 00:10:34.130 ⇒ 00:10:38.240 Josh : $500,000 worth of staff on for an hour
109 00:10:38.760 ⇒ 00:10:42.069 Josh : and waste everybody’s time. Just can’t have it happen.
110 00:10:43.280 ⇒ 00:10:48.169 Josh : So that’s that’s the accountability falls to you guys what happens again, we’ll have a problem.
111 00:10:48.370 ⇒ 00:10:53.790 Josh : Everybody gets one. They’ve been going well, but I’m just being very transparent. That can happen again.
112 00:10:56.040 ⇒ 00:10:57.599 Robert Tseng: Yep, got it.
113 00:11:00.420 ⇒ 00:11:02.620 Josh : Yeah, what’s up? What’s next?
114 00:11:08.870 ⇒ 00:11:25.760 Robert Tseng: Well, we have a we have a new sprint. So I think, if you know, I guess since you guys are both here, I mean this. These are kind of projects that we’re gonna you know, we’ve kind of prioritize. So I mean, obviously, this data centerization thing is always always top priority. And this is gonna be worked on
115 00:11:26.110 ⇒ 00:11:35.669 Robert Tseng: on the marketing side. There’s a few things that Natasha’s team from Kyle and forgot what the other new Guy was they’re requesting. That’s gonna we’re bringing in.
116 00:11:36.250 ⇒ 00:11:47.689 Robert Tseng: I don’t know if Circle is really as urgent as you’ve been really pushing for with Raja Josh. But I mean, we’ve put it as high priority, like, we, we’re ready to execute and build that out this week.
117 00:11:48.850 ⇒ 00:11:51.000 Robert Tseng: But yeah, so I mean, this is just like.
118 00:11:51.000 ⇒ 00:11:55.560 Josh : It’s important, because it’s supposed to be a revenue driver, and I have no idea if it is
119 00:11:55.750 ⇒ 00:12:02.480 Josh : so, I need to know pretty quickly. If I just need to cancel the program, or what I need to do with it. And I can’t do anything without Dave.
120 00:12:03.100 ⇒ 00:12:14.479 Robert Tseng: Okay, yeah, I mean, that’s yeah. I mean, I hear that. So I mean, as far as like, so anything that’s ad hoc that comes in like, I’m just, I’m gonna hit it against this this order pretty much like.
121 00:12:14.670 ⇒ 00:12:26.160 Robert Tseng: yeah, I mean, the the marketing. And so and circle stuff is is high as a highest priority. This, you know, this next sprint. There’s a couple of stuff from Jonah and Daniel, and not Danny.
122 00:12:26.600 ⇒ 00:12:30.970 Robert Tseng: forgot what the accounting guy’s name was. But yeah, I mean they they’re they’ve been.
123 00:12:30.970 ⇒ 00:12:32.800 Josh : Jonah and Zohab.
124 00:12:33.100 ⇒ 00:12:34.160 Robert Tseng: So heck, yeah.
125 00:12:34.849 ⇒ 00:12:42.640 Robert Tseng: so there’s there. They’ve been asking for some stuff there as well. But yeah, I mean, and then and then we have the the segment
126 00:12:42.960 ⇒ 00:12:45.859 Robert Tseng: conversation needs to happen in the next week. So.
127 00:12:46.480 ⇒ 00:12:50.929 Robert Tseng: but yeah, I mean, these are these are the main things that we’re working on this in this sprint cycle
128 00:12:59.080 ⇒ 00:13:24.440 Robert Tseng: cool. So I mean other than that there’s a couple I mean, any any demo, I think mo mainly, Annie. There any. There’s a i think there were like one or 2 things that were carried over from last cycle that are really just waiting and review, or like I, just, we’re just closing those out. So anything related to that product launch dashboard the fix of like adding filters. I think we should finish that.
129 00:13:24.740 ⇒ 00:13:27.939 Robert Tseng: And then. I think.
130 00:13:28.420 ⇒ 00:13:34.770 Robert Tseng: yeah, whatever yeah. Like, what? Don’t don’t worry about the I mean, as far as like
131 00:13:35.160 ⇒ 00:13:42.189 Robert Tseng: time to order like margin, like pharmacy related. Reporting like that’s that’s not gonna be in the cycle, I think.
132 00:13:42.717 ⇒ 00:13:48.930 Robert Tseng: We, we just don’t have the ability to action some some of the things that she’s asking for there.
133 00:13:49.420 ⇒ 00:13:54.539 Robert Tseng: So yeah, I’m I’m I’ve I’ve taken that out of cycle, if you’ve noticed. So
134 00:13:55.540 ⇒ 00:14:02.759 Robert Tseng: yeah, I mean domain wise, it’s just marketing, marketing and finance really work? In that in these next couple of weeks? Yeah.
135 00:14:02.760 ⇒ 00:14:06.860 cutter: Do you have the email, one on your schedule?
136 00:14:07.790 ⇒ 00:14:09.769 Robert Tseng: Yeah, the customer I/O stuff, I mean.
137 00:14:09.770 ⇒ 00:14:10.480 cutter: Yeah.
138 00:14:10.480 ⇒ 00:14:11.359 Robert Tseng: We’ve done.
139 00:14:12.000 ⇒ 00:14:19.370 Robert Tseng: I guess we’ve already given a a table about that. I don’t know if you, if you’ve reviewed it yet.
140 00:14:19.600 ⇒ 00:14:21.659 cutter: Now, can you send it to me? And I’ll look at it.
141 00:14:21.660 ⇒ 00:14:23.350 Robert Tseng: Okay, yeah, we’ll send it to you.
142 00:14:24.390 ⇒ 00:14:27.440 Josh : 2 requests, 2 specific requests from Adam.
143 00:14:27.880 ⇒ 00:14:29.860 Josh : which I also want to make sure we do.
144 00:14:30.040 ⇒ 00:14:30.500 Robert Tseng: Okay.
145 00:14:30.500 ⇒ 00:14:33.079 Josh : Put some. He put a lot of text into.
146 00:14:33.240 ⇒ 00:14:36.580 Josh : you know, this whole fallback and Cdp stuff.
147 00:14:36.970 ⇒ 00:14:41.130 Josh : and then also just getting a new Uri
148 00:14:41.620 ⇒ 00:14:44.380 Josh : for what we’re doing inside of tableau.
149 00:14:44.620 ⇒ 00:14:47.889 Robert Tseng: These are just things we gotta figure out outside of the Dev style.
150 00:14:49.680 ⇒ 00:14:51.290 Robert Tseng: Oh, the Uri thing.
151 00:14:51.490 ⇒ 00:14:59.489 Josh : Yeah thing, plus at least I got response. We can’t just not put a response to my partner.
152 00:15:03.950 ⇒ 00:15:06.529 Robert Tseng: Like response into I mean he.
153 00:15:07.200 ⇒ 00:15:10.810 Josh : Like I tagged you. I tagged you in a hole whole thread.
154 00:15:10.930 ⇒ 00:15:15.110 Josh : and then there’s the whole issue outside of that thread on the URL.
155 00:15:16.540 ⇒ 00:15:17.280 Robert Tseng: Okay.
156 00:15:19.230 ⇒ 00:15:26.729 Josh : Or just make it so like. If that Uri make it much more apparent of like what it is like, put it in the canvas
157 00:15:27.260 ⇒ 00:15:31.120 Josh : do something. In the meantime, so people can actually access this thing.
158 00:15:34.590 ⇒ 00:15:52.690 Robert Tseng: I did respond to the Uri thing. It’s it’s not something that we create. It’s what tableau generates when we create it. I’ve asked to change it multiple times. I mean at this point, it’s just every time I open tableau every every week or 2 weeks I have to put it in, so I don’t really know if there’s a fix there, it’s not. It’s not on us.
159 00:15:54.680 ⇒ 00:15:57.040 Josh : I get it something we gotta figure out, though.
160 00:15:57.270 ⇒ 00:16:06.089 Josh : like some sort of like clarity like you said. Maybe put the Uri in the canvas or put it somewhere. That’s much more accessible
161 00:16:06.450 ⇒ 00:16:12.080 Josh : because, like right now, the problem statement is, people don’t know how to log in. That’s a problem right?
162 00:16:12.890 ⇒ 00:16:13.339 Robert Tseng: Okay.
163 00:16:14.350 ⇒ 00:16:18.060 Josh : Go ski, baby set. But whatever the Uri is
164 00:16:18.460 ⇒ 00:16:26.000 Josh : into a canvas and make sure everyone’s very aware like, Hey heard there were some concerns. People didn’t know how to get the right Uri.
165 00:16:26.130 ⇒ 00:16:32.400 Josh : We’re posting it here in the canvas. So if you ever get kicked out, here’s what you need to do. 1, 2, 3, blah blah.
166 00:16:32.820 ⇒ 00:16:35.300 Robert Tseng: Talking about, just like the canvas and the channel.
167 00:16:35.760 ⇒ 00:16:40.360 Josh : Yeah, exactly. Just like baby stuff like people can’t get in. We gotta make sure people can get in.
168 00:16:40.760 ⇒ 00:16:46.554 Josh : I’m like they’re not relying on you to like. Send over what the thing is in a slack chat or slack.
169 00:16:47.130 ⇒ 00:16:50.219 Josh : You know what I mean. Like. Start automate these things.
170 00:16:50.690 ⇒ 00:16:57.159 Josh : So that’s 1, and then I tagged you in another thread of just a lot of chatter from this weekend.
171 00:16:58.240 ⇒ 00:17:02.299 Josh : and I think you should probably think that’s no response.
172 00:17:04.000 ⇒ 00:17:06.736 Robert Tseng: Yeah, I mean, I I got tagged like a lot.
173 00:17:07.010 ⇒ 00:17:07.410 Josh : Yeah.
174 00:17:07.420 ⇒ 00:17:08.980 Robert Tseng: Yeah, I.
175 00:17:08.980 ⇒ 00:17:11.420 Josh : And that’s the speaker. Yes, no.
176 00:17:11.420 ⇒ 00:17:19.789 Robert Tseng: Yeah, I mean, if there, if the if the why did this happen it? Yeah, I mean, I can share my, I can share our retro here, but I mean I.
177 00:17:19.790 ⇒ 00:17:20.450 Josh : Yeah.
178 00:17:20.450 ⇒ 00:17:21.609 Robert Tseng: Basically, sure, yeah.
179 00:17:21.970 ⇒ 00:17:25.390 Josh : But there’s like there’s a couple other significant questions about
180 00:17:25.520 ⇒ 00:17:28.150 Josh : what we do in in terms of fallbacks.
181 00:17:28.520 ⇒ 00:17:31.980 Josh : There’s some. There’s some questions that she can answer quick.
182 00:17:32.570 ⇒ 00:17:35.280 Josh : So just take some time, maybe, to read that.
183 00:17:36.060 ⇒ 00:17:38.470 Josh : Put together a good draft, Bruce.
184 00:17:38.470 ⇒ 00:17:41.659 Robert Tseng: Okay. I don’t recall seeing that. So I don’t know if you actually tag me.
185 00:17:41.660 ⇒ 00:17:45.430 Josh : I just tagged you. I just tagged you like an hour ago. On the whole process.
186 00:17:46.660 ⇒ 00:17:48.050 Robert Tseng: I’ll I’ll look into it.
187 00:17:51.060 ⇒ 00:17:52.360 Josh : I can spam you.
188 00:17:52.580 ⇒ 00:17:57.250 Josh : You want me to spam it to you right now. Just tag Robert Robert.
189 00:17:57.840 ⇒ 00:18:01.370 Robert Tseng: Well, I mean you can. You can bump it to me. I think that that would help.
190 00:18:01.370 ⇒ 00:18:04.020 Josh : Just bump it like an hour ago, is what I’m saying.
191 00:18:09.250 ⇒ 00:18:13.419 Josh : There’s like natash and good luck.
192 00:18:13.420 ⇒ 00:18:15.640 Robert Tseng: Yeah, yeah, I’ll I’ll look. I’ll look for it.
193 00:18:16.040 ⇒ 00:18:17.910 Robert Tseng: If I don’t, I’ll I’ll message you.
194 00:18:23.420 ⇒ 00:18:26.369 Josh : I think it’s in the analytics channel. It’s just in the analytics piece.
195 00:18:30.290 ⇒ 00:18:35.690 Josh : Yeah, the place where you said Link wasn’t an invite.
196 00:18:36.480 ⇒ 00:18:37.290 Robert Tseng: Yeah, yeah.
197 00:18:38.040 ⇒ 00:18:39.529 Josh : You should read all this shit above it.
198 00:18:40.590 ⇒ 00:18:41.370 Josh : Awesome.
199 00:18:42.050 ⇒ 00:18:44.076 Josh : That’s what I need you to respond to.
200 00:18:44.330 ⇒ 00:18:47.869 Robert Tseng: Yeah, well, all this is what we just covered. And then
201 00:18:48.380 ⇒ 00:18:55.419 Robert Tseng: I think Mattesh is. I mean, he was actually trying to defend us. So I mean, I don’t think he was disagreeing. But yeah, I think.
202 00:18:55.420 ⇒ 00:18:57.809 Josh : Agree, but there’s still stuff above that. But
203 00:19:00.890 ⇒ 00:19:03.889 Josh : there’s a comment from Adam which I agree with.
204 00:19:10.340 ⇒ 00:19:11.370 Robert Tseng: Okay.
205 00:19:16.720 ⇒ 00:19:26.020 Demilade Agboola: I believe these are the numbers that were also affected by the push. On Friday we will definitely look there and get and get things aligned.
206 00:19:33.930 ⇒ 00:19:37.370 Josh : Just please get people warm inside these. That’s saying, Hey.
207 00:19:37.830 ⇒ 00:19:40.220 Josh : moving forward, this will not happen again.
208 00:19:40.670 ⇒ 00:19:45.820 Josh : We consider this an outage and outages are not okay.
209 00:19:47.990 ⇒ 00:19:49.989 Robert Tseng: Yeah, yeah, no, I I will.
210 00:19:50.590 ⇒ 00:19:51.190 Josh : Cool.
211 00:19:51.490 ⇒ 00:19:54.840 Josh : I’m just. I’m just trying to help people really understand. The severity is like you.
212 00:19:55.020 ⇒ 00:19:59.819 Josh : We have these Kpi meetings on my whole week is flushed up. Now you have no idea.
213 00:20:00.570 ⇒ 00:20:01.670 Josh : a simple view.
214 00:20:02.630 ⇒ 00:20:04.310 Josh : It’s a really big deal.
215 00:20:10.560 ⇒ 00:20:11.360 Josh : Okay.
216 00:20:19.430 ⇒ 00:20:21.210 Robert Tseng: Okay, I mean anything else.
217 00:20:26.220 ⇒ 00:20:31.460 Josh : Oh, no, and let’s just get this stuff knocked out alright.
218 00:20:32.260 ⇒ 00:20:34.950 Robert Tseng: Yeah, yeah, we’re we’re doing damage control. Yeah.
219 00:20:35.820 ⇒ 00:20:36.600 Josh : Thanks, sis.
220 00:20:39.880 ⇒ 00:20:47.623 Robert Tseng: Okay. Yeah. I guess for rest of the team. I think we’ll just we won’t. I’m not gonna go into tickets today, I think I’ll be
221 00:20:50.610 ⇒ 00:21:04.040 Robert Tseng: he. He didn’t join. But Eden has a product project manager. His name is Tigran. Think you guys have interact with him here and there, I’m gonna kind of bring him in a bit more now. So I’m gonna catch him up to speed on linear, and he’ll probably help with some of that
222 00:21:04.730 ⇒ 00:21:05.530 Robert Tseng: moving forward.
223 00:21:06.240 ⇒ 00:21:11.700 Robert Tseng: But yeah, as you can tell, that’s this is the only thing we care about. So he’s just gonna
224 00:21:12.552 ⇒ 00:21:17.599 Robert Tseng: keep talking about it until we fix it. So this is this is what we have to deal with today.
225 00:21:19.330 ⇒ 00:21:19.810 Demilade Agboola: Yeah, okay.
226 00:21:20.303 ⇒ 00:21:28.690 Annie Yu: One question for you, Damaty. Do we need to have the new product use order? Count
227 00:21:28.990 ⇒ 00:21:30.280 Annie Yu: in this model?
228 00:21:30.500 ⇒ 00:21:34.340 Annie Yu: Just so we can have a an adjusted Aov.
229 00:21:36.020 ⇒ 00:21:37.660 Demilade Agboola: Order, count!
230 00:21:38.050 ⇒ 00:21:44.630 Annie Yu: Yeah, with with the revenue and user account. I I can adjust like
231 00:21:45.440 ⇒ 00:21:49.176 Annie Yu: rows and Cac, but not the Aov.
232 00:21:54.670 ⇒ 00:21:55.839 Demilade Agboola: Trying to think.
233 00:21:56.650 ⇒ 00:21:57.170 Annie Yu: Yeah.
234 00:21:57.810 ⇒ 00:21:58.780 Demilade Agboola: I think.
235 00:22:02.060 ⇒ 00:22:13.050 Demilade Agboola: yeah. So we will have the count of how many people bought it, but we don’t necessarily know how many orders they placed of that. So I will. Okay, I can. I can do a new order, count
236 00:22:14.530 ⇒ 00:22:17.029 Demilade Agboola: what? That would even think.
237 00:22:18.240 ⇒ 00:22:22.720 Annie Yu: New Order Council that should, based on the same logic right the.
238 00:22:24.060 ⇒ 00:22:29.899 Demilade Agboola: I mean it could. So it’s possible someone made an like 2 orders potentially
239 00:22:30.404 ⇒ 00:22:36.489 Demilade Agboola: but yes, in most cases it should be the same number as the 1st time product users.
240 00:22:37.030 ⇒ 00:22:42.989 Demilade Agboola: But it’s I would have to tweak the logic slightly empowerment, aggregating.
241 00:22:44.180 ⇒ 00:22:44.925 Annie Yu: Okay?
242 00:22:45.980 ⇒ 00:22:55.189 Annie Yu: yeah. Then, until then, I I’ll just keep it as is. Or should I use the product users as denominator?
243 00:22:58.350 ⇒ 00:23:01.759 Demilade Agboola: I think, I think, for now we can use the product users as the domin denominator.
244 00:23:02.100 ⇒ 00:23:03.450 Annie Yu: That’s fair. Okay.
245 00:23:09.740 ⇒ 00:23:20.979 Demilade Agboola: Also was just gonna say that like I think in terms of that workflow. I I saw your message about like adding tests, and I think we should add tests.
246 00:23:21.356 ⇒ 00:23:28.289 Demilade Agboola: Also, I was going to just say that, is it possible for us to? Because I also tag Danny into it. Can we make duplicate dashboards.
247 00:23:29.430 ⇒ 00:23:32.209 Robert Tseng: Yeah, we should have like a staging versus production. One, yeah, totally.
248 00:23:32.210 ⇒ 00:23:44.209 Demilade Agboola: Yeah, so the staging ones will be in house. So we are the only ones that need to see it. But obviously every time we make a Pr. The staging gets updated, we can check the dashboard and look at it against the current dashboard. If the numbers look
249 00:23:44.320 ⇒ 00:24:05.090 Demilade Agboola: out of sync, we automatically know that whatever we merge will affect production. And if it’s something that we’re doing to not like, obviously, things they are doing to affect production numbers, because the numbers are not right, for instance. But if we’re not trying to make those sort of changes, we immediately know that yet if we merge, this is gonna mess up these dashboards.
250 00:24:07.130 ⇒ 00:24:20.339 Robert Tseng: Yeah, I mean, we totally should do that. I mean, like, Josh said, we cannot have this happen again like, this is, I don’t want. Yeah, we, we know this is not a hard problem. It’s just it’s just maintenance or upkeep thing. But like, this is the thing that kind of
251 00:24:20.860 ⇒ 00:24:21.669 Robert Tseng: kind of low.
252 00:24:21.670 ⇒ 00:24:22.060 Demilade Agboola: But.
253 00:24:22.060 ⇒ 00:24:24.229 Robert Tseng: Get us called out, so, yeah, we.
254 00:24:25.410 ⇒ 00:24:41.700 Demilade Agboola: So I think 2 changes like once we do, we can add tests which we will. We can ensure this. We have like duplicate dashboards to look at that before pr merge. And then finally, I think we don’t make dashboard changes like we don’t work towards dashboard changes unless
255 00:24:42.340 ⇒ 00:24:49.990 Demilade Agboola: we have at least, you know, 24 h, or working into next day anything under 24 h. It will. Csv like it has to be Csv request
256 00:24:50.550 ⇒ 00:24:57.629 Demilade Agboola: like, we’ll give you the Csv. The logic and the Csv. But, like we cannot, we’re not going to be doing like dashboard changes. I don’t think
257 00:24:57.750 ⇒ 00:24:59.860 Demilade Agboola: that is helpful to anybody.
258 00:25:00.190 ⇒ 00:25:00.600 Robert Tseng: Yeah.
259 00:25:00.600 ⇒ 00:25:10.920 Demilade Agboola: So if you want to know if, like, cut us all 300 things, we can do a query for that. But we’ll not do a dashboard that shows that that could potentially affect other dashboards somewhere else.
260 00:25:11.750 ⇒ 00:25:13.550 Robert Tseng: Yeah, that makes sense.
261 00:25:14.220 ⇒ 00:25:14.890 Demilade Agboola: So.
262 00:25:18.210 ⇒ 00:25:28.960 Robert Tseng: I guess my only thing is just that they will always want to just look. I mean, I’m talking about Adam, and Josh will only want to look at their one report. So like we need to. I mean that one like, I guess
263 00:25:29.120 ⇒ 00:25:50.329 Robert Tseng: we could just run a query to do to kind of replicate the table like, I don’t know if the staging version like, if we end up having a query that basically materializes the same view as a table, and it’s like a Csv version rather than like a like A, you know a dashboard version. Then that might help us to do rapid changes faster, and we can share it with them without pushing it to the dash.
264 00:25:52.940 ⇒ 00:25:56.295 Demilade Agboola: I mean, yeah, if we have a staging and we can
265 00:25:56.850 ⇒ 00:26:05.250 Demilade Agboola: we can do that. But I I’m thinking of, like, you know how they. I think there’s a difference when they want to see certain numbers
266 00:26:05.610 ⇒ 00:26:11.849 Demilade Agboola: versus they want the entire like. What like the problem with the cutter request was. It wasn’t just the
267 00:26:11.960 ⇒ 00:26:12.940 Demilade Agboola: K.
268 00:26:13.260 ⇒ 00:26:33.200 Demilade Agboola: Can I? Can you? It was. Can you, redefine how we’re defining revenue for this, how we’re defining customer accounts. And then all the other things. And so that’s not just say, Oh, I need to like run a query and get those numbers and send it to you. Sort of thing. That’s it. I need to do it, test it, add it to the models, push the models.
269 00:26:33.520 ⇒ 00:26:45.619 Demilade Agboola: do it, and then rebuild the dashboard with the new formulas, because we’re going to point to new columns. That’s a lot to ask for, but like in a what 6 h turnaround.
270 00:26:45.810 ⇒ 00:26:46.210 Robert Tseng: Yeah.
271 00:26:46.510 ⇒ 00:26:48.909 Demilade Agboola: That’s that’s sort of what I’m speaking to.
272 00:26:49.260 ⇒ 00:27:10.560 Robert Tseng: I don’t think he knows either. I think he was just like oh, I think this should be the way to find like. I wonder if there’s a faster way for us to be like. Okay, this is, if you change the definition, we just show him the aggregates like this is what you’re gonna see. It’s gonna be a 20% lift and row as whatever. But like, I don’t know, like, I wonder if this is like a faster way that we can go. And just like, give him like a
273 00:27:10.600 ⇒ 00:27:23.799 Robert Tseng: quick answer on like the impact of his suggested change. And then we can say, yeah, well, we can roll. If you’re okay with this. And this makes sense to you, we can roll it out over, you know, you know, in the next one to 2 days, or whatever.
274 00:27:24.350 ⇒ 00:27:39.139 Demilade Agboola: Yeah, I I think so. What what I think, what I’m even saying is like his suggestions. Why not like like, if I was to create a query just directly to the tables and get extract the numbers from the product sequence models, and it just extract the numbers. That’s fine.
275 00:27:39.310 ⇒ 00:27:45.410 Demilade Agboola: But building out models for a dashboard is where the difficulty comes in. So if he wants to know, hey?
276 00:27:45.630 ⇒ 00:27:48.560 Demilade Agboola: Or more difficult, where things can go awry.
277 00:27:48.830 ⇒ 00:27:54.900 Demilade Agboola: but like if he wants to know, hey? Over the last 7 days, how many 1st time
278 00:27:55.520 ⇒ 00:28:10.919 Demilade Agboola: products users did we have on this product? That’s a query account right directly. It doesn’t influence anything. I can go straight to the fax transactions. Get to ensure that this is the 1st time, just to a windows function over the fact transactions.
279 00:28:10.920 ⇒ 00:28:11.410 Robert Tseng: Yeah.
280 00:28:11.410 ⇒ 00:28:14.860 Demilade Agboola: Do you get my point like that’s sort of so what I’m speaking to.
281 00:28:15.170 ⇒ 00:28:33.909 Robert Tseng: That’s what I’m saying, like, he phrases request as something that was bigger than we needed to be. We should break it down and be like. There’s a faster way to answer his question, and maybe he’ll be fine with just getting the short answer. Now we can, if it’s actually because like to me. He he wasn’t very clear on his definition, either, like he didn’t even realize that was what broke the whole thing
282 00:28:33.910 ⇒ 00:28:50.229 Robert Tseng: to him. He’s just like, yeah, I want to see a different definition. And he didn’t. He doesn’t know of like the impact. So if we can give him like a, we know how it will. It’s a lot of effort to go and do that. So if we just if we turn his model dashboard request into just
283 00:28:50.280 ⇒ 00:29:07.869 Robert Tseng: all right. We’ll just write him a query first, st and then see if this is like worth pushing further along like, I think that’s what I’m saying. Like we we can. We can always try to. Well, we yeah, we can. We can size down the request by, you know, because we know that it’s gonna take a lot in order to get what he’s asking for initially.
284 00:29:09.180 ⇒ 00:29:13.860 Demilade Agboola: Okay, sounds good. I’m on same page. Basically, all make a large scale. Yeah.
285 00:29:13.860 ⇒ 00:29:14.649 Robert Tseng: Yeah, no, I’ve got.
286 00:29:14.650 ⇒ 00:29:16.409 Demilade Agboola: Export. Changes. Yeah.
287 00:29:18.060 ⇒ 00:29:31.730 Robert Tseng: Okay? Well, yeah, we’ll we’ll stay on top of this. I have more damage control on the messaging and stuff. But yeah, please let me know when this is updated, so we can. So I can kind of keep pushing those messages along.
288 00:29:32.200 ⇒ 00:29:44.440 Annie Yu: Yeah, Robert, one more thing is the the financing request. Yeah, they they want more stuff. And I’m not sure what to prioritize. I I know.
289 00:29:44.440 ⇒ 00:29:46.769 Robert Tseng: It’s not a priority. Don’t worry. Yeah, this this.
290 00:29:46.770 ⇒ 00:29:51.000 Annie Yu: They add me again, and I feel like I’m not sure
291 00:29:51.250 ⇒ 00:29:53.769 Annie Yu: if they want it soon or so.
292 00:29:53.770 ⇒ 00:29:57.069 Robert Tseng: No, it’s okay. Yeah, don’t you? Can. You can ignore them. It’s fine.
293 00:29:58.000 ⇒ 00:30:00.440 Robert Tseng: Yeah. I saw that. Yeah, yeah.
294 00:30:00.440 ⇒ 00:30:02.939 Annie Yu: Yeah, but we will have a ticket for that. Is that it.
295 00:30:02.940 ⇒ 00:30:04.610 Robert Tseng: We will have a ticket for that.
296 00:30:04.610 ⇒ 00:30:05.530 Annie Yu: Okay. Cool.
297 00:30:07.670 ⇒ 00:30:09.719 Robert Tseng: Yeah, I’ll I’ll respond to him. Don’t worry.
298 00:30:10.000 ⇒ 00:30:10.953 Robert Tseng: Yeah, okay.
299 00:30:11.430 ⇒ 00:30:13.590 Robert Tseng: Alright, thanks everyone. Bye.
300 00:30:13.590 ⇒ 00:30:14.300 Annie Yu: Thanks, bye.