Meeting Title: US x BF | Standup Date: 2025-11-21 Meeting participants: Awaish Kumar, Emily Giant
WEBVTT
1 00:02:45.690 ⇒ 00:02:47.190 Awaish Kumar: Hello.
2 00:02:47.860 ⇒ 00:02:49.159 Emily Giant: Hi, how are you?
3 00:02:49.550 ⇒ 00:02:50.999 Awaish Kumar: I’m good, how about you?
4 00:02:51.790 ⇒ 00:02:53.219 Emily Giant: I’m pretty good.
5 00:02:53.810 ⇒ 00:03:00.600 Emily Giant: Pretty good, just working a lot, like, finding a lot of… issues with…
6 00:03:00.830 ⇒ 00:03:04.979 Emily Giant: some of the Revenue Mart stuff, and… It’s all salted.
7 00:03:05.670 ⇒ 00:03:08.459 Emily Giant: Just a pain, you know, how it is.
8 00:03:09.880 ⇒ 00:03:10.860 Awaish Kumar: Yeah.
9 00:03:11.320 ⇒ 00:03:13.360 Awaish Kumar: I can imagine.
10 00:03:13.360 ⇒ 00:03:23.179 Emily Giant: Yeah. You… I’m sure we’ve all been there many times. It’s one of those weeks where I’m like, I know it’s gonna be a hard week, but after this, it should be more stable.
11 00:03:23.680 ⇒ 00:03:26.710 Emily Giant: How’s the, oh, what are you working on?
12 00:03:28.230 ⇒ 00:03:31.570 Awaish Kumar: Yeah, I’m actually working on snapshots, and…
13 00:03:32.040 ⇒ 00:03:37.429 Awaish Kumar: What I’m seeing is that, like, this actually creating snapshots themselves is not that…
14 00:03:37.720 ⇒ 00:03:44.259 Awaish Kumar: hard, and then not that time-taking. Also, like, there is an error in one of the snapshots, I just…
15 00:03:44.430 ⇒ 00:03:50.330 Awaish Kumar: push the fix for that. I created a PR, maybe you can review that.
16 00:03:50.680 ⇒ 00:04:10.370 Awaish Kumar: Apart from that, the downstream models, which we are creating these hourly models, and because we were using all historical data, they are, like… and we are running, like, full refreshes every day on them, so they take, like, a lot of time.
17 00:04:10.370 ⇒ 00:04:14.699 Emily Giant: I don’t think we ever need to run a full refresh on those, do we? Just for the… because the…
18 00:04:15.430 ⇒ 00:04:17.650 Emily Giant: As long as the hour runs, then…
19 00:04:18.149 ⇒ 00:04:26.619 Awaish Kumar: The problem is that, number one, it was in those daily refreshes, I just figured out, like, I don’t know why it was…
20 00:04:26.729 ⇒ 00:04:33.879 Awaish Kumar: that deli refresh command. But then, like, we don’t, like…
21 00:04:34.369 ⇒ 00:04:40.219 Awaish Kumar: like, whenever we change schema, I can obviously easily can convert them to incremental.
22 00:04:40.219 ⇒ 00:04:43.389 Emily Giant: But then, the issue is that whenever you have to.
23 00:04:43.389 ⇒ 00:04:48.079 Awaish Kumar: If you add any column or anything, it becomes,
24 00:04:48.430 ⇒ 00:04:53.560 Awaish Kumar: Like, we have to run full refresh then, and then it takes time.
25 00:04:53.700 ⇒ 00:04:59.830 Awaish Kumar: And for that reason, I was asking this thing, like, do we really need Three, like, like, the…
26 00:05:00.290 ⇒ 00:05:12.839 Awaish Kumar: years of data, in their table, like, maybe… maybe, like, last one month, last 30 days, or last 60 days, or last 90 days are enough, so I can just filter that.
27 00:05:12.840 ⇒ 00:05:18.720 Emily Giant: 30 days would be perfect. I think that because we’ve changed that schema,
28 00:05:18.720 ⇒ 00:05:19.410 Awaish Kumar: even…
29 00:05:19.410 ⇒ 00:05:31.870 Emily Giant: there were a lot of issues, and I don’t think you can even go back in time and get that data, so it might not even be possible to do 30 days. We might just have to start anew and start snapshotting now.
30 00:05:32.750 ⇒ 00:05:47.410 Emily Giant: which, if it’s fixed, because it never really was working very well, so if it’s only possible to just start anew right now, as long as it’s working the way we want it to, I think that that’s better than trying to, like.
31 00:05:48.560 ⇒ 00:05:51.960 Emily Giant: Refresh all that data when it’s not even accurate.
32 00:05:53.250 ⇒ 00:06:10.639 Awaish Kumar: Yeah, what I’m trying… like, for the snapshots, basically, we have all the data, right? But what I’m trying to do right now is, I’m going to take only last 30 days of data from those snapshots, and convert it into hourly,
33 00:06:11.230 ⇒ 00:06:14.009 Awaish Kumar: The third hourly table we have.
34 00:06:14.150 ⇒ 00:06:15.070 Awaish Kumar: So…
35 00:06:15.070 ⇒ 00:06:17.459 Emily Giant: That sounds totally fine to me.
36 00:06:18.440 ⇒ 00:06:23.140 Awaish Kumar: Yeah, and once we are… once we… we are down to some, like.
37 00:06:23.610 ⇒ 00:06:25.840 Awaish Kumar: few minutes of execution time, we can easily.
38 00:06:25.840 ⇒ 00:06:26.279 Emily Giant: Didn’t make me…
39 00:06:26.280 ⇒ 00:06:29.260 Awaish Kumar: Changes and fix it quite easily.
40 00:06:29.820 ⇒ 00:06:30.180 Emily Giant: Okay.
41 00:06:30.180 ⇒ 00:06:39.020 Awaish Kumar: days to run, like, it is hard, even to debug, and what is the issue, like, I don’t know. If I make change, I don’t know if it is working, right? Because…
42 00:06:39.250 ⇒ 00:06:39.980 Emily Giant: Yeah.
43 00:06:39.980 ⇒ 00:06:41.120 Awaish Kumar: It just runs.
44 00:06:41.320 ⇒ 00:06:50.910 Awaish Kumar: Indefinitely. So, I will make it down to run for a few minutes, and then, we can, validate the data, and,
45 00:06:51.330 ⇒ 00:06:53.739 Awaish Kumar: Push the fixes if needed.
46 00:06:54.640 ⇒ 00:07:03.279 Emily Giant: Okay, yeah, that sounds fine. Let’s just do that. Were you able to check out the GA4 hourly snapshot data, too, or just the inventory?
47 00:07:04.900 ⇒ 00:07:07.820 Awaish Kumar: Right now, I have added it to the…
48 00:07:08.030 ⇒ 00:07:13.709 Awaish Kumar: I’m… I’m planning to add all… and all hourly models, so…
49 00:07:14.570 ⇒ 00:07:29.920 Emily Giant: Okay, yeah, that’s amazing. Yeah, that sounds good. I wouldn’t, like I said, just to reiterate, you don’t have to go too far back in time, because it’s not going to be accurate anyway. So, just as long as it’s good moving forward, then I think the company will be happy with that.
50 00:07:30.750 ⇒ 00:07:31.420 Awaish Kumar: Okay.
51 00:07:31.910 ⇒ 00:07:32.530 Emily Giant: Yeah.
52 00:07:32.660 ⇒ 00:07:42.709 Emily Giant: And then I’m working on, the revenue model still, just, like, the little tweaks downstream, in that MART Unified model, but it’s,
53 00:07:42.970 ⇒ 00:07:44.919 Emily Giant: I had to…
54 00:07:45.030 ⇒ 00:08:05.309 Emily Giant: essentially make new models for anything, for our issue tags, for our, like, customer care team. The models that we have to rely on are completely different than what we used to rely on in the past, so that’s what I had to change this week. And those are almost ready to review, but just not yet. They’re complicated.
55 00:08:06.130 ⇒ 00:08:12.849 Emily Giant: it’s pulling that Shopify ID from the new models that, like, it’s just hit or miss, and I don’t know why.
56 00:08:13.000 ⇒ 00:08:14.799 Emily Giant: But it’s getting there.
57 00:08:16.220 ⇒ 00:08:19.479 Awaish Kumar: Oh, oh, okay, sure, let us know if…
58 00:08:19.920 ⇒ 00:08:22.010 Awaish Kumar: I can be helpful anywhere, but…
59 00:08:22.430 ⇒ 00:08:23.429 Emily Giant: Yeah, I’m gonna reach out.
60 00:08:23.430 ⇒ 00:08:24.100 Awaish Kumar: this afternoon.
61 00:08:24.100 ⇒ 00:08:24.720 Emily Giant: scanning.
62 00:08:25.230 ⇒ 00:08:26.569 Emily Giant: To get your eyes.
63 00:08:26.570 ⇒ 00:08:28.850 Awaish Kumar: Maybe we’ll be back on Monday. Okay.
64 00:08:29.080 ⇒ 00:08:30.330 Emily Giant: Okay. Sorry. Okay.
65 00:08:30.500 ⇒ 00:08:44.790 Emily Giant: Oh, no, you’re good. But yeah, maybe Monday, or, because it’s probably getting late where you are, I’ll throw some time on your calendar to review them. They’re not ready to review yet, you’d just be like, what are you doing? So…
66 00:08:44.790 ⇒ 00:08:51.019 Emily Giant: Okay, cool. Alright, in that case, just, I’m here all day, so reach out if you have any questions.
67 00:08:51.610 ⇒ 00:08:53.210 Awaish Kumar: Yeah, sure, thank you.
68 00:08:53.640 ⇒ 00:08:54.730 Emily Giant: Cool, bye.