Meeting Title: US x BF | Planning & Retro Date: 2025-11-24 Meeting participants: Awaish Kumar, Emily Giant, Amber Lin
WEBVTT
1 00:01:53.630 ⇒ 00:01:54.840 Emily Giant: Hello!
2 00:01:58.130 ⇒ 00:01:59.030 Awaish Kumar: Hello!
3 00:02:00.740 ⇒ 00:02:01.810 Emily Giant: Did you have a good weekend?
4 00:02:02.330 ⇒ 00:02:04.430 Awaish Kumar: Yeah. What about you?
5 00:02:04.930 ⇒ 00:02:11.010 Emily Giant: It was pretty good. I saw the new, Wicked musical movie, and I loved it, so that was fun.
6 00:02:11.710 ⇒ 00:02:12.789 Awaish Kumar: Oh, which movie?
7 00:02:13.800 ⇒ 00:02:22.350 Emily Giant: Yeah, it’s, round two of the Wicked movie. I’m a… an old theater kid, so I, of course saw it on opening weekend.
8 00:02:22.800 ⇒ 00:02:23.540 Awaish Kumar: Okay.
9 00:02:26.290 ⇒ 00:02:27.560 Emily Giant: Hey, Amber!
10 00:02:28.300 ⇒ 00:02:29.349 Amber Lin: Hi there!
11 00:02:30.280 ⇒ 00:02:34.120 Amber Lin: I am a little…
12 00:02:35.030 ⇒ 00:02:43.819 Amber Lin: I haven’t been keeping up with progress for a bit, so I’m not sure if I would be able to run this, but I can support on the ticket sides, and…
13 00:02:43.950 ⇒ 00:02:45.950 Amber Lin: I’ll pull up later, and I’ll…
14 00:02:46.620 ⇒ 00:02:47.290 Emily Giant: Yeah.
15 00:02:48.600 ⇒ 00:02:57.179 Awaish Kumar: Yeah, so Demi is off, and I think… I worked last time on snapshots, So, snapshots were working fine.
16 00:02:57.390 ⇒ 00:03:05.200 Awaish Kumar: And also, I made changes to hourly tables, as we discussed.
17 00:03:05.200 ⇒ 00:03:06.660 Emily Giant: And…
18 00:03:06.660 ⇒ 00:03:23.130 Awaish Kumar: made it incremental, and also made it, like, only if you run it full, like, or fully refresh, like, if you fully refresh it, it will run for last 30… 30 days. And if you… like, it will run regularly.
19 00:03:25.820 ⇒ 00:03:45.470 Awaish Kumar: on an hourly basis, and just will, add in… just will run incrementally. And whenever we make, like, changes on a schema level, we need to run full refresh, and then it will run for, last 30 days. And in the last 30 days also.
20 00:03:46.230 ⇒ 00:03:52.040 Awaish Kumar: Like, now it is running for, like, 3… still taking, like, around 3 to 4 hours.
21 00:03:52.770 ⇒ 00:03:54.939 Emily Giant: Oh, God, okay. Wow.
22 00:03:54.940 ⇒ 00:03:59.930 Awaish Kumar: you know… For fully refreshes. That’s why I made it incremental as well, so…
23 00:04:00.650 ⇒ 00:04:04.689 Awaish Kumar: Regular runs, it will just run incrementally, and…
24 00:04:04.710 ⇒ 00:04:23.610 Awaish Kumar: But I’m seeing few errors again on one of the snapshot models. I’m not sure why. Like, last… last time when I ran, all the snapshot models were, like, finishing in 30 minutes. Now the… one of the inventory adjustment table is taking more than, like, 45 minutes, and… and run is being canceled.
25 00:04:23.720 ⇒ 00:04:29.159 Awaish Kumar: I’m not sure what happened to that table since I worked on those last time.
26 00:04:29.440 ⇒ 00:04:31.850 Emily Giant: I don’t think anything. That’s really weird.
27 00:04:31.980 ⇒ 00:04:33.860 Emily Giant: No one’s deployed anything.
28 00:04:34.290 ⇒ 00:04:49.179 Emily Giant: outside of, like, I guess some schema changes, like, I’ve held back all of mine until during the holiday. I’m gonna deploy over the weekend when no one’s working, because of potential needs for, like, full refreshes taking a long time in production.
29 00:04:49.540 ⇒ 00:04:51.159 Emily Giant: So that’s really odd.
30 00:04:52.040 ⇒ 00:04:57.929 Awaish Kumar: So, snapshot model, like, depends on… on the model. It is creating snapshots for
31 00:04:58.150 ⇒ 00:05:01.080 Awaish Kumar: So I don’t know if you push anything for that.
32 00:05:01.080 ⇒ 00:05:01.500 Emily Giant: No.
33 00:05:01.500 ⇒ 00:05:07.190 Awaish Kumar: called, I think, Inventory Adjustment Thing, which basically Or maybe there’s some…
34 00:05:08.590 ⇒ 00:05:09.830 Emily Giant: Can we look at it real quick?
35 00:05:09.830 ⇒ 00:05:10.850 Awaish Kumar: Baby?
36 00:05:11.690 ⇒ 00:05:16.060 Awaish Kumar: Yeah, I haven’t dig deeper into that, I don’t know.
37 00:05:17.980 ⇒ 00:05:18.360 Emily Giant: Huh?
38 00:05:18.360 ⇒ 00:05:18.930 Awaish Kumar: Nope.
39 00:05:19.750 ⇒ 00:05:24.900 Awaish Kumar: Yeah, I… I’m… have… oh, okay.
40 00:05:26.840 ⇒ 00:05:30.379 Awaish Kumar: I can look at real quick the latest one for that.
41 00:05:30.950 ⇒ 00:05:44.400 Emily Giant: Okay, I was thinking, like, do you think if I shared my screen and we went through the models, we could do, like, what we did with UTAM when we looked at the models and how long they were taking to run, and could turn them to incremental?
42 00:05:44.520 ⇒ 00:05:47.769 Emily Giant: If any of them aren’t, because I think there are a lot of, like…
43 00:05:48.600 ⇒ 00:05:50.839 Emily Giant: Here, I’ll show you what I mean.
44 00:05:51.670 ⇒ 00:05:57.930 Awaish Kumar: So, yeah, this is… there’s only one model where it is stuck. You can share your screen.
45 00:05:58.470 ⇒ 00:06:02.000 Awaish Kumar: But, I’m on, like, mobile, so…
46 00:06:02.510 ⇒ 00:06:08.800 Emily Giant: Oh, oh, oh, okay. If you can open the dbt production runs, I can show you the…
47 00:06:10.500 ⇒ 00:06:14.329 Emily Giant: Okay, let me share the correct screen this time.
48 00:06:14.550 ⇒ 00:06:16.360 Emily Giant: Sorry… okay.
49 00:06:17.980 ⇒ 00:06:20.730 Emily Giant: So, we’ve got production runs…
50 00:06:21.770 ⇒ 00:06:29.509 Emily Giant: Here… sorry, this is… I’m trying to rerun the refresh where it failed from last night, and I’m just watching it. But…
51 00:06:29.510 ⇒ 00:06:31.780 Awaish Kumar: Let’s scroll down, and then last one.
52 00:06:32.050 ⇒ 00:06:33.289 Emily Giant: This one? Or this one?
53 00:06:33.880 ⇒ 00:06:35.160 Awaish Kumar: Yeah, last one.
54 00:06:36.560 ⇒ 00:06:44.470 Awaish Kumar: This is basically the snapshots. If you open the… any of these runs, like, they are all failing on one
55 00:06:44.470 ⇒ 00:06:57.209 Awaish Kumar: a snapshot, which is SnapMart inventory adjustments, and it’s only… it’s not even failing, it’s just taking, infinite time, and it just gets canceled.
56 00:06:57.210 ⇒ 00:07:01.949 Emily Giant: Kill it. Let’s just kill it, and only do this one. This is the one that matters.
57 00:07:02.980 ⇒ 00:07:06.730 Awaish Kumar: Okay, can I… okay, can I remove that from this run, then?
58 00:07:06.730 ⇒ 00:07:07.420 Emily Giant: Yeah.
59 00:07:08.120 ⇒ 00:07:09.260 Awaish Kumar: Okay, yeah, that’s…
60 00:07:09.260 ⇒ 00:07:11.299 Emily Giant: I can do it now while I’m here.
61 00:07:11.640 ⇒ 00:07:13.659 Awaish Kumar: I’m in there also.
62 00:07:13.660 ⇒ 00:07:29.820 Emily Giant: Oh, okay, yeah. If you just remove that from the run, that’s… that’s perfect, because they’re the same thing, and then, the suborders is at, like, the line item level of each order, and we really just need that more high-level snapshot anyway.
63 00:07:31.420 ⇒ 00:07:35.459 Awaish Kumar: Okay, now if you refresh it, I have just made the changes.
64 00:07:35.610 ⇒ 00:07:39.400 Emily Giant: Alright, perfect. That should help. And then…
65 00:07:40.170 ⇒ 00:07:43.590 Emily Giant: the other one… yeah, I think that with that one removed, that will…
66 00:07:43.910 ⇒ 00:07:45.830 Emily Giant: Cure a lot of the issues.
67 00:07:48.420 ⇒ 00:07:50.570 Emily Giant: Because that is a major, major…
68 00:07:50.570 ⇒ 00:07:52.160 Awaish Kumar: Etigo, baby!
69 00:07:52.420 ⇒ 00:07:59.009 Awaish Kumar: For those hourly models, I’m not sure which scheduled job is basically running those
70 00:08:00.690 ⇒ 00:08:05.900 Awaish Kumar: The hourly, like, hourly changes for inventory and marketing.
71 00:08:10.280 ⇒ 00:08:13.410 Awaish Kumar: Should I include those here in this…
72 00:08:14.020 ⇒ 00:08:16.629 Awaish Kumar: Right now, if you open the settings.
73 00:08:17.060 ⇒ 00:08:17.950 Emily Giant: Huh.
74 00:08:17.950 ⇒ 00:08:19.489 Awaish Kumar: And the commands, like.
75 00:08:20.460 ⇒ 00:08:21.010 Emily Giant: Yeah.
76 00:08:21.010 ⇒ 00:08:24.159 Awaish Kumar: Yeah, we are only running snapshots here.
77 00:08:24.330 ⇒ 00:08:28.749 Awaish Kumar: If we, maybe we can also add those hourly models here if needed.
78 00:08:29.710 ⇒ 00:08:35.570 Emily Giant: Gotcha. Okay, yeah, I’ll do that. So, like, the dbt build… the end tables.
79 00:08:36.980 ⇒ 00:08:42.169 Awaish Kumar: So, like, dbt run, or build, hourly… it’s called, like, hourly lot model.
80 00:08:46.000 ⇒ 00:08:48.129 Emily Giant: So if I look here, it’s called…
81 00:08:53.650 ⇒ 00:08:54.990 Emily Giant: These two.
82 00:08:55.800 ⇒ 00:08:59.939 Emily Giant: the GA4 product hourly changes and MART inventory hourly lot changes.
83 00:09:08.850 ⇒ 00:09:10.639 Emily Giant: Right? Is that what you mean?
84 00:09:11.170 ⇒ 00:09:13.510 Awaish Kumar: Sorry, there are only two tables, yeah, one for…
85 00:09:13.510 ⇒ 00:09:14.050 Emily Giant: Yeah, yeah.
86 00:09:14.050 ⇒ 00:09:16.450 Awaish Kumar: G4, and one for lot only, yeah.
87 00:09:17.370 ⇒ 00:09:19.440 Emily Giant: Perfect. I’ll add these.
88 00:09:19.770 ⇒ 00:09:20.640 Emily Giant: Mart.
89 00:09:20.640 ⇒ 00:09:26.950 Awaish Kumar: Yeah, I didn’t add it because I didn’t know if there’s another run which is basically running
90 00:09:27.420 ⇒ 00:09:28.930 Awaish Kumar: It is, so…
91 00:09:29.330 ⇒ 00:09:31.680 Emily Giant: I will make sure that they have…
92 00:09:31.870 ⇒ 00:09:42.930 Emily Giant: What I’ll go… I’ll do right now is go into the YAML and make sure that these have a snapshot tag, so that they only run with this, and that way they’re not double-doing.
93 00:09:43.600 ⇒ 00:09:44.510 Awaish Kumar: Okay, okay.
94 00:09:44.790 ⇒ 00:09:47.879 Emily Giant: Okay, cool. Does that… does that sound like a good plan?
95 00:09:48.320 ⇒ 00:09:49.080 Awaish Kumar: Yeah.
96 00:09:49.290 ⇒ 00:09:49.860 Emily Giant: Okay.
97 00:09:49.960 ⇒ 00:09:50.830 Emily Giant: Gotcha.
98 00:09:51.810 ⇒ 00:09:54.900 Emily Giant: S… Alright.
99 00:09:55.120 ⇒ 00:09:56.920 Emily Giant: What was the other one?
100 00:09:58.540 ⇒ 00:09:59.360 Emily Giant: And then that was…
101 00:09:59.360 ⇒ 00:09:59.820 Awaish Kumar: VA.
102 00:09:59.820 ⇒ 00:10:00.720 Emily Giant: for…
103 00:10:01.070 ⇒ 00:10:01.400 Awaish Kumar: Yeah.
104 00:10:01.400 ⇒ 00:10:05.370 Emily Giant: I really… GA4 product hourly changes.
105 00:10:17.050 ⇒ 00:10:18.410 Emily Giant: So, I can just add.
106 00:10:18.410 ⇒ 00:10:19.210 Awaish Kumar: Contact.
107 00:10:19.210 ⇒ 00:10:20.710 Emily Giant: Each of these in the YAML.
108 00:10:20.900 ⇒ 00:10:23.670 Awaish Kumar: Yeah, for inventory, it was also, like, hourly changes.
109 00:10:25.270 ⇒ 00:10:26.619 Awaish Kumar: The name of the…
110 00:10:26.620 ⇒ 00:10:27.960 Emily Giant: Oh, oh, is it wrong?
111 00:10:28.520 ⇒ 00:10:29.180 Awaish Kumar: Yeah.
112 00:10:29.830 ⇒ 00:10:30.650 Emily Giant: Thank you.
113 00:10:31.170 ⇒ 00:10:39.179 Emily Giant: I always try to copy the names in dbt, and since the change, Smart product hourly changes, yeah.
114 00:10:41.290 ⇒ 00:10:49.880 Emily Giant: Wait, more… sorry, I feel like my brain is… Already… on vacation.
115 00:10:50.070 ⇒ 00:10:52.820 Emily Giant: It, like, doesn’t let me copy the name!
116 00:10:54.190 ⇒ 00:10:58.010 Awaish Kumar: Yeah, I’m not sure. You can copy it from…
117 00:10:58.010 ⇒ 00:10:59.160 Emily Giant: Inventory.
118 00:11:00.760 ⇒ 00:11:03.760 Emily Giant: Sorry, I will figure it out, I promise.
119 00:11:04.930 ⇒ 00:11:06.200 Emily Giant: So, dbt build…
120 00:11:06.200 ⇒ 00:11:07.520 Awaish Kumar: Hi, Wendy.
121 00:11:08.090 ⇒ 00:11:12.689 Awaish Kumar: Smart, inventory, lot, hourly changes. Lot.
122 00:11:12.720 ⇒ 00:11:15.080 Emily Giant: Marked inventory.
123 00:11:15.940 ⇒ 00:11:19.139 Awaish Kumar: Yeah, you have to remove the inventory, there’s two times the inventory.
124 00:11:20.100 ⇒ 00:11:21.860 Emily Giant: Oh, my God.
125 00:11:22.100 ⇒ 00:11:22.890 Emily Giant: My mind is.
126 00:11:22.890 ⇒ 00:11:24.000 Awaish Kumar: It’s gone.
127 00:11:24.000 ⇒ 00:11:26.020 Emily Giant: Smart Inventory Lot, Hours.
128 00:11:26.020 ⇒ 00:11:28.099 Awaish Kumar: How many interviews, yeah.
129 00:11:28.400 ⇒ 00:11:29.760 Awaish Kumar: That’s not… that’s okay.
130 00:11:29.760 ⇒ 00:11:30.450 Emily Giant: Okay.
131 00:11:30.790 ⇒ 00:11:32.739 Emily Giant: Woo! We did it!
132 00:11:33.340 ⇒ 00:11:37.550 Emily Giant: Jeez. Okay, okay, so that is updated.
133 00:11:37.710 ⇒ 00:11:42.070 Emily Giant: I’m just gonna… Okay, that run already got stopped, right?
134 00:11:43.670 ⇒ 00:11:45.150 Awaish Kumar: It’s in queue right now.
135 00:11:45.150 ⇒ 00:11:46.630 Emily Giant: Oh, okay, perfect.
136 00:11:47.740 ⇒ 00:11:59.370 Emily Giant: Okay, I’ll add those to the YAML also, so that they don’t have, like, it has the inventory tag right now, so it is running with the other inventory models.
137 00:11:59.500 ⇒ 00:12:00.810 Awaish Kumar: And it should not.
138 00:12:00.810 ⇒ 00:12:05.400 Emily Giant: So I’m just gonna… wait, that’s my branch. I’ll make a new branch and deploy that in a second.
139 00:12:05.990 ⇒ 00:12:06.720 Awaish Kumar: Okay.
140 00:12:07.070 ⇒ 00:12:08.300 Emily Giant: Okay, cool.
141 00:12:08.960 ⇒ 00:12:12.139 Emily Giant: Alright, and then, as far as what.
142 00:12:12.140 ⇒ 00:12:12.790 Awaish Kumar: ticket?
143 00:12:12.790 ⇒ 00:12:25.169 Emily Giant: I’m just… I’m working on all of this simultaneously, but I’m gonna wait until, close of business on, Wednesday… on Tuesday to deploy them.
144 00:12:25.300 ⇒ 00:12:30.069 Emily Giant: Because there have been too many issues with the jobs, so they’ll all be done.
145 00:12:30.070 ⇒ 00:12:48.690 Emily Giant: But, I just don’t want to disrupt anything during our actual sales week, and I’m gonna wait till people aren’t on their computers to mess up all the jobs, and sit there and, like, rerun them, because it’s gonna take us schema full refresh for staging and for production, and that’s gonna take forever. So, I’ll just wait.
146 00:12:49.650 ⇒ 00:13:02.180 Amber Lin: I see. Okay. I guess overall, my question is, like, what are the three main things we want to accomplish this week? I know we have, like, a short week, like, is there a few things we want to get done this week?
147 00:13:03.770 ⇒ 00:13:12.190 Emily Giant: For me, it’s, finishing the revenue mark, and all of those changes are, they’re all, like.
148 00:13:13.070 ⇒ 00:13:14.749 Emily Giant: in my staging.
149 00:13:15.320 ⇒ 00:13:20.089 Emily Giant: But, I just want those to be deployed and running in production, and then…
150 00:13:20.410 ⇒ 00:13:25.339 Emily Giant: That’s my main goal, because that will be, like, the finish of revenue, right there.
151 00:13:25.340 ⇒ 00:13:25.760 Amber Lin: Okay.
152 00:13:25.760 ⇒ 00:13:28.380 Emily Giant: And then I can start replacing the tables.
153 00:13:28.610 ⇒ 00:13:37.360 Amber Lin: Oh, sounds good. When you finish it, do you need any support from Wage, etc? I know you plan to, like, deploy in the holidays, so I don’t know…
154 00:13:37.360 ⇒ 00:13:46.060 Emily Giant: Yeah. Not during the holiday, but, The only,
155 00:13:46.660 ⇒ 00:13:59.639 Emily Giant: potential help that I would want is, like, making sure that all the configuration is correct in the models, so that they’re running as efficiently as possible. But I can tack him in, like, tomorrow on those in my stages.
156 00:13:59.640 ⇒ 00:14:00.810 Amber Lin: That will be okay.
157 00:14:01.150 ⇒ 00:14:12.749 Emily Giant: Okay, yeah, I’ll just… I’ll send the PR. It’s gonna be massive, just FYI. There’s, like, not a way around it this round, because changing one thing in revenue requires changing, like.
158 00:14:12.970 ⇒ 00:14:18.209 Emily Giant: 5 other things downstream. But, I’ve been testing it for a week and a half.
159 00:14:18.360 ⇒ 00:14:19.510 Emily Giant: So it’s…
160 00:14:20.250 ⇒ 00:14:29.520 Emily Giant: It’s gonna be okay, but I just wanna make sure, like, the config is good. And maybe I’ll just throw a call on tomorrow, if that’s okay, Awash, and we can go over the configs together.
161 00:14:29.930 ⇒ 00:14:31.270 Awaish Kumar: Yeah, that’s good.
162 00:14:31.600 ⇒ 00:14:33.739 Emily Giant: Alright, cool. Is there a time that works for you?
163 00:14:35.370 ⇒ 00:14:39.470 Awaish Kumar: Yeah, we can join in… we can just increase our time for stand-up tomorrow.
164 00:14:39.830 ⇒ 00:14:41.800 Emily Giant: Oh, okay, that’d be great.
165 00:14:43.620 ⇒ 00:14:47.540 Awaish Kumar: From 15 minutes to maybe 30 or something, which… whatever is good.
166 00:14:47.540 ⇒ 00:14:53.890 Emily Giant: 30 would probably be fine. It’s, like, 15 models to just look through the configuration, so, yeah.
167 00:14:54.760 ⇒ 00:14:55.819 Awaish Kumar: Okay, lower.
168 00:14:55.820 ⇒ 00:14:56.390 Emily Giant: Alright.
169 00:14:56.390 ⇒ 00:14:56.780 Amber Lin: Excellent.
170 00:14:56.780 ⇒ 00:14:57.340 Emily Giant: Cool!
171 00:14:57.510 ⇒ 00:15:01.570 Amber Lin: Then Awish, is there anything you want to get… you have to get done this week?
172 00:15:03.730 ⇒ 00:15:09.090 Awaish Kumar: Yeah, for, like, normally, There’s nothing which we…
173 00:15:10.150 ⇒ 00:15:20.900 Awaish Kumar: Basically, we’ll be, like, developing from scratch, it’s just that the runs… the dbt runs… just runs smoothly, the metaplane works, and the…
174 00:15:21.590 ⇒ 00:15:26.180 Awaish Kumar: and that support that, that, like, Emily needs in the revenue models out.
175 00:15:27.700 ⇒ 00:15:30.670 Amber Lin: Okay, great. Yeah, that’s all I need. I’ll,
176 00:15:31.210 ⇒ 00:15:34.139 Amber Lin: I’ll send the notes in the channel. Sounds good.
177 00:15:34.140 ⇒ 00:15:36.949 Emily Giant: Alright. Thanks, Amber. Thanks, Awash. I’ll talk to you soon.
178 00:15:36.950 ⇒ 00:15:38.360 Amber Lin: Thanks, everyone. Bye.