Meeting Title: Working session Date: 2025-10-20 Meeting participants: Demilade Agboola, Emily Giant
WEBVTT
1 00:01:04.090 ⇒ 00:01:05.480 Emily Giant: Hello!
2 00:01:11.080 ⇒ 00:01:12.200 Demilade Agboola: Hi, I mean, how are you?
3 00:01:13.150 ⇒ 00:01:15.049 Emily Giant: I’m good! How was your weekend?
4 00:01:16.150 ⇒ 00:01:18.480 Demilade Agboola: It just went by, to be honest.
5 00:01:18.480 ⇒ 00:01:19.310 Emily Giant: Oof.
6 00:01:19.310 ⇒ 00:01:25.920 Demilade Agboola: I have no idea how… I did, I had tennis on… Saturday?
7 00:01:27.300 ⇒ 00:01:29.850 Demilade Agboola: I actually won, which is quite nice.
8 00:01:29.850 ⇒ 00:01:32.209 Emily Giant: Yes! That’s awesome!
9 00:01:32.840 ⇒ 00:01:37.129 Demilade Agboola: Yeah. So, making great improvements quite quickly.
10 00:01:37.820 ⇒ 00:01:41.860 Demilade Agboola: And then I was supposed to have tennis again on Sunday.
11 00:01:42.030 ⇒ 00:01:45.959 Demilade Agboola: But then I misread my coach’s message.
12 00:01:46.740 ⇒ 00:01:52.490 Demilade Agboola: So he said, oh, let’s have a session at 13.30, which is 1.30.
13 00:01:52.950 ⇒ 00:01:53.890 Emily Giant: Right.
14 00:01:53.890 ⇒ 00:01:58.229 Demilade Agboola: I wasn’t wearing my glasses or something. I saw it as 3.30.
15 00:01:58.690 ⇒ 00:02:00.269 Emily Giant: Oh, no.
16 00:02:00.270 ⇒ 00:02:04.500 Demilade Agboola: So, at 1.38th, he texts me, and he’s like, am I still coming?
17 00:02:05.140 ⇒ 00:02:09.909 Demilade Agboola: And I hadn’t seen… so I saw that message, like, 2.30, because I was just about, you know, getting ready.
18 00:02:09.919 ⇒ 00:02:10.719 Emily Giant: Yeah.
19 00:02:10.720 ⇒ 00:02:14.389 Demilade Agboola: Which is… and then I see the message, and I’m like, oh, shoot.
20 00:02:15.670 ⇒ 00:02:16.230 Demilade Agboola: So I…
21 00:02:16.230 ⇒ 00:02:16.870 Emily Giant: Man.
22 00:02:16.870 ⇒ 00:02:22.840 Demilade Agboola: And he’s like, oh, no, he’s left now, but… he, like, he… because I was actually, like, obviously, because, you know, I…
23 00:02:23.160 ⇒ 00:02:26.120 Demilade Agboola: I just apologize because, you know, I didn’t see it properly.
24 00:02:26.120 ⇒ 00:02:26.860 Emily Giant: Yeah.
25 00:02:26.860 ⇒ 00:02:29.689 Demilade Agboola: And he’s like, no, no, he’s fine. And then…
26 00:02:29.850 ⇒ 00:02:31.849 Demilade Agboola: We will schedule for, like, next weekend.
27 00:02:32.140 ⇒ 00:02:36.830 Emily Giant: Yeah. Well, maybe it was nice to, like, end the weekend on a win.
28 00:02:37.680 ⇒ 00:02:38.330 Emily Giant: Yes.
29 00:02:39.180 ⇒ 00:02:43.529 Demilade Agboola: I mean, my coach, my coach… you know one thing about, like, tennis?
30 00:02:44.150 ⇒ 00:02:50.370 Demilade Agboola: For me, it’s just, like, it gives you immediate feedback on the disparity
31 00:02:51.460 ⇒ 00:02:58.350 Demilade Agboola: in levels between people that play. Like, so my coach used to… my coach is like a… he’s almost 60, he’s 59.
32 00:02:59.340 ⇒ 00:03:01.320 Demilade Agboola: He used to represent Walter when he was younger.
33 00:03:01.690 ⇒ 00:03:02.829 Emily Giant: Oh, dang!
34 00:03:02.830 ⇒ 00:03:07.639 Demilade Agboola: And so, as you can tell, he’s pretty good. His son right now is actually Malta’s number one.
35 00:03:08.160 ⇒ 00:03:10.620 Emily Giant: No way! That’s awesome.
36 00:03:10.940 ⇒ 00:03:12.900 Demilade Agboola: So he’s pretty good, as you can tell.
37 00:03:12.900 ⇒ 00:03:13.730 Emily Giant: Yeah.
38 00:03:13.990 ⇒ 00:03:18.050 Demilade Agboola: He might not have the athleticism anymore, because he’s, like, almost 60.
39 00:03:18.250 ⇒ 00:03:19.080 Emily Giant: Yeah.
40 00:03:20.740 ⇒ 00:03:40.690 Demilade Agboola: even when he’s holding, like, some… because, you know, some… when he’s playing, he might hold multiple balls in his hand and just keep hitting back and forth with me. But even when he’s, like, holding multiple balls in his hand, and I can’t keep up. Yeah. When you think about just how, like, if he, like, how there’s so many levels to that, like, if he… I can’t keep up with him.
41 00:03:40.770 ⇒ 00:03:45.270 Demilade Agboola: But I’m sure in the world of tennis, there are people he can’t keep up with, and he just can’t keep extra.
42 00:03:45.270 ⇒ 00:03:46.050 Emily Giant: Yeah.
43 00:03:46.490 ⇒ 00:03:50.269 Demilade Agboola: Wow, like, the skill level, skill gap is insane.
44 00:03:50.940 ⇒ 00:04:00.429 Emily Giant: Oh, man. Yeah, it’s… I used to take singing lessons, and that’s how it always felt. It was like… I thought I was killing it, and then…
45 00:04:00.430 ⇒ 00:04:13.039 Emily Giant: they would give me a note and sing it, and I’m like, oh, I’m… I got a long way to go, don’t I? Yeah, that’s very cool, though, that you’re, like… I think that’s a lot with sports, is it’ll be really difficult, and then something will just click.
46 00:04:13.250 ⇒ 00:04:24.080 Emily Giant: And your, your level will just, like, exponentially increase all of a sudden. But it takes, like, that initial getting over the hump.
47 00:04:25.090 ⇒ 00:04:30.420 Demilade Agboola: Yeah, yeah, I agree, I agree. Then I also had swimming on Saturday as well, so it was a decent weekend.
48 00:04:30.600 ⇒ 00:04:31.910 Demilade Agboola: How’s your weekend?
49 00:04:32.580 ⇒ 00:04:36.889 Emily Giant: Oh, I was watching Children the entire time, so it was…
50 00:04:37.430 ⇒ 00:04:44.120 Emily Giant: It was fine, it was cute, I guess, but it was, like, whew, yeah.
51 00:04:44.170 ⇒ 00:05:03.290 Emily Giant: Lots of nephews, lots of nieces, and then the night that I didn’t have them, I… friends came over with their kids, and so it just felt like herding cats that weren’t cats, which I would have preferred cats, but, yeah, it was fine, though. You know, restful, I didn’t like…
52 00:05:03.830 ⇒ 00:05:09.479 Emily Giant: do anything that would have kept me up late, so I feel like I actually rested this weekend.
53 00:05:09.480 ⇒ 00:05:34.460 Emily Giant: Instead of just doing manual labor. I also moved, like, 700 bricks, and started washing them off, because we save everything, and that wall that they knocked down in the basement, it was a brick wall that was, like, 3 layers deep. So, we’re creating, like, garden paths around all the gardens and lining it with brick. So instead of buying brick, because we spent all our money on fixing the wall, we’re, like, salvaging the old bricks from
54 00:05:34.460 ⇒ 00:05:37.580 Emily Giant: house, so I did do a fair amount of, like.
55 00:05:37.780 ⇒ 00:05:52.320 Emily Giant: brick sorting and lifting. So that was my manual labor, but I was outside, and there’s this podcast I’m listening to, it’s pretty crass, but it’s called Last Podcast on the Left, and they’re doing, a four-part series on Heinrich Himmler.
56 00:05:52.340 ⇒ 00:06:05.980 Emily Giant: And, if anyone could make, like, learning about World War II horrifying and funny at the same time, it’s these people. So, listen to, like, 6 hours of my Heinrich Himmler podcast.
57 00:06:06.110 ⇒ 00:06:08.990 Emily Giant: And moved bricks. So it was pretty good!
58 00:06:10.460 ⇒ 00:06:13.189 Demilade Agboola: Sounds like a… sounds like a great weekend. I mean, you might not.
59 00:06:13.190 ⇒ 00:06:14.280 Emily Giant: Yep.
60 00:06:14.510 ⇒ 00:06:15.319 Demilade Agboola: art book.
61 00:06:16.970 ⇒ 00:06:27.840 Emily Giant: Yeah. But, okay. So, I wanted to review my sub stuff this morning so that we could push it soon. The historical stuff. Did you have anything you wanted to do?
62 00:06:28.300 ⇒ 00:06:30.170 Demilade Agboola: Not particularly. I think…
63 00:06:30.490 ⇒ 00:06:33.179 Demilade Agboola: We’re in a good spot for the meeting with.
64 00:06:33.420 ⇒ 00:06:34.999 Demilade Agboola: I wanted to make some charts.
65 00:06:35.530 ⇒ 00:06:36.170 Emily Giant: Yeah.
66 00:06:36.400 ⇒ 00:06:40.260 Demilade Agboola: Well, like, I think we’re in a good spot for our meeting with Perry today.
67 00:06:40.540 ⇒ 00:06:45.850 Emily Giant: Okay, I’ll make sure that it’s all in Looker, also. That’s what I can do.
68 00:06:45.850 ⇒ 00:06:47.500 Demilade Agboola: That would be super helpful, if you could have.
69 00:06:47.500 ⇒ 00:06:57.790 Emily Giant: Yeah. I know it’s annoying as fuck when it’s not in there, because the users, like, don’t know what’s going on. So I can do that, even, like, if we end early, or, like, right after this meeting, I’ll make sure I do that.
70 00:06:57.790 ⇒ 00:07:01.250 Demilade Agboola: Perry can play around with herself, and just kind of…
71 00:07:01.250 ⇒ 00:07:02.030 Emily Giant: Yeah.
72 00:07:02.280 ⇒ 00:07:06.899 Demilade Agboola: Like, across, like, product types and stuff, that would really, really be helpful.
73 00:07:06.900 ⇒ 00:07:10.220 Emily Giant: Yeah, I can do that, that’s no problem. Alright, let me share my screen.
74 00:07:10.400 ⇒ 00:07:23.599 Emily Giant: Well, let me open what I wanted to show you in the first place. I pretty much want to look through those PRs and, just see if there’s any, like, holes. I started building… what did I start building? On Friday?
75 00:07:23.760 ⇒ 00:07:24.970 Emily Giant: Whatever.
76 00:07:25.070 ⇒ 00:07:26.949 Demilade Agboola: Hold on, can you see my screen?
77 00:07:28.340 ⇒ 00:07:28.760 Demilade Agboola: Yes.
78 00:07:28.760 ⇒ 00:07:39.619 Emily Giant: I was like, it’s just a page with all my passwords on it, because I need to get… I need to get a password protector. What… what password program do you use?
79 00:07:39.620 ⇒ 00:07:44.649 Demilade Agboola: I use something called NordPass, so it’s N-O-R-D-P-A-S, P-A-S-S.
80 00:07:47.350 ⇒ 00:07:48.150 Emily Giant: Hold on.
81 00:07:51.410 ⇒ 00:07:52.740 Demilade Agboola: Perfect.
82 00:07:54.270 ⇒ 00:07:58.119 Emily Giant: Okay, because… I know that I need to have these
83 00:07:58.390 ⇒ 00:08:01.020 Emily Giant: be more secure, but I also, like…
84 00:08:01.020 ⇒ 00:08:01.899 Demilade Agboola: Like, who wants to have it.
85 00:08:01.900 ⇒ 00:08:03.380 Emily Giant: want to research.
86 00:08:03.620 ⇒ 00:08:08.739 Demilade Agboola: what I do is, I have it across, like, almost all my devices, so my iPad.
87 00:08:09.540 ⇒ 00:08:15.319 Demilade Agboola: So, because I have two phones, so I have it across both phones, my iPhone and my Pixel, I have it.
88 00:08:15.320 ⇒ 00:08:16.040 Emily Giant: Huh.
89 00:08:16.180 ⇒ 00:08:16.830 Demilade Agboola: book.
90 00:08:16.980 ⇒ 00:08:25.239 Demilade Agboola: And even in my MacBook, I have it, like, as an extension in Chrome, I have it as an extension. Basically, anytime I need to have a password, I’m just, like.
91 00:08:25.750 ⇒ 00:08:36.380 Demilade Agboola: I just use it for… I just get passwords from there, and it helps me auto-fill sometimes, and all that. It’s really… it’s really helpful. And then it also helps creating passwords when you want to create it, when you’re, like, they’re asking to create a password.
92 00:08:36.380 ⇒ 00:08:37.370 Emily Giant: Oh, sweet.
93 00:08:37.370 ⇒ 00:08:53.090 Demilade Agboola: We can give you suggestions. You can actually even increase the complexity, so you can use, like, 40 characters if you want to make it really long, and tell it to mix it up with signals, with some… with symbols and everything. And you can make, like, really, really complex passwords that you don’t have to worry about forgetting, because it’s just right there. So you can…
94 00:08:53.090 ⇒ 00:08:53.620 Emily Giant: Okay.
95 00:08:53.890 ⇒ 00:09:02.480 Demilade Agboola: So I get… you get that beautiful flow balance of, like, you can actually get way more complex passwords, as well as not worrying about forgetting those complex passwords.
96 00:09:02.480 ⇒ 00:09:04.919 Emily Giant: Without having to type them in.
97 00:09:04.920 ⇒ 00:09:22.849 Emily Giant: That part sounds important. Like, I have so many of my passwords memorized that are, like… that’s my one thing, is I’m good at… I think it’s why I’m okay at, like, picking this up later in life, this, like, SQL and whatnot, is because I’m good at memorizing random strings of things, but…
98 00:09:22.850 ⇒ 00:09:29.669 Emily Giant: I think that my brain could probably focus on more important things and use a password saver instead of
99 00:09:29.670 ⇒ 00:09:42.700 Emily Giant: remembering long strings of nonsense. Okay, so this is, admin is the last of the subscription platforms that we used, and… let me get this out of the way.
100 00:09:43.340 ⇒ 00:09:44.490 Emily Giant: So I built…
101 00:09:45.050 ⇒ 00:09:57.160 Emily Giant: the staging in 1PR, and then there are some modifications in the second one, because I realized I didn’t need some of the Postgres tables, and I don’t want to just have, like.
102 00:09:57.500 ⇒ 00:10:13.070 Emily Giant: tables sitting around that aren’t used, because that’s why our DAG looks the way it does now. So I did delete them in the second version of this, so would it… no, it wouldn’t make sense, because it won’t show these changes.
103 00:10:13.820 ⇒ 00:10:15.590 Emily Giant: Okay, so…
104 00:10:16.630 ⇒ 00:10:26.950 Emily Giant: I’m trying to decide if GitHub or dbt is a better place to run through these. One of the, pieces of feedback that Utam gave was that I had
105 00:10:27.100 ⇒ 00:10:34.220 Emily Giant: and I had, duplicated the get date, so I did remove… the other get date.
106 00:10:34.570 ⇒ 00:10:39.670 Emily Giant: From these, and that, like he said, other than that, it looked… Okay.
107 00:10:40.380 ⇒ 00:10:41.370 Emily Giant: But…
108 00:10:41.630 ⇒ 00:10:47.910 Emily Giant: Would it be easier for you to hop in and look at it, or what should we go through? They’re really simple, these are all just staging models.
109 00:10:49.160 ⇒ 00:10:52.219 Demilade Agboola: Yeah, if they’re certain models, like, I think they’ll be fine.
110 00:10:52.560 ⇒ 00:10:53.470 Demilade Agboola: Okay.
111 00:10:53.900 ⇒ 00:10:56.519 Demilade Agboola: Are you thinking, Nikki? It just seems like you’re renaming.
112 00:10:57.150 ⇒ 00:10:59.619 Emily Giant: Yeah, exactly. And then, like, if…
113 00:10:59.620 ⇒ 00:11:00.700 Demilade Agboola: 3 years old.
114 00:11:00.700 ⇒ 00:11:01.940 Emily Giant: formalized.
115 00:11:02.110 ⇒ 00:11:03.359 Emily Giant: I’ll do…
116 00:11:03.730 ⇒ 00:11:06.339 Demilade Agboola: If the tiers aren’t normalized, I’ll do, like…
117 00:11:06.370 ⇒ 00:11:11.560 Emily Giant: Enhanced and clean it up and align it to, like, how we do it today.
118 00:11:11.830 ⇒ 00:11:12.550 Demilade Agboola: Okay.
119 00:11:13.120 ⇒ 00:11:16.129 Emily Giant: And then… I’m trying to see if there’s anything in this one…
120 00:11:16.340 ⇒ 00:11:19.429 Demilade Agboola: Only thing I could also advise is potentially casting types.
121 00:11:20.920 ⇒ 00:11:22.800 Emily Giant: Yeah, yeah, that’s true.
122 00:11:22.870 ⇒ 00:11:23.920 Demilade Agboola: Awesome.
123 00:11:24.260 ⇒ 00:11:25.330 Demilade Agboola: Prophet looked good.
124 00:11:26.700 ⇒ 00:11:31.260 Emily Giant: Yeah, these are probably fine. So, the intermediate is in the second…
125 00:11:31.500 ⇒ 00:11:38.339 Emily Giant: These also don’t touch anything, so if I deploy, it’s just not gonna matter.
126 00:11:38.610 ⇒ 00:11:44.400 Emily Giant: I’m just gonna do it, because, again, very low stakes.
127 00:11:44.520 ⇒ 00:11:46.839 Emily Giant: And then the second PR…
128 00:11:49.240 ⇒ 00:12:01.380 Emily Giant: I think I got these historical ones down to, like, potentially two intermediate models, and then, then I can just union it to fax subscriptions.
129 00:12:01.670 ⇒ 00:12:05.940 Emily Giant: But… let’s make this… okay, so this is…
130 00:12:06.590 ⇒ 00:12:12.470 Emily Giant: Legacy Postgres Merge. This table, I am, I’m just gonna open it.
131 00:12:13.760 ⇒ 00:12:33.090 Emily Giant: In this table, I’m joining the various Postgres tables that I’m using, so there’s Postgres charges, subscriptions, and tiers, and then I fill it in, and downstream, I fill it in with any missing information from Hivo. And Hivo doesn’t do much, but it’s that same legacy model that I used for Sticky.
132 00:12:33.160 ⇒ 00:12:38.399 Emily Giant: So… here… So this is what I wanted to ask.
133 00:12:38.650 ⇒ 00:12:42.189 Emily Giant: I… Steven had a version of this.
134 00:12:42.310 ⇒ 00:12:50.230 Emily Giant: And he had filtered it on these subscription IDs, and this range of subscription IDs, and I do not know why.
135 00:12:53.100 ⇒ 00:12:58.379 Demilade Agboola: Yeah, this is… So… I also do not know why.
136 00:12:58.380 ⇒ 00:12:59.240 Emily Giant: Yeah.
137 00:12:59.390 ⇒ 00:13:01.630 Demilade Agboola: What we could do is we could, like, look them up.
138 00:13:02.220 ⇒ 00:13:06.759 Demilade Agboola: And look at the ones also outside that range, and kind of see…
139 00:13:07.120 ⇒ 00:13:11.870 Demilade Agboola: If there’s any pattern to them, or if, like, they’re, like, dummy.
140 00:13:12.120 ⇒ 00:13:14.960 Demilade Agboola: Subscriptions, for instance.
141 00:13:14.960 ⇒ 00:13:15.740 Emily Giant: Yeah.
142 00:13:15.740 ⇒ 00:13:23.510 Demilade Agboola: Obviously, the golden rule is if you’re hard-coding values into whatever, you need to explain why those values are hard-coded that way.
143 00:13:23.510 ⇒ 00:13:25.630 Emily Giant: Yeah, so I…
144 00:13:25.800 ⇒ 00:13:40.769 Emily Giant: just left notes for anything like that that was unclear. I can just use mode for now, because I need to go get my phone downstairs. They’re hammering again, and jackhammering, so… it’s like… they told me that it was going to take 2 days. This is the third week.
145 00:13:40.770 ⇒ 00:13:56.810 Emily Giant: That they’re doing construction on our house. I’m like, I get it. I do that all the time. I’m like, it’ll take 2 hours. And then 3 weeks later, I’m still working on the model. But, oh my god. Select everything from dbt egiant.
146 00:14:01.320 ⇒ 00:14:04.130 Emily Giant: what’s it called? Int Subscriptions Postgres Merge.
147 00:14:09.550 ⇒ 00:14:17.900 Emily Giant: We’re subscription… ID is less than… what’s that range?
148 00:14:32.920 ⇒ 00:14:52.619 Emily Giant: Yeah, all of the, like, weird filtering is very cryptic. I’m like, what? We may never know. So, this model, it should have, a unique OMS order ID, and… The subscription ID, I do believe I, in the config.
149 00:14:54.220 ⇒ 00:14:54.860 Demilade Agboola: Is that essential?
150 00:14:54.860 ⇒ 00:14:55.370 Emily Giant: Yeah, exactly.
151 00:14:56.160 ⇒ 00:15:01.800 Demilade Agboola: I think we could look at the subscriptions that, like, Don’t fit in.
152 00:15:02.330 ⇒ 00:15:06.759 Demilade Agboola: Can we look at the same way we can look at the subscription?
153 00:15:07.130 ⇒ 00:15:11.369 Demilade Agboola: that are less than… like, I mean, we’re looking at tits now in the data form, but then we…
154 00:15:11.370 ⇒ 00:15:12.180 Emily Giant: Yeah.
155 00:15:12.200 ⇒ 00:15:12.790 Demilade Agboola: As promised.
156 00:15:12.790 ⇒ 00:15:22.240 Emily Giant: You know what? I… I think there is, but I will need to get access to it, because it’s a program that we’re trying desperately to sunset, and
157 00:15:23.110 ⇒ 00:15:29.919 Emily Giant: And I don’t think I have access to it anymore, but I can ask Tazdiq or Alex. I’ll just ask… no.
158 00:15:31.080 ⇒ 00:15:33.530 Demilade Agboola: Alex…
159 00:15:34.810 ⇒ 00:15:36.960 Emily Giant: You know what? I’ll ask in the tech channel.
160 00:15:40.960 ⇒ 00:15:41.760 Emily Giant: Stack.
161 00:15:42.830 ⇒ 00:15:49.900 Emily Giant: Is there any way I would be able to get… admin access?
162 00:15:50.290 ⇒ 00:15:59.200 Emily Giant: So that I can… What’s the word that I’m doing? I’m so dumb today. Verify.
163 00:15:59.700 ⇒ 00:16:00.270 Demilade Agboola: Yeah.
164 00:16:00.270 ⇒ 00:16:06.400 Emily Giant: gene information… Legacy subs.
165 00:16:06.800 ⇒ 00:16:07.750 Emily Giant: habit.
166 00:16:08.020 ⇒ 00:16:11.539 Emily Giant: All worked out in the data form.
167 00:16:13.840 ⇒ 00:16:20.910 Emily Giant: But Steven… had… It’s weird… filtering…
168 00:16:23.700 ⇒ 00:16:29.630 Emily Giant: In the legacy models, or in the old… version of models.
169 00:16:33.900 ⇒ 00:16:38.110 Emily Giant: I… Don’t totally understand.
170 00:16:39.540 ⇒ 00:16:40.450 Emily Giant: About.
171 00:16:41.170 ⇒ 00:16:42.250 Emily Giant: seen it.
172 00:16:42.770 ⇒ 00:16:44.679 Emily Giant: source level.
173 00:16:45.360 ⇒ 00:16:46.590 Emily Giant: Alright, cool.
174 00:16:48.910 ⇒ 00:16:53.149 Emily Giant: Yeah, because it all looks fine and good,
175 00:16:53.940 ⇒ 00:16:58.859 Emily Giant: the cost is different, but these are also from, like, 2017.
176 00:17:01.750 ⇒ 00:17:07.699 Emily Giant: But… yeah, I’ll see, because that’s the only real way, I think, that we’ll be able to figure out what…
177 00:17:08.550 ⇒ 00:17:16.959 Emily Giant: The purpose of… You know, I’ll even add that to the chat, because maybe… just maybe, Alex knows.
178 00:17:21.210 ⇒ 00:17:23.049 Demilade Agboola: Yeah, maybe he does, actually.
179 00:17:25.520 ⇒ 00:17:38.610 Emily Giant: For example, This is… Of the filters… for… Postgres admin subs.
180 00:17:39.020 ⇒ 00:17:40.170 Emily Giant: Goodbye.
181 00:17:41.450 ⇒ 00:17:42.400 Emily Giant: Tony.
182 00:17:43.670 ⇒ 00:17:44.870 Emily Giant: Totally.
183 00:17:46.420 ⇒ 00:17:47.970 Emily Giant: Yep.
184 00:17:53.560 ⇒ 00:17:54.640 Emily Giant: I’ve gotten her.
185 00:17:58.590 ⇒ 00:17:59.510 Emily Giant: Yes.
186 00:18:04.620 ⇒ 00:18:08.130 Emily Giant: Check out the… Bare statement.
187 00:18:08.970 ⇒ 00:18:13.540 Emily Giant: And this… Great.
188 00:18:51.090 ⇒ 00:18:51.790 Emily Giant: Hmm.
189 00:18:55.420 ⇒ 00:18:58.800 Emily Giant: Alright, well, that’s helpful that he’s answering pretty quickly.
190 00:18:59.130 ⇒ 00:19:05.610 Emily Giant: But other than that, this is pretty straightforward. I do need to be able to sign in to…
191 00:19:06.030 ⇒ 00:19:15.399 Emily Giant: Let me go get my phone real quick, I’m sorry. I ran upstairs once I realized that we could actually meet this morning and left everything that I need downstairs. I will be right back.
192 00:19:15.970 ⇒ 00:19:17.140 Demilade Agboola: Okay, sounds good.
193 00:19:41.570 ⇒ 00:19:43.150 Emily Giant: Okay…
194 00:19:48.510 ⇒ 00:19:50.120 Emily Giant: Authenticator…
195 00:20:31.760 ⇒ 00:20:36.789 Emily Giant: Oh, I started building out these care tag things, that’s right. Because,
196 00:20:37.450 ⇒ 00:20:45.030 Emily Giant: we need to tie those to the new line item data. I was like, I know I started building out something on Friday because I had time, but…
197 00:20:46.790 ⇒ 00:20:47.670 Emily Giant: Okay.
198 00:20:54.190 ⇒ 00:20:55.570 Emily Giant: See, Felix wrote back.
199 00:20:55.690 ⇒ 00:20:56.490 Emily Giant: Nope.
200 00:21:22.230 ⇒ 00:21:24.180 Emily Giant: It’s doing its Monday morning thing.
201 00:21:25.870 ⇒ 00:21:35.250 Emily Giant: But in the… as far as tests go, since those are pretty straightforward, excuse me, so I did wind up deleting
202 00:21:35.580 ⇒ 00:21:41.560 Emily Giant: a couple models in this PR, because they’re just not needed. This is where I merge it with LMS.
203 00:21:42.780 ⇒ 00:21:49.340 Emily Giant: But, testing-wise… Because I know that I kind of… fudged,
204 00:21:50.020 ⇒ 00:21:56.439 Emily Giant: the last schema file, and that’s what we had to go over. So, it’s an int subscription schema.
205 00:21:56.960 ⇒ 00:22:04.110 Emily Giant: So definitely in its own thing, but it’s supposed to be an in-subscriptions legacy schema, isn’t it? Like, these are supposed to be pulled out since they’re in a different folder.
206 00:22:05.450 ⇒ 00:22:09.149 Demilade Agboola: Sirbs, can you repeat that question?
207 00:22:09.150 ⇒ 00:22:16.850 Emily Giant: Sure. So, we had talked last… last week about, like, configuration of the schema file, and when it’s legacy.
208 00:22:17.050 ⇒ 00:22:21.559 Emily Giant: Or when it’s in a different folder, you had mentioned that it should have its own
209 00:22:21.780 ⇒ 00:22:33.300 Emily Giant: file, and this one, I didn’t do that, so I still need to do that. Like, it’s in the intermediate subscriptions, but it’s not in intermediate subscriptions legacy.
210 00:22:33.680 ⇒ 00:22:37.420 Demilade Agboola: Yeah, that would be… that’ll be very helpful.
211 00:22:38.030 ⇒ 00:22:42.150 Emily Giant: Okay, so I’ll need to pull that out. Server failure rate.
212 00:22:42.380 ⇒ 00:22:44.919 Emily Giant: But… it’s polyatomic.
213 00:22:45.640 ⇒ 00:22:55.109 Emily Giant: Sticky Legacy, this is, like, not… Updated. Oh, it’s…
214 00:22:56.540 ⇒ 00:23:00.579 Emily Giant: I’m actually confused as to why that doesn’t have…
215 00:23:05.860 ⇒ 00:23:10.620 Emily Giant: It doesn’t have, like, any of the intermediate fi- oh, I’m in the wrong folder, oh my god, okay.
216 00:23:13.110 ⇒ 00:23:18.369 Emily Giant: Okay, so… Those are sticky.
217 00:23:22.890 ⇒ 00:23:24.599 Emily Giant: That was from last week.
218 00:23:24.950 ⇒ 00:23:32.099 Emily Giant: These are actually all… I can move this directly into the legacy file, because they’re all legacy files on this one so far.
219 00:23:33.400 ⇒ 00:23:39.379 Emily Giant: So… not null, and OMS order ID is the unique.
220 00:23:41.340 ⇒ 00:23:51.320 Emily Giant: And then, order ID… is… not null, which is tied to the subscription ID.
221 00:23:53.020 ⇒ 00:23:56.309 Emily Giant: And then I just have the coded for, like, the true-false ones.
222 00:23:57.040 ⇒ 00:24:00.670 Emily Giant: And then same for this, it just doesn’t… it shouldn’t have a…
223 00:24:01.560 ⇒ 00:24:06.929 Emily Giant: a null or not unique OMS order ID, actually.
224 00:24:08.840 ⇒ 00:24:10.950 Emily Giant: I need to add a test for not null.
225 00:24:21.870 ⇒ 00:24:22.740 Emily Giant: Okay.
226 00:24:25.410 ⇒ 00:24:32.850 Emily Giant: Alright, this is the only one that should actually be in this file, because it’s the only, like, not-legacy one.
227 00:24:34.020 ⇒ 00:24:40.410 Emily Giant: So I’m just gonna… duplicate this.
228 00:24:41.930 ⇒ 00:24:43.160 Emily Giant: call it.
229 00:24:50.510 ⇒ 00:24:57.100 Emily Giant: And that’s gonna make dbt crap out, because there’s gonna be a bunch of duplicates in there.
230 00:25:00.620 ⇒ 00:25:08.750 Emily Giant: And then, just erase… everything, but… loop.
231 00:25:16.690 ⇒ 00:25:17.510 Emily Giant: Okay.
232 00:25:18.790 ⇒ 00:25:26.600 Emily Giant: So now that should be fixed. Legacy is now in Legacy, and subscriptions that are active are there.
233 00:25:27.500 ⇒ 00:25:28.370 Demilade Agboola: Nice.
234 00:25:28.600 ⇒ 00:25:38.430 Emily Giant: Noise… I forgot to do that, and as soon as I was talking to you, I was like, shit! I was supposed to do… why are you airing? Oh, I need to remove Loop from this.
235 00:25:59.930 ⇒ 00:26:06.240 Emily Giant: Hopefully people just, like, do not need to reference too many of these subscriptions. That would be great.
236 00:26:07.220 ⇒ 00:26:12.620 Emily Giant: Because then we could just deploy it and tweak it once we understand why
237 00:26:12.890 ⇒ 00:26:15.879 Emily Giant: Those filters are in place, separated out.
238 00:26:16.550 ⇒ 00:26:18.750 Emily Giant: Legacy and active.
239 00:26:19.310 ⇒ 00:26:20.610 Emily Giant: description…
240 00:26:34.660 ⇒ 00:26:35.390 Emily Giant: Hey.
241 00:26:36.760 ⇒ 00:26:42.700 Emily Giant: So… I added the not null, and now I’m worried that it’s not gonna pass.
242 00:26:42.980 ⇒ 00:26:45.700 Emily Giant: But, let’s see…
243 00:26:50.030 ⇒ 00:26:52.140 Emily Giant: Alright, so this is the first…
244 00:26:52.670 ⇒ 00:26:57.240 Emily Giant: where I merge all of the, postgres files together.
245 00:26:59.220 ⇒ 00:27:01.430 Emily Giant: Postgres models, not files.
246 00:27:17.630 ⇒ 00:27:18.570 Emily Giant: Alright?
247 00:27:20.570 ⇒ 00:27:23.330 Emily Giant: So this one passes…
248 00:27:29.850 ⇒ 00:27:31.900 Emily Giant: Okay, so that one works.
249 00:27:32.280 ⇒ 00:27:39.700 Emily Giant: And then downstream, this would be the one directly… Before,
250 00:27:39.940 ⇒ 00:27:42.239 Emily Giant: I merge it to fax suborders.
251 00:27:42.880 ⇒ 00:27:50.709 Emily Giant: So, it’s… Oh, it’s not formatted at all, sorry. I will make it look not crappy.
252 00:27:52.250 ⇒ 00:27:55.789 Emily Giant: So it takes everything from that previous model we just ran.
253 00:27:56.010 ⇒ 00:28:01.719 Emily Giant: And then that legacy HEVO table, just to fill in any of the missing values,
254 00:28:03.870 ⇒ 00:28:09.350 Emily Giant: We qualify for a number over partition. I do partition it, because…
255 00:28:09.860 ⇒ 00:28:19.710 Emily Giant: There’s tons of, like, the same lines, but some will have re-deliveries, yadda yadda, and that… those are filtered out in this previous model, but…
256 00:28:20.160 ⇒ 00:28:25.480 Emily Giant: It’s still, was creating duplicates when I didn’t.
257 00:28:26.300 ⇒ 00:28:33.140 Emily Giant: And then I just merge them together and coalesce anywhere it could potentially be filled from either table.
258 00:28:34.180 ⇒ 00:28:39.979 Emily Giant: And then I did a left join. At first I did a full outer, but then I realized, like.
259 00:28:40.550 ⇒ 00:28:52.970 Emily Giant: I did a query to pull any subscriptions that were in the Hivo table that weren’t in the Postgres table, and there weren’t any. So, I was like, I don’t think I need to do a full outer, because that
260 00:28:53.330 ⇒ 00:28:56.969 Emily Giant: there are no additional subscriptions in Hivo.
261 00:28:58.010 ⇒ 00:29:00.129 Emily Giant: Does that… is that valid?
262 00:29:00.420 ⇒ 00:29:01.569 Demilade Agboola: Yeah, that’s valid.
263 00:29:01.570 ⇒ 00:29:06.689 Emily Giant: Okay, so I did remove that, and then, let me run this, make sure it’s…
264 00:29:10.030 ⇒ 00:29:12.399 Emily Giant: Still behaving like it was on Friday.
265 00:29:13.720 ⇒ 00:29:16.269 Emily Giant: Alex, you didn’t write me back?
266 00:29:35.450 ⇒ 00:29:37.700 Emily Giant: These run really quickly, which is nice.
267 00:29:38.300 ⇒ 00:29:40.450 Emily Giant: We’ll watch it prove me wrong, but…
268 00:29:47.710 ⇒ 00:30:03.529 Emily Giant: But the good news is, in the last 2 years, I think only 2 to 10 of these subscriptions were even still… well, 0 were running in the last 2 years… the last year, and in the last 2 years, there were very, very few Legacy subscriptions that still ran, so…
269 00:30:04.110 ⇒ 00:30:17.299 Emily Giant: even if, those filters are really important, it should not mess up the numbers that much at all. Like, it would just not have a sizable impact,
270 00:30:17.870 ⇒ 00:30:19.710 Emily Giant: If we deployed this.
271 00:30:20.070 ⇒ 00:30:23.309 Demilade Agboola: Yeah. Also, it appears like Alex might have texted you back.
272 00:30:24.800 ⇒ 00:30:29.849 Emily Giant: Oh yeah, can you run the staging table in Redshift? I’m struggling to match fields at the moment, or it’s ephemeral.
273 00:30:48.310 ⇒ 00:30:49.940 Emily Giant: Okay, something failed here.
274 00:30:51.150 ⇒ 00:30:52.110 Demilade Agboola: Yeah, not normal.
275 00:30:52.110 ⇒ 00:30:53.840 Emily Giant: Oh, huh.
276 00:30:55.000 ⇒ 00:30:58.220 Emily Giant: That makes no sense to me, because…
277 00:30:58.310 ⇒ 00:30:59.790 Demilade Agboola: There are no…
278 00:31:00.760 ⇒ 00:31:01.800 Emily Giant: How many?
279 00:31:02.520 ⇒ 00:31:04.210 Emily Giant: 157.
280 00:31:05.090 ⇒ 00:31:05.949 Demilade Agboola: Can we see?
281 00:31:06.180 ⇒ 00:31:06.800 Emily Giant: Yeah.
282 00:31:11.850 ⇒ 00:31:23.489 Emily Giant: It’s odd because there are no orders in the Hibo table that weren’t in Postgres, and they were not null in the previous model. So how did they become null? What happened? Oh.
283 00:31:23.970 ⇒ 00:31:25.380 Emily Giant: Super helpful.
284 00:31:25.540 ⇒ 00:31:27.560 Emily Giant: Just, like, blank.
285 00:31:38.500 ⇒ 00:31:41.050 Emily Giant: Okay, there’s no order ID.
286 00:31:43.290 ⇒ 00:31:55.090 Emily Giant: no created at, these orders didn’t happen. So this happened in the other… this is probably, like, a cancellation, or some other subscription action that needs to be tied
287 00:31:55.630 ⇒ 00:31:57.320 Emily Giant: to an order.
288 00:31:59.350 ⇒ 00:32:01.060 Demilade Agboola: Then we can confirm what I’m at.
289 00:32:01.060 ⇒ 00:32:04.120 Emily Giant: Yeah, so I don’t even know if these are in…
290 00:32:07.170 ⇒ 00:32:09.809 Emily Giant: This is gonna be really hard without access to…
291 00:32:10.050 ⇒ 00:32:12.830 Emily Giant: Let me pull it from the staging table.
292 00:32:40.870 ⇒ 00:32:43.080 Emily Giant: Teaching postcard subscriptions.
293 00:33:26.550 ⇒ 00:33:30.850 Emily Giant: Okay, let me pull it from the orders table. Select everything…
294 00:33:59.050 ⇒ 00:34:01.419 Emily Giant: So this is where I’m pulling the order ID.
295 00:34:01.560 ⇒ 00:34:02.990 Emily Giant: And it’s right there.
296 00:34:03.640 ⇒ 00:34:08.130 Emily Giant: So, I don’t know what… Something went won wonky.
297 00:34:12.130 ⇒ 00:34:13.860 Demilade Agboola: Is that the same order ID?
298 00:34:14.489 ⇒ 00:34:20.719 Emily Giant: Well, there is no order ID, so it got flagged. But that’s…
299 00:34:21.189 ⇒ 00:34:29.289 Emily Giant: Yeah, that’s what should be there, and if I go one… table up… To the other intermediate table.
300 00:34:29.469 ⇒ 00:34:30.659 Emily Giant: staging.
301 00:34:32.569 ⇒ 00:34:34.139 Emily Giant: Oh, no, it’s intermediate.
302 00:35:08.799 ⇒ 00:35:11.259 Emily Giant: I don’t know why it’s blank, that’s really odd.
303 00:35:15.220 ⇒ 00:35:17.930 Demilade Agboola: Can you… can you go back to the model? Yeah.
304 00:35:19.250 ⇒ 00:35:20.080 Demilade Agboola: Okay.
305 00:35:22.560 ⇒ 00:35:23.500 Emily Giant: It’s this one.
306 00:35:24.580 ⇒ 00:35:25.550 Emily Giant: Oh, nope.
307 00:35:25.990 ⇒ 00:35:27.420 Emily Giant: Here. This one.
308 00:35:29.700 ⇒ 00:35:34.450 Emily Giant: That’s the OMS merge, and then this is the Postgres merge, but it was blank and…
309 00:35:34.950 ⇒ 00:35:40.539 Emily Giant: both, so I wanna… I need to make sure it’s… Pulling through here…
310 00:35:42.590 ⇒ 00:35:45.089 Emily Giant: Is it canceled? Is that… it’s…
311 00:35:46.340 ⇒ 00:35:48.509 Demilade Agboola: And console does not equate close to 1.
312 00:35:53.680 ⇒ 00:35:54.910 Emily Giant: Let me run this again.
313 00:36:10.150 ⇒ 00:36:16.110 Emily Giant: Well, it shouldn’t have pulled at all. Well, no, that’s the… that’s the source. I don’t see is canceled.
314 00:36:28.020 ⇒ 00:36:31.940 Demilade Agboola: Yeah, but it’s not… it’s not Legacy Subscriptions, is it? I believe it’s a different…
315 00:36:33.270 ⇒ 00:36:39.800 Emily Giant: This is the legacy orders table, but to get the OMS order ID, you have to tie it to this table.
316 00:36:41.470 ⇒ 00:36:44.139 Demilade Agboola: Yeah, but can you go back to the model? Yeah.
317 00:36:45.290 ⇒ 00:36:48.300 Demilade Agboola: It’s ain’t legacy orders.
318 00:36:50.780 ⇒ 00:36:53.719 Demilade Agboola: So can we look at that? Like, can we take the…
319 00:36:53.880 ⇒ 00:36:58.240 Demilade Agboola: code, like the order ID and check in that table.
320 00:36:59.630 ⇒ 00:37:03.070 Emily Giant: Yes. Wait, that is the one where you pull the order ID.
321 00:37:03.480 ⇒ 00:37:10.730 Emily Giant: So… The table is… this.
322 00:37:20.500 ⇒ 00:37:25.080 Emily Giant: And then the order ID, since this is the table, is, nope.
323 00:37:32.010 ⇒ 00:37:33.140 Emily Giant: Boom.
324 00:37:35.190 ⇒ 00:37:35.940 Emily Giant: Here.
325 00:37:36.260 ⇒ 00:37:37.449 Emily Giant: Let’s just run it again.
326 00:37:42.080 ⇒ 00:37:42.910 Emily Giant: Oh.
327 00:37:44.320 ⇒ 00:37:45.280 Emily Giant: It’s canceled.
328 00:37:45.630 ⇒ 00:37:47.109 Emily Giant: Is canceled equals 1.
329 00:37:47.790 ⇒ 00:37:48.540 Demilade Agboola: Yeah.
330 00:37:49.670 ⇒ 00:37:53.930 Emily Giant: So… Okay, I get it.
331 00:37:54.420 ⇒ 00:37:59.660 Emily Giant: It’s because it’s pulling up the subscription ID, but it doesn’t understand that the order is canceled.
332 00:37:59.940 ⇒ 00:38:03.419 Demilade Agboola: Yeah. So basically, she filtered out canceled orders.
333 00:38:04.400 ⇒ 00:38:10.260 Demilade Agboola: left joining into orders. It doesn’t have the order information anymore to add to it, so that’s why it’s not…
334 00:38:11.080 ⇒ 00:38:16.430 Emily Giant: Okay, so I guess I need to, like… Further filter for…
335 00:38:17.860 ⇒ 00:38:22.680 Emily Giant: blend… well, I don’t want to do that, because I don’t want to accidentally obscure something where it skipped over the…
336 00:38:22.680 ⇒ 00:38:26.739 Demilade Agboola: What you need to do is join it, and then filter from the joined.
337 00:38:26.740 ⇒ 00:38:28.010 Emily Giant: Yeah.
338 00:38:29.070 ⇒ 00:38:31.270 Emily Giant: Alright, just added in here.
339 00:38:32.130 ⇒ 00:38:39.469 Demilade Agboola: No, no, no, like, what I mean by… So, you have sole borders, Go down.
340 00:38:43.010 ⇒ 00:38:45.449 Demilade Agboola: And then… you have subs.
341 00:38:45.870 ⇒ 00:38:46.470 Demilade Agboola: Indeed.
342 00:38:46.470 ⇒ 00:38:51.529 Emily Giant: You want me to do it from here? Yes. From the joints. Okay, so I do need to add it to this CTE.
343 00:38:51.530 ⇒ 00:38:53.560 Demilade Agboola: What’s East Console.
344 00:38:53.700 ⇒ 00:38:55.960 Demilade Agboola: Don’t filter out this console.
345 00:38:56.730 ⇒ 00:38:58.230 Emily Giant: Gotcha. Yeah, yeah, yeah.
346 00:38:59.110 ⇒ 00:39:04.660 Demilade Agboola: And also, probably don’t filter out is re-delivery, so just filter it from the join of…
347 00:39:04.890 ⇒ 00:39:06.170 Emily Giant: Got it.
348 00:39:06.910 ⇒ 00:39:10.080 Demilade Agboola: of them, so now it will remove it completely.
349 00:39:10.230 ⇒ 00:39:14.930 Demilade Agboola: And you don’t have, like, those vacuum, those, like, null… Order IDs.
350 00:39:17.130 ⇒ 00:39:19.990 Emily Giant: Okay, that makes perfect sense.
351 00:39:27.490 ⇒ 00:39:28.500 Emily Giant: And then I’m gonna…
352 00:39:28.660 ⇒ 00:39:33.960 Emily Giant: run that staging model for Alex real quick, and just send him a spreadsheet, so we’re…
353 00:39:34.230 ⇒ 00:39:36.150 Emily Giant: what is it called? Subs.
354 00:39:49.310 ⇒ 00:39:51.739 Emily Giant: Was it called Isree Delivery? No.
355 00:39:54.600 ⇒ 00:39:55.909 Emily Giant: I do not remember.
356 00:39:56.550 ⇒ 00:39:58.720 Demilade Agboola: I think you’re sighted up there.
357 00:40:00.440 ⇒ 00:40:02.770 Demilade Agboola: And you said it’s not re-delivery or something?
358 00:40:02.770 ⇒ 00:40:05.209 Emily Giant: Oh yeah, I wrote it, didn’t I? Israeli.
359 00:40:24.470 ⇒ 00:40:26.209 Demilade Agboola: Is these subs or suborders?
360 00:40:27.470 ⇒ 00:40:28.300 Emily Giant: Oh.
361 00:40:30.590 ⇒ 00:40:31.559 Emily Giant: Good catch.
362 00:41:10.690 ⇒ 00:41:12.759 Emily Giant: Alright, well that’s running, I’m gonna queue up.
363 00:41:26.720 ⇒ 00:41:27.570 Emily Giant: Error.
364 00:41:36.260 ⇒ 00:41:38.219 Emily Giant: Yay! Okay, that looks good.
365 00:41:40.160 ⇒ 00:41:46.789 Emily Giant: Where are those weird filters? It’s less than… Hang on for a second.
366 00:41:53.060 ⇒ 00:41:56.129 Demilade Agboola: I mean, I suppose I have anytime I have to hop to.
367 00:41:56.130 ⇒ 00:42:02.390 Emily Giant: Oh, no problem, no problem. Okay, I will take this time. Thank you. Should I… should I go ahead and merge this if it passes the tests?
368 00:42:02.730 ⇒ 00:42:04.089 Demilade Agboola: Yes, that should be fine.
369 00:42:04.090 ⇒ 00:42:10.220 Emily Giant: Okay, great, and then I’m gonna go ahead and take the next type, 15, and add the fields to Looker.
370 00:42:10.590 ⇒ 00:42:11.650 Demilade Agboola: Okay, sounds, sounds.
371 00:42:11.650 ⇒ 00:42:16.350 Emily Giant: Alright, thank you so much for helping. Yay! Alright, talk to you later.
372 00:42:16.350 ⇒ 00:42:17.090 Demilade Agboola: Further.
373 00:42:17.410 ⇒ 00:42:18.180 Emily Giant: Bye.
374 00:42:18.180 ⇒ 00:42:18.790 Demilade Agboola: Bye.