Meeting Title: Javy-Project-Internal-Review Date: 2024-09-30 Meeting participants: Brian Pei, Nicolas Sucari, Uttam Kumaran
WEBVTT
1 00:05:25.250 ⇒ 00:05:27.689 Brian Pei: Hey! Give me! Give me a minute.
2 00:05:28.640 ⇒ 00:05:29.500 Nicolas Sucari: No problem.
3 00:05:59.630 ⇒ 00:06:00.280 Nicolas Sucari: sure.
4 00:06:20.470 ⇒ 00:06:21.420 Brian Pei: Okay.
5 00:06:21.830 ⇒ 00:06:24.879 Brian Pei: I’m back and I’m ready to
6 00:06:26.190 ⇒ 00:06:26.775 Brian Pei: sink.
7 00:06:28.920 ⇒ 00:06:30.530 Nicolas Sucari: Hi, Brian, how are you?
8 00:06:30.920 ⇒ 00:06:31.720 Brian Pei: Good.
9 00:06:32.190 ⇒ 00:06:36.150 Brian Pei: This should be quick. There’s been some stuff getting done.
10 00:06:38.050 ⇒ 00:06:40.090 Brian Pei: there is
11 00:06:40.440 ⇒ 00:06:41.540 Brian Pei: from
12 00:06:41.670 ⇒ 00:06:45.920 Brian Pei: Thursday, Friday, and I mean I just woke up this morning. But
13 00:06:47.005 ⇒ 00:06:51.580 Brian Pei: those 5 starter starting tables.
14 00:06:51.690 ⇒ 00:06:53.130 Brian Pei: I finished.
15 00:06:53.510 ⇒ 00:06:57.300 Brian Pei: Actually, there’s 6 now. I finished 3 of them because
16 00:06:58.570 ⇒ 00:06:59.800 Brian Pei: product
17 00:06:59.910 ⇒ 00:07:02.769 Brian Pei: coffee product is split into 2 tables.
18 00:07:02.860 ⇒ 00:07:04.330 Brian Pei: There’s basically
19 00:07:04.470 ⇒ 00:07:08.644 Brian Pei: there’s an overall coffee product like
20 00:07:11.000 ⇒ 00:07:13.059 Brian Pei: 2% black, you know.
21 00:07:13.150 ⇒ 00:07:14.199 Brian Pei: And then
22 00:07:14.898 ⇒ 00:07:18.039 Brian Pei: products variant is just like
23 00:07:18.320 ⇒ 00:07:20.449 Brian Pei: that product. 2% black.
24 00:07:20.810 ⇒ 00:07:28.076 Brian Pei: Are they buying 2 bottles or 4 bottles or 8 bottles? That’s kind of like the product variant. It’s
25 00:07:29.290 ⇒ 00:07:33.099 Brian Pei: it’s quantity. But also like bundles like, people can buy
26 00:07:34.150 ⇒ 00:07:40.939 Brian Pei: 2 products like, yeah, 2% black. And the product Creamer, and it’s like called something different.
27 00:07:43.400 ⇒ 00:07:48.157 Brian Pei: so oh, I will repeat that cause utam just hopped on
28 00:07:48.590 ⇒ 00:07:50.129 Uttam Kumaran: Hi, guys. Sorry sorry.
29 00:07:50.130 ⇒ 00:07:52.640 Brian Pei: No, you’re good. So
30 00:07:52.710 ⇒ 00:08:01.290 Brian Pei: yeah, there, there were originally 5 starter tables that we agreed on that now is 6. I finished 3 out of the 6 of them
31 00:08:01.470 ⇒ 00:08:08.310 Brian Pei: across Thursday, Friday, and then, technically, this this morning. But I just woke up, but I just created them in dev.
32 00:08:08.590 ⇒ 00:08:09.000 Uttam Kumaran: Cool.
33 00:08:09.930 ⇒ 00:08:17.449 Brian Pei: So I have. So the SQL logic I have saved in Snowflake, and the the plan is to get
34 00:08:17.550 ⇒ 00:08:21.800 Brian Pei: these like 6 pretty important tables in dev
35 00:08:22.224 ⇒ 00:08:27.240 Brian Pei: that, they can tell me is looks right before I just migrate them to dbt.
36 00:08:27.280 ⇒ 00:08:29.579 Brian Pei: but migrating, you know, like the
37 00:08:29.980 ⇒ 00:08:36.560 Brian Pei: the crux of the time that I’m using is I? I’m looking at every table and writing the SQL. Logic
38 00:08:37.100 ⇒ 00:08:42.698 Brian Pei: when it, if it’s right, then moving into Dbt. Will will be pretty quick, but I’m focusing on
39 00:08:43.559 ⇒ 00:08:46.510 Brian Pei: you know, getting getting the SQL logic right? So
40 00:08:47.089 ⇒ 00:08:50.769 Brian Pei: of the 6 tables I did. I finished customer.
41 00:08:52.140 ⇒ 00:08:57.430 Brian Pei: and then product I. And this is same in pool parts. I was just saying.
42 00:08:57.980 ⇒ 00:09:06.330 Brian Pei: I ended up making 2 product tables. There’s product and products variant which we know fondly from pool parts. Product is like
43 00:09:06.840 ⇒ 00:09:08.270 Brian Pei: is like the
44 00:09:08.910 ⇒ 00:09:11.559 Brian Pei: black iced coffee. Javi coffee.
45 00:09:11.900 ⇒ 00:09:21.489 Brian Pei: and the product variant is like the black iced coffee, 2 bottles, black diced coffee, 4 bottles, 8 bottles. So it’s kind of kind of like parent child.
46 00:09:23.220 ⇒ 00:09:33.857 Brian Pei: so. And the the product also has things like like Creamer is. This is another product, and a variant could be 2 bottles of iced coffee plus creamer, you know, stuff like that.
47 00:09:34.400 ⇒ 00:09:36.940 Brian Pei: and the prices and the like.
48 00:09:37.070 ⇒ 00:09:41.129 Brian Pei: Quantity and grams and weight are in the product variant.
49 00:09:41.300 ⇒ 00:09:53.699 Brian Pei: and the product is the is the is the parent product that they are selling, that they are able to split into skews when they sell them on shopify or Amazon.
50 00:09:54.420 ⇒ 00:10:03.400 Brian Pei: So those 3 are done, and I’m working through the harder ones, which is obviously orders, subscriptions.
51 00:10:03.530 ⇒ 00:10:06.829 Brian Pei: and the Amazon stuff cause
52 00:10:06.840 ⇒ 00:10:08.640 Brian Pei: the Amazon stuff is
53 00:10:09.450 ⇒ 00:10:12.029 Brian Pei: a very different structure. It’s another
54 00:10:13.090 ⇒ 00:10:22.809 Brian Pei: similar to pool parts where you have to union the stuff together. So you have to find the connecting fields and their name differently, and spread out in different places for Amazon.
55 00:10:24.089 ⇒ 00:10:24.879 Brian Pei: So
56 00:10:25.530 ⇒ 00:10:30.940 Brian Pei: iteratively I I finished the easier tables first, st so that I could send them to
57 00:10:31.220 ⇒ 00:10:33.060 Brian Pei: right now, just internally.
58 00:10:34.380 ⇒ 00:10:36.280 Brian Pei: I can send.
59 00:10:37.060 ⇒ 00:10:42.500 Nicolas Sucari: Can I ask you about the customer tables like, how were you able to match the
60 00:10:43.070 ⇒ 00:10:49.879 Nicolas Sucari: or like? It’s it’s it’s information coming from shopify only the in the customer table, or also from Amazon.
61 00:10:50.510 ⇒ 00:10:56.449 Brian Pei: It’s shopify only because doesn’t have a customer’s table.
62 00:10:56.990 ⇒ 00:10:57.310 Nicolas Sucari: Okay.
63 00:10:58.190 ⇒ 00:11:00.060 Brian Pei: And I wrote
64 00:11:00.080 ⇒ 00:11:03.380 Brian Pei: the the table names have the name shopify in them
65 00:11:03.570 ⇒ 00:11:06.279 Brian Pei: to let them know like this is coming from shopify.
66 00:11:06.840 ⇒ 00:11:07.450 Brian Pei: Yeah.
67 00:11:07.450 ⇒ 00:11:13.870 Nicolas Sucari: Product ones. Yes, but the customer I was just yeah. We don’t have like shopify customers on it.
68 00:11:14.110 ⇒ 00:11:14.860 Nicolas Sucari: Oh.
69 00:11:14.860 ⇒ 00:11:17.467 Brian Pei: It’s just dim customer. Yeah, that was
70 00:11:18.340 ⇒ 00:11:23.920 Nicolas Sucari: No, because I I thought you were going going to try using the address from Amazon
71 00:11:24.250 ⇒ 00:11:28.289 Nicolas Sucari: to identify or try to match. But yeah, I think we can do that like
72 00:11:28.570 ⇒ 00:11:30.760 Nicolas Sucari: lay after you have the other tables.
73 00:11:31.570 ⇒ 00:11:33.640 Brian Pei: Yeah, I can try like the
74 00:11:33.950 ⇒ 00:11:35.490 Brian Pei: the stuff. That
75 00:11:35.900 ⇒ 00:11:37.530 Brian Pei: is not
76 00:11:37.680 ⇒ 00:11:42.100 Brian Pei: a definite like, I can spend an hour trying to do it. And I might not get anywhere.
77 00:11:42.816 ⇒ 00:11:47.990 Brian Pei: Starting with what I can do, so I can get a couple of tables out there.
78 00:11:48.270 ⇒ 00:11:51.559 Brian Pei: and then when I finish those I can do some of.
79 00:11:51.560 ⇒ 00:11:52.230 Nicolas Sucari: Yeah, yeah.
80 00:11:52.230 ⇒ 00:11:55.420 Brian Pei: Shouldn’t have like. Let’s see if I can join this to Amazon somewhere.
81 00:11:55.420 ⇒ 00:11:56.120 Nicolas Sucari: Perfect.
82 00:11:56.120 ⇒ 00:11:57.390 Brian Pei: To to figure out
83 00:11:58.360 ⇒ 00:11:59.010 Nicolas Sucari: Okay.
84 00:12:00.170 ⇒ 00:12:00.900 Nicolas Sucari: yeah, I mean.
85 00:12:01.420 ⇒ 00:12:06.010 Nicolas Sucari: okay, yeah, that’s fine. And are we gonna keep using like, the dev.
86 00:12:06.545 ⇒ 00:12:14.820 Nicolas Sucari: a database inside analytics? Or we’re gonna move all of those ones, all of those tables into intermediate database.
87 00:12:15.360 ⇒ 00:12:17.320 Brian Pei: I will move them.
88 00:12:17.590 ⇒ 00:12:18.579 Brian Pei: That’s like all warning.
89 00:12:18.580 ⇒ 00:12:20.939 Uttam Kumaran: Once you once you set it up in Dvc. Right.
90 00:12:20.940 ⇒ 00:12:22.220 Brian Pei: Yeah, there.
91 00:12:22.220 ⇒ 00:12:22.970 Nicolas Sucari: Oh, okay.
92 00:12:22.970 ⇒ 00:12:23.710 Brian Pei: It says.
93 00:12:24.690 ⇒ 00:12:25.075 Brian Pei: Yeah,
94 00:12:25.460 ⇒ 00:12:29.440 Uttam Kumaran: Yeah, on that point. Whenever we get the green light from.
95 00:12:29.690 ⇒ 00:12:46.279 Uttam Kumaran: So let me. I’ll talk about that second. But whenever we get the green line the tables. Can you just chat with Patrick, or spend like 30 min with Patrick? So that he can hand you over like a a Dbt project file that’ll have, like all the necessary configs, cause we want to just make it super easy, for, like
96 00:12:46.540 ⇒ 00:12:51.819 Uttam Kumaran: depending on what folder stuff is in it gets into the right schema. He has all that, so.
97 00:12:52.010 ⇒ 00:12:54.110 Brian Pei: Yeah, I I will do that.
98 00:12:54.990 ⇒ 00:12:56.889 Uttam Kumaran: And you could just basically ask for all.
99 00:12:56.890 ⇒ 00:12:57.779 Brian Pei: To do that
100 00:12:58.461 ⇒ 00:13:01.549 Brian Pei: yeah, cause I think he’ll
101 00:13:02.750 ⇒ 00:13:10.479 Brian Pei: all the setup config and like variable shit that I haven’t done yet. He will probably be able to do for me in like 5 min.
102 00:13:11.511 ⇒ 00:13:14.399 Brian Pei: But yeah, if it says Dev, right now.
103 00:13:14.420 ⇒ 00:13:16.059 Brian Pei: it’s because I’m
104 00:13:16.070 ⇒ 00:13:17.250 Brian Pei: literally
105 00:13:17.350 ⇒ 00:13:21.200 Brian Pei: writing. Create table in Snowflake. I’m not using Dbt at all.
106 00:13:21.680 ⇒ 00:13:27.749 Brian Pei: Dev is is just for them to know, like, Hey, I ran this once. It’s not on a schedule. It’s not updating.
107 00:13:28.110 ⇒ 00:13:29.490 Brian Pei: I just want
108 00:13:29.600 ⇒ 00:13:33.490 Brian Pei: you to see the columns and to make sure that it looks okay
109 00:13:34.030 ⇒ 00:13:34.720 Brian Pei: when it’s in.
110 00:13:34.720 ⇒ 00:13:40.519 Nicolas Sucari: Maybe when we share, when we share with with them, we need to like, let them know about this
111 00:13:40.680 ⇒ 00:13:41.440 Nicolas Sucari: fine.
112 00:13:42.370 ⇒ 00:13:42.980 Brian Pei: Yeah.
113 00:13:42.980 ⇒ 00:13:45.890 Nicolas Sucari: Like for for Payas, maybe 1st
114 00:13:46.267 ⇒ 00:13:53.209 Nicolas Sucari: so that he’s aware that this is not gonna be updating. And I I think we’re not gonna share these tables with a man yet.
115 00:13:53.580 ⇒ 00:14:03.549 Nicolas Sucari: But just in case, maybe we can leave a note there in the Channel, because if he access snowflakes and try to use this table just to know that we’re using it this way.
116 00:14:03.550 ⇒ 00:14:05.027 Brian Pei: Yeah, it is
117 00:14:05.770 ⇒ 00:14:07.670 Brian Pei: best practice to do
118 00:14:07.850 ⇒ 00:14:10.430 Brian Pei: dev first, st because
119 00:14:10.640 ⇒ 00:14:13.040 Brian Pei: when they don’t see any.
120 00:14:13.230 ⇒ 00:14:18.059 Brian Pei: when they don’t have like a they didn’t have a blueprint for us, right? So we’re going off of.
121 00:14:18.060 ⇒ 00:14:18.440 Nicolas Sucari: Yeah, yeah.
122 00:14:18.440 ⇒ 00:14:26.240 Brian Pei: Extinct, so it’s easier if I do it in dev. And if Aman says, Oh, I need these columns, I don’t need these columns.
123 00:14:26.960 ⇒ 00:14:33.590 Brian Pei: It’s not in Dbt yet, so I don’t have to like read. I don’t have to like backfill or create any crazy, dpt stuff.
124 00:14:33.610 ⇒ 00:14:34.740 Brian Pei: It’s more
125 00:14:34.940 ⇒ 00:14:36.450 Brian Pei: back and forth of
126 00:14:36.490 ⇒ 00:14:43.300 Brian Pei: is this all of the data that you want? And then, once he gives the check mark, then I just like move it to Dbt, and then it runs on a schedule.
127 00:14:44.390 ⇒ 00:14:45.740 Brian Pei: Yeah, great.
128 00:14:46.570 ⇒ 00:14:51.969 Uttam Kumaran: So, I think, yeah, let’s basically, I hope the way this ends up working is we just
129 00:14:52.400 ⇒ 00:15:10.920 Uttam Kumaran: basically his pious becomes like our primary stakeholder. So what I want to do is like, I wanna hand this to him and basically say, Hey, the goal is gross margin. Here’s what we have so far like, tell us where else we need to go that way. Also, we can kind of push some of the communication stuff onto him as well.
130 00:15:10.960 ⇒ 00:15:14.020 Uttam Kumaran: So yeah, just ping pious with all this stuff.
131 00:15:14.080 ⇒ 00:15:24.189 Uttam Kumaran: and then we can remote. I mean, he should be aware of like what our goal is, which is the gross margin dash. But then, basically, he can start to give us the more concrete data requirements.
132 00:15:24.330 ⇒ 00:15:35.480 Uttam Kumaran: and then he can also. I’ll ping him. And then between him and Nico. You guys can communicate to him on. But I think that way it’ll it’ll be perfect.
133 00:15:37.760 ⇒ 00:15:38.900 Nicolas Sucari: Yeah, and I think we are.
134 00:15:38.900 ⇒ 00:15:44.970 Uttam Kumaran: Our stuff is going to continue to take longer. So I want pious on the analysis side to basically start to
135 00:15:45.220 ⇒ 00:15:53.120 Uttam Kumaran: give more updates and and also own the actual delivery ideally, that delivery is in real also, so he can start on that.
136 00:15:54.200 ⇒ 00:15:59.199 Nicolas Sucari: Yeah, yeah, for for now I think Brian already shared like you said with us already
137 00:15:59.220 ⇒ 00:16:10.900 Nicolas Sucari: these 3 tables for by us to check, he he told us, he will be checking that today. And and yeah, once we have the other tables we can share, too, and once by us told us, tell us that
138 00:16:10.930 ⇒ 00:16:13.559 Nicolas Sucari: that is okay. We can move them
139 00:16:14.005 ⇒ 00:16:17.910 Nicolas Sucari: to Dvt, and yeah, send it. Send them to a man.
140 00:16:19.010 ⇒ 00:16:29.759 Nicolas Sucari: Well, I think, for now we are. Yeah, we’re we’re doing that process. Maybe we need to. Send these kind of notes, Brian, to by us in the the internal channel, so that he’s aware.
141 00:16:30.260 ⇒ 00:16:31.000 Nicolas Sucari: okay.
142 00:16:32.149 ⇒ 00:16:38.289 Brian Pei: Yeah. Do you prefer so I can. If I send it to him in the general channel, then Aman will see them.
143 00:16:38.410 ⇒ 00:16:41.560 Brian Pei: Do you prefer I do that, or do you prefer? I send it to.
144 00:16:41.950 ⇒ 00:16:48.520 Uttam Kumaran: No, just do it in the internal channel, and then can you send a note to him on just like summarize this meeting, and then.
145 00:16:48.520 ⇒ 00:16:48.960 Nicolas Sucari: Yeah.
146 00:16:48.960 ⇒ 00:16:51.280 Uttam Kumaran: We should be good cause we’re gonna talk to him tomorrow.
147 00:16:51.570 ⇒ 00:16:52.120 Uttam Kumaran: So just.
148 00:16:52.120 ⇒ 00:16:52.560 Nicolas Sucari: Yeah, yeah.
149 00:16:52.560 ⇒ 00:16:54.751 Uttam Kumaran: Yeah. And then that’s it.
150 00:16:55.360 ⇒ 00:17:05.939 Uttam Kumaran: that way we can get. I think this is a good cadence, though, overall, like we meet today, we kind of get our stuff ready for tomorrow. And then we basically send a note today. And then
151 00:17:06.109 ⇒ 00:17:08.389 Uttam Kumaran: I think you’ll basically be happy to see that.
152 00:17:09.349 ⇒ 00:17:10.140 Uttam Kumaran: Yep.
153 00:17:10.630 ⇒ 00:17:11.579 Nicolas Sucari: That’s great.
154 00:17:13.780 ⇒ 00:17:14.720 Nicolas Sucari: Okay.
155 00:17:14.720 ⇒ 00:17:19.871 Brian Pei: I’ll keep going through orders, and subscriptions are harder, obviously so.
156 00:17:20.710 ⇒ 00:17:36.839 Uttam Kumaran: Yeah, and then put put up all the anything on the Snowflake. Real Cbt project side. Brian, like Pat is gonna have like notes on everything we want to do there. So just push that off until you meet with him again. The goal is to get it right on the 1st try
157 00:17:37.360 ⇒ 00:17:39.399 Uttam Kumaran: and then basically try to like
158 00:17:39.420 ⇒ 00:17:48.480 Uttam Kumaran: we’re we’re we’re basically having. We’re gonna have, like one structured Github template and like one Dbt project file that we use across all projects that basically like
159 00:17:48.570 ⇒ 00:17:55.110 Uttam Kumaran: takes care of all like the Bs so ideally like that should work out. So this is our kind of our 1st test of that. So.
160 00:17:55.450 ⇒ 00:17:56.090 Brian Pei: Sweet.
161 00:17:57.090 ⇒ 00:17:58.240 Brian Pei: Yep. Sounds good.
162 00:18:00.980 ⇒ 00:18:01.395 Nicolas Sucari: Okay.
163 00:18:01.810 ⇒ 00:18:02.450 Uttam Kumaran: Okay. Thanks.
164 00:18:02.450 ⇒ 00:18:03.280 Nicolas Sucari: Ryan.
165 00:18:03.280 ⇒ 00:18:04.999 Brian Pei: Michelle. Thanks guys.
166 00:18:05.000 ⇒ 00:18:06.520 Uttam Kumaran: Thanks. Guys. Talk soon.
167 00:18:06.780 ⇒ 00:18:07.480 Nicolas Sucari: Bye, bye.