Meeting Title: SQL-Fluff-discussion Date: 2024-07-26 Meeting participants: Atharv Gudi, Nicolas Sucari, Patrick Trainer
WEBVTT
1 00:02:06.970 ⇒ 00:02:08.180 Patrick Trainer: Hey? It’s our.
2 00:02:10.080 ⇒ 00:02:13.710 Atharv Gudi: Sorry I haven’t been able to catch up all week. I’ve been
3 00:02:13.810 ⇒ 00:02:16.419 Atharv Gudi: running around in a lot of places here.
4 00:02:16.770 ⇒ 00:02:22.629 Patrick Trainer: Yeah, no, no, no need, no need to apologize totally, totally understand.
5 00:02:22.870 ⇒ 00:02:23.330 Atharv Gudi: Yeah.
6 00:02:23.330 ⇒ 00:02:25.370 Patrick Trainer: I’ve been. I’ve been the same way.
7 00:02:26.430 ⇒ 00:02:27.350 Atharv Gudi: Yeah, I think.
8 00:02:28.050 ⇒ 00:02:31.050 Atharv Gudi: Well, school starting in a month. So I’ve been.
9 00:02:31.520 ⇒ 00:02:32.220 Patrick Trainer: Yeah.
10 00:02:32.220 ⇒ 00:02:34.720 Atharv Gudi: When sorted out, and then all the other kind of.
11 00:02:35.515 ⇒ 00:02:38.880 Patrick Trainer: Yeah, yeah, is this your is, is this your final year?
12 00:02:39.900 ⇒ 00:02:40.740 Patrick Trainer: Okay?
13 00:02:40.910 ⇒ 00:02:41.280 Atharv Gudi: Yeah.
14 00:02:41.593 ⇒ 00:02:42.220 Patrick Trainer: Like a
15 00:02:43.053 ⇒ 00:02:45.170 Patrick Trainer: you’re like a triple major.
16 00:02:45.170 ⇒ 00:02:46.070 Nicolas Sucari: Hi guys right.
17 00:02:46.590 ⇒ 00:02:47.980 Patrick Trainer: Hello! But.
18 00:02:47.980 ⇒ 00:02:49.090 Atharv Gudi: Hey? Nico.
19 00:02:50.240 ⇒ 00:02:51.080 Nicolas Sucari: Why, a.
20 00:02:51.540 ⇒ 00:02:53.700 Patrick Trainer: Yeah, you’re doing what math and.
21 00:02:53.700 ⇒ 00:02:54.470 Atharv Gudi: Matt
22 00:02:56.290 ⇒ 00:02:59.349 Atharv Gudi: math statistics and German.
23 00:02:59.680 ⇒ 00:03:03.080 Atharv Gudi: But I’m also doing Cs minor and
24 00:03:04.630 ⇒ 00:03:05.870 Atharv Gudi: a bunch of like.
25 00:03:05.870 ⇒ 00:03:07.490 Patrick Trainer: So how how many.
26 00:03:07.640 ⇒ 00:03:11.859 Patrick Trainer: how many hours are you taking, or have you averaged like a year.
27 00:03:13.440 ⇒ 00:03:15.700 Atharv Gudi: So freshman year. I think
28 00:03:16.130 ⇒ 00:03:20.820 Atharv Gudi: I had a lot of proficiency tests. So I just got a lot of credits out of the way.
29 00:03:20.820 ⇒ 00:03:21.530 Patrick Trainer: Okay.
30 00:03:21.530 ⇒ 00:03:24.070 Atharv Gudi: 13 semester.
31 00:03:24.829 ⇒ 00:03:25.180 Patrick Trainer: While.
32 00:03:25.430 ⇒ 00:03:28.050 Atharv Gudi: And I need, I think, 1 28 to graduate.
33 00:03:28.290 ⇒ 00:03:29.320 Atharv Gudi: So yeah.
34 00:03:29.360 ⇒ 00:03:37.319 Atharv Gudi: I think it was freshman year that I took a lot of tests. And then sophomore year onwards. I just kept overloading. I got maybe
35 00:03:39.460 ⇒ 00:03:42.396 Atharv Gudi: 40 credits a year.
36 00:03:43.710 ⇒ 00:03:44.350 Patrick Trainer: Wow!
37 00:03:44.350 ⇒ 00:03:47.199 Atharv Gudi: But it’s all overlapping so.
38 00:03:47.200 ⇒ 00:03:49.910 Patrick Trainer: Right? Right? So why’d you choose German?
39 00:03:50.870 ⇒ 00:03:53.769 Atharv Gudi: I just had the credit right there. Cause, I mean.
40 00:03:53.770 ⇒ 00:03:54.470 Patrick Trainer: Okay.
41 00:03:54.830 ⇒ 00:03:58.656 Atharv Gudi: I knew German, and it was just that easy. So it’s just like routine.
42 00:03:59.390 ⇒ 00:04:00.040 Patrick Trainer: Yeah.
43 00:04:00.400 ⇒ 00:04:11.149 Patrick Trainer: yeah, that’s that’s crazy. Well, I commend you on the amount of work that you’ve been doing. I imagine that’s insane.
44 00:04:11.150 ⇒ 00:04:15.309 Atharv Gudi: I mean, with the amount of overlap and math statistics and Cs, it’s.
45 00:04:16.050 ⇒ 00:04:17.070 Patrick Trainer: That’s true.
46 00:04:17.070 ⇒ 00:04:17.660 Atharv Gudi: Yeah.
47 00:04:17.660 ⇒ 00:04:18.140 Patrick Trainer: That’s true.
48 00:04:18.540 ⇒ 00:04:19.519 Patrick Trainer: keeps you fresh.
49 00:04:19.529 ⇒ 00:04:23.739 Atharv Gudi: Yeah, is Utam? Wanna be joining us, or do I just dive right in.
50 00:04:24.540 ⇒ 00:04:27.749 Nicolas Sucari: I don’t think so. So if you can. Yeah, you can dive ready.
51 00:04:27.750 ⇒ 00:04:28.775 Atharv Gudi: Okay.
52 00:04:30.471 ⇒ 00:04:33.420 Atharv Gudi: playing around with what exactly the
53 00:04:34.150 ⇒ 00:04:37.530 Atharv Gudi: algorithm should be to implement SQL, Fluff.
54 00:04:37.540 ⇒ 00:04:45.830 Atharv Gudi: I think one of the things that Utam asked me on Monday was to get just run SQL. Flop on all the files that we already have.
55 00:04:46.980 ⇒ 00:04:48.769 Atharv Gudi: So I that
56 00:04:48.850 ⇒ 00:04:51.939 Atharv Gudi: that was, I think, my 1st question
57 00:04:52.347 ⇒ 00:04:58.240 Atharv Gudi: he. He’s referring to all of the files in pool parts to go right all the dot SQL.
58 00:04:58.240 ⇒ 00:05:00.549 Patrick Trainer: Right? Yeah. Everything within the
59 00:05:01.170 ⇒ 00:05:04.190 Patrick Trainer: excuse me. Sorry the Dbt project.
60 00:05:05.710 ⇒ 00:05:06.310 Atharv Gudi: And.
61 00:05:07.090 ⇒ 00:05:13.261 Patrick Trainer: Yeah, yeah, so basically, like, just all of the sequel files, really,
62 00:05:14.510 ⇒ 00:05:17.920 Patrick Trainer: And so I’m not sure if you can. Well, you probably
63 00:05:17.960 ⇒ 00:05:23.261 Patrick Trainer: it probably looks for SQL. Files just in general. So I imagine it would
64 00:05:23.980 ⇒ 00:05:27.313 Patrick Trainer: skip that. But I think that’s a good
65 00:05:29.850 ⇒ 00:05:33.731 Patrick Trainer: Yeah way to think about it. Just everything within that Dbt project directory.
66 00:05:34.871 ⇒ 00:05:46.109 Patrick Trainer: and go that way even if if you wanted to just run it on like one file, just to make sure that, like everything looks good like if you want to create
67 00:05:46.210 ⇒ 00:05:49.749 Patrick Trainer: like a like a test file or something
68 00:05:50.684 ⇒ 00:05:55.692 Patrick Trainer: just to to be able to play around with and and tweak
69 00:05:56.420 ⇒ 00:05:58.779 Patrick Trainer: that’s absolutely fine.
70 00:05:58.780 ⇒ 00:06:06.130 Atharv Gudi: Yeah, I had done that. So I noticed that E pool parts to go real also has a bunch of sequel files, and I was wondering if.
71 00:06:06.550 ⇒ 00:06:09.380 Patrick Trainer: Yeah. Yeah, we can do that as well.
72 00:06:09.953 ⇒ 00:06:13.019 Patrick Trainer: So that would. That would be good, too.
73 00:06:13.020 ⇒ 00:06:13.490 Atharv Gudi: Okay.
74 00:06:14.748 ⇒ 00:06:18.500 Atharv Gudi: I think I’ll just go through all of
75 00:06:18.690 ⇒ 00:06:23.519 Atharv Gudi: the folders. But it’s entirely within pool parts to go. That’s the part that I wanted to do. Yeah.
76 00:06:23.520 ⇒ 00:06:29.260 Patrick Trainer: Yeah, yeah, yeah. Yeah. For now. That’s yeah. Limited to to that.
77 00:06:29.600 ⇒ 00:06:32.840 Atharv Gudi: Okay? I. The next thing that
78 00:06:33.512 ⇒ 00:06:37.240 Atharv Gudi: so I’m using a configuration file. That
79 00:06:37.400 ⇒ 00:06:43.290 Atharv Gudi: he has a template of. This should be the indentation. Everything should be lower. Case blah blah blah.
80 00:06:43.630 ⇒ 00:06:43.970 Patrick Trainer: Right.
81 00:06:43.970 ⇒ 00:06:50.810 Atharv Gudi: So far I think so. On Monday Utam had sent the link to the Dbt repo
82 00:06:52.073 ⇒ 00:06:55.600 Atharv Gudi: structure. He’d sent one of those documents.
83 00:06:56.720 ⇒ 00:06:59.120 Atharv Gudi: They don’t quite have
84 00:07:00.750 ⇒ 00:07:04.920 Atharv Gudi: they? So they have the structure of the repository, but they don’t have kind of
85 00:07:05.940 ⇒ 00:07:06.440 Atharv Gudi: oh.
86 00:07:06.440 ⇒ 00:07:09.740 Patrick Trainer: Kind of like like the the conventions.
87 00:07:09.740 ⇒ 00:07:11.599 Atharv Gudi: Yeah, that we should be following for all of these.
88 00:07:11.600 ⇒ 00:07:12.450 Patrick Trainer: Fright.
89 00:07:13.316 ⇒ 00:07:14.629 Patrick Trainer: So like
90 00:07:14.960 ⇒ 00:07:19.910 Patrick Trainer: to be, I mean completely honest, like the those conventions are up to us.
91 00:07:20.552 ⇒ 00:07:21.797 Patrick Trainer: And so
92 00:07:23.420 ⇒ 00:07:25.759 Patrick Trainer: I would say, like.
93 00:07:26.020 ⇒ 00:07:27.010 Patrick Trainer: I’m
94 00:07:27.570 ⇒ 00:07:31.999 Patrick Trainer: like, some popular conventions are either like uppercase or lowercase.
95 00:07:32.010 ⇒ 00:07:40.480 Patrick Trainer: I like lower case. I think lowercase is great to go with. Some other conventions are like trailing or leading commas.
96 00:07:40.990 ⇒ 00:07:48.480 Patrick Trainer: I think trailing is fine. There’s there’s a lot of debate around what people like, but I think trailing is fine
97 00:07:50.120 ⇒ 00:07:54.688 Patrick Trainer: and then other conventions are probably like
98 00:07:56.352 ⇒ 00:08:01.420 Patrick Trainer: like, how like the join syntax is is made like our our
99 00:08:01.560 ⇒ 00:08:02.420 Patrick Trainer: a
100 00:08:03.270 ⇒ 00:08:05.509 Patrick Trainer: like joins like the the
101 00:08:06.180 ⇒ 00:08:08.750 Patrick Trainer: table, a equals table B,
102 00:08:08.990 ⇒ 00:08:11.119 Patrick Trainer: or is that on a separate line
103 00:08:11.130 ⇒ 00:08:13.559 Patrick Trainer: or not? Like, that’s fine.
104 00:08:14.120 ⇒ 00:08:19.670 Patrick Trainer: Really what we can do or what I would suggest is, just get something like.
105 00:08:20.510 ⇒ 00:08:22.120 Patrick Trainer: do what
106 00:08:22.500 ⇒ 00:08:24.000 Patrick Trainer: you think is right
107 00:08:24.300 ⇒ 00:08:25.900 Patrick Trainer: or like.
108 00:08:26.060 ⇒ 00:08:29.350 Patrick Trainer: just what? Yeah, like, how you like to see sequel
109 00:08:29.782 ⇒ 00:08:35.740 Patrick Trainer: and then you push that up into a pull request, and then we can collaborate there
110 00:08:36.099 ⇒ 00:08:38.199 Patrick Trainer: and so everybody can kind of like
111 00:08:38.640 ⇒ 00:08:50.539 Patrick Trainer: put their opinion in so like, by no means. And that’s kind of like the the beauty of pull requests. Is that like it doesn’t have to be perfect to to pull it in
112 00:08:50.560 ⇒ 00:08:54.770 Patrick Trainer: and like that’s kind of like. The purpose of the pull request is to
113 00:08:54.930 ⇒ 00:08:57.180 Patrick Trainer: not just get everything like
114 00:08:57.620 ⇒ 00:09:07.539 Patrick Trainer: like if it looks good it’s to get like feedback by others. And so and and so that’s like a great place to start. So
115 00:09:07.841 ⇒ 00:09:12.209 Patrick Trainer: A lot of the times like like when I make a pull request like I
116 00:09:12.880 ⇒ 00:09:26.530 Patrick Trainer: am adding like commits to that, and like getting feedback along along the way. It’s kind of like a way to to be able to quickly iterate because one of the like. The last things that you want to do is like
117 00:09:26.670 ⇒ 00:09:30.149 Patrick Trainer: work on something for like an entire week
118 00:09:30.625 ⇒ 00:09:31.839 Patrick Trainer: and then like.
119 00:09:32.140 ⇒ 00:09:34.080 Patrick Trainer: show it. And then it’s like.
120 00:09:34.750 ⇒ 00:09:42.169 Patrick Trainer: Oh, we could have like caught like the like, just to make sure you’re going in the right direction, we’d be able to catch that like
121 00:09:42.330 ⇒ 00:09:46.100 Patrick Trainer: further up the line, or like in the past.
122 00:09:47.080 ⇒ 00:09:48.340 Patrick Trainer: Does that make sense.
123 00:09:48.340 ⇒ 00:09:54.159 Atharv Gudi: Yeah, I get that I’m just gonna share the screen and show what I have. So far, I think.
124 00:09:54.340 ⇒ 00:09:55.039 Patrick Trainer: Yeah, go for it.
125 00:09:55.040 ⇒ 00:09:55.909 Atharv Gudi: We’ll just
126 00:09:57.440 ⇒ 00:10:01.159 Atharv Gudi: stick to this. Okay, this is the SQL fluff. Yeah.
127 00:10:01.710 ⇒ 00:10:02.550 Atharv Gudi: honey.
128 00:10:03.120 ⇒ 00:10:07.460 Atharv Gudi: So far, I’ve just used this dialect is a standard. I don’t. I can’t.
129 00:10:08.050 ⇒ 00:10:14.529 Patrick Trainer: Okay, yeah, I think the the dialect I believe, like, it’s going to be snowflake.
130 00:10:15.082 ⇒ 00:10:20.289 Patrick Trainer: And so I think, yeah, I think you can set that directly as snowflake.
131 00:10:22.340 ⇒ 00:10:25.270 Patrick Trainer: tab space, too, like that looks perfect
132 00:10:26.158 ⇒ 00:10:29.100 Patrick Trainer: capitalization. Lower. That looks perfect.
133 00:10:29.845 ⇒ 00:10:32.614 Patrick Trainer: And I’m not sure what the other
134 00:10:34.426 ⇒ 00:10:39.090 Patrick Trainer: like keys are, but like this looks great so far.
135 00:10:39.090 ⇒ 00:10:42.180 Atharv Gudi: I think so. When I was using Nancy, I
136 00:10:42.680 ⇒ 00:10:45.079 Atharv Gudi: I I so I’d made a copy of
137 00:10:45.910 ⇒ 00:10:51.009 Atharv Gudi: all within the models. And I’d gotten these differences. I think
138 00:10:51.310 ⇒ 00:10:55.149 Atharv Gudi: I was. I was using the wrong, a different dialect. So let me just try.
139 00:10:55.410 ⇒ 00:11:04.620 Patrick Trainer: Okay, yeah. Yeah. The anti dialect is like everything kind of like stems off Anty. But like Snowflake has
140 00:11:05.134 ⇒ 00:11:12.690 Patrick Trainer: like abstractions over some of the dialect. So like I think in like normal ancill, let’s say.
141 00:11:13.078 ⇒ 00:11:16.119 Patrick Trainer: like the Ansql. Doesn’t have like the date trunk
142 00:11:16.210 ⇒ 00:11:18.139 Patrick Trainer: function like you have to
143 00:11:18.742 ⇒ 00:11:24.358 Patrick Trainer: create something else. So it’d probably like error on on that side.
144 00:11:24.890 ⇒ 00:11:25.980 Atharv Gudi: See.
145 00:11:26.392 ⇒ 00:11:29.690 Patrick Trainer: But yeah, and so there’s like, there’s certain
146 00:11:30.790 ⇒ 00:11:38.780 Patrick Trainer: just how like every sequel engine has its own kind of like flavor of sequel, like my sequel is different than postgress, and
147 00:11:38.840 ⇒ 00:11:42.199 Patrick Trainer: postgres is different from like redshift
148 00:11:42.655 ⇒ 00:11:47.160 Patrick Trainer: and so on, so forth. So that’s just like the way to
149 00:11:47.400 ⇒ 00:11:48.870 Patrick Trainer: define it. There.
150 00:11:49.430 ⇒ 00:11:50.120 Atharv Gudi: Don’t, Adam.
151 00:11:51.020 ⇒ 00:11:55.129 Atharv Gudi: Okay, now that I’ve I run it, it does show a lot of
152 00:11:55.450 ⇒ 00:11:56.410 Atharv Gudi: less.
153 00:11:57.430 ⇒ 00:12:04.550 Atharv Gudi: a lot less. There’s no fixable violations that I find the difference between
154 00:12:04.860 ⇒ 00:12:06.700 Atharv Gudi: the original
155 00:12:08.180 ⇒ 00:12:08.759 Atharv Gudi: and the
156 00:12:09.640 ⇒ 00:12:11.739 Atharv Gudi: the base, the linted one, I think.
157 00:12:12.050 ⇒ 00:12:13.660 Atharv Gudi: aside from
158 00:12:13.710 ⇒ 00:12:16.530 Atharv Gudi: I don’t think that’s something that’s
159 00:12:17.520 ⇒ 00:12:20.160 Atharv Gudi: I don’t think the shipments part is
160 00:12:21.240 ⇒ 00:12:23.999 Atharv Gudi: oh, well, the shipments part is fine, but it’s
161 00:12:25.380 ⇒ 00:12:29.210 Atharv Gudi: the very last line. I just wanted to make sure that this is
162 00:12:30.430 ⇒ 00:12:35.119 Atharv Gudi: the linking is going fine. So the syntax is here.
163 00:12:35.120 ⇒ 00:12:38.380 Patrick Trainer: Yeah. So that’s that’s good. The
164 00:12:38.400 ⇒ 00:12:43.690 Patrick Trainer: what we don’t want is the if you go back to the
165 00:12:43.760 ⇒ 00:12:44.839 Patrick Trainer: other one.
166 00:12:44.840 ⇒ 00:12:46.089 Atharv Gudi: The original. Yes.
167 00:12:46.090 ⇒ 00:12:47.882 Patrick Trainer: Yeah, the original
168 00:12:48.700 ⇒ 00:12:50.290 Patrick Trainer: those quotes
169 00:12:50.912 ⇒ 00:13:00.390 Patrick Trainer: are going to for snowflake. Specifically, the quotes are gonna mess things up. So the way snowflake and is so snowflake is
170 00:13:00.530 ⇒ 00:13:02.700 Patrick Trainer: by default.
171 00:13:02.950 ⇒ 00:13:03.890 Patrick Trainer: A
172 00:13:04.670 ⇒ 00:13:05.660 Patrick Trainer: is
173 00:13:05.980 ⇒ 00:13:14.359 Patrick Trainer: what do you call it? Like it? It doesn’t care if it’s upper case. It’s not case sensitive. It’s it’s only case sensitive.
174 00:13:14.500 ⇒ 00:13:25.129 Patrick Trainer: If the if the values are in quotes. And so like, if you create a a table that like create table asks like
175 00:13:25.380 ⇒ 00:13:28.242 Patrick Trainer: Foo right, and you put Foo in uppercase
176 00:13:29.660 ⇒ 00:13:36.079 Patrick Trainer: just as it is, it’s not going to matter. Like if you select star from Foo, you can put it.
177 00:13:36.090 ⇒ 00:13:41.440 Patrick Trainer: That’s lower case, and I’ll do it. But if you create the table foo in quotes.
178 00:13:41.490 ⇒ 00:13:51.639 Patrick Trainer: then you’re gonna have to follow that convention always like. If you try and do it, lowercase down the line it’ll throw an error and won’t be able to find it.
179 00:13:51.740 ⇒ 00:13:58.409 Patrick Trainer: So yeah, the the what you have in the copy as those are like, not in quotes, that’s the
180 00:13:58.650 ⇒ 00:14:00.230 Patrick Trainer: preferred way to do it.
181 00:14:00.230 ⇒ 00:14:02.240 Atharv Gudi: Okay. So if this is
182 00:14:03.174 ⇒ 00:14:06.589 Atharv Gudi: just a moment, I think I need to go check something out.
183 00:14:06.960 ⇒ 00:14:08.010 Patrick Trainer: Oh, yeah, go for it.
184 00:14:12.450 ⇒ 00:14:13.729 Patrick Trainer: How’s it going, Nika?
185 00:14:19.140 ⇒ 00:14:23.209 Nicolas Sucari: All good just working with a lot of stuff right now.
186 00:14:23.320 ⇒ 00:14:24.650 Nicolas Sucari: trying to
187 00:14:25.460 ⇒ 00:14:29.039 Nicolas Sucari: to change a lot of things on our website. So.
188 00:14:29.040 ⇒ 00:14:29.550 Patrick Trainer: Yeah.
189 00:14:29.550 ⇒ 00:14:37.800 Nicolas Sucari: I’m creating the case. I’m creating the case, studies. Just yeah. Going through components. See how everything is work trying to work on the different links.
190 00:14:38.137 ⇒ 00:14:42.300 Nicolas Sucari: I will send a couple of links then to everyone, so that you can see.
191 00:14:42.300 ⇒ 00:14:42.890 Patrick Trainer: That’s sweet.
192 00:14:43.205 ⇒ 00:14:47.939 Nicolas Sucari: All of the case studies that we’ve been creating. I’m trying to set everything up.
193 00:14:48.672 ⇒ 00:14:51.770 Nicolas Sucari: Yeah, I have other meetings today, too.
194 00:14:51.980 ⇒ 00:14:55.560 Nicolas Sucari: We are trying to keep up with everything busy. Friday.
195 00:14:55.560 ⇒ 00:14:57.519 Patrick Trainer: That’s the way to go. No kidding.
196 00:14:58.300 ⇒ 00:15:03.680 Nicolas Sucari: I know. I know you’ve been working a lot yesterday with the time I’ve seen a bunch of pull requests.
197 00:15:03.990 ⇒ 00:15:06.280 Patrick Trainer: Yeah, yeah, it’s
198 00:15:07.000 ⇒ 00:15:08.429 Patrick Trainer: and the
199 00:15:08.540 ⇒ 00:15:11.131 Patrick Trainer: there’s like a bug in
200 00:15:11.650 ⇒ 00:15:12.320 Nicolas Sucari: Yeah.
201 00:15:12.320 ⇒ 00:15:16.359 Patrick Trainer: Like in Github runners, where it’s a pending like a new line symbol.
202 00:15:16.770 ⇒ 00:15:21.050 Patrick Trainer: And so we’re just been like fighting that.
203 00:15:21.110 ⇒ 00:15:27.609 Patrick Trainer: Yeah, it’s it’s been a lot of fun. So let’s I’m just kinda going through that.
204 00:15:28.370 ⇒ 00:15:29.070 Patrick Trainer: Yeah, yeah.
205 00:15:29.070 ⇒ 00:15:30.260 Nicolas Sucari: Yeah, that’s okay.
206 00:15:30.750 ⇒ 00:15:31.810 Nicolas Sucari: We’re good. We’re good.
207 00:15:31.810 ⇒ 00:15:32.450 Patrick Trainer: This.
208 00:15:32.600 ⇒ 00:15:36.250 Patrick Trainer: yeah. So what? It’s just the way it goes. I think I’m
209 00:15:39.780 ⇒ 00:15:43.969 Patrick Trainer: I’m I’m really close to having it done.
210 00:15:45.790 ⇒ 00:15:46.430 Nicolas Sucari: Yep.
211 00:15:46.950 ⇒ 00:15:47.800 Patrick Trainer: See?
212 00:15:49.730 ⇒ 00:15:50.615 Patrick Trainer: Cool.
213 00:15:55.450 ⇒ 00:15:57.329 Patrick Trainer: yeah. Sorry. It’s our. You can.
214 00:15:59.314 ⇒ 00:16:00.969 Atharv Gudi: Okay, I think this
215 00:16:01.770 ⇒ 00:16:04.009 Atharv Gudi: was the part which I
216 00:16:04.490 ⇒ 00:16:08.509 Atharv Gudi: can. I. This is the part that I can basically work out pretty well.
217 00:16:09.180 ⇒ 00:16:12.949 Atharv Gudi: This covers all of the running sequel Fluff, on
218 00:16:13.130 ⇒ 00:16:14.850 Atharv Gudi: all the files we have.
219 00:16:15.220 ⇒ 00:16:16.080 Atharv Gudi: Okay.
220 00:16:17.250 ⇒ 00:16:18.210 Atharv Gudi: I
221 00:16:18.620 ⇒ 00:16:24.430 Atharv Gudi: checked out Chat Gpt, and I think I’ve been thrown off a little by the pre-commit hook
222 00:16:24.860 ⇒ 00:16:25.990 Atharv Gudi: part, I think.
223 00:16:26.110 ⇒ 00:16:29.336 Atharv Gudi: Could I wanna screen share that as well?
224 00:16:35.470 ⇒ 00:16:36.150 Atharv Gudi: Yep.
225 00:16:37.560 ⇒ 00:16:39.000 Atharv Gudi: this should work?
226 00:16:42.540 ⇒ 00:16:43.349 Atharv Gudi: Oh, no.
227 00:16:56.250 ⇒ 00:16:57.630 Atharv Gudi: yeah. So
228 00:16:58.070 ⇒ 00:17:01.520 Atharv Gudi: I had installed pre-commit and everything
229 00:17:01.740 ⇒ 00:17:08.218 Atharv Gudi: I am. I was very thrown off by where I should put up. Pre commit config, Yaml.
230 00:17:09.089 ⇒ 00:17:09.919 Patrick Trainer: Okay.
231 00:17:11.499 ⇒ 00:17:12.949 Patrick Trainer: not really sure.
232 00:17:13.585 ⇒ 00:17:15.889 Patrick Trainer: But there is a
233 00:17:17.139 ⇒ 00:17:18.909 Patrick Trainer: in action
234 00:17:19.189 ⇒ 00:17:21.499 Patrick Trainer: here that actually a
235 00:17:22.159 ⇒ 00:17:23.599 Patrick Trainer: friend of mine
236 00:17:23.759 ⇒ 00:17:27.929 Patrick Trainer: maintains the repo, and it’s built around
237 00:17:27.969 ⇒ 00:17:28.989 Patrick Trainer: pre-commit.
238 00:17:29.299 ⇒ 00:17:30.029 Patrick Trainer: But
239 00:17:32.059 ⇒ 00:17:33.599 Patrick Trainer: a a
240 00:17:34.099 ⇒ 00:17:36.009 Patrick Trainer: here, I’ll send it in the chat
241 00:17:36.401 ⇒ 00:17:42.349 Patrick Trainer: but it’s specific to dbt and has a lot of the pre-commit hooks built in
242 00:17:54.829 ⇒ 00:17:56.659 Patrick Trainer: I just sent that chat.
243 00:17:56.950 ⇒ 00:17:58.369 Atharv Gudi: Yeah, I just got that.
244 00:18:00.680 ⇒ 00:18:03.709 Atharv Gudi: let me have a stop to sharing. I can see this.
245 00:18:07.970 ⇒ 00:18:11.200 Atharv Gudi: Oh, yeah, I see the pre-commit hooks dot Yaml.
246 00:18:13.380 ⇒ 00:18:14.859 Atharv Gudi: And okay.
247 00:18:24.980 ⇒ 00:18:26.370 Atharv Gudi: eyes. Okay.
248 00:18:29.380 ⇒ 00:18:32.610 Atharv Gudi: where does this file come in?
249 00:18:33.238 ⇒ 00:18:35.080 Patrick Trainer: So that’s going to be
250 00:18:35.550 ⇒ 00:18:39.669 Patrick Trainer: in like the dot Github slash workflows.
251 00:18:40.320 ⇒ 00:18:43.520 Patrick Trainer: I believe it’s going to be in there
252 00:18:44.736 ⇒ 00:18:45.990 Patrick Trainer: and so
253 00:18:46.500 ⇒ 00:18:49.089 Patrick Trainer: I actually might be able to.
254 00:18:53.750 ⇒ 00:18:57.350 Atharv Gudi: Okay. So it’s gonna be in dot github workflows.
255 00:18:58.080 ⇒ 00:18:58.820 Patrick Trainer: Yes.
256 00:19:01.330 ⇒ 00:19:02.060 Patrick Trainer: he
257 00:19:06.280 ⇒ 00:19:06.980 Patrick Trainer: thank.
258 00:19:07.240 ⇒ 00:19:07.920 Patrick Trainer: It’s.
259 00:19:14.660 ⇒ 00:19:17.179 Patrick Trainer: Hey? I might have an example.
260 00:19:18.260 ⇒ 00:19:18.920 Patrick Trainer: Oak
261 00:19:45.160 ⇒ 00:19:47.750 Patrick Trainer: don’t have an example. Yeah.
262 00:19:49.440 ⇒ 00:19:51.830 Patrick Trainer: Oh, pre-commit config.
263 00:19:53.110 ⇒ 00:19:57.870 Patrick Trainer: Okay, it’s actually going to go in the Root Directory
264 00:19:58.410 ⇒ 00:19:59.190 Patrick Trainer: A,
265 00:20:00.840 ⇒ 00:20:02.790 Patrick Trainer: and then here’s an example.
266 00:20:15.220 ⇒ 00:20:17.860 Atharv Gudi: Oh, so it’s gonna go in the root directly. Not Github.
267 00:20:17.860 ⇒ 00:20:19.499 Patrick Trainer: Yes, in yeah, in the route.
268 00:20:20.150 ⇒ 00:20:20.870 Atharv Gudi: Okay?
269 00:20:25.340 ⇒ 00:20:26.155 Atharv Gudi: And
270 00:20:28.220 ⇒ 00:20:33.769 Atharv Gudi: okay. So it goes on the route. And then I think, like the rest of it should be, I can.
271 00:20:34.940 ⇒ 00:20:35.530 Atharv Gudi: I think.
272 00:20:35.530 ⇒ 00:20:38.531 Patrick Trainer: Probably just like copy this file directly.
273 00:20:39.010 ⇒ 00:20:40.999 Patrick Trainer: almost, except for the
274 00:20:42.450 ⇒ 00:20:45.539 Patrick Trainer: okay. Yeah, it’s using super fluff.
275 00:20:46.240 ⇒ 00:20:53.550 Atharv Gudi: Yeah, I also, I think if I have to lend or fix, if I have to. If SQL. Fluff has to be run, then I have to
276 00:20:53.730 ⇒ 00:20:55.869 Atharv Gudi: add arguments that we
277 00:20:56.370 ⇒ 00:20:57.270 Atharv Gudi: make.
278 00:21:00.120 ⇒ 00:21:01.020 Atharv Gudi: Yes.
279 00:21:07.430 ⇒ 00:21:08.300 Atharv Gudi: yeah.
280 00:21:13.310 ⇒ 00:21:15.150 Atharv Gudi: yeah, I think that’s
281 00:21:15.460 ⇒ 00:21:19.520 Atharv Gudi: I should be able to create a folder like that. And
282 00:21:20.310 ⇒ 00:21:21.929 Atharv Gudi: The last part was.
283 00:21:22.810 ⇒ 00:21:31.280 Atharv Gudi: will we so chat Gpt recommends that just to verify before, you know, pushing or pulling.
284 00:21:31.430 ⇒ 00:21:33.319 Atharv Gudi: we need that it
285 00:21:33.430 ⇒ 00:21:35.139 Atharv Gudi: recommends, I think.
286 00:21:35.600 ⇒ 00:21:39.479 Atharv Gudi: adding so adding a workflow to the Ci pipeline.
287 00:21:46.170 ⇒ 00:21:47.090 Nicolas Sucari: To do what
288 00:21:47.200 ⇒ 00:21:48.040 Nicolas Sucari: like
289 00:21:48.310 ⇒ 00:21:51.859 Nicolas Sucari: adding a step on that pipeline to check for.
290 00:21:52.930 ⇒ 00:21:53.830 Atharv Gudi: To check if the file.
291 00:21:53.830 ⇒ 00:21:54.470 Nicolas Sucari: Yeah, for.
292 00:21:54.470 ⇒ 00:21:55.130 Atharv Gudi: So it will.
293 00:21:55.130 ⇒ 00:21:55.989 Nicolas Sucari: Okay, did.
294 00:21:57.250 ⇒ 00:21:58.220 Nicolas Sucari: Okay.
295 00:21:58.500 ⇒ 00:21:59.650 Nicolas Sucari: what do you think? Bud?
296 00:22:01.950 ⇒ 00:22:02.600 Patrick Trainer: Keep waiting for.
297 00:22:02.600 ⇒ 00:22:11.459 Nicolas Sucari: Is something is is something running on the files before pushing that checks the syntax of the sequel files
298 00:22:12.130 ⇒ 00:22:12.850 Nicolas Sucari: right
299 00:22:13.790 ⇒ 00:22:15.607 Nicolas Sucari: like the action tree is that.
300 00:22:15.910 ⇒ 00:22:18.809 Patrick Trainer: I believe that’s all the the pre commitment
301 00:22:19.240 ⇒ 00:22:19.920 Patrick Trainer: right.
302 00:22:20.090 ⇒ 00:22:20.650 Nicolas Sucari: Yeah.
303 00:22:22.430 ⇒ 00:22:23.340 Atharv Gudi: Okay, I’m
304 00:22:24.540 ⇒ 00:22:27.580 Atharv Gudi: so we don’t want to add a
305 00:22:27.870 ⇒ 00:22:30.319 Atharv Gudi: anything to the Ci pipeline yet. Then.
306 00:22:31.199 ⇒ 00:22:32.900 Patrick Trainer: Yeah, that should be fine.
307 00:22:32.900 ⇒ 00:22:33.310 Atharv Gudi: Okay.
308 00:22:40.490 ⇒ 00:22:47.359 Atharv Gudi: Alright! Those were about all the questions I had. I think I was just confused when I was running
309 00:22:48.340 ⇒ 00:22:49.450 Atharv Gudi: the
310 00:22:49.600 ⇒ 00:22:55.510 Atharv Gudi: SQL. When I was running the leaner this whole week, and it had just been throwing errors left, right.
311 00:22:55.510 ⇒ 00:22:57.590 Patrick Trainer: Oh, yeah, right?
312 00:22:58.050 ⇒ 00:22:59.920 Atharv Gudi: I got it to work today somehow, but
313 00:23:00.030 ⇒ 00:23:01.501 Atharv Gudi: I think now I.
314 00:23:03.430 ⇒ 00:23:06.559 Patrick Trainer: Yeah, that’s kinda how it goes. Sometimes.
315 00:23:07.050 ⇒ 00:23:07.970 Atharv Gudi: Yeah.
316 00:23:08.590 ⇒ 00:23:09.940 Atharv Gudi: I guess that’s an
317 00:23:10.280 ⇒ 00:23:11.690 Atharv Gudi: Vs code
318 00:23:11.800 ⇒ 00:23:13.080 Atharv Gudi: that is coding.
319 00:23:14.050 ⇒ 00:23:16.179 Atharv Gudi: You just do stuff until something works.
320 00:23:16.610 ⇒ 00:23:17.105 Patrick Trainer: Right.
321 00:23:19.170 ⇒ 00:23:20.350 Patrick Trainer: That’s kinda
322 00:23:21.970 ⇒ 00:23:23.079 Patrick Trainer: what I’m doing.
323 00:23:23.080 ⇒ 00:23:24.073 Nicolas Sucari: Okay. Now.
324 00:23:25.585 ⇒ 00:23:26.140 Nicolas Sucari: yeah.
325 00:23:26.190 ⇒ 00:23:36.799 Nicolas Sucari: can I ask just question about sequel? Fluff? At our, probably you can answer, it’s pretty simple. But so if if we want, like everyone to use sequel Fluff
326 00:23:37.310 ⇒ 00:23:47.820 Nicolas Sucari: locally before committing or pushing anything right like, that’s the idea. What is the steps we need to do? It’s just to like. Probably there is
327 00:23:48.420 ⇒ 00:23:51.539 Nicolas Sucari: Ps code extension or something that we can
328 00:23:51.740 ⇒ 00:23:52.750 Nicolas Sucari: use
329 00:23:52.940 ⇒ 00:23:54.089 Nicolas Sucari: or how we
330 00:23:54.140 ⇒ 00:23:55.930 Nicolas Sucari: like create like a
331 00:23:56.080 ⇒ 00:23:58.639 Nicolas Sucari: setup document for everyone to start using it.
332 00:23:58.640 ⇒ 00:24:03.170 Atharv Gudi: Yeah. So I think the only thing that would be required is
333 00:24:03.260 ⇒ 00:24:13.059 Atharv Gudi: number one to install SQL. Fluff, which I mean, if anyone just opens up Vs code or the terminal or shell, and just put types and pip install SQL. Fluff.
334 00:24:13.100 ⇒ 00:24:15.310 Atharv Gudi: It’s gonna install the latest version.
335 00:24:15.310 ⇒ 00:24:16.060 Nicolas Sucari: Perfect.
336 00:24:16.060 ⇒ 00:24:23.530 Atharv Gudi: That’s gonna happen. And I think once I add the configuration find. Once I add
337 00:24:24.310 ⇒ 00:24:27.029 Atharv Gudi: both the configuration and the pre-commit file.
338 00:24:27.130 ⇒ 00:24:28.280 Atharv Gudi: then
339 00:24:28.880 ⇒ 00:24:32.859 Atharv Gudi: I think there’s also gonna be. They also have to. Everyone would also have to install
340 00:24:33.620 ⇒ 00:24:36.890 Atharv Gudi: if install pre-commit. So I’ll just type those in
341 00:24:37.030 ⇒ 00:24:39.030 Atharv Gudi: 5th install.
342 00:24:41.540 ⇒ 00:24:43.679 Nicolas Sucari: If we can like, have a.
343 00:24:43.680 ⇒ 00:24:44.180 Atharv Gudi: Don’t want.
344 00:24:44.180 ⇒ 00:24:46.340 Nicolas Sucari: Or something where we
345 00:24:46.520 ⇒ 00:24:55.460 Nicolas Sucari: know, like all of the things required, or what are the steps that we need to take? In order to everyone be using simple stuff that would be great.
346 00:24:56.520 ⇒ 00:25:03.689 Atharv Gudi: Yeah. So put them. Asked me to make the document as well. But he said that I can add on to the document as we go on
347 00:25:04.080 ⇒ 00:25:05.230 Atharv Gudi: perfect.
348 00:25:05.980 ⇒ 00:25:11.909 Atharv Gudi: So I’m still. So that’s where the Ci pipeline actually comes in. Because if someone is not
349 00:25:12.270 ⇒ 00:25:26.450 Atharv Gudi: using is not linting, the the linting won’t happen unless they’ve already installed pre-commit, and if they haven’t installed pre-commit, they’re just pushing without lending anything or without checking anything that’s where the ci pipeline
350 00:25:26.700 ⇒ 00:25:28.479 Atharv Gudi: configuration would come in
351 00:25:29.150 ⇒ 00:25:35.130 Atharv Gudi: to check, whether in Linda or not. And it does also link
352 00:25:35.890 ⇒ 00:25:38.060 Atharv Gudi: or fix one of those
353 00:25:39.590 ⇒ 00:25:42.740 Atharv Gudi: 3 account. I’m just gonna type in
354 00:25:46.970 ⇒ 00:25:51.309 Atharv Gudi: so far, I know that everyone would have to just use these 2 commands
355 00:25:51.470 ⇒ 00:25:54.269 Atharv Gudi: install SQL. Fluff and pre-commit
356 00:26:02.230 ⇒ 00:26:03.470 Atharv Gudi: unless
357 00:26:04.040 ⇒ 00:26:06.190 Atharv Gudi: unless we fully.
358 00:26:06.920 ⇒ 00:26:10.189 Atharv Gudi: unless someone has fully installed pre-commit, and
359 00:26:10.290 ⇒ 00:26:16.460 Atharv Gudi: added that Github the linter, won’t run on any SQL. Code before pushing.
360 00:26:17.659 ⇒ 00:26:18.060 Nicolas Sucari: Okay.
361 00:26:18.060 ⇒ 00:26:21.159 Atharv Gudi: That’s kind of the most important crux of this whole thing.
362 00:26:22.080 ⇒ 00:26:25.380 Nicolas Sucari: Okay, yeah. Probably when you
363 00:26:26.290 ⇒ 00:26:33.669 Nicolas Sucari: finish the config file, I think that’s the one that you’re just working on. We can have like that like steps
364 00:26:33.740 ⇒ 00:26:40.019 Nicolas Sucari: that anyone can follow and install what they need and start using yeah.
365 00:26:40.060 ⇒ 00:26:56.000 Nicolas Sucari: this code with that installed in, okay, we can you, when once you are ready with that, let me know. And we can go through like with me. With my Vs code. We can set that up. We can screen, record or do something like that, and use that for the document. If you want.
366 00:26:56.290 ⇒ 00:26:57.710 Atharv Gudi: Good. I think
367 00:26:57.990 ⇒ 00:27:00.369 Atharv Gudi: I would also say it’s
368 00:27:00.550 ⇒ 00:27:07.890 Atharv Gudi: maybe a good idea to revisit the Ci pipeline part of it at a later date. Just.
369 00:27:08.275 ⇒ 00:27:08.660 Nicolas Sucari: Bay.
370 00:27:08.660 ⇒ 00:27:10.440 Atharv Gudi: Someone hasn’t.
371 00:27:11.580 ⇒ 00:27:15.310 Atharv Gudi: Okay. So if I’m someone who’s written
372 00:27:15.880 ⇒ 00:27:18.740 Atharv Gudi: the config file, if I’ve written the pre-commit, yeah.
373 00:27:18.740 ⇒ 00:27:19.360 Nicolas Sucari: Yeah.
374 00:27:19.360 ⇒ 00:27:23.000 Atharv Gudi: And I’ve that’s gonna be kind of a mandatory thing
375 00:27:23.250 ⇒ 00:27:24.710 Atharv Gudi: on every
376 00:27:24.880 ⇒ 00:27:26.849 Atharv Gudi: directory, every project.
377 00:27:27.140 ⇒ 00:27:31.679 Atharv Gudi: But if someone else comes in and they have neither sequel. Fluff, not precomp.
378 00:27:31.680 ⇒ 00:27:32.290 Nicolas Sucari: Okay.
379 00:27:32.540 ⇒ 00:27:35.829 Atharv Gudi: They would be. The files would not be used at all, and
380 00:27:36.270 ⇒ 00:27:37.360 Atharv Gudi: it would just be.
381 00:27:37.360 ⇒ 00:27:43.099 Nicolas Sucari: Yeah, but I mean they they won’t be using it, but it won’t make like it won’t generate any error right? Like.
382 00:27:43.100 ⇒ 00:27:43.690 Atharv Gudi: It won’t take.
383 00:27:43.690 ⇒ 00:27:44.549 Nicolas Sucari: And I’ve.
384 00:27:44.940 ⇒ 00:27:46.009 Atharv Gudi: It won’t generate.
385 00:27:46.010 ⇒ 00:27:46.830 Nicolas Sucari: That’s fine!
386 00:27:47.210 ⇒ 00:27:50.160 Atharv Gudi: The lender would not have worked, basically.
387 00:27:50.160 ⇒ 00:27:50.820 Nicolas Sucari: Okay.
388 00:27:51.930 ⇒ 00:27:53.140 Nicolas Sucari: yeah. Okay.
389 00:27:54.023 ⇒ 00:27:57.059 Nicolas Sucari: Yeah, probably we can revisit the CIO.
390 00:27:57.060 ⇒ 00:27:57.570 Atharv Gudi: So.
391 00:27:57.570 ⇒ 00:28:03.219 Nicolas Sucari: Later, I I think. But you can work. You can help us there later to see
392 00:28:03.250 ⇒ 00:28:06.020 Nicolas Sucari: if we will need to trigger something
393 00:28:06.240 ⇒ 00:28:13.019 Nicolas Sucari: there to see if we’re using the lender stuff or not. But I think I think, for now, if we just like have these steps
394 00:28:13.170 ⇒ 00:28:20.810 Nicolas Sucari: that everyone needs to start using sequel file from the local environment and then pushing everything and everything gets reviewed before
395 00:28:20.870 ⇒ 00:28:23.349 Nicolas Sucari: pushing. I think that’s fine for now. Yeah.
396 00:28:23.570 ⇒ 00:28:24.310 Atharv Gudi: Okay.
397 00:28:24.310 ⇒ 00:28:28.139 Nicolas Sucari: We can create. We can create a document. See that everyone just
398 00:28:28.280 ⇒ 00:28:32.540 Nicolas Sucari: follows that instructions to set that up and then continue working. Probably
399 00:28:34.280 ⇒ 00:28:35.150 Nicolas Sucari: right?
400 00:28:38.200 ⇒ 00:28:39.630 Nicolas Sucari: Perfect. Okay.
401 00:28:40.590 ⇒ 00:28:44.270 Atharv Gudi: Okay, listen. Thanks. So much for sitting down with me. Pat. This is.
402 00:28:44.270 ⇒ 00:28:45.150 Patrick Trainer: Yeah, check.
403 00:28:45.320 ⇒ 00:28:47.550 Atharv Gudi: The these were the big hurdles and
404 00:28:47.950 ⇒ 00:28:48.670 Atharv Gudi: the butter.
405 00:28:48.670 ⇒ 00:29:00.510 Nicolas Sucari: And don’t. Don’t hesitate to send questions through slack. If you have any other stuff, and don’t want to wait until the meeting. Just send there and the channel the questions and we are gonna try to help you.
406 00:29:00.760 ⇒ 00:29:01.829 Atharv Gudi: Yeah, I care for Nick.
407 00:29:01.830 ⇒ 00:29:02.380 Nicolas Sucari: Okay.
408 00:29:02.380 ⇒ 00:29:04.870 Atharv Gudi: I guess most of the questions that I have.
409 00:29:06.310 ⇒ 00:29:11.519 Atharv Gudi: Well, I do need to maybe share a file, share a screenshot, and then
410 00:29:11.840 ⇒ 00:29:16.449 Atharv Gudi: ask a question regarding it, which is why I prefer to do it on video, but I’ll try to get it.
411 00:29:16.890 ⇒ 00:29:19.060 Atharv Gudi: Ask questions through slack more often
412 00:29:21.780 ⇒ 00:29:22.420 Atharv Gudi: yet.
413 00:29:22.420 ⇒ 00:29:23.120 Nicolas Sucari: Perfect.
414 00:29:25.200 ⇒ 00:29:26.030 Atharv Gudi: Alright!
415 00:29:26.885 ⇒ 00:29:27.740 Nicolas Sucari: Okay.
416 00:29:27.890 ⇒ 00:29:29.020 Nicolas Sucari: Great guys.
417 00:29:29.020 ⇒ 00:29:30.550 Atharv Gudi: Well, thank you so much. May.
418 00:29:32.360 ⇒ 00:29:33.030 Nicolas Sucari: Bye, bye.