Meeting Title: Data platform stand up Date: 2025-05-14 Meeting participants: Luke Daque, Awaish Kumar, Caio Velasco
WEBVTT
1 00:02:04.810 ⇒ 00:02:05.540 Caio Velasco: Hey! Wish.
2 00:02:06.450 ⇒ 00:02:09.525 Awaish Kumar: Alright! Let’s get started.
3 00:02:10.810 ⇒ 00:02:13.690 Awaish Kumar: I think Luke will be joining, but I don’t know.
4 00:02:17.700 ⇒ 00:02:18.560 Caio Velasco: No problem.
5 00:02:19.590 ⇒ 00:02:38.089 Awaish Kumar: But we can start with our discussion on. So I see your questions. But I don’t know what what like the sheets. I see the shared by, and then the one shared by me kind of similar. There’s not not much like conflicts.
6 00:02:39.400 ⇒ 00:02:47.818 Awaish Kumar: So you we can use the one for 18, because that’s when we built for the client. It’s already been shared with the client. And I think,
7 00:02:49.000 ⇒ 00:02:56.400 Awaish Kumar: like, it’s okay, like it’s I don’t. I have not received any bad feedback about the negative, any negative feedback about it.
8 00:02:56.530 ⇒ 00:03:01.589 Awaish Kumar: So it’s good enough like we have metrics like there are 2 tabs, I suggested. But
9 00:03:01.720 ⇒ 00:03:08.499 Awaish Kumar: the outcomes have 3 tabs, but we can add 3 tabs, so like one is where we have metrics.
10 00:03:08.910 ⇒ 00:03:14.539 Awaish Kumar: So if you have open it up like, maybe I can share the screen.
11 00:03:16.920 ⇒ 00:03:18.790 Caio Velasco: You want me to open, or are you gonna open.
12 00:03:19.312 ⇒ 00:03:20.880 Awaish Kumar: Will do that.
13 00:03:21.570 ⇒ 00:03:22.650 Awaish Kumar: That’s okay.
14 00:03:22.780 ⇒ 00:03:24.270 Awaish Kumar: Thank you.
15 00:03:28.070 ⇒ 00:03:29.220 Awaish Kumar: So.
16 00:03:31.700 ⇒ 00:03:32.380 Luke Daque: Hello!
17 00:03:33.110 ⇒ 00:03:34.279 Luke Daque: Now, let’s see.
18 00:03:34.820 ⇒ 00:03:36.230 Awaish Kumar: Hello.
19 00:03:40.620 ⇒ 00:03:47.769 Awaish Kumar: okay, this one. Like, if if we if we can like see like core metrics, tab
20 00:03:48.810 ⇒ 00:03:53.568 Awaish Kumar: like this is good enough for me 4 clients
21 00:03:54.390 ⇒ 00:03:56.260 Awaish Kumar: I think for over, and then.
22 00:04:00.150 ⇒ 00:04:06.449 Caio Velasco: And all the columns or our column are any of the columns. We don’t need.
23 00:04:06.450 ⇒ 00:04:09.410 Awaish Kumar: Yeah, yeah, it’s it’s only the metric right?
24 00:04:13.610 ⇒ 00:04:20.879 Caio Velasco: It depends on the goal. Like, if what we want to do with this, when we have the core metrics, we have the data source.
25 00:04:22.140 ⇒ 00:04:24.660 Caio Velasco: And I see the data pipeline.
26 00:04:25.700 ⇒ 00:04:33.780 Awaish Kumar: The goal is to share with the client what metrics we are building right.
27 00:04:33.960 ⇒ 00:04:50.270 Awaish Kumar: which are part of some dashboard, like what? What all metrics we are, we are kind of tracking. What is the data source where the data is coming from for them? And in our pipeline most data bundle is just mainly for us.
28 00:04:50.430 ⇒ 00:05:00.600 Awaish Kumar: like which tables we have to look for, to find out the calculation for this metric, and then
29 00:05:00.980 ⇒ 00:05:07.840 Awaish Kumar: the dashboard name, and to like the like, yeah.
30 00:05:07.990 ⇒ 00:05:10.009 Awaish Kumar: let’s more name of the link. Whatever
31 00:05:11.270 ⇒ 00:05:13.740 Awaish Kumar: do you see? Like 3, 4 columns only.
32 00:05:13.950 ⇒ 00:05:16.370 Awaish Kumar: How many required?
33 00:05:16.660 ⇒ 00:05:17.800 Awaish Kumar: This is like
34 00:05:17.910 ⇒ 00:05:24.120 Awaish Kumar: tableau data source. Yeah, we can add this, like the for each dashboard, we have few data sources.
35 00:05:24.250 ⇒ 00:05:51.690 Awaish Kumar: So this table is coming from this source, which tableau data sources which will be directly linked with like some final table here, which is like this in pipeline, you can see the last product says something by transaction. This is the table in the final. It’s a warehouse final table. And this is directly will be linked with a tableau data source. And then this data source is being used at this tableau dashboard. So
36 00:05:52.050 ⇒ 00:05:53.470 Awaish Kumar: that’s basically it.
37 00:05:54.870 ⇒ 00:05:57.480 Awaish Kumar: The other one is kind of similar, like in.
38 00:05:57.690 ⇒ 00:06:02.019 Awaish Kumar: But yeah, this one. I am preferring this one because it has some tag work
39 00:06:02.570 ⇒ 00:06:05.869 Awaish Kumar: have, and we have been sharing it with the client as well.
40 00:06:07.620 ⇒ 00:06:13.270 Awaish Kumar: Other tab is this one? This is just the list of all the active resources.
41 00:06:16.870 ⇒ 00:06:17.620 Caio Velasco: Okay.
42 00:06:19.170 ⇒ 00:06:21.980 Awaish Kumar: The data source name active.
43 00:06:22.180 ⇒ 00:06:24.430 Awaish Kumar: There’s a we know any description.
44 00:06:25.255 ⇒ 00:06:28.990 Awaish Kumar: Yeah, like, we don’t actually need this like owners.
45 00:06:29.310 ⇒ 00:06:30.849 Awaish Kumar: Anyone in the team is.
46 00:06:31.740 ⇒ 00:06:32.025 Caio Velasco: Yeah.
47 00:06:33.070 ⇒ 00:06:37.890 Awaish Kumar: Is, this will be the owner like you can change. So we don’t need to pay this.
48 00:06:39.100 ⇒ 00:06:43.719 Awaish Kumar: Oh, yeah, pipeline tool can see like which tool we are using to actually bring in the data.
49 00:06:45.160 ⇒ 00:06:51.700 Awaish Kumar: we can sense, we can write round frequency. And also this, if it’s a batch or event processing.
50 00:06:52.265 ⇒ 00:06:54.709 Awaish Kumar: Yeah, these are some things we can do.
51 00:06:56.360 ⇒ 00:07:00.800 Awaish Kumar: And then 3rd one, which which autumn said, which will be kind of similar
52 00:07:01.140 ⇒ 00:07:08.559 Awaish Kumar: like we already have here, but that’s just a different view of it. We’ll have a dashboards list and the
53 00:07:09.310 ⇒ 00:07:12.060 Awaish Kumar: and the honors. But owners will. Basically this.
54 00:07:12.350 ⇒ 00:07:20.819 Awaish Kumar: The data analyst who is building the dashboard. It’s mostly the the same person, because we only have single data analyst on
55 00:07:21.080 ⇒ 00:07:22.510 Awaish Kumar: on every project.
56 00:07:23.050 ⇒ 00:07:25.880 Awaish Kumar: So yeah, that will be the order.
57 00:07:28.476 ⇒ 00:07:28.910 Caio Velasco: So just
58 00:07:29.330 ⇒ 00:07:40.129 Caio Velasco: it looks good. The only thing that I’m worried is about column C data pipeline, because I remember that when I was doing this like right in the beginning, when I started.
59 00:07:40.520 ⇒ 00:07:46.870 Caio Velasco: it was taking me ages just to find all the raw and in tables pointing to a single metric.
60 00:07:49.590 ⇒ 00:07:54.310 Awaish Kumar: Yeah, like, budget help. Yeah, like.
61 00:07:54.720 ⇒ 00:07:59.150 Awaish Kumar: it does take time. But yeah, like, if I see, like, maybe the
62 00:08:00.270 ⇒ 00:08:05.829 Awaish Kumar: Amazon calls Amazon calls coming from income is like Amazon log, back order table.
63 00:08:05.950 ⇒ 00:08:09.859 Awaish Kumar: Then it goes to in front Amazon order, line or orders whatever.
64 00:08:10.050 ⇒ 00:08:13.400 Awaish Kumar: Then it goes back to at all.
65 00:08:14.280 ⇒ 00:08:22.579 Awaish Kumar: So I think that’s the very like I know that it’s
66 00:08:24.370 ⇒ 00:08:28.540 Awaish Kumar: it’s like, once you are in there, after you have made like
67 00:08:29.290 ⇒ 00:08:38.140 Awaish Kumar: like, we won’t have list of a lot of like very big list of metrics we will have, maybe in all the dashboards we have like
68 00:08:39.299 ⇒ 00:08:45.220 Awaish Kumar: we might have, like, maybe see 60 70 metrics and
69 00:08:45.320 ⇒ 00:08:59.539 Awaish Kumar: and some of the metrics will be calculated from same source. So we already know, like this source or this final table is being built on from on top of the these raw animals. So we can just copy paste right? So I know this like this thing.
70 00:08:59.900 ⇒ 00:09:04.290 Awaish Kumar: new revenue returning revenue, total revenue. This is coming from same thing right?
71 00:09:04.510 ⇒ 00:09:06.149 Awaish Kumar: I just have to copy this.
72 00:09:07.960 ⇒ 00:09:13.939 Caio Velasco: Yeah. Yeah. But still it’s a, it’s, it’s a. It’s a lot of work in terms of really a lot of hours.
73 00:09:14.200 ⇒ 00:09:19.250 Caio Velasco: If you want to take that into consideration, because I was doing that in the beginning, for for the Amazon.
74 00:09:19.250 ⇒ 00:09:30.110 Awaish Kumar: Yeah, I have built this like, the seed thing. Is this so the person who have worked on it? I don’t like this. This basically column. I have filled it out.
75 00:09:30.770 ⇒ 00:09:34.180 Awaish Kumar: Kind of it. Did.
76 00:09:34.180 ⇒ 00:09:35.120 Caio Velasco: Is there.
77 00:09:35.380 ⇒ 00:09:38.619 Awaish Kumar: Like days to do that like. It’s just a few hours.
78 00:09:40.890 ⇒ 00:09:44.120 Caio Velasco: Yeah. And and do you have a definition for
79 00:09:44.530 ⇒ 00:09:48.910 Caio Velasco: for this structure? You have, like parentheses, or
80 00:09:50.460 ⇒ 00:09:54.000 Caio Velasco: whatever like, it’s right into March, like, what is the.
81 00:09:55.300 ⇒ 00:09:56.960 Caio Velasco: so that I can follow the same.
82 00:10:00.460 ⇒ 00:10:02.810 Awaish Kumar: Like structure, for like.
83 00:10:03.540 ⇒ 00:10:08.430 Awaish Kumar: So this is how it’s just make sure like.
84 00:10:08.570 ⇒ 00:10:18.319 Awaish Kumar: So I have. The name of tables in our 1st bracket, square brackets. This is kind of the
85 00:10:18.700 ⇒ 00:10:22.320 Awaish Kumar: basic tables like vow tables
86 00:10:22.530 ⇒ 00:10:31.109 Awaish Kumar: from, and then then have this marker. And then this is basically the upper layer, like the tables, or
87 00:10:31.690 ⇒ 00:10:40.469 Awaish Kumar: maybe the march already. But whatever is on top of it, and then this is on top of that one so like
88 00:10:40.860 ⇒ 00:10:49.589 Awaish Kumar: you have to define my case to case like if if you have to like this and 2 layers or 3 layers because we have some raw tables, then we have some
89 00:10:51.654 ⇒ 00:10:57.130 Awaish Kumar: in tables. Then we have some March table, and then in March we have some summary tables, so.
90 00:10:57.260 ⇒ 00:11:06.270 Awaish Kumar: and sometimes directly we take from our stable sometime. Take it from somebody table, so it can be like 3 more or 4 whatever layers
91 00:11:06.640 ⇒ 00:11:10.560 Awaish Kumar: that we can just separate them with these square brackets.
92 00:11:12.060 ⇒ 00:11:16.269 Caio Velasco: Okay? So it’s at the end of the day is basically Dbt lineage.
93 00:11:17.700 ⇒ 00:11:20.550 Awaish Kumar: Yeah, like this, this is basically DVD models.
94 00:11:22.660 ⇒ 00:11:23.330 Caio Velasco: Okay.
95 00:11:25.400 ⇒ 00:11:26.670 Caio Velasco: Okay. Okay.
96 00:11:31.020 ⇒ 00:11:39.840 Awaish Kumar: And then I think, if so, once we have notion docs completed for all the clients
97 00:11:40.160 ⇒ 00:11:44.549 Awaish Kumar: we can work on this thing. And and even if, like.
98 00:11:45.630 ⇒ 00:11:51.490 Awaish Kumar: somebody wants to move this like, if if outcome says like, let’s move it to motion
99 00:11:51.610 ⇒ 00:11:57.560 Awaish Kumar: like once we have in the sheet, I don’t think it’s going to take us long. We just copy, paste it in motion right.
100 00:11:59.060 ⇒ 00:12:05.579 Caio Velasco: Yes, yes, so exactly the question. So because I was doing everything in notion. So of course it would be like text.
101 00:12:05.580 ⇒ 00:12:07.030 Awaish Kumar: Yeah, like, that’s
102 00:12:07.320 ⇒ 00:12:23.120 Awaish Kumar: what I’m what I’m trying to say is that like, let’s build it. Then building this, going to take time moving it into notion will will not take us time. Right? I we can just copy paste there from here, right? It won’t take
103 00:12:23.640 ⇒ 00:12:38.410 Awaish Kumar: so. But building really this thing like, list of core metrics. Okay, to figure output from tableau dashboards, list of data sources. List of data, pipeline. This is going to takes take some time. Obviously, so, yeah, that’s.
104 00:12:40.490 ⇒ 00:13:05.620 Caio Velasco: Yeah, you know this, this when I was doing the the knowledge Base Knowledge base page. There are sections for this. So those sections I assume that I have to delete, and then we will just put this table, for example, at the end, because there are section about the which are the dashboards or, what is the end to end? Data flow? So this is basically everything together.
105 00:13:06.990 ⇒ 00:13:35.989 Awaish Kumar: Yeah, like I. The last time we discussed which we saw the motion document that, like, you have been given the android flow. It was mostly about top level flow of okay, the data coming to raw and then it going. It is going to march, and then it is going to the raw. Intend March, and this is the structure. This is the table name or data set, name or whatever. But
106 00:13:36.490 ⇒ 00:13:41.780 Awaish Kumar: the lotion dog didn’t have the god.
107 00:13:42.930 ⇒ 00:13:45.359 Awaish Kumar: This level of granularity right.
108 00:13:45.730 ⇒ 00:13:49.760 Caio Velasco: Yes, yes, but that’s that’s the point. If we have this.
109 00:13:49.970 ⇒ 00:14:01.729 Caio Velasco: and this is being consumed by the AI agent. The other questions over there. It’s also already answered. So that’s what I mean. I maybe we don’t need them over there. Or do you think we still need.
110 00:14:03.240 ⇒ 00:14:09.909 Awaish Kumar: Like. Can you show me like if you can share your screen and show me like what is like? Kind of you think
111 00:14:10.840 ⇒ 00:14:13.720 Awaish Kumar: His contract is like duplicate.
112 00:14:14.710 ⇒ 00:14:16.382 Caio Velasco: Yes. One. Sec.
113 00:14:30.500 ⇒ 00:14:34.119 Caio Velasco: Okay, so this is the the main document.
114 00:14:35.010 ⇒ 00:14:38.290 Caio Velasco: And then this is the page.
115 00:14:43.390 ⇒ 00:14:44.943 Caio Velasco: For example.
116 00:14:52.060 ⇒ 00:14:57.539 Caio Velasco: this section we don’t need anymore, because it’s everything. It’s in this spreadsheet that you shared.
117 00:14:57.810 ⇒ 00:14:59.830 Awaish Kumar: Yeah, that. That’s what I’m saying.
118 00:15:00.310 ⇒ 00:15:00.640 Caio Velasco: Yeah.
119 00:15:00.640 ⇒ 00:15:03.409 Awaish Kumar: This this section. We can.
120 00:15:04.030 ⇒ 00:15:07.488 Awaish Kumar: We can remove it because
121 00:15:09.200 ⇒ 00:15:26.390 Awaish Kumar: like, if even if we want to bring it back to notion, we just have to copy, paste it from sheets. So it’s like, that’s not a big task. That’s my only saying, if you build that dot table in notion. Or if you build that table in sheets
122 00:15:26.590 ⇒ 00:15:30.050 Awaish Kumar: kind of same like, let’s build a sheet.
123 00:15:30.260 ⇒ 00:15:50.010 Awaish Kumar: If if AI agent needs it to be in notion, we just copy paste it otherwise. Let’s let let’s it be to be in the sheet as well, because sheets we are going to share them with the client, and we can just copy paste it here as well for our AI agent. So that’s like it doesn’t.
124 00:15:50.010 ⇒ 00:15:50.400 Caio Velasco: Yes.
125 00:15:50.580 ⇒ 00:15:51.910 Awaish Kumar: Clearly it will be.
126 00:15:52.500 ⇒ 00:15:53.300 Caio Velasco: Yeah, that’s.
127 00:15:53.300 ⇒ 00:15:53.880 Awaish Kumar: Yeah, that’s exactly
128 00:15:53.880 ⇒ 00:16:02.070 Awaish Kumar: a lot of hours, right? We can just copy, paste it here for our agent as well, and keep in the sheet as well for our clients. So that’s.
129 00:16:02.070 ⇒ 00:16:02.670 Caio Velasco: If.
130 00:16:02.980 ⇒ 00:16:12.720 Caio Velasco: Yeah, this is exactly what I what I meant. That’s why it will. It’s already here. The link is already here. If we wanna embed or something. This is, I understand your point. Yeah, yeah.
131 00:16:12.720 ⇒ 00:16:16.099 Awaish Kumar: So yeah, let’s maybe create a table like, don’t add a link.
132 00:16:16.340 ⇒ 00:16:23.969 Awaish Kumar: Let’s start like, let’s start out with the create, like copy like this is for how are you
133 00:16:25.210 ⇒ 00:16:27.599 Awaish Kumar: this document? What does it fall.
134 00:16:28.680 ⇒ 00:16:39.009 Caio Velasco: Theoretically, the Javi is Mvp. But everything that you see here. It’s like the structure. Yeah, this is about Javi. This is about Javi. But.
135 00:16:39.270 ⇒ 00:16:42.920 Awaish Kumar: Yeah. So what I’m trying to say is that
136 00:16:44.860 ⇒ 00:16:53.099 Awaish Kumar: let’s leave it like that until we have that sheet for Joby right now we only have for aiden. So let’s
137 00:16:53.420 ⇒ 00:16:59.577 Awaish Kumar: when you work on the Ed. v. 1 documentation part we will.
138 00:17:00.370 ⇒ 00:17:11.329 Awaish Kumar: then for Ed, we will copy. Paste it from the sheet, because they already have a sheet for for others. We just keep us keep that section empty, and we will fill it after we have that sheet.
139 00:17:11.790 ⇒ 00:17:16.259 Awaish Kumar: But just and what? Yeah, finalize other things.
140 00:17:16.369 ⇒ 00:17:17.810 Awaish Kumar: Taking in the document.
141 00:17:18.181 ⇒ 00:17:29.699 Caio Velasco: Even for the spreadsheet. I will. I will change so that we have something hybrid for everything, because that one is particular, for even because we have that blue dashboard.
142 00:17:29.870 ⇒ 00:17:35.790 Awaish Kumar: That is particularly for Indian. We what we want is basically
143 00:17:36.120 ⇒ 00:17:45.029 Awaish Kumar: same, use it as a template like, create a copy of it, and use this as a template. To build up, build it out for job.
144 00:17:45.950 ⇒ 00:17:46.610 Caio Velasco: Yeah.
145 00:17:47.260 ⇒ 00:17:50.710 Caio Velasco: And then for this part.
146 00:17:50.710 ⇒ 00:18:01.169 Awaish Kumar: Just, I, I think, for now just finalize notion document for all the clients, and then we in a I think, second iteration. We we are going to work on these sheets
147 00:18:01.660 ⇒ 00:18:10.670 Awaish Kumar: once, like I have. I have some tickets for you, for for documentation, for all the 4 clients, Tommy elan
148 00:18:11.181 ⇒ 00:18:30.679 Awaish Kumar: urban stems and matter more once they are done like maybe today, tomorrow, whenever you, you will be done with them. I can add more tasks to build out those sheets, and then we can decide if you want to take it, or if anybody else want to take it, whatever like we can meet every one of us, and then we can decide.
149 00:18:32.200 ⇒ 00:18:39.690 Caio Velasco: Okay, no, I got it. I got it. But then, last question is about this section here. This can also be in the spreadsheet.
150 00:18:40.400 ⇒ 00:18:41.480 Caio Velasco: All this.
151 00:18:42.510 ⇒ 00:18:44.950 Caio Velasco: This is basically the last tab you showed me.
152 00:18:48.850 ⇒ 00:18:51.210 Awaish Kumar: Yeah, maybe right?
153 00:18:56.860 ⇒ 00:19:19.739 Awaish Kumar: Okay, like that thing, we will. Let’s keep it like that right now. We will discuss it with AI team like how they want to prefer like tabular like Utam said tabular format is is good enough for AI as well. Right? And and you are saying that the of discussion with the it you think this this format in the notion talk
154 00:19:20.030 ⇒ 00:19:21.440 Awaish Kumar: like in a
155 00:19:22.500 ⇒ 00:19:28.869 Awaish Kumar: as a bullet points, is good. So we will finalize with the it which one is. It is good, and we’ll keep it like that.
156 00:19:30.420 ⇒ 00:19:38.570 Caio Velasco: For me. Anything is anything is okay. This, this spreadsheet has everything. So we don’t even need. Honestly, we don’t need this
157 00:19:38.880 ⇒ 00:19:41.890 Caio Velasco: because this can be here. It’s already here.
158 00:19:42.730 ⇒ 00:19:47.849 Awaish Kumar: Yeah, yeah. But I like we, we will build this sheet. But then we will.
159 00:19:47.980 ⇒ 00:19:52.259 Awaish Kumar: I’m what I’m saying is, we copy, paste this these tables into this motion. Doc.
160 00:19:52.850 ⇒ 00:19:56.639 Caio Velasco: Yes, but what I mean is, I don’t need.
161 00:19:56.640 ⇒ 00:20:21.089 Awaish Kumar: You are saying to and flow but that’s that I want to confirm from the item. First, st let’s like, give it. Give me, maybe today to to finalize, like to meet with the it and and ask them instead of this format, if I put it in as a table, will it be good for agent as well? So if they say Okay, and then we will just move forward with what you are saying.
162 00:20:22.326 ⇒ 00:20:23.510 Caio Velasco: Okay, okay, got it.
163 00:20:23.700 ⇒ 00:20:27.219 Caio Velasco: And here would be the same, because this is also another tab.
164 00:20:28.123 ⇒ 00:20:31.440 Caio Velasco: So basically, I don’t have anything else.
165 00:20:31.440 ⇒ 00:20:41.459 Awaish Kumar: Is going to be in a sheet. So, as we mentioned, we will build out 3 sheets data, source documentation, core metrics and data dashboard name as this one, this table
166 00:20:41.590 ⇒ 00:20:42.910 Awaish Kumar: and like.
167 00:20:43.490 ⇒ 00:20:54.260 Awaish Kumar: and then all these tables in this, from the sheet, they will be copied into the notion, notion as well, so as you are showing showing it we will just also copy this one from
168 00:20:54.640 ⇒ 00:21:00.979 Awaish Kumar: from this, the from the sheet. So so like I think you. You got the point right.
169 00:21:01.660 ⇒ 00:21:05.119 Caio Velasco: Yeah, no, I got it. I got it. And then the last point is.
170 00:21:05.260 ⇒ 00:21:09.130 Caio Velasco: so the this page is ready. I don’t have anything else to do.
171 00:21:10.140 ⇒ 00:21:10.820 Awaish Kumar: Sorry.
172 00:21:11.300 ⇒ 00:21:13.639 Caio Velasco: I think this page is ready already.
173 00:21:13.810 ⇒ 00:21:15.620 Caio Velasco: I don’t have anything else to add.
174 00:21:15.620 ⇒ 00:21:32.449 Awaish Kumar: Okay? So that’s okay. Let’s build out similar kind of structure for all of our clients. And when you are done with everything let me know how. We will create some more tickets for these sheets, and then we build the sheets.
175 00:21:33.930 ⇒ 00:21:36.029 Awaish Kumar: That’s the lead forward from here.
176 00:21:36.780 ⇒ 00:21:40.329 Caio Velasco: No perfect perfect. That’s exactly what I posted in the in the chat.
177 00:21:41.690 ⇒ 00:21:42.400 Awaish Kumar: Yeah.
178 00:21:42.700 ⇒ 00:21:46.260 Awaish Kumar: So we are good here. Right? So no more configuration.
179 00:21:47.160 ⇒ 00:21:47.730 Caio Velasco: Yep.
180 00:21:48.000 ⇒ 00:21:58.292 Awaish Kumar: So tomorrow, we kind of want to finalize these documents for Eden. We, we have the 2 sheets built out.
181 00:21:59.140 ⇒ 00:22:06.540 Awaish Kumar: maybe we can just copy paste from there, or build a like the motion document for for Eden, and that will be a good
182 00:22:06.880 ⇒ 00:22:11.509 Awaish Kumar: good document to show the Utam and other team members that. Okay, let’s.
183 00:22:11.670 ⇒ 00:22:16.780 Awaish Kumar: this is how it’s going to look right. Because for Eden we have some tables already.
184 00:22:17.227 ⇒ 00:22:24.170 Awaish Kumar: We can show it to them. And then we can say, Okay, let’s now we are building similar
185 00:22:24.630 ⇒ 00:22:31.549 Awaish Kumar: page for all the clients and for others. We will be missing these tables. Let’s
186 00:22:32.263 ⇒ 00:22:36.259 Awaish Kumar: just finalize this document and then start working on the sheets.
187 00:22:36.560 ⇒ 00:22:43.300 Awaish Kumar: Apart from that, what else you have on your plate?
188 00:22:43.930 ⇒ 00:22:49.220 Caio Velasco: So the only last question I had it’s about fax. I don’t. Fax will be
189 00:22:49.990 ⇒ 00:22:55.699 Caio Velasco: another separate document, or if we them here. But I think it was still gonna ask the AI team right.
190 00:22:55.990 ⇒ 00:23:19.270 Awaish Kumar: No, no faqs. Will be here in this same document. We don’t want it. In a separate page or separate document. It’s it’s going to be simple. FAQ, like, just like, FAQ. Question answering like you are asking me a question. I’m answering it similar way, like, if I ask questions. You answer it like how we do it, just like how we normally read it.
191 00:23:19.600 ⇒ 00:23:24.940 Awaish Kumar: It’s it’s going to similar, like, we Tyler.
192 00:23:24.940 ⇒ 00:23:25.380 Caio Velasco: Thank you.
193 00:23:25.380 ⇒ 00:23:27.969 Awaish Kumar: I don’t see any question answered here.
194 00:23:28.504 ⇒ 00:23:36.285 Awaish Kumar: But yeah, for Pr. Some reason I I did say that we might just move it to it to a next page. But
195 00:23:38.760 ⇒ 00:23:39.280 Awaish Kumar: But for.
196 00:23:39.280 ⇒ 00:23:40.510 Caio Velasco: Yeah, yeah.
197 00:23:40.510 ⇒ 00:23:46.324 Awaish Kumar: This thing that this Faqs are going to be this way. And I I told you that maybe spend
198 00:23:46.900 ⇒ 00:23:52.139 Awaish Kumar: an hour to searching like the questions you asked
199 00:23:52.280 ⇒ 00:24:04.870 Awaish Kumar: Robert or me, or anyone else about Javi and and our answers. If you have them written anywhere in slack, like slack history you can copy, paste it here. I don’t want like you.
200 00:24:05.090 ⇒ 00:24:09.479 Awaish Kumar: brainstorm. Find out the question, find out the answer in the back and build it. But just
201 00:24:10.330 ⇒ 00:24:17.860 Awaish Kumar: just when searching in slack. If you have already something which we can put in there as our initial set of FAQ.
202 00:24:19.190 ⇒ 00:24:26.869 Caio Velasco: Okay, okay, okay, got it. And would you say the same about even though you don’t said that this is not priority.
203 00:24:28.654 ⇒ 00:24:31.096 Awaish Kumar: This one is
204 00:24:33.150 ⇒ 00:24:43.080 Awaish Kumar: This one is like this one. Demo is working on it right? We have separate page. You have already created a template. And now that it’s
205 00:24:43.614 ⇒ 00:24:54.090 Awaish Kumar: like he’s not here today. But I know maybe we will. We get an update from him. But he’s researching on how to do that, how to
206 00:24:54.320 ⇒ 00:25:01.010 Awaish Kumar: for each run for each pr, how we are going to push updates to this page. So that’s like
207 00:25:01.680 ⇒ 00:25:06.199 Awaish Kumar: working on researching it. And then he’s going to implement that part.
208 00:25:07.260 ⇒ 00:25:15.139 Caio Velasco: Okay, okay, got it. And and the video, any any news about this part or.
209 00:25:17.110 ⇒ 00:25:18.130 Awaish Kumar: On
210 00:25:19.520 ⇒ 00:25:32.850 Awaish Kumar: videos and groups. So so zoom videos are already like Zoom Meetings for each client are already being transferred to AI agent. Right? So we don’t need to take care of them. And for zoom we.
211 00:25:33.030 ⇒ 00:25:35.960 Awaish Kumar: we are going to build a pipeline if needed.
212 00:25:36.070 ⇒ 00:25:38.510 Awaish Kumar: Yeah, but we don’t need them. With this speech.
213 00:25:41.040 ⇒ 00:25:42.490 Caio Velasco: So then I can just delete.
214 00:25:42.490 ⇒ 00:25:56.330 Awaish Kumar: Yeah, you you can. Just you can just put it as a links, like, maybe zoom recordings page like you can click on this link to get to the link room recordings and then click on this link to get the zoom recordings.
215 00:25:56.570 ⇒ 00:26:00.259 Awaish Kumar: But there will be only 2 links here like nothing else.
216 00:26:02.010 ⇒ 00:26:02.570 Caio Velasco: Okay?
217 00:26:05.650 ⇒ 00:26:08.549 Caio Velasco: Oh, so I think on my end is all good.
218 00:26:09.010 ⇒ 00:26:17.819 Awaish Kumar: Okay, great Luke, how you doing? Sorry we we were just going over this talk.
219 00:26:19.420 ⇒ 00:26:21.399 Luke Daque: Yeah, no worries. I’m doing good.
220 00:26:21.700 ⇒ 00:26:25.499 Luke Daque: Maybe we can talk about the next steps for Meta playing.
221 00:26:25.740 ⇒ 00:26:30.349 Luke Daque: I think Uton has a few like he wants to
222 00:26:31.230 ⇒ 00:26:36.120 Luke Daque: add it to the other clients as well, like maybe full parts, and more than I don’t know.
223 00:26:36.310 ⇒ 00:26:40.055 Awaish Kumar: Yes, we want to add it like but
224 00:26:41.657 ⇒ 00:26:46.330 Awaish Kumar: but I I’m not seeing like I
225 00:26:46.770 ⇒ 00:26:53.405 Awaish Kumar: pr for Indian. I’m seeing foundational messages, but on the Pr. I’m not seeing any reports
226 00:26:54.030 ⇒ 00:26:56.980 Awaish Kumar: on the Pr. Like Pr. Thing as a Pr. Comments.
227 00:26:59.230 ⇒ 00:27:00.850 Luke Daque: Hmm. I see.
228 00:27:01.090 ⇒ 00:27:08.969 Luke Daque: Maybe it’s not working as intended. Then maybe we need. We need a different workflow just for Pr.
229 00:27:08.970 ⇒ 00:27:13.929 Awaish Kumar: Finalize this like we, I want to. I want final Caden to have
230 00:27:14.110 ⇒ 00:27:25.439 Awaish Kumar: everything that’s needed, and then let’s on board the team and then build it out for all the clients. So these are the next steps.
231 00:27:27.050 ⇒ 00:27:29.390 Luke Daque: Sure, can you.
232 00:27:29.390 ⇒ 00:27:30.079 Awaish Kumar: He didn’t. We want.
233 00:27:30.080 ⇒ 00:27:33.970 Luke Daque: We already knew create this one. The bug fix one.
234 00:27:36.170 ⇒ 00:27:38.340 Luke Daque: Is this the Pr that you were mentioning.
235 00:27:38.340 ⇒ 00:27:48.300 Awaish Kumar: Like any. Pr, this, this is one of the examples. I created 1 1 other which just merged now. But yeah, there! There was no comments.
236 00:27:49.650 ⇒ 00:27:56.310 Luke Daque: I see. And is that the only thing that we want for from Meta plane? Or do we need other stuff like monitoring.
237 00:27:56.310 ⇒ 00:27:58.400 Awaish Kumar: Like, did you? Added the testing.
238 00:27:59.393 ⇒ 00:27:59.979 Luke Daque: I have.
239 00:27:59.980 ⇒ 00:28:00.750 Awaish Kumar: The monitors right.
240 00:28:00.750 ⇒ 00:28:01.110 Luke Daque: But.
241 00:28:01.110 ⇒ 00:28:04.853 Awaish Kumar: I created that ticket for you to add those.
242 00:28:05.270 ⇒ 00:28:05.810 Luke Daque: Same.
243 00:28:06.820 ⇒ 00:28:10.100 Awaish Kumar: So I want each table in Mars
244 00:28:11.198 ⇒ 00:28:13.829 Awaish Kumar: like in the for 18 months
245 00:28:14.424 ⇒ 00:28:19.660 Awaish Kumar: for every table we like. I have some things in my mind. Which?
246 00:28:20.190 ⇒ 00:28:25.859 Awaish Kumar: Which I I think you, I I’m writing here in the chat. Maybe you can create ticket for each of them.
247 00:28:26.320 ⇒ 00:28:30.130 Awaish Kumar: and then we can decide. Let’s talk tomorrow, or
248 00:28:30.410 ⇒ 00:28:33.019 Awaish Kumar: and the deadlines and the points.
249 00:28:33.410 ⇒ 00:28:41.010 Awaish Kumar: But let’s like number one. We want to fix this beyond comments.
250 00:28:41.510 ⇒ 00:28:45.839 Awaish Kumar: Number 2 is, add Dbt tests.
251 00:28:47.136 ⇒ 00:28:50.679 Awaish Kumar: like add test, basically that monitors
252 00:28:52.340 ⇒ 00:28:55.600 Awaish Kumar: which are which are going to be.
253 00:28:58.960 ⇒ 00:29:04.159 Luke Daque: So wouldn’t that be a duplicate test, though, like, if we create the same testing, not a plane.
254 00:29:04.160 ⇒ 00:29:04.790 Awaish Kumar: Sorry.
255 00:29:05.740 ⇒ 00:29:11.010 Luke Daque: Like we already you mentioned. We already have DVD tests right?
256 00:29:11.010 ⇒ 00:29:11.380 Awaish Kumar: I.
257 00:29:11.380 ⇒ 00:29:13.890 Luke Daque: Train. Would that be a duplicate test, then.
258 00:29:13.890 ⇒ 00:29:25.739 Awaish Kumar: So we have some DVD tests, some some built in and like normal, unique, these kind of thing. And then some tests. We have, like custom tests like in the test, folder.
259 00:29:28.360 ⇒ 00:29:33.150 Awaish Kumar: Yeah. And I want I just want them to be moved like.
260 00:29:33.480 ⇒ 00:29:43.360 Awaish Kumar: not move, but just copied right there in the Dbt, let’s add it in Meta plane, and then we can see like which one is better. Meta plane or Dbt.
261 00:29:43.720 ⇒ 00:29:44.490 Luke Daque: Okay.
262 00:29:45.030 ⇒ 00:29:48.520 Awaish Kumar: I add custom test there. Add this.
263 00:29:48.780 ⇒ 00:29:54.221 Awaish Kumar: got it to to build a test there for Eden, fixed beyond comments.
264 00:29:56.380 ⇒ 00:30:03.480 Awaish Kumar: And then we number 3. I but I want want to know.
265 00:30:03.630 ⇒ 00:30:20.050 Awaish Kumar: Wonderful is for the Dbt, yeah, add freshness tests like freshness test monitors. And for all the
266 00:30:21.420 ⇒ 00:30:23.420 Awaish Kumar: a masterms.
267 00:30:26.220 ⇒ 00:30:28.990 Caio Velasco: And what else we have.
268 00:30:31.000 ⇒ 00:30:35.290 Awaish Kumar: If you click on oops and the.
269 00:30:38.570 ⇒ 00:30:40.289 Luke Daque: There seems to be default, monitor
270 00:30:41.520 ⇒ 00:30:44.540 Luke Daque: duration of the DVD runs like this one.
271 00:30:45.660 ⇒ 00:30:46.679 Luke Daque: We need this
272 00:30:47.667 ⇒ 00:30:53.569 Luke Daque: we. It seems to have like default monitors, for, like Dbt. Or run durations like this one.
273 00:30:53.690 ⇒ 00:30:54.219 Luke Daque: like there.
274 00:30:54.220 ⇒ 00:30:57.609 Awaish Kumar: Yeah, it’s okay, like, it’s, it’s if it’s spider
275 00:30:57.970 ⇒ 00:31:00.650 Awaish Kumar: language. It’s a good plan. We can see it right.
276 00:31:01.330 ⇒ 00:31:01.740 Luke Daque: Okay.
277 00:31:02.720 ⇒ 00:31:12.900 Awaish Kumar: But I want to have want you to spend some time on this like staging
278 00:31:20.590 ⇒ 00:31:21.830 Awaish Kumar: or so
279 00:31:25.870 ⇒ 00:31:27.699 Awaish Kumar: to installation.
280 00:31:28.040 ⇒ 00:31:28.980 Awaish Kumar: Yes.
281 00:31:32.150 ⇒ 00:31:36.620 Awaish Kumar: excuse me, please.
282 00:31:36.760 ⇒ 00:31:46.920 Awaish Kumar: And maybe you know one on the Pr when we create a Pr, we are going to hit a.
283 00:31:49.560 ⇒ 00:31:58.343 Awaish Kumar: okay, let’s yeah, let’s focus on these things for eating. I I I don’t expect that you
284 00:31:59.400 ⇒ 00:32:03.210 Awaish Kumar: add like, like, whole lot of tests
285 00:32:03.662 ⇒ 00:32:21.449 Awaish Kumar: for like for number 2, just copy over whatever is activity test for 3. Just add for march table, and it’s quite easy, because it’s it will be by few clicks. You can just add it for number 4 and 5, and maybe even like one or 2 to test for
286 00:32:21.700 ⇒ 00:32:29.519 Awaish Kumar: for these, for as an initial state will be good enough like you need to just find out, like, if we can do it
287 00:32:29.860 ⇒ 00:32:40.150 Awaish Kumar: with the Meta plan and how we can, because, like in the documents, this documentation, they do say that we can perform staging versus production teams like, if I
288 00:32:40.630 ⇒ 00:32:49.000 Awaish Kumar: create a Pr and it runs something and it goes to staging
289 00:32:49.290 ⇒ 00:32:56.632 Awaish Kumar: like in case a new table is stating, and we already have something in production. So now we compare, like
290 00:32:57.190 ⇒ 00:33:00.830 Awaish Kumar: like the diff between them, right? So
291 00:33:01.370 ⇒ 00:33:05.360 Awaish Kumar: kind of not the test. We can say like difference.
292 00:33:05.900 ⇒ 00:33:07.650 Awaish Kumar: So between staging and
293 00:33:07.840 ⇒ 00:33:14.320 Awaish Kumar: and production there will be difference like there’s a table like fact orders and the staging. We have maybe
294 00:33:14.460 ⇒ 00:33:20.869 Awaish Kumar: okay, 10,000. I’m missing
295 00:33:21.100 ⇒ 00:33:24.089 Awaish Kumar: because of this Pr change.
296 00:33:24.250 ⇒ 00:33:26.120 Awaish Kumar: Correct? Something like that. So
297 00:33:26.651 ⇒ 00:33:36.559 Awaish Kumar: that’s why. What what I mean from this study was this production, if source was destination? Is that compared to raw like compared to raw table
298 00:33:37.017 ⇒ 00:33:42.010 Awaish Kumar: like, if we have link over all the data like we have order. I, for example, order Ids.
299 00:33:42.791 ⇒ 00:33:45.948 Awaish Kumar: we expect that all if we have
300 00:33:46.930 ⇒ 00:33:58.499 Awaish Kumar: raw order table, which has 1,000 order Ids that in the production order table there should be 1,000 order Ids. As well. So source was his production. Staging was production. Please
301 00:33:58.870 ⇒ 00:34:04.630 Awaish Kumar: these deals. So desktop.
302 00:34:05.334 ⇒ 00:34:08.729 Awaish Kumar: If if you just find out how to
303 00:34:09.080 ⇒ 00:34:20.060 Awaish Kumar: do it and just add, maybe add a couple like 1, 2, 1, 2 for each. So we have a proof of concept like, okay, that’s all we can do within it.
304 00:34:20.239 ⇒ 00:34:22.425 Awaish Kumar: Then we can move forward, and
305 00:34:23.139 ⇒ 00:34:25.329 Awaish Kumar: and what you say like, we can
306 00:34:25.780 ⇒ 00:34:28.390 Awaish Kumar: roll out it for other clients as well.
307 00:34:29.500 ⇒ 00:34:30.300 Luke Daque: Okay.
308 00:34:30.790 ⇒ 00:34:31.840 Luke Daque: Sounds good.
309 00:34:32.980 ⇒ 00:34:35.799 Awaish Kumar: So yeah, we can split them
310 00:34:37.120 ⇒ 00:34:41.350 Awaish Kumar: out in separate tickets each one of them is going to take some time.
311 00:34:45.020 ⇒ 00:34:47.145 Luke Daque: Yeah, I’ll I’ll do that. Then.
312 00:34:47.679 ⇒ 00:34:51.249 Awaish Kumar: So let’s spend some time on this.
313 00:34:51.399 ⇒ 00:34:59.179 Awaish Kumar: I know the most apply to all other clients, and I’m also. But yeah, I wanted.
314 00:35:00.319 ⇒ 00:35:03.379 Awaish Kumar: I want to say, see the analytics
315 00:35:04.359 ⇒ 00:35:07.369 Awaish Kumar: we are utilizing all its capabilities for.
316 00:35:07.619 ⇒ 00:35:10.689 Awaish Kumar: And then we can move forward like it’s easier once
317 00:35:11.518 ⇒ 00:35:24.159 Awaish Kumar: once we build it like that. It’s easier because we can on board. It’s it’s why based. And mostly we, then we can on board everybody in the team, right to write tests like data analysts can just themselves write tests.
318 00:35:24.679 ⇒ 00:35:35.959 Awaish Kumar: If he thinks something I can write test. If I think, okay, let’s that’s something I we should add, so everybody can just go in. Ui added the custom test.
319 00:35:39.010 ⇒ 00:35:39.889 Luke Daque: Sounds good.
320 00:35:42.940 ⇒ 00:35:49.299 Awaish Kumar: Okay, that’s the direction. Let’s meet tomorrow to look at the tickets, find out
321 00:35:49.810 ⇒ 00:35:56.600 Awaish Kumar: again. Prepare the like, the deadlines and the and the and points for each ticket.
322 00:35:59.810 ⇒ 00:36:02.359 Awaish Kumar: Okay, okay, anything else.
323 00:36:04.540 ⇒ 00:36:05.859 Caio Velasco: No! For me, no!
324 00:36:11.160 ⇒ 00:36:17.200 Awaish Kumar: Okay, thank you. For your time. Have a great week ahead.
325 00:36:18.840 ⇒ 00:36:20.719 Caio Velasco: You wish you, too. Bye-bye.