Meeting Title: Engineering Task Review and Updates Date: 2025-07-14 Meeting participants: Awaish Kumar, Vishnu
WEBVTT
1 00:01:32.310 ⇒ 00:01:36.000 Awaish Kumar: No before.
2 00:01:36.400 ⇒ 00:01:36.980 Awaish Kumar: Hello!
3 00:01:37.500 ⇒ 00:01:39.639 Vishnu: Hello! Good morning, avesh.
4 00:01:41.380 ⇒ 00:01:42.640 Awaish Kumar: How you doing?
5 00:01:45.009 ⇒ 00:01:45.769 Awaish Kumar: Sorry!
6 00:01:47.060 ⇒ 00:01:48.290 Awaish Kumar: How are you doing.
7 00:01:48.920 ⇒ 00:01:54.890 Vishnu: I’m good avish your voice is like, super unclear or do you?
8 00:01:57.900 ⇒ 00:02:01.309 Vishnu: Yes, okay, so, Avesh, I just wanted to.
9 00:02:01.790 ⇒ 00:02:03.940 Vishnu: I will give you an update.
10 00:02:05.164 ⇒ 00:02:08.139 Awaish Kumar: To the linear mode.
11 00:02:08.720 ⇒ 00:02:10.889 Awaish Kumar: We have a good year.
12 00:02:13.751 ⇒ 00:02:15.809 Awaish Kumar: So I saw your Pr
13 00:02:16.150 ⇒ 00:02:25.819 Awaish Kumar: about the operating. I’ve reviewed it. It looks fine. Only one thing is missing is, we need to add a schedule for our job.
14 00:02:26.620 ⇒ 00:02:33.020 Awaish Kumar: and I have commented that it’s in the in the same repository. There’s a
15 00:02:33.170 ⇒ 00:02:37.280 Awaish Kumar: file in the root folder. It’s called representative. Ey.
16 00:02:37.820 ⇒ 00:02:42.879 Awaish Kumar: we just need to address schedule there. So you can see there are other examples there.
17 00:02:43.420 ⇒ 00:02:46.990 Awaish Kumar: and that’s it. After that we can merge it.
18 00:02:49.870 ⇒ 00:02:51.720 Vishnu: So? How? How?
19 00:02:51.720 ⇒ 00:02:52.080 Awaish Kumar: What about?
20 00:02:52.080 ⇒ 00:02:54.589 Vishnu: Add a scheduler like Cron, job.
21 00:02:55.120 ⇒ 00:03:02.779 Awaish Kumar: No, no, you just go in there in the Repository Dot pi. You can see there are, like other examples of pipelines
22 00:03:03.660 ⇒ 00:03:06.530 Awaish Kumar: which are already running right. I can show you here.
23 00:03:08.290 ⇒ 00:03:14.879 Awaish Kumar: So we there are already some pipelines which are running here we have this file.
24 00:03:18.160 ⇒ 00:03:21.989 Awaish Kumar: and these are the schedules. So you have to write something like this.
25 00:03:23.450 ⇒ 00:03:24.420 Vishnu: Okay.
26 00:03:24.420 ⇒ 00:03:28.300 Awaish Kumar: And return it from. In this parameter of this function.
27 00:03:29.620 ⇒ 00:03:34.409 Vishnu: Got it. Okay, this is a repository. Okay, I, okay, I’ll implement that.
28 00:03:35.320 ⇒ 00:03:43.630 Awaish Kumar: And yeah, go back to this one. So we are kind of in the 4
29 00:03:44.140 ⇒ 00:03:48.299 Awaish Kumar: operating task. I think I think you have moved it to done.
30 00:03:50.330 ⇒ 00:03:51.460 Vishnu: Yes, yes.
31 00:03:54.050 ⇒ 00:03:54.810 Awaish Kumar: Okay, well, let’s.
32 00:03:54.810 ⇒ 00:03:56.869 Vishnu: I just moved it to done yesterday.
33 00:03:57.390 ⇒ 00:04:02.860 Awaish Kumar: In progress to we cannot impeachment hell.
34 00:04:03.660 ⇒ 00:04:04.700 Vishnu: Yes. Okay.
35 00:04:07.560 ⇒ 00:04:10.519 Awaish Kumar: I will see how we can maybe add more.
36 00:04:12.550 ⇒ 00:04:15.620 Awaish Kumar: I want to add one more column.
37 00:04:18.810 ⇒ 00:04:19.560 Vishnu: Okay.
38 00:04:20.500 ⇒ 00:04:27.572 Awaish Kumar: But we will. I’ll do that afterwards. And yeah, so that what it is in testing, for example, you, you will add
39 00:04:29.110 ⇒ 00:04:32.026 Awaish Kumar: testing and review. So you will add it at
40 00:04:32.600 ⇒ 00:04:38.190 Awaish Kumar: schedule, and we we can merge it and test it if it is working. So we just leave it.
41 00:04:38.530 ⇒ 00:04:43.819 Awaish Kumar: Otherwise you have to fix. And apart from that, what about this one.
42 00:04:45.662 ⇒ 00:04:51.470 Vishnu: This I was not able to solve the Snowflake issue like, Oh.
43 00:04:51.470 ⇒ 00:04:52.080 Awaish Kumar: This.
44 00:04:52.220 ⇒ 00:04:55.619 Vishnu: On on Friday I had again spent like 3 h on this.
45 00:04:55.620 ⇒ 00:04:56.180 Awaish Kumar: You.
46 00:04:56.690 ⇒ 00:05:02.630 Awaish Kumar: I shared you the username and how you access it. Right? What was the issue that you couldn’t solve?
47 00:05:03.845 ⇒ 00:05:06.410 Awaish Kumar: I share the exact code, right? How you can.
48 00:05:06.410 ⇒ 00:05:12.999 Vishnu: Yes, yes, so I don’t know like I was like unable to.
49 00:05:13.000 ⇒ 00:05:18.060 Awaish Kumar: But can you share the the issue? You are getting to us? So in the
50 00:05:18.520 ⇒ 00:05:22.380 Awaish Kumar: in the slack there’s a channel called Engineering
51 00:05:22.860 ⇒ 00:05:25.870 Awaish Kumar: the dev support. Sorry the Dev support.
52 00:05:26.330 ⇒ 00:05:32.890 Awaish Kumar: maybe try. Just put it there like, what is the error you are getting? So you can unblock you like the doubt
53 00:05:33.610 ⇒ 00:05:36.490 Awaish Kumar: any input, like we don’t know what’s happening.
54 00:05:37.050 ⇒ 00:05:52.371 Vishnu: Yes, okay, okay, okay. So I, I’ll do that. And I was just asking you like, would it be possible for you to like redistribute the other tasks like, because again last week was like super heavy and super
55 00:05:53.750 ⇒ 00:05:54.120 Vishnu: like.
56 00:05:54.490 ⇒ 00:05:58.840 Awaish Kumar: But I I don’t think we haven’t done much in the last week.
57 00:05:59.290 ⇒ 00:06:14.810 Vishnu: Exactly. Yes, that so I I was not able to like spend a a lot like I didn’t give my 100% here. So that, that’s gonna change this week. But then again, like, if you could like redistribute to one task, it would be good like
58 00:06:15.190 ⇒ 00:06:18.219 Vishnu: like the productivity dashboard.
59 00:06:20.840 ⇒ 00:06:29.549 Awaish Kumar: But the issue. The thing is, Abigail is not here yet, and we don’t like this is these projects which we are working on. They are specifically
60 00:06:31.841 ⇒ 00:06:45.420 Awaish Kumar: like for this internal team. We don’t have any people working on this. So we have people, you and Abigail throughout. And this one is like the crucial part of this project, because
61 00:06:45.810 ⇒ 00:06:48.199 Awaish Kumar: with you building the back end
62 00:06:48.768 ⇒ 00:06:53.550 Awaish Kumar: we don’t have anything to show to our team members like what we have done like.
63 00:06:53.700 ⇒ 00:07:01.130 Awaish Kumar: So, for example, if we in the Friday retro, for example, if we go just with this back end, pipeline, what you are, gonna see right?
64 00:07:01.240 ⇒ 00:07:03.859 Awaish Kumar: Only the data team or engineering team like we
65 00:07:04.270 ⇒ 00:07:07.150 Awaish Kumar: 5, 6 people can understand what you’re saying.
66 00:07:07.280 ⇒ 00:07:09.519 Awaish Kumar: But everybody else like from
67 00:07:10.263 ⇒ 00:07:22.259 Awaish Kumar: marketing sales operations. They don’t know like without without them seeing anything. They just like see some like few lines of code, and they don’t understand what’s what’s happening.
68 00:07:22.260 ⇒ 00:07:27.269 Vishnu: Yeah, okay, okay. Got it. Then, okay, okay, I’ll I’ll push through. Okay.
69 00:07:27.550 ⇒ 00:07:31.486 Awaish Kumar: Whenever, if she’s back, we we can just assign these
70 00:07:32.453 ⇒ 00:07:38.589 Awaish Kumar: dashboard. Ask to her, but until she’s back like we, we don’t have anyone else.
71 00:07:39.600 ⇒ 00:07:52.219 Vishnu: Got it. Okay? So another. Another thing I wanted to bring it up with you is in in project management thread with them said operating data model CC, Vishnu. And he, like
72 00:07:53.070 ⇒ 00:08:02.843 Vishnu: shared a bunch of like stuff under that, he said. Let’s move this raw data to so and so file. And when I open that file it is clockify hours export automation. So
73 00:08:03.370 ⇒ 00:08:09.320 Vishnu: I, I did not understand what I have to do here like I’ll just send you the screenshot on your slack.
74 00:08:10.530 ⇒ 00:08:13.109 Awaish Kumar: He did like. He messaged you directly or from your.
75 00:08:13.110 ⇒ 00:08:16.999 Vishnu: No, so it’s a public on the project management thread.
76 00:08:17.990 ⇒ 00:08:23.019 Awaish Kumar: Okay, I can give you, did he tag you? Okay.
77 00:08:23.020 ⇒ 00:08:27.600 Vishnu: Yes, he tagged me. It it’s it was on Saturday, 1 49 Pm.
78 00:08:28.840 ⇒ 00:08:34.049 Awaish Kumar: Just make sure I can all the previous people.
79 00:08:39.280 ⇒ 00:08:47.390 Awaish Kumar: This cheat is okay, he’s asking you to, just
80 00:08:47.550 ⇒ 00:08:54.180 Awaish Kumar: from like, create all those sheets which you are creating in the in this, in your sheet, into this one.
81 00:08:54.670 ⇒ 00:08:59.270 Awaish Kumar: So we just want to write that data into this sheet.
82 00:09:01.030 ⇒ 00:09:02.089 Vishnu: Oh, okay.
83 00:09:02.450 ⇒ 00:09:02.970 Awaish Kumar: In, your.
84 00:09:02.970 ⇒ 00:09:04.500 Vishnu: Please, move this raw data.
85 00:09:04.700 ⇒ 00:09:06.399 Awaish Kumar: You just have to change this
86 00:09:06.510 ⇒ 00:09:12.525 Awaish Kumar: sheet Id, and it it will upload it here, and then maybe give access to Dbt. Cloud
87 00:09:15.130 ⇒ 00:09:20.080 Vishnu: Okay, okay, so it it already has the access.
88 00:09:20.360 ⇒ 00:09:23.479 Awaish Kumar: So g sheets. Reader, already has the access.
89 00:09:24.280 ⇒ 00:09:24.610 Vishnu: Okay.
90 00:09:24.610 ⇒ 00:09:29.710 Awaish Kumar: So if you are using the same service account, you just have to change the
91 00:09:30.351 ⇒ 00:09:31.910 Awaish Kumar: sheets. Id, and that’s all.
92 00:09:31.910 ⇒ 00:09:32.380 Vishnu: Okay.
93 00:09:32.380 ⇒ 00:09:33.959 Awaish Kumar: That’s nothing much here.
94 00:09:35.200 ⇒ 00:09:36.790 Vishnu: Change the sheet id.
95 00:09:37.800 ⇒ 00:09:39.050 Awaish Kumar: And only.
96 00:09:42.830 ⇒ 00:09:47.869 Vishnu: Okay, that will be done then. Another thing he asked was.
97 00:09:48.705 ⇒ 00:09:51.894 Vishnu: If I go to clock if I
98 00:09:52.650 ⇒ 00:09:55.642 Vishnu: He had left a comment here somewhere
99 00:09:57.560 ⇒ 00:09:58.240 Awaish Kumar: I.
100 00:09:59.386 ⇒ 00:10:03.129 Vishnu: No utham had left a comment here near person.
101 00:10:08.170 ⇒ 00:10:12.160 Awaish Kumar: Like. Are you sharing the screen like where he has commented.
102 00:10:12.600 ⇒ 00:10:13.450 Awaish Kumar: Keep there.
103 00:10:13.450 ⇒ 00:10:15.520 Vishnu: 1 min I’ll share the screen
104 00:10:37.160 ⇒ 00:10:39.268 Vishnu: here, he he asked us.
105 00:10:40.570 ⇒ 00:10:49.539 Vishnu: I want to match projects and operating with contracts we have with clients using. q. 1. q. 2, q. 3. Is that my? Is that something I have to do, or it’s worth others.
106 00:10:49.540 ⇒ 00:10:51.310 Awaish Kumar: We have at the link
107 00:10:56.210 ⇒ 00:10:58.670 Awaish Kumar: match projects in upgrading.
108 00:10:59.700 ⇒ 00:11:03.160 Awaish Kumar: So in operating, we have projects right.
109 00:11:03.160 ⇒ 00:11:03.910 Vishnu: Yes.
110 00:11:04.700 ⇒ 00:11:10.190 Awaish Kumar: And we have like for each project, we will have some hours
111 00:11:10.820 ⇒ 00:11:17.650 Awaish Kumar: assigned to that project, and we somehow have users like Project for example, internship project.
112 00:11:18.620 ⇒ 00:11:31.800 Awaish Kumar: Vishnu and Abigail working both 2020 h. And then we have a client contract on the side where we want. We are saying, okay for this client. I want to. We want to. We have signed a contract for
113 00:11:32.230 ⇒ 00:11:39.159 Awaish Kumar: 80 h per month or 1 60 h per month, something like that. So what you have to do basically
114 00:11:39.540 ⇒ 00:11:43.819 Awaish Kumar: let me. Let’s go. Let let me share my screen.
115 00:11:44.430 ⇒ 00:11:45.060 Vishnu: Okay.
116 00:11:46.905 ⇒ 00:11:51.150 Awaish Kumar: We will. But like that is exactly the Tbt product right?
117 00:11:53.350 ⇒ 00:11:59.060 Awaish Kumar: So if like, so we actually wanted to chrome.
118 00:11:59.847 ⇒ 00:12:08.890 Awaish Kumar: So what? Yeah? So for example, like, let’s let’s give this task a priority plug in?
119 00:12:09.831 ⇒ 00:12:16.259 Awaish Kumar: Okay, and share like, what is the issue like with this task, share your like, maybe create a room video.
120 00:12:17.310 ⇒ 00:12:17.720 Vishnu: Okay.
121 00:12:17.720 ⇒ 00:12:28.530 Awaish Kumar: And then the logs of the error put, put like copy paste the logs of the errors in this ticket, and put a URL of the room video, I will check it, and I can. Maybe I can then
122 00:12:29.250 ⇒ 00:12:33.590 Awaish Kumar: show you how to solve it. Otherwise we can meet again just just for that.
123 00:12:34.480 ⇒ 00:12:35.890 Vishnu: Okay, okay. I’ll do that.
124 00:12:35.890 ⇒ 00:12:38.760 Awaish Kumar: If it’s not solved, we will just like pair program.
125 00:12:39.470 ⇒ 00:12:40.140 Vishnu: Okay.
126 00:12:40.140 ⇒ 00:12:48.080 Awaish Kumar: Sometime. And yeah, this one I just like right now we can move it down.
127 00:12:48.650 ⇒ 00:12:53.370 Awaish Kumar: Second, yeah, like, this is kind of I, I would say, kind of just
128 00:12:53.630 ⇒ 00:12:56.479 Awaish Kumar: do what I’ve said, and just leave it right now
129 00:12:56.720 ⇒ 00:13:01.059 Awaish Kumar: and then. This Tbt project is the give it a priority.
130 00:13:01.667 ⇒ 00:13:07.230 Awaish Kumar: Just create a repository in the Github Repo as an intern DVD project.
131 00:13:08.140 ⇒ 00:13:14.909 Awaish Kumar: and instead of that, create a like a template DVD project. And then in the models
132 00:13:15.180 ⇒ 00:13:19.840 Awaish Kumar: folder. We are going to create some models right?
133 00:13:20.000 ⇒ 00:13:26.049 Awaish Kumar: And if one of the model is that so? What what that model will be doing?
134 00:13:26.460 ⇒ 00:13:27.420 Awaish Kumar: Wow!
135 00:13:28.460 ⇒ 00:13:31.249 Awaish Kumar: I’m not sure if if Dbt can read from
136 00:13:31.870 ⇒ 00:13:34.803 Awaish Kumar: sheets, okay, what you have to do is
137 00:13:38.190 ⇒ 00:13:41.199 Awaish Kumar: yeah. That’s why I wanted to convince.
138 00:13:46.570 ⇒ 00:13:56.879 Awaish Kumar: Okay, so so you can create, like the Dbt project, cannot directly read, excel sheets on the Google sheets.
139 00:13:57.060 ⇒ 00:13:58.010 Vishnu: Okay.
140 00:13:58.260 ⇒ 00:14:00.399 Awaish Kumar: So that’s the problem.
141 00:14:00.600 ⇒ 00:14:04.459 Awaish Kumar: Okay, like, we have to write it somewhere.
142 00:14:05.880 ⇒ 00:14:08.230 Awaish Kumar: Let’s write it in the like. Let’s
143 00:14:08.430 ⇒ 00:14:14.059 Awaish Kumar: let’s focus on the this one part connecting with snowflake.
144 00:14:14.953 ⇒ 00:14:18.339 Awaish Kumar: So we can. Also write this data.
145 00:14:18.850 ⇒ 00:14:25.449 Awaish Kumar: So we’ll like store clockify data and the operating data both in snowflake.
146 00:14:25.840 ⇒ 00:14:27.790 Awaish Kumar: So whatever the issue is, just
147 00:14:28.822 ⇒ 00:14:32.647 Awaish Kumar: share the logs, share the room everything with me, and
148 00:14:33.340 ⇒ 00:14:35.129 Awaish Kumar: I can guide you through it.
149 00:14:37.580 ⇒ 00:14:38.310 Vishnu: Okay.
150 00:14:38.640 ⇒ 00:14:43.550 Awaish Kumar: In the, in the this, in this, in the digester, pipeline. Right?
151 00:14:44.020 ⇒ 00:14:45.390 Awaish Kumar: And
152 00:14:46.950 ⇒ 00:14:56.380 Awaish Kumar: apart from that, we. And then we will see, like when the data is in Snowflake. It will be easier for us to go to the Dbt project, connect with Snowflake and
153 00:14:58.510 ⇒ 00:15:00.149 Awaish Kumar: understand more than 2.
154 00:15:01.050 ⇒ 00:15:06.330 Vishnu: Okay. So 1st let me complete clock if I will. Again. Redo, try to redo it.
155 00:15:06.330 ⇒ 00:15:07.890 Awaish Kumar: Like, don’t go to.
156 00:15:08.860 ⇒ 00:15:12.360 Awaish Kumar: Yeah. Just like, first, st let’s work on
157 00:15:12.510 ⇒ 00:15:20.609 Awaish Kumar: like establishing the connection. I’m I’m not sure why you are getting that error. And let’s focus like, focus on that one. I want.
158 00:15:20.610 ⇒ 00:15:21.310 Vishnu: Okay.
159 00:15:21.750 ⇒ 00:15:24.350 Awaish Kumar: One problem on that part. Then we can.
160 00:15:24.350 ⇒ 00:15:24.990 Vishnu: Okay.
161 00:15:24.990 ⇒ 00:15:29.729 Awaish Kumar: Work on this marketing data like the clock. If I to Snowflake, or according to Snowflake.
162 00:15:30.390 ⇒ 00:15:35.940 Awaish Kumar: both are okay, like everything else, will be the same except this, if you are unblocked.
163 00:15:37.530 ⇒ 00:15:47.880 Awaish Kumar: Then you can like loading data from, like, you already have data, some in some data frames, right? When getting from Apis.
164 00:15:48.480 ⇒ 00:15:54.429 Awaish Kumar: So now, what is the actual code like? Put this data frame into the snowflake, that the part will
165 00:15:54.960 ⇒ 00:16:01.649 Awaish Kumar: that that can be reused in both clockify pipeline and also just copy paste and operating pipeline.
166 00:16:01.980 ⇒ 00:16:05.780 Awaish Kumar: So that’s the same piece of code. And the only thing that’s blocking you is
167 00:16:07.291 ⇒ 00:16:12.708 Awaish Kumar: getting connected to something. So let’s focus on that part.
168 00:16:14.320 ⇒ 00:16:16.436 Awaish Kumar: I’m I’m free of like
169 00:16:21.730 ⇒ 00:16:22.400 Vishnu: Cool.
170 00:16:22.400 ⇒ 00:16:24.530 Awaish Kumar: After like 45 min.
171 00:16:24.920 ⇒ 00:16:26.648 Awaish Kumar: Okay, so let’s let’s
172 00:16:27.420 ⇒ 00:16:34.990 Awaish Kumar: share your errors with me in the meantime, and I I will go get back to you after after my few other meetings.
173 00:16:35.670 ⇒ 00:16:42.670 Vishnu: Okay. Okay, yes, okay. I wish I’ll do that. And I’ll I’ll keep you updated today.