Meeting Title: Data Model Debugging Sync Date: 2025-07-25 Meeting participants: luke, Annie Yu, Awaish Kumar
WEBVTT
1 00:00:31.370 ⇒ 00:00:32.670 Annie Yu: Hello! Look!
2 00:00:36.180 ⇒ 00:00:37.950 Annie Yu: Hi again! I’m
3 00:00:39.730 ⇒ 00:00:52.769 Annie Yu: I’m not sure if I think I wish set this up, and I’m not sure if he will. I’m not sure if he will run the real on his end before this meeting or during.
4 00:00:54.440 ⇒ 00:00:56.840 luke: I don’t know as well.
5 00:00:57.950 ⇒ 00:00:58.710 Annie Yu: Yeah.
6 00:00:59.700 ⇒ 00:01:00.746 luke: You ready
7 00:01:05.040 ⇒ 00:01:10.269 luke: were you able to discuss it with him? For in slack or something.
8 00:01:10.530 ⇒ 00:01:15.810 Annie Yu: Yeah, I did share. I did share the the
9 00:01:18.690 ⇒ 00:01:20.060 Annie Yu: A message.
10 00:01:21.460 ⇒ 00:01:25.449 Awaish Kumar: Hello! Sorry I was in another meeting.
11 00:01:26.218 ⇒ 00:01:33.250 Awaish Kumar: I just tried to install the oh, thrilled.
12 00:01:34.330 ⇒ 00:01:37.329 Awaish Kumar: Oh, let’s see.
13 00:01:39.590 ⇒ 00:01:43.589 Awaish Kumar: So like, okay, yeah. Then, in the meantime, if you guys can.
14 00:01:43.790 ⇒ 00:01:47.530 Awaish Kumar: if Perry, you can share your screen and show us what’s happening.
15 00:01:49.647 ⇒ 00:01:54.240 Annie Yu: Okay, we kind of went through this a few times already.
16 00:01:58.246 ⇒ 00:01:58.800 Annie Yu: Let me.
17 00:01:58.800 ⇒ 00:01:59.570 Awaish Kumar: Okay.
18 00:02:00.630 ⇒ 00:02:05.100 Annie Yu: I’m just gonna make sure I’m gonna show what I usually do
19 00:02:06.808 ⇒ 00:02:11.180 Annie Yu: fetch origin and then open cursor.
20 00:02:11.650 ⇒ 00:02:14.270 Annie Yu: and then I’ll open a new terminal.
21 00:02:17.420 ⇒ 00:02:21.090 Annie Yu: Okay, we’ll start.
22 00:02:23.760 ⇒ 00:02:32.099 Annie Yu: And here we go. I’m gonna stay in the Ui, so we can see the the red. That means it’s not working correctly.
23 00:02:32.500 ⇒ 00:02:41.249 Annie Yu: So here, yeah. So here it works fine if I just specify one date.
24 00:02:41.730 ⇒ 00:02:47.400 Annie Yu: But it doesn’t work when I do like a wild card.
25 00:02:57.080 ⇒ 00:03:02.000 Annie Yu: So this is the the thing that I got, and we also tried.
26 00:03:02.850 ⇒ 00:03:07.339 Awaish Kumar: Yeah. But so you are directly reading the
27 00:03:07.970 ⇒ 00:03:10.489 Awaish Kumar: file. And you want to create a model.
28 00:03:10.890 ⇒ 00:03:13.739 Awaish Kumar: It’s a it’s a source, right? We are just reading the.
29 00:03:15.560 ⇒ 00:03:23.750 Annie Yu: Yeah. So all these models are connecting to this source. So it only works if I specify one date here.
30 00:03:24.180 ⇒ 00:03:24.760 Awaish Kumar: Okay?
31 00:03:26.720 ⇒ 00:03:30.830 Awaish Kumar: And then, yeah, which is weird, because this work on my end.
32 00:03:32.260 ⇒ 00:03:37.000 Awaish Kumar: how the data looks like right in the
33 00:03:40.125 ⇒ 00:03:45.354 Awaish Kumar: like, I don’t know. If how does the data
34 00:03:47.360 ⇒ 00:03:50.869 Awaish Kumar: like, how is it like you reverted my changes?
35 00:03:51.620 ⇒ 00:03:56.660 Awaish Kumar: So after that it should not be a problem right it should have just
36 00:03:57.150 ⇒ 00:04:02.729 Awaish Kumar: there should. Everything should be just just the
37 00:04:03.330 ⇒ 00:04:06.609 Awaish Kumar: dictionaries should be dictionaries. List should be list.
38 00:04:07.170 ⇒ 00:04:10.739 Awaish Kumar: Why, like any seeing the.
39 00:04:14.890 ⇒ 00:04:21.000 luke: Yeah, I don’t actually know as well, because when I tried it on my end locally, it.
40 00:04:21.000 ⇒ 00:04:21.320 Awaish Kumar: Green.
41 00:04:21.329 ⇒ 00:04:24.449 luke: When I used wildcard so.
42 00:04:26.980 ⇒ 00:04:28.490 Awaish Kumar: I just want to understand.
43 00:04:29.560 ⇒ 00:04:31.839 Awaish Kumar: Did you revert it? The changes I made.
44 00:04:31.840 ⇒ 00:04:32.450 luke: Thank you.
45 00:04:32.450 ⇒ 00:04:33.880 Awaish Kumar: They are in production.
46 00:04:34.180 ⇒ 00:04:36.250 Awaish Kumar: Sir, those changes are in production.
47 00:04:37.160 ⇒ 00:04:37.760 Awaish Kumar: Okay.
48 00:04:37.760 ⇒ 00:04:39.430 luke: It should be, yeah, yeah.
49 00:04:40.240 ⇒ 00:04:49.080 Awaish Kumar: Okay, it should like, are those like it should not like, can you please confirm that any? If you can show me your
50 00:04:52.350 ⇒ 00:04:54.690 Awaish Kumar: Okay. Oh, sorry not to.
51 00:04:54.900 ⇒ 00:05:05.799 Annie Yu: Wait. I do have one question. So if we did. If this was indeed converted on my end as well, these fields should stay. Json.
52 00:05:06.320 ⇒ 00:05:12.460 Awaish Kumar: Yeah, yeah, that’s what I’m expecting. My changes are reverted. They should be the Json.
53 00:05:12.600 ⇒ 00:05:17.900 Annie Yu: Yeah. But right now the Json’s are actually flattened already, and the list are still list.
54 00:05:18.670 ⇒ 00:05:23.010 Awaish Kumar: So that’s the actually, that’s what I’m trying to figure out. Why is that?
55 00:05:24.906 ⇒ 00:05:25.860 Awaish Kumar: Let me.
56 00:06:18.060 ⇒ 00:06:22.860 Awaish Kumar: Okay, let me from this again.
57 00:06:41.326 ⇒ 00:06:43.750 Awaish Kumar: Okay. Look like, Hello.
58 00:06:45.390 ⇒ 00:06:46.909 Awaish Kumar: Should you see anything?
59 00:06:48.040 ⇒ 00:06:48.969 Annie Yu: I I don’t think so.
60 00:06:49.430 ⇒ 00:06:51.729 luke: Can you share your screen?
61 00:06:52.860 ⇒ 00:06:54.919 Annie Yu: Oh! Should I stop sharing.
62 00:08:07.170 ⇒ 00:08:09.770 Awaish Kumar: How do you start the project right away on the rail.
63 00:08:12.490 ⇒ 00:08:14.299 Annie Yu: Wait, should I? Should I shut it down.
64 00:08:14.300 ⇒ 00:08:15.120 Awaish Kumar: How about?
65 00:08:15.560 ⇒ 00:08:22.379 Awaish Kumar: I’m just asking any like how you start the point with real dev command or other one.
66 00:08:22.850 ⇒ 00:08:27.770 luke: Real start. If you’re in the real, you need to be in the yeah
67 00:08:28.030 ⇒ 00:08:30.300 luke: need to be in the real project.
68 00:08:30.970 ⇒ 00:08:31.540 Awaish Kumar: Okay.
69 00:08:31.540 ⇒ 00:08:33.360 luke: I mean, Doc.
70 00:08:33.760 ⇒ 00:08:36.479 Awaish Kumar: Should I give the name, or just really start.
71 00:08:38.380 ⇒ 00:08:41.161 luke: Just real start. But you need to be in the
72 00:08:41.919 ⇒ 00:08:44.329 luke: What do you call this in the folder.
73 00:08:46.010 ⇒ 00:08:53.229 luke: the the real, the ABC. Home and commercial, industrial. And then who the rails are there?
74 00:08:53.730 ⇒ 00:09:03.780 luke: But I guess before that you need to pull the environment variables. So you do a real end. I can send it in the chat.
75 00:09:29.800 ⇒ 00:09:31.739 Awaish Kumar: I think I will need a bigger.
76 00:09:35.150 ⇒ 00:09:38.609 Annie Yu: Do you wanna share your screen? A wish? Would that be easier.
77 00:09:40.260 ⇒ 00:09:42.929 Awaish Kumar: No, actually, I’m on windows, and
78 00:09:43.440 ⇒ 00:09:53.000 Awaish Kumar: that’s the problem I’m carrying right now is, and withdrawal. I just returned drill.
79 00:09:55.220 ⇒ 00:09:57.799 luke: Oh, yeah, I think what we.
80 00:09:57.800 ⇒ 00:09:59.130 Awaish Kumar: Because you need to run it.
81 00:09:59.130 ⇒ 00:10:00.960 luke: In, yeah, yeah.
82 00:10:00.960 ⇒ 00:10:10.546 Awaish Kumar: Yeah, I installed using Wsl install the rail. But now the problem is, I have to start the rail from a human to stance. But
83 00:10:11.210 ⇒ 00:10:16.279 Awaish Kumar: but it, it does not have access to the project. I might need to clone
84 00:10:16.450 ⇒ 00:10:23.540 Awaish Kumar: the repository inside of that project and then run so it will just take
85 00:10:23.640 ⇒ 00:10:31.120 Awaish Kumar: bit more time. But yeah, I’ve started running the Api once more to
86 00:10:31.260 ⇒ 00:10:38.320 Awaish Kumar: with the new changes. Luke’s Luke is saying. He he reverted my oh.
87 00:10:42.830 ⇒ 00:10:51.320 Awaish Kumar: transformation step. So, yeah, so can you see, can you show the any? Can you show
88 00:10:51.660 ⇒ 00:10:53.929 Awaish Kumar: the screen now and see?
89 00:10:54.070 ⇒ 00:10:59.620 Awaish Kumar: Because I just re-uploaded the files with the new data.
90 00:11:00.310 ⇒ 00:11:01.400 Annie Yu: You mean? Here.
91 00:11:01.770 ⇒ 00:11:02.300 Awaish Kumar: Yep.
92 00:11:03.310 ⇒ 00:11:03.980 Annie Yu: How can I?
93 00:11:03.980 ⇒ 00:11:07.820 Awaish Kumar: 24, just say static, we should.
94 00:11:09.580 ⇒ 00:11:14.749 Awaish Kumar: Oh, not static. Just do the. I think it’s I think it worked only for the
95 00:11:14.850 ⇒ 00:11:16.430 Awaish Kumar: 24, maybe.
96 00:11:17.200 ⇒ 00:11:17.590 Annie Yu: Oh!
97 00:11:17.590 ⇒ 00:11:18.130 Awaish Kumar: Okay.
98 00:11:18.130 ⇒ 00:11:20.800 Annie Yu: Wait, so I can’t do the wildcard.
99 00:11:21.610 ⇒ 00:11:23.939 Awaish Kumar: Yeah, we after we.
100 00:11:23.940 ⇒ 00:11:24.540 Annie Yu: Okay. Okay.
101 00:11:24.540 ⇒ 00:11:28.480 Awaish Kumar: Yes, if it works, then we can go to it.
102 00:11:29.040 ⇒ 00:11:33.820 Awaish Kumar: Let me run it for different dates, because I just ran it for for one date.
103 00:11:34.110 ⇒ 00:11:34.735 Awaish Kumar: Hmm.
104 00:11:35.530 ⇒ 00:11:39.200 Annie Yu: So it looks like the Json are now back to Json.
105 00:11:39.850 ⇒ 00:11:49.819 Awaish Kumar: Okay, so let’s let me run it for 7th July 20th and onwards.
106 00:11:50.050 ⇒ 00:11:52.190 Awaish Kumar: and then you can do the.
107 00:11:56.980 ⇒ 00:11:58.120 Annie Yu: How do I?
108 00:11:59.490 ⇒ 00:12:03.600 Awaish Kumar: In my yeah, let me run it like.
109 00:12:04.050 ⇒ 00:12:14.369 Awaish Kumar: so let me run it for July from July 2025, th so it will re upload all these files, and then we can see file card is working for you.
110 00:12:15.160 ⇒ 00:12:18.920 Annie Yu: Okay, wait. So what should I type here? You said 20.
111 00:12:19.650 ⇒ 00:12:22.670 Awaish Kumar: Yeah, 24 is is the latest data
112 00:12:24.050 ⇒ 00:12:27.120 Awaish Kumar: I mentioned that I’m running the script
113 00:12:27.740 ⇒ 00:12:32.699 Awaish Kumar: from 2020.th So now we will have like data for
114 00:12:32.860 ⇒ 00:12:36.059 Awaish Kumar: 20th June 2122, 2324,
115 00:12:36.270 ⇒ 00:12:42.120 Awaish Kumar: and then you can try it with Wildcard. But just you have to wait for like
116 00:12:42.320 ⇒ 00:12:47.990 Awaish Kumar: 5, 10 min, 5 min, until my script executes successfully.
117 00:12:48.270 ⇒ 00:12:49.480 Annie Yu: Okay. Okay.
118 00:12:53.580 ⇒ 00:13:01.080 Awaish Kumar: In the meantime, Luke, can you show any like how to get the data from Jason
119 00:13:01.460 ⇒ 00:13:04.100 Awaish Kumar: in the model itself? Right? Instead of
120 00:13:05.400 ⇒ 00:13:08.660 Awaish Kumar: we can transform this Json field in the model right?
121 00:13:11.950 ⇒ 00:13:14.349 luke: Yeah, I think so we can do that.
122 00:13:15.210 ⇒ 00:13:16.750 Awaish Kumar: Can we try that right now?
123 00:13:21.340 ⇒ 00:13:23.250 Awaish Kumar: Can you just.
124 00:13:23.460 ⇒ 00:13:24.510 luke: Not the top of you.
125 00:13:26.500 ⇒ 00:13:29.859 Awaish Kumar: Any. Can you just say days, 24.
126 00:13:30.220 ⇒ 00:13:31.970 Awaish Kumar: Market as a source?
127 00:13:32.880 ⇒ 00:13:35.840 Awaish Kumar: Yeah, save it as a source, and just go to the model
128 00:13:37.700 ⇒ 00:13:39.980 Awaish Kumar: where we. You are referencing the source.
129 00:13:40.340 ⇒ 00:13:48.249 Awaish Kumar: And we are going to read this field one of the adjacent field what it is called
130 00:13:49.960 ⇒ 00:13:51.400 Awaish Kumar: finish time.
131 00:13:51.710 ⇒ 00:13:55.565 Awaish Kumar: Yeah, finish time, maybe here and
132 00:13:57.400 ⇒ 00:14:00.260 Awaish Kumar: yeah. Now, look, if you can just point out.
133 00:14:00.390 ⇒ 00:14:03.139 Awaish Kumar: I don’t know if what SQL dynamic it supports.
134 00:14:03.320 ⇒ 00:14:05.278 Awaish Kumar: So for the finish time
135 00:14:06.120 ⇒ 00:14:13.420 Awaish Kumar: is adjacent. How can I access? The the key called value is just, can I just do dot value, or is it something different?
136 00:14:14.802 ⇒ 00:14:19.970 luke: And I’m not sure. So let me try something. Because this is, I think this is using Doc. Maybe
137 00:14:21.530 ⇒ 00:14:22.900 luke: So yeah, let me check.
138 00:14:22.900 ⇒ 00:14:24.030 Awaish Kumar: Oh, yeah. Okay.
139 00:14:27.640 ⇒ 00:14:28.720 Awaish Kumar: Read.
140 00:14:31.700 ⇒ 00:14:38.130 luke: Or maybe Annie, can you maybe take a screenshot of the since? I’m not in my laptop at the moment.
141 00:14:38.260 ⇒ 00:14:40.270 luke: If we go back to Source.
142 00:14:41.190 ⇒ 00:14:42.430 Annie Yu: Take us.
143 00:14:42.630 ⇒ 00:14:45.840 luke: Yeah. Take a screenshot of the the Json meeting.
144 00:14:46.230 ⇒ 00:14:47.959 luke: Any time I could show you
145 00:14:48.460 ⇒ 00:14:51.039 luke: like the start of time, or what.
146 00:14:51.310 ⇒ 00:14:54.469 Annie Yu: This one. Yeah, we can use this one, too.
147 00:14:54.970 ⇒ 00:15:03.339 luke: Like, yeah, maybe take a screenshot of that, and then ask in person how to
148 00:15:03.680 ⇒ 00:15:08.560 luke: how to pick just the year or the Value
149 00:15:09.695 ⇒ 00:15:12.250 luke: from the Customer Journey. Duration Field.
150 00:15:12.250 ⇒ 00:15:13.169 Awaish Kumar: Yeah, you can do this.
151 00:15:13.170 ⇒ 00:15:14.040 Awaish Kumar: That’s true.
152 00:15:14.560 ⇒ 00:15:17.270 luke: In using duck B, that’s.
153 00:15:18.270 ⇒ 00:15:19.060 Annie Yu: Bye.
154 00:15:19.830 ⇒ 00:15:21.270 Awaish Kumar: Any you can just do.
155 00:15:22.500 ⇒ 00:15:25.800 Awaish Kumar: I’ve just sent a message in the thread
156 00:15:27.340 ⇒ 00:15:30.069 Awaish Kumar: in the chat, chat in the zoom.
157 00:15:31.860 ⇒ 00:15:35.359 Awaish Kumar: Just copy this and paste it.
158 00:15:37.060 ⇒ 00:15:44.300 Awaish Kumar: So casting. Yeah. So I just want to know that where should we finish time?
159 00:15:46.610 ⇒ 00:15:52.350 Awaish Kumar: VAR is is the name of the variable, and it is called finish time. Here.
160 00:15:52.790 ⇒ 00:15:54.250 Awaish Kumar: Can you please change that.
161 00:15:54.470 ⇒ 00:15:57.450 Annie Yu: And yeah, finish time. Here.
162 00:15:57.650 ⇒ 00:16:02.080 Awaish Kumar: So, and the I don’t know if the values are integer, then we can.
163 00:16:02.410 ⇒ 00:16:06.480 Awaish Kumar: So we are accessing. So for finish time and then arrows
164 00:16:06.620 ⇒ 00:16:12.570 Awaish Kumar: and then value field. That’s basically we are trying to access. The
165 00:16:12.740 ⇒ 00:16:21.700 Awaish Kumar: value key from this dictionary casting is just. We are casting the value as integer. If we need, we can remove it. If we don’t need that.
166 00:16:23.650 ⇒ 00:16:25.310 Annie Yu: Finish time. So I guess.
167 00:16:25.310 ⇒ 00:16:28.829 Awaish Kumar: Now, just for now we can keep it because it’s integer right.
168 00:16:29.790 ⇒ 00:16:32.540 Annie Yu: Finish time. No, I think it’s a timestamp.
169 00:16:36.610 ⇒ 00:16:40.900 Awaish Kumar: But the values are in the integer format. Right?
170 00:16:43.290 ⇒ 00:16:45.320 Awaish Kumar: I don’t know. I don’t remember.
171 00:16:47.870 ⇒ 00:16:50.620 Awaish Kumar: How is the time? Okay? Sorry, not duration.
172 00:16:51.150 ⇒ 00:16:53.180 Awaish Kumar: Yeah, we can keep the cost.
173 00:16:53.730 ⇒ 00:16:54.110 Annie Yu: Is there.
174 00:16:54.110 ⇒ 00:16:55.779 Awaish Kumar: Remove the cost as well. Yeah.
175 00:16:57.120 ⇒ 00:17:03.310 Awaish Kumar: I confuse it with other field. But yeah, remove the cost, and cost is a function
176 00:17:05.400 ⇒ 00:17:12.770 Awaish Kumar: in the select cast, you can remove that and also remove the bracket
177 00:17:15.660 ⇒ 00:17:21.890 Awaish Kumar: and also remove this as integer thing, integer as integer. Both. Yeah.
178 00:17:22.930 ⇒ 00:17:25.370 Awaish Kumar: Now it should be. We should be good.
179 00:17:27.230 ⇒ 00:17:30.950 Annie Yu: Wait. Is it okay?
180 00:17:30.950 ⇒ 00:17:31.540 Awaish Kumar: Yeah.
181 00:17:32.270 ⇒ 00:17:35.360 Annie Yu: So. So I have to do this for.
182 00:17:36.000 ⇒ 00:17:37.520 Awaish Kumar: Yeah, for Json fields.
183 00:17:40.933 ⇒ 00:17:41.446 Annie Yu: Okay.
184 00:17:41.960 ⇒ 00:17:45.329 Awaish Kumar: It’s just we are accessing the the finish. Time is a dictionary.
185 00:17:45.610 ⇒ 00:17:50.550 Awaish Kumar: and if if you want to access something inside a dictionary, this is the syntax
186 00:17:50.860 ⇒ 00:17:54.320 Awaish Kumar: value is the name of the key in the dictionary.
187 00:17:56.990 ⇒ 00:18:06.640 Awaish Kumar: So if you see the in the source, if you see the finish time, it has 2 key keys. One is called key, and the other one is called value.
188 00:18:06.970 ⇒ 00:18:07.690 Annie Yu: Yeah.
189 00:18:08.690 ⇒ 00:18:14.699 Awaish Kumar: So now, we don’t care about key because and only make
190 00:18:14.950 ⇒ 00:18:20.000 Awaish Kumar: we just care about value. So we are just accessing value key M,
191 00:18:20.150 ⇒ 00:18:24.820 Awaish Kumar: the relevant, the the related value, and that’s all.
192 00:18:25.060 ⇒ 00:18:29.159 Awaish Kumar: So now it is I. I don’t know if it’s in timestamp, or it’s a
193 00:18:29.390 ⇒ 00:18:34.040 Awaish Kumar: what you are seeing is in string, so you you have to cast it as well.
194 00:18:36.333 ⇒ 00:18:37.579 Annie Yu: Okay, then.
195 00:18:38.510 ⇒ 00:18:44.020 Awaish Kumar: In the model. We we get this value finish time.
196 00:18:47.310 ⇒ 00:18:47.640 Annie Yu: No.
197 00:18:47.640 ⇒ 00:18:49.729 Awaish Kumar: So this. So this is.
198 00:18:49.850 ⇒ 00:18:58.010 Awaish Kumar: is it a? It’s a voucher. It’s a string value. Right now. You can just say search. Maybe
199 00:18:58.160 ⇒ 00:18:59.880 Awaish Kumar: you can ask, chat, gpt.
200 00:19:00.210 ⇒ 00:19:00.560 Annie Yu: Yeah.
201 00:19:00.560 ⇒ 00:19:10.439 Awaish Kumar: In duck TV how to cast a string, and you can put this format there and and cast it to like date, time, or timestamp.
202 00:19:10.590 ⇒ 00:19:12.930 Awaish Kumar: and it can just help you do that.
203 00:19:14.570 ⇒ 00:19:17.940 Annie Yu: Okay. How about the list?
204 00:19:20.860 ⇒ 00:19:25.670 Awaish Kumar: Yeah, right list is just, I think, indexing. Right? You can access by index.
205 00:19:29.660 ⇒ 00:19:33.980 Awaish Kumar: Just select some color. We we can just same.
206 00:19:33.980 ⇒ 00:19:39.070 Annie Yu: Can we keep every item in the list, instead of selecting one.
207 00:19:40.280 ⇒ 00:19:42.400 Awaish Kumar: So right now it’s already list, right.
208 00:19:43.340 ⇒ 00:19:45.970 Annie Yu: Yeah, but I can’t join on list.
209 00:19:47.050 ⇒ 00:19:50.189 Awaish Kumar: Yeah. But what do you need? Like, you need a list, or you need a value.
210 00:19:52.579 ⇒ 00:20:01.470 Annie Yu: I need the all the values in that list. So for this one I will want to keep both cute and handled, but not in the list.
211 00:20:02.390 ⇒ 00:20:04.470 Awaish Kumar: Okay. So that is.
212 00:20:04.630 ⇒ 00:20:13.490 Awaish Kumar: I think, yeah, it’s just it’s just asking chat, Gpt or searching in Google. But I can like, I know, help.
213 00:20:15.950 ⇒ 00:20:17.023 Annie Yu: Okay, okay.
214 00:20:19.050 ⇒ 00:20:26.060 Annie Yu: So I guess I will do this now within real. And does that mean,
215 00:20:29.460 ⇒ 00:20:33.590 Annie Yu: okay. And we’ll we’ll move all these to Dbt, right?
216 00:20:34.840 ⇒ 00:20:37.510 Awaish Kumar: Not sure right now. We don’t have a decision on that.
217 00:20:38.970 ⇒ 00:20:41.569 luke: Okay, who’s the yeah. I think that’s what you want.
218 00:20:43.520 ⇒ 00:20:49.040 luke: Yes, that’s what we want to do, what we need it to do weekly. But then we are actively
219 00:20:53.262 ⇒ 00:20:56.820 luke: cannot access. S. 3 data directly.
220 00:20:57.240 ⇒ 00:20:58.260 luke: I think.
221 00:21:03.930 ⇒ 00:21:05.550 Awaish Kumar: Yeah, you can do that.
222 00:21:07.080 ⇒ 00:21:13.140 Awaish Kumar: And then I think for for list, you can do this.
223 00:21:13.760 ⇒ 00:21:18.279 Awaish Kumar: Just give like interaction levels is.
224 00:21:18.590 ⇒ 00:21:21.859 Awaish Kumar: go to the model. Select, copy this and paste.
225 00:21:25.890 ⇒ 00:21:27.040 Annie Yu: Interaction.
226 00:21:31.350 ⇒ 00:21:33.530 Awaish Kumar: I have sent you the message in chat.
227 00:21:33.650 ⇒ 00:21:35.459 Awaish Kumar: Copy that function.
228 00:21:35.990 ⇒ 00:21:36.770 Annie Yu: Okay?
229 00:21:44.470 ⇒ 00:21:50.090 Annie Yu: Oh, okay, string.
230 00:21:53.220 ⇒ 00:21:55.660 Annie Yu: So where do I put the
231 00:21:57.640 ⇒ 00:22:03.040 Annie Yu: put? I guess I should put the column name here.
232 00:22:08.920 ⇒ 00:22:17.630 Awaish Kumar: What? Yeah, in- in the instead of this, a copy list just put the real name of the
233 00:22:18.790 ⇒ 00:22:20.579 Awaish Kumar: remove. This list.
234 00:22:23.370 ⇒ 00:22:25.380 Annie Yu: We remove the entire thing.
235 00:22:25.600 ⇒ 00:22:26.310 Awaish Kumar: Yeah, yeah.
236 00:22:26.480 ⇒ 00:22:27.210 Annie Yu: Equipment.
237 00:22:32.090 ⇒ 00:22:35.390 Annie Yu: Okay, so.
238 00:22:36.200 ⇒ 00:22:39.580 Awaish Kumar: You can say, as, Yeah, okay, plus.
239 00:22:44.610 ⇒ 00:22:49.200 Annie Yu: Okay, okay, so I just do.
240 00:22:50.210 ⇒ 00:22:55.180 Awaish Kumar: For finish time. It’s a it’s a string. If you need the in the date time.
241 00:22:55.380 ⇒ 00:23:03.250 Awaish Kumar: Just copy this across, copy the sample value, not copy the
242 00:23:03.894 ⇒ 00:23:07.129 Awaish Kumar: copy. The no, no. Just copy, single value.
243 00:23:07.130 ⇒ 00:23:07.920 Annie Yu: Okay.
244 00:23:07.920 ⇒ 00:23:10.499 Awaish Kumar: Yeah, you can just copy single value.
245 00:23:10.730 ⇒ 00:23:12.539 Awaish Kumar: Ask chat. Gpt.
246 00:23:13.080 ⇒ 00:23:18.979 Awaish Kumar: Convert this string from work chart to the date time
247 00:23:19.370 ⇒ 00:23:24.060 Awaish Kumar: in the like in the duck. dB, direct right? SQL. Direct.
248 00:23:24.340 ⇒ 00:23:27.459 Awaish Kumar: It can just do it for you.
249 00:23:27.680 ⇒ 00:23:29.450 Awaish Kumar: You can try that right now.
250 00:23:30.020 ⇒ 00:23:33.570 Annie Yu: Okay, to times.
251 00:23:33.570 ⇒ 00:23:37.990 Awaish Kumar: Browser. Just go in the browser. Can you just open a chat, gpt.
252 00:23:39.520 ⇒ 00:23:39.955 Annie Yu: Okay.
253 00:23:53.530 ⇒ 00:23:54.970 Annie Yu: I’ll say.
254 00:23:55.860 ⇒ 00:23:59.410 Annie Yu: But I also wanted to build upon this one right.
255 00:24:01.010 ⇒ 00:24:01.630 Awaish Kumar: Got it.
256 00:24:06.530 ⇒ 00:24:10.705 Awaish Kumar: Yeah. Just just ask, Jvg,
257 00:24:12.929 ⇒ 00:24:13.330 Annie Yu: Hmm.
258 00:24:13.330 ⇒ 00:24:13.665 Awaish Kumar: This.
259 00:24:14.770 ⇒ 00:24:17.979 Awaish Kumar: Sure, that’s okay. Right? We, you know that
260 00:24:18.220 ⇒ 00:24:21.640 Awaish Kumar: the where the value is coming from we just need to copy.
261 00:24:25.140 ⇒ 00:24:28.020 Awaish Kumar: Hmm, just ask, like
262 00:24:28.150 ⇒ 00:24:38.070 Awaish Kumar: the the date time in the given picture is in the string. I want to convert it into a date time or timestamp column
263 00:24:38.190 ⇒ 00:24:46.190 Awaish Kumar: in a duck dB, and like it can give you the.
264 00:24:58.120 ⇒ 00:24:59.909 Awaish Kumar: And yeah, just do that.
265 00:25:04.080 ⇒ 00:25:05.950 Annie Yu: Wait. Did I?
266 00:25:08.720 ⇒ 00:25:09.540 Annie Yu: Yeah.
267 00:25:15.020 ⇒ 00:25:16.039 Awaish Kumar: Put a comma.
268 00:25:16.760 ⇒ 00:25:17.530 Annie Yu: Okay.
269 00:25:18.010 ⇒ 00:25:19.190 Awaish Kumar: Then, yeah.
270 00:25:20.110 ⇒ 00:25:22.800 Annie Yu: So that’s now a time.
271 00:25:23.260 ⇒ 00:25:25.850 Awaish Kumar: Finish time pass. Can you see if it is a.
272 00:25:26.780 ⇒ 00:25:27.420 Annie Yu: Understand?
273 00:25:29.020 ⇒ 00:25:31.489 Annie Yu: Okay? And then I will.
274 00:25:31.490 ⇒ 00:25:34.420 Awaish Kumar: Can you scroll on this column? Can you verify.
275 00:25:36.070 ⇒ 00:25:36.960 Annie Yu: What’s that?
276 00:25:38.170 ⇒ 00:25:41.929 Awaish Kumar: Can you scroll over the column? Finish time, zone.
277 00:25:44.323 ⇒ 00:25:45.170 Annie Yu: This one.
278 00:25:45.170 ⇒ 00:25:45.760 Awaish Kumar: Quest?
279 00:25:45.970 ⇒ 00:25:48.070 Awaish Kumar: No, no! In that. In the result set.
280 00:25:49.020 ⇒ 00:25:49.889 Annie Yu: How do I do that.
281 00:25:49.890 ⇒ 00:25:55.519 Awaish Kumar: Is that okay? And the result said, Can you please hover
282 00:25:55.640 ⇒ 00:25:59.009 Awaish Kumar: over the finish? Time past? Column name, yeah.
283 00:25:59.010 ⇒ 00:25:59.650 Annie Yu: Yeah.
284 00:25:59.650 ⇒ 00:26:03.209 Awaish Kumar: Just here, so it is successfully converted.
285 00:26:03.680 ⇒ 00:26:08.649 Awaish Kumar: And now make you can just do that for other fields.
286 00:26:08.790 ⇒ 00:26:10.449 Awaish Kumar: Whatever fields you need.
287 00:26:10.820 ⇒ 00:26:11.740 Annie Yu: Okay.
288 00:26:14.460 ⇒ 00:26:21.720 Awaish Kumar: And so now you have okay. Now, the only issue is about the wild cards. Right?
289 00:26:24.650 ⇒ 00:26:25.500 Awaish Kumar: Again.
290 00:26:25.500 ⇒ 00:26:28.349 Annie Yu: Which ones are you referring to?
291 00:26:29.260 ⇒ 00:26:37.459 Awaish Kumar: No, no, I’m referring. So here we are. Good, right? You can access Jason Fields, or you can access list as a strings. Everything is good.
292 00:26:37.680 ⇒ 00:26:38.040 Annie Yu: Yeah.
293 00:26:38.040 ⇒ 00:26:42.959 Awaish Kumar: List all the columns you need, and and you can just build your SQL. Carry.
294 00:26:43.220 ⇒ 00:26:45.310 Awaish Kumar: I’m referring to now the source.
295 00:26:46.510 ⇒ 00:26:50.349 Awaish Kumar: You’re reading the data right now. We are only reading one file.
296 00:26:51.250 ⇒ 00:26:51.750 Annie Yu: Yes.
297 00:26:51.750 ⇒ 00:26:52.320 Awaish Kumar: Yes.
298 00:26:52.540 ⇒ 00:26:58.479 Awaish Kumar: so now the only issue is now it should work for you with this direct. I’m on that one.
299 00:26:59.210 ⇒ 00:27:02.470 Awaish Kumar: Just let me see how my script is going.
300 00:27:02.800 ⇒ 00:27:03.530 Annie Yu: Okay.
301 00:27:06.350 ⇒ 00:27:07.770 Awaish Kumar: Yes.
302 00:27:58.257 ⇒ 00:28:03.709 luke: By the way, a wish can you share us like how you refreshed the data?
303 00:28:04.010 ⇒ 00:28:06.270 luke: After I reverted the.
304 00:28:06.940 ⇒ 00:28:08.969 Awaish Kumar: I don’t know. I just executed the
305 00:28:09.270 ⇒ 00:28:13.699 Awaish Kumar: I just executed the script in the local machine.
306 00:28:14.018 ⇒ 00:28:15.610 luke: In that store you mean.
307 00:28:15.610 ⇒ 00:28:18.919 Awaish Kumar: That’s no, no. I just ran locally on my machine.
308 00:28:19.880 ⇒ 00:28:20.920 luke: I see.
309 00:28:25.720 ⇒ 00:28:26.910 Awaish Kumar: There it is.
310 00:32:26.950 ⇒ 00:32:35.110 Awaish Kumar: I we can pair again like I. When the script is done, I we’ll let you know any
311 00:32:35.270 ⇒ 00:32:38.900 Awaish Kumar: you can try with wildcard. If it works good.
312 00:32:39.100 ⇒ 00:32:44.590 Awaish Kumar: whether it’s if it’s if it is, if it does not work, then just we can pair again.
313 00:32:45.010 ⇒ 00:32:48.400 Annie Yu: Right now. It’s still working. It’s still running, so.
314 00:32:54.590 ⇒ 00:32:59.709 Awaish Kumar: Yeah, it. It is not working right now, because the the script is not done.
315 00:32:59.930 ⇒ 00:33:00.270 Annie Yu: And this.
316 00:33:00.270 ⇒ 00:33:02.360 Awaish Kumar: Still has the old data there.
317 00:33:02.720 ⇒ 00:33:06.549 Awaish Kumar: so when it is done I will let you know, and then try.
318 00:33:08.070 ⇒ 00:33:16.349 Annie Yu: Okay. So at least, okay. So at least before that fixed, I can do the cast here, and then we’ll.
319 00:33:16.350 ⇒ 00:33:19.719 Awaish Kumar: You can on on the 24.th Yeah, you can work.
320 00:33:19.880 ⇒ 00:33:23.100 Awaish Kumar: Build your skill model. Dashboard? Anything?
321 00:33:23.100 ⇒ 00:33:23.610 Awaish Kumar: Yeah.
322 00:33:23.610 ⇒ 00:33:27.110 Awaish Kumar: Yeah. For the avail cards. I will just let you know when it is done.
323 00:33:28.590 ⇒ 00:33:29.510 Annie Yu: Okay. Yeah.
324 00:33:29.510 ⇒ 00:33:30.330 Awaish Kumar: We can pair it with.
325 00:33:30.330 ⇒ 00:33:40.769 Annie Yu: The thing is with the dashboard. It doesn’t really make sense to have just one day that oh, now we can see. But it doesn’t.
326 00:33:40.770 ⇒ 00:33:44.949 Awaish Kumar: And you can like just I know that. But just
327 00:33:45.809 ⇒ 00:33:52.130 Awaish Kumar: have the charts ready as soon as data comes in. Just pop pops up everything.
328 00:33:52.820 ⇒ 00:33:57.840 Annie Yu: Yeah, yeah, okay.
329 00:33:59.620 ⇒ 00:34:00.760 Awaish Kumar: Okay. Thank you.