Meeting Title: Data Service Standup Date: 2026-01-21 Meeting participants: Mustafa Raja, Awaish Kumar, Ashwini Sharma, Uttam Kumaran
WEBVTT
1 00:01:21.420 ⇒ 00:01:22.380 Awaish Kumar: Hello?
2 00:01:24.740 ⇒ 00:01:25.889 Mustafa Raja: Hey, how are you?
3 00:01:26.210 ⇒ 00:01:27.690 Awaish Kumar: I’m good, how about you?
4 00:01:27.900 ⇒ 00:01:28.990 Mustafa Raja: Yeah, doing good.
5 00:01:36.500 ⇒ 00:01:39.969 Awaish Kumar: Who’s the… What’s everything?
6 00:01:41.140 ⇒ 00:01:41.840 Mustafa Raja: Sorry?
7 00:01:42.800 ⇒ 00:01:44.100 Awaish Kumar: How’s everything in the hall?
8 00:01:45.080 ⇒ 00:01:56.810 Mustafa Raja: Yeah… it’s… it’s good, it’s good. I just… the EQA… the EQA’s still not good enough, so I… I went out this weekend, and…
9 00:01:57.130 ⇒ 00:02:03.479 Mustafa Raja: it caught my throat. Again, Yeah, I’m… I got… I got really bad cough.
10 00:02:03.700 ⇒ 00:02:06.069 Mustafa Raja: So, EQI is really an issue.
11 00:02:08.169 ⇒ 00:02:13.399 Awaish Kumar: Yeah, it’s… It’s going to be like this for a few weeks, still for a few.
12 00:02:13.400 ⇒ 00:02:14.170 Mustafa Raja: Yeah.
13 00:02:14.620 ⇒ 00:02:21.110 Mustafa Raja: Yeah, I just wish it rains, so the air quality gets a little better.
14 00:02:23.090 ⇒ 00:02:25.549 Mustafa Raja: Yeah, we are going to have Basand over here, you know?
15 00:02:26.820 ⇒ 00:02:28.239 Awaish Kumar: Hey, aye.
16 00:02:30.020 ⇒ 00:02:33.329 Awaish Kumar: I haven’t actually celebrated, but I… I just know that.
17 00:02:33.550 ⇒ 00:02:43.359 Mustafa Raja: Yeah, I used to when I was a lot younger, so, like, around 8, 9, and after that it got banned. But now it’s…
18 00:02:44.610 ⇒ 00:02:47.260 Mustafa Raja: I don’t… I don’t endorse it, to be honest.
19 00:02:50.680 ⇒ 00:02:51.390 Awaish Kumar: But…
20 00:02:51.390 ⇒ 00:02:52.320 Mustafa Raja: It is what it is, I guess.
21 00:02:52.320 ⇒ 00:02:52.720 Awaish Kumar: Hello.
22 00:02:53.570 ⇒ 00:02:56.300 Awaish Kumar: Yeah, on the bushunt also, there will be a lot of…
23 00:02:57.110 ⇒ 00:02:58.930 Awaish Kumar: Like, incidents and all of that.
24 00:02:58.930 ⇒ 00:03:01.370 Mustafa Raja: Yeah, I don’t, I don’t, I don’t like that.
25 00:03:03.120 ⇒ 00:03:04.140 Awaish Kumar: I actually…
26 00:03:04.140 ⇒ 00:03:06.569 Mustafa Raja: I don’t think… I don’t think it’s worth the risk, you know.
27 00:03:08.810 ⇒ 00:03:09.440 Mustafa Raja: Hey.
28 00:03:09.440 ⇒ 00:03:10.180 Awaish Kumar: How you doing?
29 00:03:10.580 ⇒ 00:03:12.570 Ashwini Sharma: I’m good, man. How are you guys?
30 00:03:12.980 ⇒ 00:03:14.100 Awaish Kumar: Doing good.
31 00:03:16.400 ⇒ 00:03:17.120 Ashwini Sharma: Oh…
32 00:03:18.640 ⇒ 00:03:21.500 Mustafa Raja: I think the Milar is, out of her facility.
33 00:03:22.000 ⇒ 00:03:29.170 Awaish Kumar: Yeah, damage of… So, I hope the… Same as the last time.
34 00:03:29.360 ⇒ 00:03:32.290 Awaish Kumar: You will be covering, as a…
35 00:03:32.430 ⇒ 00:03:36.230 Awaish Kumar: as a backup for… as a CSO for him, for today.
36 00:03:37.400 ⇒ 00:03:46.479 Awaish Kumar: Yeah, please check out any time comms, if you have to do, or, like, end-of-date Slack updates and… and things like that.
37 00:03:46.670 ⇒ 00:03:52.400 Awaish Kumar: And, yeah, escalate if there is anything which… which, which you don’t know, or…
38 00:03:53.240 ⇒ 00:04:04.370 Awaish Kumar: whatever, like, something you think it’s escalated, just let us know. Yeah, we can start off with Magic Spoon, Ashwini, yeah.
39 00:04:04.370 ⇒ 00:04:07.670 Ashwini Sharma: Magic Spoon, right, I’ll just provide an update,
40 00:04:08.110 ⇒ 00:04:17.569 Ashwini Sharma: The QA thing required more attributes, and I had to run the pipeline to add more attributes, but again, like, the pipeline starts to fail abruptly, right?
41 00:04:17.839 ⇒ 00:04:21.850 Ashwini Sharma: And, like, I tried multiple times since yesterday.
42 00:04:22.040 ⇒ 00:04:33.940 Ashwini Sharma: It kind of runs for about 2 hours or so, and then kind of fails after that, right? And then I lose the data, or the progress, because, like, with the framework that… that is there.
43 00:04:34.480 ⇒ 00:04:47.689 Ashwini Sharma: it does not support the kind of load that ideally should be there, right? So, I think that would be a different project at all, if we have to support such kind of loads. Yeah, but the thing is, like, I have a call today with Michael.
44 00:04:47.690 ⇒ 00:04:52.200 Awaish Kumar: Can… can I have some context on this? What is… actually, this is about?
45 00:04:52.900 ⇒ 00:05:00.499 Ashwini Sharma: So, this is about, Spins data, okay? So, Spins is a GraphQL API. It’s, it’s a…
46 00:05:00.720 ⇒ 00:05:05.079 Ashwini Sharma: SaaS solution, yeah, it provides a GraphQL API from where you extract the data.
47 00:05:05.560 ⇒ 00:05:12.919 Awaish Kumar: like, we build a data pipeline to move the data from Spin’s API to Warehouse.
48 00:05:12.920 ⇒ 00:05:16.250 Ashwini Sharma: Right, yeah. Now, the data volume is huge, okay?
49 00:05:16.440 ⇒ 00:05:16.820 Awaish Kumar: Okay.
50 00:05:16.820 ⇒ 00:05:35.540 Ashwini Sharma: So earlier, what I had done was I… they had presented one Excel sheet where there were, like, around 20 attributes or so for which we had to fetch the data. And I had fetched for those 20 things, and then it worked fine, right? But when they are doing the QA, it’s… it’s a lot more than 20.
51 00:05:35.820 ⇒ 00:05:36.850 Ashwini Sharma: Okay, so…
52 00:05:36.850 ⇒ 00:05:37.220 Awaish Kumar: So…
53 00:05:37.220 ⇒ 00:05:40.800 Ashwini Sharma: Now I have to fetch for the other attributes also, right? More than 20.
54 00:05:41.190 ⇒ 00:05:46.910 Ashwini Sharma: And that’s where the pipeline started to fail, because the data volume is huge, and after.
55 00:05:46.910 ⇒ 00:05:47.530 Awaish Kumar: Sometime…
56 00:05:47.530 ⇒ 00:05:49.789 Ashwini Sharma: It just, yeah, go ahead.
57 00:05:49.790 ⇒ 00:05:52.039 Awaish Kumar: Yeah, let me summarize it in a…
58 00:05:52.350 ⇒ 00:05:57.940 Awaish Kumar: Like, so, we built a pipeline for 20 attributes, and it was working fine.
59 00:05:57.940 ⇒ 00:06:00.760 Ashwini Sharma: And now they have asked for more data, right?
60 00:06:00.760 ⇒ 00:06:03.619 Awaish Kumar: And when we are trying to fix that, pipeline is failing.
61 00:06:04.390 ⇒ 00:06:10.040 Ashwini Sharma: Yes, yes, that, that is in a nutshell.
62 00:06:10.540 ⇒ 00:06:11.949 Uttam Kumaran: Yeah, and .
63 00:06:11.950 ⇒ 00:06:12.450 Ashwini Sharma: Yeah.
64 00:06:12.450 ⇒ 00:06:13.530 Awaish Kumar: So… You’re not.
65 00:06:13.980 ⇒ 00:06:14.770 Ashwini Sharma: Slutty.
66 00:06:14.770 ⇒ 00:06:15.849 Awaish Kumar: Is that the problem?
67 00:06:16.230 ⇒ 00:06:17.140 Ashwini Sharma: Am I audible?
68 00:06:18.340 ⇒ 00:06:20.800 Awaish Kumar: Yeah, you are audible. My question is, like.
69 00:06:20.910 ⇒ 00:06:30.180 Awaish Kumar: Did I understand it correctly, that while we are trying to get new, more fields, we are, like, we are getting some kind of out-of-memory error, or something like that?
70 00:06:30.180 ⇒ 00:06:41.980 Ashwini Sharma: Right. Not exactly out of memory. It does not display the error at all, it just, you know, terminates the container without any logs or anything, and I’m trying to get the logs so badly, but…
71 00:06:42.330 ⇒ 00:06:44.899 Ashwini Sharma: It’s just not there.
72 00:06:45.160 ⇒ 00:06:51.870 Awaish Kumar: Able to, run pipeline in a way that we, split the data, like.
73 00:06:52.250 ⇒ 00:07:09.570 Ashwini Sharma: Yeah, I’ve done that. I have done that. I have splitted it into smaller chunks of data, and then inserting it into the database, into the warehouse, but after some time, again, like, even with smaller amounts of data, it just goes off, and does not give any hint of why it terminated.
74 00:07:10.670 ⇒ 00:07:15.529 Ashwini Sharma: And yeah, like, while doing this, fixing this.
75 00:07:15.750 ⇒ 00:07:18.079 Ashwini Sharma: I think today I encountered,
76 00:07:18.400 ⇒ 00:07:21.079 Ashwini Sharma: you know, rate limit error from GraphQL.
77 00:07:21.230 ⇒ 00:07:29.029 Ashwini Sharma: Right, so I’ll wait for some time and talk to Michael in the meeting today to see if we can extend the GraphQL limit.
78 00:07:29.390 ⇒ 00:07:33.669 Ashwini Sharma: Or wait for some more time, and then rerun it.
79 00:07:34.490 ⇒ 00:07:41.440 Awaish Kumar: It’s failing abruptly, that means it needs better logging, right? At least we should be able to capture.
80 00:07:41.440 ⇒ 00:07:44.779 Ashwini Sharma: I have done all the logging possible.
81 00:07:44.780 ⇒ 00:07:45.270 Awaish Kumar: That’s good.
82 00:07:45.270 ⇒ 00:07:49.609 Ashwini Sharma: That, you know, we can see it sometime, yeah, we can see it sometime, definitely.
83 00:07:49.610 ⇒ 00:07:50.360 Awaish Kumar: Nice.
84 00:07:50.530 ⇒ 00:07:57.429 Awaish Kumar: Maybe pair… pair on it after the stand-up, or, like, some… sometime today at the end of day, and we can…
85 00:07:57.630 ⇒ 00:07:59.790 Awaish Kumar: basically go over it, like, I’m just…
86 00:08:00.200 ⇒ 00:08:04.380 Awaish Kumar: throwing my ideas, I’m not sure what we’ve tried, but, like, we can go over it.
87 00:08:04.770 ⇒ 00:08:05.779 Ashwini Sharma: Sure, sure, yeah.
88 00:08:05.920 ⇒ 00:08:06.890 Ashwini Sharma: Definitely.
89 00:08:07.010 ⇒ 00:08:09.609 Ashwini Sharma: Yeah, so that’s.
90 00:08:10.730 ⇒ 00:08:11.910 Awaish Kumar: How’s it for this?
91 00:08:12.310 ⇒ 00:08:19.559 Ashwini Sharma: So, yeah, again, right, so the way it works is we get weekly data, right, from spins.
92 00:08:19.690 ⇒ 00:08:23.560 Ashwini Sharma: For every week since December.
93 00:08:24.380 ⇒ 00:08:25.370 Ashwini Sharma: till.
94 00:08:25.370 ⇒ 00:08:25.920 Awaish Kumar: Okay.
95 00:08:26.080 ⇒ 00:08:27.449 Awaish Kumar: I’m just asking…
96 00:08:27.450 ⇒ 00:08:30.640 Ashwini Sharma: Oh, okay. Yeah, so basically, like,
97 00:08:32.120 ⇒ 00:08:37.360 Ashwini Sharma: Hold on a second, right? So, that part number 8 is sort of done, okay?
98 00:08:37.480 ⇒ 00:08:40.469 Awaish Kumar: Okay. I’ll talk to Michael today and then confirm.
99 00:08:40.470 ⇒ 00:08:43.179 Ashwini Sharma: Basically, what we wanted was,
100 00:08:43.409 ⇒ 00:08:48.009 Ashwini Sharma: To check the output produced by ticket number 8,
101 00:08:48.170 ⇒ 00:08:54.440 Ashwini Sharma: with the platform data, right? And since the platform data has much more attributes than what I had in
102 00:08:54.880 ⇒ 00:08:58.590 Ashwini Sharma: Ticket number 8, I had to reload the pipeline.
103 00:08:58.890 ⇒ 00:09:04.930 Ashwini Sharma: Okay. So, what I’ll do today is, I’ll talk to Michael and compare with the existing attributes that is there.
104 00:09:05.070 ⇒ 00:09:06.090 Ashwini Sharma: in aid.
105 00:09:06.300 ⇒ 00:09:14.140 Ashwini Sharma: the… the part number 8 that creates, creates it, and then see how much QA we can do, right? Now, there…
106 00:09:14.140 ⇒ 00:09:14.760 Awaish Kumar: Okay.
107 00:09:14.760 ⇒ 00:09:27.130 Ashwini Sharma: what they want… their platform data has a lot more attributes, right? So we cannot do the QA for the entire dataset, but at least we can do it for some of the stuff, and then see whether, you know, the thing that we are trying to do works or not.
108 00:09:28.020 ⇒ 00:09:31.269 Awaish Kumar: So, all of these three tickets are kind of related, right?
109 00:09:31.270 ⇒ 00:09:33.110 Ashwini Sharma: It’s kind of related, yes.
110 00:09:34.060 ⇒ 00:09:39.699 Awaish Kumar: Okay, and did you know the… what’s, like, on Demi’s part, like, is there any updates?
111 00:09:40.180 ⇒ 00:09:49.560 Ashwini Sharma: No, so Demi will be building, no, he can at least do the other part, so… but I haven’t been able to get in touch with Demi already.
112 00:09:50.090 ⇒ 00:09:50.820 Awaish Kumar: Okay.
113 00:09:50.820 ⇒ 00:09:56.530 Ashwini Sharma: So, he was not much online yesterday also, and I have not seen him online today as well.
114 00:09:56.530 ⇒ 00:10:11.139 Uttam Kumaran: Yeah, he was working on Eden stuff yesterday, and today he… he has a doctor’s appointment right now, so he’ll be on in another hour. But yeah, I mean, I would… if anything’s ready to model, I would let him know, and I would just send in the channel, Ashwini, you don’t need to wait to…
115 00:10:12.080 ⇒ 00:10:13.569 Uttam Kumaran: Chat with him directly.
116 00:10:13.770 ⇒ 00:10:22.310 Ashwini Sharma: So he doesn’t have to wait… Yeah, he doesn’t have to wait for me to build this model. Like, he has two work items, right? One is the optimization of dbt models.
117 00:10:22.650 ⇒ 00:10:24.880 Uttam Kumaran: Yeah. Which he can work independent of.
118 00:10:24.880 ⇒ 00:10:25.729 Ashwini Sharma: what I’ve done.
119 00:10:25.730 ⇒ 00:10:30.870 Uttam Kumaran: But that he’s almost done on. Like, we’re… we’re gonna be discussing with him today.
120 00:10:31.110 ⇒ 00:10:33.690 Uttam Kumaran: Like, he’s gonna send me some stuff, we’re gonna wrap that up.
121 00:10:33.700 ⇒ 00:10:38.009 Ashwini Sharma: Okay. Yeah, the second one is the MMM model.
122 00:10:38.350 ⇒ 00:10:44.479 Ashwini Sharma: Which will be based on the SPINS data. So, I think that… that MMM can also start.
123 00:10:44.600 ⇒ 00:10:46.660 Ashwini Sharma: Partially. Let me confirm that.
124 00:10:46.890 ⇒ 00:10:50.770 Uttam Kumaran: Yeah, so I would try to let him know that that is unblocked.
125 00:10:50.900 ⇒ 00:10:52.580 Uttam Kumaran: And, like, how to begin on that.
126 00:10:52.580 ⇒ 00:10:53.680 Ashwini Sharma: Okay, sure.
127 00:10:54.230 ⇒ 00:10:54.910 Uttam Kumaran: Okay.
128 00:10:54.910 ⇒ 00:10:56.960 Ashwini Sharma: Yeah, that’s on the magic spoon.
129 00:10:58.630 ⇒ 00:11:01.719 Awaish Kumar: Okay, we can then move on.
130 00:11:03.370 ⇒ 00:11:05.820 Awaish Kumar: to… CTA.
131 00:11:08.030 ⇒ 00:11:17.610 Ashwini Sharma: CTA… so yesterday was all magic phones for me, right? And today, I’m looking into CTA. Catherine has changed the underlying,
132 00:11:17.910 ⇒ 00:11:24.160 Ashwini Sharma: folders in the data, right? So I’ll have to reload the data that she has put into a different schema.
133 00:11:24.450 ⇒ 00:11:27.160 Ashwini Sharma: And that is what I’m doing right now.
134 00:11:27.650 ⇒ 00:11:35.589 Ashwini Sharma: I’m also, you know, in the meanwhile, creating these source scripts, so that in case we have to load it again, we have it somewhere handy.
135 00:11:36.930 ⇒ 00:11:37.370 Awaish Kumar: Okay.
136 00:11:37.370 ⇒ 00:11:44.640 Uttam Kumaran: So, I think one thing on CTA, maybe, Ashwini, we can loop in Awash and have him get onboarded onto the client?
137 00:11:45.100 ⇒ 00:11:48.099 Uttam Kumaran: That way, he can also kind of play some coverage.
138 00:11:49.990 ⇒ 00:11:56.479 Uttam Kumaran: I can… I can go ahead and request that unless, unless you want to. I can go ahead and try to send a message.
139 00:11:57.910 ⇒ 00:12:00.700 Ashwini Sharma: Sure, anything is fine. You want me to send it? I can do that.
140 00:12:01.880 ⇒ 00:12:07.850 Uttam Kumaran: Okay, yeah, maybe if you don’t… if you don’t mind sending that and just looping him into the channel, and then…
141 00:12:07.970 ⇒ 00:12:12.220 Uttam Kumaran: Yeah, pinging Catherine and Jay, and just saying, like, we’d like to onboard Awash.
142 00:12:12.780 ⇒ 00:12:15.769 Uttam Kumaran: And then away, you can give a brief introduction.
143 00:12:15.950 ⇒ 00:12:19.440 Uttam Kumaran: That way I know, Ashwini, your time is starting to get split, so…
144 00:12:20.030 ⇒ 00:12:28.149 Uttam Kumaran: Away, a lot of our work right now is just straight DE work, so I think you’re gonna be… it’s gonna be really helpful to have you there.
145 00:12:28.910 ⇒ 00:12:31.719 Uttam Kumaran: And then once we bring on another DE, we can…
146 00:12:31.820 ⇒ 00:12:34.120 Uttam Kumaran: You know, you can start to probably pare down, so…
147 00:12:35.250 ⇒ 00:12:36.400 Awaish Kumar: Okay, yeah.
148 00:12:36.400 ⇒ 00:12:39.999 Uttam Kumaran: So yeah, let’s… let’s do that, because access may take some time today.
149 00:12:41.220 ⇒ 00:12:46.479 Awaish Kumar: Okay, did we actually work on linear and Gantt… Gantt chart on C4CTA?
150 00:12:47.130 ⇒ 00:12:48.670 Uttam Kumaran: I didn’t get a chance to…
151 00:12:48.670 ⇒ 00:12:49.390 Ashwini Sharma: No.
152 00:12:49.570 ⇒ 00:12:50.910 Uttam Kumaran: Dewey yesterday.
153 00:12:50.910 ⇒ 00:13:05.680 Ashwini Sharma: No, linear is updated with the modeling requirement, but yeah, on Monday, today’s what, Wednesday, right? Yeah. Monday, things changed. I’ll have to add one more ticket to ingest all those archived data sources.
154 00:13:06.560 ⇒ 00:13:12.540 Awaish Kumar: Okay, but is this correct? Like, this has been here for… For a few weeks now.
155 00:13:16.000 ⇒ 00:13:19.909 Ashwini Sharma: One second, man. Okay, let me refactor this today.
156 00:13:20.290 ⇒ 00:13:22.720 Awaish Kumar: Okay. Once again, let me take a note of that.
157 00:13:24.550 ⇒ 00:13:25.480 Awaish Kumar: Okay, yeah.
158 00:13:25.480 ⇒ 00:13:26.410 Ashwini Sharma: items…
159 00:13:28.310 ⇒ 00:13:31.600 Awaish Kumar: And also, like, maybe add, like, as I mentioned.
160 00:13:31.840 ⇒ 00:13:36.549 Awaish Kumar: Already, maybe we want to have a few more… Report… tickets for reports, which…
161 00:13:36.700 ⇒ 00:13:40.380 Awaish Kumar: Maybe you are already working on, but they are not here.
162 00:13:41.590 ⇒ 00:13:46.930 Uttam Kumaran: We had a long meeting on… we had a long meeting on Monday, where, like, a bunch of requirements came.
163 00:13:47.060 ⇒ 00:13:50.510 Uttam Kumaran: I was supposed to do this yesterday, I just didn’t get a chance to.
164 00:13:50.620 ⇒ 00:13:54.550 Uttam Kumaran: So, maybe once you’re on Awash, I can get your help.
165 00:13:56.320 ⇒ 00:14:02.380 Uttam Kumaran: Because my time has just really been… this is… this one’s on me, like, for driving forward, I said I would try to drive for Monday.
166 00:14:03.740 ⇒ 00:14:07.150 Awaish Kumar: Okay, okay, then we can look at it afterwards.
167 00:14:07.250 ⇒ 00:14:20.610 Awaish Kumar: Apart from that, we have… Element… For the element, we basically… Like, delivered the wholesale data.
168 00:14:20.760 ⇒ 00:14:25.040 Awaish Kumar: Cause, like, is there anything else, like, after that?
169 00:14:26.450 ⇒ 00:14:30.110 Awaish Kumar: Like, yesterday, do we have any… kind of…
170 00:14:30.110 ⇒ 00:14:32.659 Uttam Kumaran: They didn’t send any updates, I…
171 00:14:32.820 ⇒ 00:14:46.860 Uttam Kumaran: they also, like, again, this stupid formatting thing, like, we were totally right, and she kind of messed it up, but it’s fine. So, I think today, Awash, maybe we can just ping Laura and say, like, hey.
172 00:14:47.390 ⇒ 00:14:56.659 Uttam Kumaran: did it end up being useful for their meeting yesterday? And then, like, we should go ahead and get that in… we should go ahead and start, modeling
173 00:14:56.830 ⇒ 00:15:01.999 Uttam Kumaran: basically, like, a final wholesale table that we can start to schedule in DBT.
174 00:15:03.240 ⇒ 00:15:06.059 Awaish Kumar: So, like, we…
175 00:15:06.430 ⇒ 00:15:14.540 Awaish Kumar: So that, the one, the big one, which is a basic… Yeah. That is already, like, kind of in DBT, and it is…
176 00:15:14.700 ⇒ 00:15:20.010 Awaish Kumar: you can say, DVD model is running daily and up-to-date, we just need to…
177 00:15:20.010 ⇒ 00:15:20.540 Uttam Kumaran: Okay.
178 00:15:21.170 ⇒ 00:15:26.480 Awaish Kumar: run it through Polytomic to… for, like, regular updates in Google Sheet, that’s all.
179 00:15:27.480 ⇒ 00:15:30.679 Uttam Kumaran: Okay, so I guess two pieces. One is, like, we want to weave in
180 00:15:30.790 ⇒ 00:15:37.630 Uttam Kumaran: we want to weave in more, dimensions, right? Like… I think keeping the 52-week
181 00:15:38.360 ⇒ 00:15:45.019 Uttam Kumaran: thing, and the monthly thing is fine, but I also want to weave in the other dimensions there as well.
182 00:15:45.260 ⇒ 00:15:49.749 Uttam Kumaran: But there’s… I think we’re gonna have two tables.
183 00:15:49.940 ⇒ 00:15:52.789 Uttam Kumaran: Like, I think we’re gonna have… yeah, yeah, go ahead.
184 00:15:53.280 ⇒ 00:15:56.209 Awaish Kumar: Yeah, that’s what I’m saying, like, there’s one base table, right?
185 00:15:56.580 ⇒ 00:15:57.010 Uttam Kumaran: Yeah, yeah, yeah.
186 00:15:57.250 ⇒ 00:16:06.420 Awaish Kumar: just the partner’s data on a partner level. Like, on the second one is a summary view, basically, and it just has the…
187 00:16:06.600 ⇒ 00:16:11.430 Awaish Kumar: metrics, right? So we want to have these two different tables running daily, right?
188 00:16:12.140 ⇒ 00:16:13.220 Uttam Kumaran: Yes, that’s correct.
189 00:16:14.410 ⇒ 00:16:16.289 Awaish Kumar: Okay, and it should just be.
190 00:16:16.290 ⇒ 00:16:20.790 Uttam Kumaran: So if you… if you want to ship that, and then I can review, Let’s do it.
191 00:16:21.320 ⇒ 00:16:24.200 Awaish Kumar: Okay, yeah, that’s totally possible, I can do that.
192 00:16:24.720 ⇒ 00:16:32.259 Uttam Kumaran: Cool, cool. Yeah, and then that way, this week, we can collaborate with them and finalize some of those definitions. So, yeah, let’s do that.
193 00:16:32.880 ⇒ 00:16:40.309 Uttam Kumaran: And then, in our tech meeting later today, I want to just walk, that team through the first model that we developed.
194 00:16:41.060 ⇒ 00:16:41.640 Awaish Kumar: Okay.
195 00:16:42.770 ⇒ 00:16:45.399 Uttam Kumaran: So, that’s basically it for today.
196 00:16:46.630 ⇒ 00:16:49.249 Awaish Kumar: Okay, yeah, that’s… Okay, that’s the.
197 00:16:49.250 ⇒ 00:16:51.890 Uttam Kumaran: Polytomic sent us an email about, like.
198 00:16:51.890 ⇒ 00:16:56.099 Awaish Kumar: I read it, but I didn’t have… I haven’t got time.
199 00:16:56.100 ⇒ 00:16:59.319 Uttam Kumaran: of, like, I’m still, like, not, like, happy with the response.
200 00:16:59.870 ⇒ 00:17:00.460 Awaish Kumar: Yeah, I’m…
201 00:17:00.460 ⇒ 00:17:02.169 Uttam Kumaran: Just sync, just sync from reading.
202 00:17:02.170 ⇒ 00:17:04.150 Awaish Kumar: I’m also not happy, like, because…
203 00:17:04.150 ⇒ 00:17:04.960 Uttam Kumaran: Yeah.
204 00:17:04.960 ⇒ 00:17:18.170 Awaish Kumar: the problem is they already have the data, right? Shopify is no longer a blocker. They have more than 3 million rows downloaded from Shopify, but it is sitting in polyatomic.
205 00:17:20.790 ⇒ 00:17:29.420 Uttam Kumaran: Yeah, I mean, like… Yeah, I agree, like… This is pretty rough.
206 00:17:29.980 ⇒ 00:17:35.710 Uttam Kumaran: So, I don’t know, like, I don’t know what alternatives we have, though, like…
207 00:17:36.310 ⇒ 00:17:38.210 Uttam Kumaran: They need to build connectors.
208 00:17:38.560 ⇒ 00:17:42.110 Uttam Kumaran: first… maybe for cli- like, I don’t know…
209 00:17:42.690 ⇒ 00:17:46.429 Uttam Kumaran: maybe I just gotta ping Gob and say, like, yo, what’s…
210 00:17:47.700 ⇒ 00:17:59.989 Uttam Kumaran: like, what’s going on here, because for our clients, they’re gonna want more recent data first, so… I’ll piggyback on the email and just try to say, like, hey, we’d like to have a long-term plan here, because, like, we’re continuing to push Polytonic.
211 00:18:00.480 ⇒ 00:18:01.719 Ashwini Sharma: I wish got dropped.
212 00:18:02.910 ⇒ 00:18:03.879 Uttam Kumaran: Oh, okay, okay.
213 00:18:20.320 ⇒ 00:18:27.120 Uttam Kumaran: I guess otherwise, maybe Mustafa, briefly, I can, I would love if you can,
214 00:18:27.300 ⇒ 00:18:30.760 Uttam Kumaran: I left some comments on the default.
215 00:18:31.290 ⇒ 00:18:39.089 Uttam Kumaran: thing. My ask, I think, like, moving forward is, like, for you to get feedback from Robert and from.
216 00:18:39.090 ⇒ 00:18:39.420 Mustafa Raja: Yeah.
217 00:18:40.190 ⇒ 00:18:41.740 Uttam Kumaran: EPs first.
218 00:18:42.710 ⇒ 00:18:44.260 Mustafa Raja: And, like, push, like…
219 00:18:44.410 ⇒ 00:18:48.160 Uttam Kumaran: push people to give you feedback, like, tag them.
220 00:18:49.150 ⇒ 00:18:55.209 Uttam Kumaran: Like, the goal of having the different groups is for everyone to give feedback on each other’s stuff.
221 00:18:55.320 ⇒ 00:18:59.569 Uttam Kumaran: So I don’t want to continue to, like… I mean, I’m gonna kinda, like, pull myself out of it.
222 00:18:59.830 ⇒ 00:19:18.640 Uttam Kumaran: But, like, it’s up to you to work with your CSO, and then I think you guys basically did that, and then when you… when you release for feedback, go to the SLs, and go to the EPs. If you… I think… if you want, just send it into engineering and tag the people that you want reviews from. We’re a small group, right? So, like.
223 00:19:18.790 ⇒ 00:19:23.540 Uttam Kumaran: I think, probably, I would say avoid just, like, sending it with no tags.
224 00:19:23.770 ⇒ 00:19:41.429 Uttam Kumaran: always try to tag people directly, you know? Because I want a ways to look at that too, but I also want other EPs to sort of see a little bit of amplitude work. Robert, in particular, is the service lead for strategy and analytics, so he needs to give the approval. Like, I’m… consider me, like.
225 00:19:41.640 ⇒ 00:19:42.600 Uttam Kumaran: the…
226 00:19:42.990 ⇒ 00:19:50.710 Uttam Kumaran: backup, backup, backup plan. Or, like, red alert. If, like, if you, like, need a review urgently, I can come figure it out, but, like.
227 00:19:50.820 ⇒ 00:19:52.590 Uttam Kumaran: Consider me Plan D, you know?
228 00:19:52.590 ⇒ 00:20:08.929 Mustafa Raja: Yeah. Yeah, I did that. I pinged Robert, to give a review, and I, synced with, Greg, to sort of work on whatever, reviews you had, on the GAN. Okay. So, I’ve sent Robert a new word, new…
229 00:20:08.930 ⇒ 00:20:16.310 Uttam Kumaran: I actually would also want to ask if you can join the strategy stand-ups, now that you have
230 00:20:16.820 ⇒ 00:20:20.189 Uttam Kumaran: So you can go ahead and either ping Rico to add you.
231 00:20:20.460 ⇒ 00:20:32.940 Uttam Kumaran: So your job, and for all the EPs, your job is to push. Like, whether it’s through Slack or through a meeting, say, like, hey, I need a review on this, like, we’re not going anywhere until you give me a review.
232 00:20:33.100 ⇒ 00:20:40.060 Uttam Kumaran: You know? So, yeah, join the strategy meeting today, and then ask right in that meeting. Like, it’ll be a good discussion, so…
233 00:20:40.060 ⇒ 00:20:41.539 Mustafa Raja: Okay, I’ll do that.
234 00:20:41.540 ⇒ 00:20:42.270 Uttam Kumaran: Okay, cool.
235 00:20:42.580 ⇒ 00:20:47.710 Uttam Kumaran: And then Awash, yeah, let’s, maybe me and you can chat about Polyatomic offline, and we can figure it out.
236 00:20:49.500 ⇒ 00:20:56.150 Awaish Kumar: Okay, yeah, sure. And, yeah, like, for this also, like, if I get your help, actually.
237 00:20:56.560 ⇒ 00:20:59.250 Awaish Kumar: Like, we already worked on Gantt chart.
238 00:20:59.360 ⇒ 00:21:02.280 Awaish Kumar: But, yeah, if there are any missing stuff.
239 00:21:02.480 ⇒ 00:21:04.760 Awaish Kumar: Or, like, if we need a plan for…
240 00:21:05.010 ⇒ 00:21:07.499 Awaish Kumar: Next few weeks, we can just edit here.
241 00:21:07.910 ⇒ 00:21:08.620 Awaish Kumar: In…
242 00:21:08.620 ⇒ 00:21:12.779 Ashwini Sharma: Yeah, sure, I’ll sync up with you on this one to get.
243 00:21:13.700 ⇒ 00:21:15.030 Awaish Kumar: Robert, yeah.
244 00:21:15.030 ⇒ 00:21:15.790 Ashwini Sharma: Okay.
245 00:21:16.420 ⇒ 00:21:21.099 Ashwini Sharma: In the meantime, I’ll just introduce you in the CTA channel to Catherine.
246 00:21:23.300 ⇒ 00:21:28.960 Awaish Kumar: Then we have… ABC, right? We are all, like…
247 00:21:29.150 ⇒ 00:21:32.399 Awaish Kumar: how we end up on BigQuery ingestion, most far?
248 00:21:32.550 ⇒ 00:21:34.870 Mustafa Raja: Yeah, so,
249 00:21:35.130 ⇒ 00:21:53.689 Mustafa Raja: I need to, record a loom for the last bit. About 60… 65% of the data is in there, the rest of the data, it has a lot of different schemas, so I need to figure that out, with the team. So I’m going to record a loom.
250 00:21:54.230 ⇒ 00:21:58.979 Mustafa Raja: For the team to, to see how people can help me out there.
251 00:22:01.980 ⇒ 00:22:03.779 Uttam Kumaran: What data is this concerning?
252 00:22:03.870 ⇒ 00:22:22.719 Mustafa Raja: This is, this is the initial, data that we got from, ABC team for sales. I think Amber did her analysis on this, so no one’s blocked because of this, because analysis is already done. Amber said that she would still want this data
253 00:22:22.720 ⇒ 00:22:25.839 Mustafa Raja: to be in BigQuery for future reference.
254 00:22:27.090 ⇒ 00:22:31.810 Uttam Kumaran: Okay, okay, great, yeah. And I’m continuing to push on Evolve and Dream.
255 00:22:31.990 ⇒ 00:22:33.720 Uttam Kumaran: for access? Did we get cheese?
256 00:22:33.720 ⇒ 00:22:34.090 Awaish Kumar: Yup.
257 00:22:34.090 ⇒ 00:22:39.059 Uttam Kumaran: like, did we get GA data in BigQuery, or, like, what’s blocking us to do the native integration?
258 00:22:42.170 ⇒ 00:22:43.349 Mustafa Raja: Sorry, which data?
259 00:22:43.570 ⇒ 00:22:43.920 Awaish Kumar: Like, who.
260 00:22:43.920 ⇒ 00:22:45.180 Uttam Kumaran: The Google Analytics data?
261 00:22:45.180 ⇒ 00:22:45.569 Awaish Kumar: What was it?
262 00:22:45.570 ⇒ 00:22:47.869 Uttam Kumaran: If not, then let’s create a ticket for that.
263 00:22:48.090 ⇒ 00:22:50.689 Mustafa Raja: Yeah, it’s not… yeah, I don’t have context on that.
264 00:22:50.690 ⇒ 00:22:53.290 Uttam Kumaran: Let’s do that, because I think you may just have to press a button.
265 00:22:53.540 ⇒ 00:22:54.140 Mustafa Raja: Okay.
266 00:22:55.650 ⇒ 00:22:56.480 Awaish Kumar: Yeah, yeah.
267 00:22:57.230 ⇒ 00:22:59.770 Awaish Kumar: Like, it’s very easy to do that.
268 00:23:00.590 ⇒ 00:23:09.859 Awaish Kumar: Oh… Yeah, so… I think we got the service count, we got the PKD setup, we got the…
269 00:23:10.150 ⇒ 00:23:14.129 Awaish Kumar: Sales data there, some of it, and we will be easily…
270 00:23:14.370 ⇒ 00:23:22.159 Awaish Kumar: move, like, ingest GA data to BigQuery. So, what is DEX like? Like, why did we want it in BigQuery? Just for GA, or…
271 00:23:22.320 ⇒ 00:23:23.130 Awaish Kumar: Like, what’s the next.
272 00:23:23.130 ⇒ 00:23:27.110 Uttam Kumaran: No, no, no, we’re gonna be proposing them, to adopt it and…
273 00:23:27.230 ⇒ 00:23:29.390 Uttam Kumaran: Build their data warehouse on there.
274 00:23:31.290 ⇒ 00:23:35.640 Awaish Kumar: Okay. Okay, so all the evolved data and everything now goes to BigQuery,
275 00:23:35.940 ⇒ 00:23:39.100 Awaish Kumar: we will be proposing BigQuery as a warehouse.
276 00:23:40.190 ⇒ 00:23:40.690 Uttam Kumaran: Correct.
277 00:23:45.960 ⇒ 00:23:50.859 Awaish Kumar: Okay, then we have… The final one, default.
278 00:23:51.370 ⇒ 00:23:58.709 Mustafa Raja: Yeah, so, we might be, we might, we might get, a little bit behind, because,
279 00:23:58.820 ⇒ 00:24:14.280 Mustafa Raja: we were projecting, to ingest all the data sources in Mother Duck by this week, but, I see that the meeting with Polyatomic and Default is set up for this Friday.
280 00:24:14.280 ⇒ 00:24:22.570 Mustafa Raja: And we still don’t have access to all of the data sources that we would need. So, we need to push that.
281 00:24:24.850 ⇒ 00:24:32.319 Awaish Kumar: So, why do we need access to all the data sources, like, beforehand? We can do it incrementally, right?
282 00:24:33.580 ⇒ 00:24:39.760 Mustafa Raja: Yeah, I think, I think we might, we might, we own, hmm… Yeah…
283 00:24:40.520 ⇒ 00:24:49.309 Mustafa Raja: But I, they are meeting with, Polytomic. I, I need to sync, sync, with Demiladi on that. No, we can’t have…
284 00:24:49.800 ⇒ 00:24:57.499 Awaish Kumar: We can have a list of data sources, we can have an estimate of data volume, and then they can sync with the polyatomic team.
285 00:24:57.610 ⇒ 00:25:08.559 Awaish Kumar: For that, we don’t need access, and even if we have one or two data sources authentication details, we can just sync that, and we can continue to do that incrementally.
286 00:25:09.070 ⇒ 00:25:10.769 Awaish Kumar: That’s how we do.
287 00:25:10.770 ⇒ 00:25:15.129 Mustafa Raja: dual… Yeah, we do have access on the few of, data sources.
288 00:25:16.950 ⇒ 00:25:19.700 Awaish Kumar: Okay, but did we have approval for polyatomic?
289 00:25:20.080 ⇒ 00:25:21.210 Awaish Kumar: From client.
290 00:25:21.640 ⇒ 00:25:29.969 Mustafa Raja: I don’t think so, I think that is why we are, they are meeting with, Polyatomic directly. I believe Ademate will be in that meeting also.
291 00:25:31.560 ⇒ 00:25:39.459 Awaish Kumar: Okay, so that’s… so, okay, that’s the plan. We are… Yeah, so, like Actually, this does not reflect
292 00:25:39.830 ⇒ 00:25:42.500 Awaish Kumar: So, we already shipped the ETL plan, right?
293 00:25:42.500 ⇒ 00:25:43.130 Mustafa Raja: Yeah.
294 00:25:46.340 ⇒ 00:25:53.759 Awaish Kumar: Yeah, client review is… I don’t know. That’s done right. That’s why they are meeting polyatomic.
295 00:25:54.090 ⇒ 00:25:55.760 Mustafa Raja: Yeah, it’s pretty much done.
296 00:25:58.930 ⇒ 00:26:03.320 Awaish Kumar: And then, like, if we are meeting with Polyatomic, we should be… have a… we should have a…
297 00:26:03.580 ⇒ 00:26:06.929 Awaish Kumar: some kind of… Tracker here.
298 00:26:07.350 ⇒ 00:26:14.680 Awaish Kumar: Okay. Because, like, Jamie will be spending time being in that meeting, right? Okay. It will be kind of an hour long, maybe.
299 00:26:14.830 ⇒ 00:26:19.580 Awaish Kumar: Similarly, What else, in terms of tickets?
300 00:26:19.580 ⇒ 00:26:23.820 Mustafa Raja: So we started, working on the Salesforce dashboard,
301 00:26:24.740 ⇒ 00:26:30.740 Mustafa Raja: And and we are projecting this to be, done within… within this week.
302 00:26:30.980 ⇒ 00:26:34.099 Mustafa Raja: And then we wanted to, ingest the data.
303 00:26:34.210 ⇒ 00:26:37.400 Mustafa Raja: to Mother Duck, but I think this is going to take time.
304 00:26:44.920 ⇒ 00:26:49.350 Awaish Kumar: What about, set up dbt for modeling.
305 00:26:49.350 ⇒ 00:26:57.560 Mustafa Raja: Yeah, this is for… this is for next week. This is… this is going to start… this is going… going… going to start mid this week, and then.
306 00:26:57.560 ⇒ 00:26:58.150 Awaish Kumar: Ed.
307 00:27:01.140 ⇒ 00:27:05.470 Awaish Kumar: ingestion also can, like, I don’t think… We…
308 00:27:06.380 ⇒ 00:27:08.910 Awaish Kumar: We can, may… we may start, like…
309 00:27:09.770 ⇒ 00:27:14.380 Awaish Kumar: Tomorrow, if they, like, approve or something, but I don’t think so, it’s…
310 00:27:15.290 ⇒ 00:27:26.500 Mustafa Raja: Yeah. Going to be… Yeah, so I was going to, I was going to, sync with Demilade, and rework, the, Gantt chart, and then, and then I was going to reflect that on,
311 00:27:26.840 ⇒ 00:27:27.670 Mustafa Raja: Linear.
312 00:27:29.700 ⇒ 00:27:38.319 Awaish Kumar: What… so, like, are we clear on the deliverables for this week? So we will be getting approval for ETL tool.
313 00:27:38.840 ⇒ 00:27:39.190 Mustafa Raja: Yeah.
314 00:27:40.970 ⇒ 00:27:43.780 Mustafa Raja: And we want to make sure that we have all of the access that we need.
315 00:27:44.600 ⇒ 00:27:45.919 Mustafa Raja: And for the…
316 00:27:45.920 ⇒ 00:27:46.500 Awaish Kumar: Oh my god.
317 00:27:46.960 ⇒ 00:27:50.209 Mustafa Raja: The Salesforce dashboard would be one of that.
318 00:27:51.740 ⇒ 00:28:08.930 Mustafa Raja: This, this should be good. I haven’t, 2.13, I haven’t received any, any other feedback on that. And then for this, 219, Sam, Sam and Greg suggested that I should look into, Crunchpace for data.
319 00:28:08.930 ⇒ 00:28:15.049 Mustafa Raja: And then, the public companies, they do submit, some of the metrics.
320 00:28:15.790 ⇒ 00:28:18.369 Mustafa Raja: So, so I should be looking into that.
321 00:28:18.630 ⇒ 00:28:22.430 Mustafa Raja: So I’m going to take a look at that, and… I’d update this.
322 00:28:25.140 ⇒ 00:28:26.030 Awaish Kumar: Okay, and…
323 00:28:26.030 ⇒ 00:28:26.740 Mustafa Raja: This is dependence.
324 00:28:26.740 ⇒ 00:28:27.819 Awaish Kumar: We go next.
325 00:28:27.820 ⇒ 00:28:32.699 Mustafa Raja: This is going to be next week, yeah. The rerun analysis is going to be next week.
326 00:28:35.140 ⇒ 00:28:35.830 Awaish Kumar: Okay.
327 00:28:36.000 ⇒ 00:28:40.920 Awaish Kumar: So the… that are the actual deliverables for this week.
328 00:28:41.190 ⇒ 00:28:41.750 Mustafa Raja: Okay.
329 00:28:41.880 ⇒ 00:28:46.910 Awaish Kumar: Okay, I’m not touching Greg’s work.
330 00:28:47.240 ⇒ 00:28:54.830 Awaish Kumar: Okay, great. I’m good with this, like, but I just want to make sure everyone who are on the…
331 00:28:54.940 ⇒ 00:28:57.499 Awaish Kumar: AP’s role should know what are the tickets.
332 00:28:58.180 ⇒ 00:29:04.070 Awaish Kumar: on Mondays, like, that we are going to deliver on… at the weekend, by the end of week, and then on the…
333 00:29:04.680 ⇒ 00:29:12.220 Awaish Kumar: By the end of week, we should have an update from EPs that What’s done? What is delayed?
334 00:29:12.420 ⇒ 00:29:14.989 Awaish Kumar: And what is blocked, or stuff like that.
335 00:29:15.260 ⇒ 00:29:15.900 Mustafa Raja: Okay.
336 00:29:17.870 ⇒ 00:29:18.530 Awaish Kumar: Okay.
337 00:29:19.890 ⇒ 00:29:33.509 Awaish Kumar: Great. I think, okay, that’s all from my side, so if you have anything to discuss, or, like, GA4 stuff, or anything, just let me know. Like, that is, like, really few clicks.
338 00:29:33.890 ⇒ 00:29:37.430 Awaish Kumar: There, and we should be done with that.
339 00:29:37.730 ⇒ 00:29:44.759 Awaish Kumar: Sam, ashwini, if you want to sync, either with me, or, like, Dami, or anyone.
340 00:29:45.250 ⇒ 00:29:52.159 Awaish Kumar: Just let me know, right? I will be available today, between 3 to 5, 5 PM Eastern.
341 00:29:54.440 ⇒ 00:29:55.090 Ashwini Sharma: Sure.
342 00:29:59.360 ⇒ 00:30:02.349 Awaish Kumar: Yeah. Okay, thank you, thank you.
343 00:30:02.950 ⇒ 00:30:03.990 Awaish Kumar: Alright, thanks.
344 00:30:04.550 ⇒ 00:30:05.130 Awaish Kumar: Right.
345 00:30:06.040 ⇒ 00:30:06.819 Mustafa Raja: Thank you.