Meeting Title: Client ABC BigQuery Integration Sync Date: 2026-03-13 Meeting participants: Pranav Narahari, Mustafa Raja


WEBVTT

1 00:00:32.220 00:00:33.440 Pranav Narahari: Hey, Mustavo.

2 00:00:33.770 00:00:34.669 Mustafa Raja: How’s it going?

3 00:00:35.050 00:00:37.989 Pranav Narahari: Thanks for hopping on the call. I’m good, I’m good.

4 00:00:38.310 00:00:48.179 Pranav Narahari: Yeah, so I just want to confirm, because they’re… I’m thinking these logs, they may be what are giving us information about, like, execution time.

5 00:00:48.390 00:00:49.239 Mustafa Raja: Yeah, yeah.

6 00:00:49.240 00:00:55.780 Pranav Narahari: Right? That’s gonna… Okay, so then that is very, I guess, essential, because we’ll need that to, like…

7 00:00:56.090 00:01:00.059 Pranav Narahari: Do reporting on for, like, accuracy, things of that nature.

8 00:01:00.950 00:01:02.209 Mustafa Raja: He’s gonna…

9 00:01:02.640 00:01:03.160 Pranav Narahari: Okay.

10 00:01:03.160 00:01:22.860 Mustafa Raja: So, so in current Snowflake, what we have is… what we do is, with each… with each execution in NHN, we send that execution to, BigQuery, right? So, not actually BigQuery, Snowflake, right? Now…

11 00:01:23.090 00:01:32.849 Mustafa Raja: What happens is, if someone, you know, thumbs up or thumbs down, that particular record that’s already in it and gets updated, you know?

12 00:01:34.360 00:01:43.920 Mustafa Raja: Now, we are not sending anything from Astra at all, you know? So, our messages are just not going to be found in Snowflake right now.

13 00:01:43.920 00:01:48.219 Pranav Narahari: So, what we can do is probably just, since…

14 00:01:48.870 00:02:01.269 Pranav Narahari: I’m guessing that the integration right now with Snowflake is easier. If you feel like that they’re equivalent, we can have them in BigQuery.

15 00:02:01.790 00:02:11.450 Pranav Narahari: But I… the… another level of complexity that I don’t want to have, like, in the next, like, few weeks is just, like, being able to compare the two.

16 00:02:11.450 00:02:22.040 Pranav Narahari: So, like, pulling in the information from Snowflake and BigQuery, is that going to be an issue? The issue is, part of the reason of the migration is that they want to fully move to.

17 00:02:22.360 00:02:25.239 Mustafa Raja: Google’s platform, right? So BigQuery…

18 00:02:25.390 00:02:27.540 Pranav Narahari: That’s true, so…

19 00:02:27.690 00:02:37.929 Pranav Narahari: I think this will be something that we definitely do. I believe this will be lightweight enough that if we need to move it over to BigQuery, like, in the future, it won’t be, like.

20 00:02:38.140 00:02:41.240 Pranav Narahari: a week’s effort, even, right?

21 00:02:43.220 00:02:54.060 Mustafa Raja: Yeah, okay, so, right now, what I should be doing is, I should… I should be sending, the… the master outputs to… what’s it called?

22 00:02:54.060 00:02:54.500 Pranav Narahari: So far.

23 00:02:54.500 00:02:59.519 Mustafa Raja: to conflict, right? Yeah. And then, and then have, the feedback.

24 00:03:00.200 00:03:07.080 Mustafa Raja: workflow, in Maestra, connect to that, rather than working, working with BigQuery right now, right?

25 00:03:07.590 00:03:11.670 Pranav Narahari: Yeah, so with BigQuery too, do we even have everything from Tim?

26 00:03:12.330 00:03:24.329 Mustafa Raja: we do have everything, part, because Amber had to do some analysis, and for that, we had to fully set up the BigQuery. So, we do have everything that we need to start working with BigQuery.

27 00:03:25.590 00:03:30.179 Pranav Narahari: Okay, so is there already, like, logs or any type of data in there?

28 00:03:30.180 00:03:42.789 Mustafa Raja: No. Because we haven’t connected the, the workflows, right? So we have, we haven’t connected the, Cloud SQL with BigQuery, right? So there’s nothing right now.

29 00:03:43.090 00:03:46.859 Pranav Narahari: Okay, yeah, so I think we just create a ticket for this in the future, like.

30 00:03:47.490 00:03:57.679 Pranav Narahari: moving everything into BigQuery. I know that that might already exist in Linear. Linear has, like, 400 tickets right now, so I need to update some of that stuff.

31 00:03:58.570 00:04:08.519 Pranav Narahari: let’s… I think it’ll be a pretty… it’ll be a pretty quick… probably Cursor can bang this out, just, like, getting it integrated into Snowflake. These logs itself aren’t, like…

32 00:04:08.910 00:04:21.640 Pranav Narahari: probably is not an insane, like, pipeline connecting it to Mashra. So just, like, you know, plugging it in and out, Snowflake in, BigQuery in the future should not be an issue.

33 00:04:21.880 00:04:24.309 Mustafa Raja: Does that sound… does that sound reasonable?

34 00:04:25.120 00:04:34.490 Mustafa Raja: Yeah, yeah, so, so my, my, my, my task is going to be, or what I’m going to take it as is, I’m going to figure out, the best, the best

35 00:04:34.850 00:04:44.080 Mustafa Raja: path, where I can, you know, integrate the, integrate sending the, output to… Snowflake, right?

36 00:04:44.110 00:04:57.010 Mustafa Raja: Because how NN does this is NN sends out… sends the AI output first to Google Chat, and then it walks towards, you know, sending the output to Snowflake.

37 00:04:57.020 00:05:04.660 Mustafa Raja: Gotcha. Right. I’m going to figure out something similar. So, the response time doesn’t get affected, right?

38 00:05:04.970 00:05:08.149 Pranav Narahari: Perfect. Yeah, that makes sense.

39 00:05:08.660 00:05:14.329 Pranav Narahari: Cool. And how are we going… how are we doing with just, like, the thumbs up, thumbs down feedback in general? .

40 00:05:14.330 00:05:19.019 Mustafa Raja: Yeah, the code logic is there. So if you would take a look at.

41 00:05:19.140 00:05:20.550 Pranav Narahari: the channel.

42 00:05:21.400 00:05:23.140 Mustafa Raja: What’s the name of the channel?

43 00:05:23.240 00:05:30.089 Mustafa Raja: ABC… client ABC logs, the recent one is from me, and it was being… it was sent from…

44 00:05:30.090 00:05:33.199 Pranav Narahari: I think I have access, actually, to that channel. Let me just add myself.

45 00:05:33.600 00:05:34.870 Mustafa Raja: I ain’t let you.

46 00:05:35.150 00:05:36.530 Pranav Narahari: Okay, perfect, thank you.

47 00:05:38.270 00:05:40.569 Mustafa Raja: Let me add you here…

48 00:05:43.730 00:05:44.960 Mustafa Raja: Ginov…

49 00:05:55.130 00:05:58.009 Mustafa Raja: Okay, I tagged you, I think you’re already in here, though.

50 00:05:59.890 00:06:01.709 Pranav Narahari: Oh, am I? Oh, maybe.

51 00:06:03.110 00:06:05.930 Pranav Narahari: I might have just had it, like, muted from a long time ago.

52 00:06:06.370 00:06:09.480 Mustafa Raja: Yeah, it’s just, too much logs, you know.

53 00:06:09.480 00:06:10.650 Pranav Narahari: Yeah. You know what I’m saying?

54 00:06:12.910 00:06:15.720 Pranav Narahari: Okay, yeah, I had it muted. Let me unmute this…

55 00:06:16.740 00:06:25.240 Mustafa Raja: Again, tagged in the recent one, and this is being… this is what I… This is what I sent from the custom route in Master.

56 00:06:25.840 00:06:26.950 Mustafa Raja: For testing.

57 00:06:28.250 00:06:32.700 Mustafa Raja: So the stuff is there, the staging would be what I will be doing.

58 00:06:33.170 00:06:35.789 Mustafa Raja: So, maybe I do our job now?

59 00:06:37.220 00:06:41.410 Pranav Narahari: Cool. And then, maybe, yeah, at the end of the day, let’s just sync on that.

60 00:06:41.690 00:06:51.360 Pranav Narahari: I would love for just, like, Yvette and Janiece to be able to just, like, poke around, just, like, make sure there’s not any weird bugs when they’re asking questions to, like, the staging Andy.

61 00:06:51.830 00:07:01.420 Pranav Narahari: And so, staging Andy already is up based on all the work that Casey’s done. Will this also be integrated to that staging bot that they have access to?

62 00:07:01.980 00:07:08.039 Mustafa Raja: I don’t know, because I don’t have any context on staging bot, on which branch it’s connected to. Do you know?

63 00:07:09.860 00:07:12.520 Mustafa Raja: Do you know which branch it’s being linked to?

64 00:07:13.590 00:07:19.680 Pranav Narahari: I will find that out for you. I’ll let you get back to work, and then, I’ll just ping you, like, on Slack. How’s that work?

65 00:07:19.680 00:07:21.039 Mustafa Raja: Yeah, that, that, that was…

66 00:07:21.040 00:07:23.650 Pranav Narahari: I need to do some research on just, like, what Casey…

67 00:07:23.810 00:07:26.360 Pranav Narahari: Casey’s update was on Wednesday before he dipped.

68 00:07:27.200 00:07:28.880 Mustafa Raja: Yep, that worked.

69 00:07:28.880 00:07:32.240 Pranav Narahari: Perfect. Cool. Thanks, Mustafa.

70 00:07:32.630 00:07:33.600 Mustafa Raja: Thank you!

71 00:07:33.600 00:07:34.449 Pranav Narahari: Yeah, talk later.