Meeting Title: GCP Cloud Run Script Discussion Date: 2025-10-27 Meeting participants: Henry Zhao, Awaish Kumar


WEBVTT

1 00:08:48.430 00:08:49.460 Awaish Kumar: Hello?

2 00:08:52.010 00:08:55.980 Henry Zhao: I don’t know if you’re in the README channel.

3 00:08:56.200 00:08:58.139 Henry Zhao: But things are getting a little crazy.

4 00:08:58.630 00:08:59.829 Henry Zhao: Oh, you’re not, okay.

5 00:09:00.300 00:09:04.470 Henry Zhao: Yeah, basically, like, yeah, there’s lots going on, so thank you for your help.

6 00:09:05.560 00:09:06.729 Awaish Kumar: No worries.

7 00:09:08.000 00:09:10.889 Henry Zhao: Okay, so I don’t know how you want to do this.

8 00:09:11.280 00:09:23.540 Awaish Kumar: Like, I have a simple, like, answer, like, I don’t know if you wanna handle it, if you want to do it, like, it’s okay, but if you wanna…

9 00:09:23.850 00:09:27.719 Henry Zhao: like, hand over it to me. Yes. I can…

10 00:09:27.720 00:09:36.070 Awaish Kumar: do that if, If that’s what you think. Whatever you think is… is right, right?

11 00:09:36.210 00:09:48.260 Awaish Kumar: So I… what I can tell you, why I proposed Dexter, is that Dexter is the one… is, like, for the GCP Cloud Run, you have to create a script, then you write down your function there.

12 00:09:48.400 00:10:02.700 Awaish Kumar: And it will run on time, some, like, but we don’t have any visibility into what’s happening. If it fails sometimes, you just… you have to go to GCP and figure out if it has failed, or whatever happened to the function, and fix it.

13 00:10:02.700 00:10:15.100 Awaish Kumar: So why with… like, that’s why we introduced Dexter in the past. Dexter is just a tool, like this Google Cloud Function, to run the scripts on some schedule. There’s nothing fancy there. So…

14 00:10:16.410 00:10:31.180 Awaish Kumar: why we can use, and, like, then you mentioned we have to write JavaScript. That’s not what we have to do, right? They shared a JavaScript, which you have, in your hand, and you can directly use…

15 00:10:31.180 00:10:33.050 Henry Zhao: Woosh, whoosh!

16 00:10:33.050 00:10:44.110 Awaish Kumar: Google Cloud Run and use that, but what I’m suggesting is that now with the GPT, you can easily convert it to a Python script, so you don’t need a JavaScript.

17 00:10:44.110 00:10:55.630 Awaish Kumar: that JavaScript… that is a script which Catalyst already wrote, because they maybe have JavaScript developers, right? And what… what that script is doing is basically sending… like, calling an API.

18 00:10:55.810 00:11:03.810 Awaish Kumar: to send some, and it is making some API calls with orders data, right? It collects some orders…

19 00:11:04.160 00:11:10.170 Awaish Kumar: It does something, and then just sends it, On… on the endpoint, right?

20 00:11:10.170 00:11:12.430 Henry Zhao: Okay, we can test and see if it works.

21 00:11:12.450 00:11:23.840 Awaish Kumar: Because the Catalyst engineer said those are the only two options, but you’re right, if you can convert it to Python, it works. I can read it for you, right? What it just do, right?

22 00:11:25.280 00:11:31.790 Henry Zhao: So this is the… so this is the script that you helped me approve this morning. So that has the columns you need.

23 00:11:32.190 00:11:42.659 Awaish Kumar: I understand that, like, what I’m trying to say is that what that JavaScript is doing, it is reading the data from your table.

24 00:11:42.660 00:11:46.069 Henry Zhao: No, that’s fine. I’m just explaining to you now what needs to be done.

25 00:11:46.360 00:11:48.660 Henry Zhao: And then body data order number…

26 00:11:50.080 00:11:52.690 Awaish Kumar: I exactly understand, what…

27 00:11:53.750 00:11:59.260 Awaish Kumar: what is the task? So, yeah, that’s… I won’t just want to make it, quick.

28 00:12:00.010 00:12:01.990 Henry Zhao: Yeah, that’s what I’m writing this for you now.

29 00:12:02.500 00:12:06.970 Henry Zhao: Timestamp, you can use… To see when the order was updated.

30 00:12:07.760 00:12:10.629 Awaish Kumar: to update only new orders, I guess…

31 00:12:11.160 00:12:14.600 Awaish Kumar: And I think that JavaScript, which you have in your hands.

32 00:12:14.700 00:12:21.509 Awaish Kumar: is… I don’t know, I think they share it with you to lose it in segment, right?

33 00:12:22.140 00:12:22.460 Henry Zhao: Yeah.

34 00:12:22.460 00:12:22.990 Awaish Kumar: Agreed.

35 00:12:23.190 00:12:24.870 Henry Zhao: No, they said that those are the…

36 00:12:25.550 00:12:27.819 Henry Zhao: Order number, sorry. Order number is…

37 00:12:28.060 00:12:28.610 Awaish Kumar: Nope.

38 00:12:28.920 00:12:29.840 Awaish Kumar: I just said.

39 00:12:29.840 00:12:35.740 Henry Zhao: But if we want to update… thank you. Page tracking.

40 00:12:36.390 00:12:48.989 Awaish Kumar: So, like, there’s a problem, right? If you have to use that script in a destination function, so that… what happens is segment is sending that data as an input, so that part…

41 00:12:49.030 00:13:04.069 Awaish Kumar: is already handled by Segment, and we are using some script to read that data and send it somewhere else. If you put it in GCP Cloud Run, it won’t work like that, because GCP Cloud Run won’t gather data for us.

42 00:13:04.070 00:13:14.910 Henry Zhao: Yeah, I was thinking about using the GCP Cloud Run to send the rows of the model as events to segment, then we do what I showed you last week, which is use segment destination function to read those events and insert.

43 00:13:14.910 00:13:21.189 Awaish Kumar: Yeah, so you have to, like, update your script to basically get the data from BigQuery, and then send it to Catless.

44 00:13:21.190 00:13:21.840 Henry Zhao: Right.

45 00:13:22.790 00:13:28.859 Henry Zhao: So I… so I will… so I will send you the… Bring forge…

46 00:13:29.990 00:13:36.749 Awaish Kumar: what I need, if you wanna… if you’re looking to hand over this task to me, then what I need is what…

47 00:13:36.890 00:13:42.320 Awaish Kumar: fields you need… you want me to send to, Catalyst, or if there’s a really…

48 00:13:42.320 00:13:42.940 Henry Zhao: Good morning for you here.

49 00:13:42.940 00:13:43.510 Awaish Kumar: Correct.

50 00:13:44.320 00:13:47.150 Awaish Kumar: Cause, yeah, I, I,

51 00:13:47.820 00:13:58.440 Awaish Kumar: I see, that, but I don’t like… if I look at JavaScript, I can understand more, but if you have any of the information, just, like, give me that, and that’s all.

52 00:13:58.650 00:14:02.289 Henry Zhao: just, these are the information that I have. Or it says we updated to pay for…

53 00:14:02.600 00:14:05.030 Henry Zhao: The orders that exist in the model.

54 00:14:05.340 00:14:10.430 Awaish Kumar: So that’s okay, yeah. If I need anything, I will just ping you, but otherwise, it’s good enough.

55 00:14:10.960 00:14:16.220 Henry Zhao: Okay, so I made it a wish, you can update the number of points, it’ll probably take 3 or more, but I’ll let you decide that.

56 00:14:17.640 00:14:20.730 Awaish Kumar: Okay, and what is… is it, like, is…

57 00:14:20.950 00:14:23.469 Awaish Kumar: What is the deadline? Do you need it today?

58 00:14:23.740 00:14:26.839 Awaish Kumar: They needed it two weeks ago, so just as soon as possible.

59 00:14:27.320 00:14:28.160 Awaish Kumar: Okay.

60 00:14:28.160 00:14:36.149 Henry Zhao: That’s why people have been freaking out at me, because this was supposed to be done two weeks ago. But it’s not my fault, because just things have been coming up non-stop from there. Okay, we can handle it.

61 00:14:36.680 00:14:46.100 Awaish Kumar: Yeah, I can write a script today, but what I need from you is, to test it, Oh…

62 00:14:46.100 00:14:46.610 Henry Zhao: Absolutely.

63 00:14:46.930 00:14:53.220 Awaish Kumar: Is there any order? Like, can I just send something? Some order, like, as in.

64 00:14:53.220 00:14:55.080 Henry Zhao: Don’t break anything, so you can just send it.

65 00:14:55.430 00:14:57.080 Awaish Kumar: Okay, we… I can sense…

66 00:14:57.450 00:15:01.400 Awaish Kumar: I can write a script, and then we can send one or two or three orders.

67 00:15:01.400 00:15:06.729 Henry Zhao: Yeah, send one order, exactly. Just one order from the model, and we can see in Catalyst if it changed.

68 00:15:07.770 00:15:08.840 Awaish Kumar: Yeah.

69 00:15:08.990 00:15:12.329 Henry Zhao: Preferably one with, like, a heightened order number, so we can…

70 00:15:12.490 00:15:15.580 Henry Zhao: Make sure that that’s not just a coincidence that it stayed as one.

71 00:15:19.350 00:15:21.460 Awaish Kumar: One with what? Higher?

72 00:15:22.020 00:15:32.789 Henry Zhao: So there’s an order number column. If you want to just pick any random order, pick one where that number’s not 1, so you can just test if that field updated as 1, or as 2, or higher.

73 00:15:33.210 00:15:35.410 Henry Zhao: Because it might be a coincidence that was updated as one.

74 00:15:36.260 00:15:38.359 Awaish Kumar: Oh, okay, maybe…

75 00:15:38.440 00:15:39.930 Henry Zhao: We’re gonna talk about that when we get there.

76 00:15:39.930 00:15:42.440 Awaish Kumar: Just send me the order ID, I will just use that.

77 00:15:42.440 00:15:43.030 Henry Zhao: Okay.

78 00:15:43.520 00:15:46.799 Henry Zhao: Just let me know when you’re ready for that test ID, and I’ll send it to you.

79 00:15:47.380 00:15:50.269 Henry Zhao: Two other questions before the hour ends.

80 00:15:50.410 00:15:54.299 Henry Zhao: Were you able to help Stuart with the thing that he asked about on Friday?

81 00:15:55.980 00:16:02.980 Awaish Kumar: Obviously not, right? He asked me to standardize the fee product names, that’s…

82 00:16:03.610 00:16:13.060 Awaish Kumar: One of the tasks which we can add in our linear, And, second one… Was just, like.

83 00:16:13.640 00:16:21.499 Awaish Kumar: why there’s no campaign name, that’s because we can’t get it from API, and there’s no campaigns in Catalyst, so that’s… that’s all.

84 00:16:23.080 00:16:23.670 Henry Zhao: Okay.

85 00:16:25.870 00:16:33.710 Awaish Kumar: Yeah, I… but we can standardize butter greens, that’s what I… I can do, and yeah, I will maybe try to finish that.

86 00:16:33.910 00:16:35.540 Awaish Kumar: After this script is done.

87 00:16:35.540 00:16:45.609 Henry Zhao: Yeah, after this one, yeah, thank you. And then the last thing is I had a question this morning on, do you remember when you added, like, 250,000 additional customer I.O. profiles?

88 00:16:45.830 00:16:54.420 Awaish Kumar: I just, I just have to… I think it was just that table called Russeer of, like, user profiles.

89 00:16:55.360 00:16:56.609 Awaish Kumar: But, yeah, yeah.

90 00:16:56.610 00:16:57.770 Henry Zhao: Just added it to that table.

91 00:16:58.020 00:17:03.969 Awaish Kumar: niche user profiles. In that table, I just, like, what we… what was missing, you said, is that…

92 00:17:04.310 00:17:06.989 Awaish Kumar: the user ID, right? So I just…

93 00:17:07.550 00:17:19.019 Awaish Kumar: We have an existing table, and I used left-handed with the product, and just got the user ID where the phone number on the email matches.

94 00:17:19.020 00:17:25.669 Henry Zhao: Okay, great. Okay, great, now I know how to do this, so now I just need to change user ID to email to map correctly. Alright, thank you, Aish.

95 00:17:25.880 00:17:27.619 Henry Zhao: That was it for that question.

96 00:17:28.610 00:17:29.419 Awaish Kumar: Thank you. Bye.

97 00:17:29.420 00:17:31.300 Henry Zhao: Alright, thank you so much. Take care.