Meeting Title: Shreya <> Casie: Insomnia Cookies Validation Date: 2025-09-24 Meeting participants: Shreya Chowdhury, Casie Aviles


WEBVTT

1 00:01:18.550 00:01:19.420 Casie Aviles: Hey.

2 00:01:19.760 00:01:20.860 Casie Aviles: Hey, Sharon.

3 00:01:21.480 00:01:23.019 Shreya Chowdhury: Hey, how’s it going?

4 00:01:24.090 00:01:31.230 Casie Aviles: Yeah, doing good. I just stopped off a call with Mustafa. I walked him through the… Process…

5 00:01:31.640 00:01:32.990 Shreya Chowdhury: Okay, nice.

6 00:01:34.510 00:01:38.540 Shreya Chowdhury: Yeah, so that should be taken care of for next week.

7 00:01:38.680 00:01:59.789 Shreya Chowdhury: there were two things that I mainly wanted to go over. One was if we could review, the backfilled data. Like, I know you finished that and we closed out the ticket, but I just want to make sure that if we could walk through the sheet really quickly, just so I make sure that I understand the data correctly, the data limitations, and

8 00:01:59.940 00:02:02.950 Shreya Chowdhury: interpretations for when I do the analysis.

9 00:02:03.760 00:02:05.900 Casie Aviles: Sure, okay.

10 00:02:06.200 00:02:08.330 Casie Aviles: And let me just look for…

11 00:02:10.810 00:02:13.589 Casie Aviles: Alright, so we’ll start with that one, then.

12 00:02:13.590 00:02:14.200 Shreya Chowdhury: Yeah.

13 00:02:16.310 00:02:17.340 Casie Aviles: Okay.

14 00:02:19.860 00:02:23.189 Casie Aviles: Let me just… I’ll share my screen again.

15 00:02:24.130 00:02:25.090 Shreya Chowdhury: Sure.

16 00:02:35.510 00:02:39.429 Casie Aviles: I’m looking for a sheet, I might have overwritten it.

17 00:02:41.000 00:02:42.380 Shreya Chowdhury: Yeah, no worries.

18 00:02:53.700 00:02:55.329 Casie Aviles: Yeah, there’s a lot of…

19 00:02:55.560 00:02:57.120 Shreya Chowdhury: Yeah, there’s so many paths.

20 00:03:03.120 00:03:05.940 Casie Aviles: Oh my god, I forgot where it is now.

21 00:03:06.510 00:03:15.580 Casie Aviles: Should be in… Although, you did see it, right? Like, I did send you… The, the sheet, but…

22 00:03:15.880 00:03:16.469 Casie Aviles: It made me…

23 00:03:16.470 00:03:19.940 Shreya Chowdhury: Yeah, I’m looking through Slack right now,

24 00:03:21.830 00:03:25.309 Shreya Chowdhury: I think you sent me a…

25 00:03:28.690 00:03:29.940 Shreya Chowdhury: Cool, like…

26 00:03:32.990 00:03:37.019 Shreya Chowdhury: But I don’t see anything in the daily sales flash.

27 00:03:37.190 00:03:38.280 Shreya Chowdhury: Hey, guess what?

28 00:03:38.520 00:03:45.730 Shreya Chowdhury: I’m looking for is… Let me see if I can pull up.

29 00:04:04.640 00:04:06.389 Casie Aviles: I can’t find it anymore.

30 00:04:06.640 00:04:13.409 Shreya Chowdhury: Do you remember the… the password for Insomnia Cookies? From Robert’s account?

31 00:04:14.880 00:04:19.950 Casie Aviles: It should have been updated. We were having issues earlier, so…

32 00:04:19.950 00:04:23.780 Shreya Chowdhury: Do you know what the new one is? I think… I have the link, but I can’t log in.

33 00:04:25.150 00:04:30.979 Casie Aviles: Yeah, it should be in the OnePass. I can just send you the new password.

34 00:04:30.980 00:04:34.259 Shreya Chowdhury: Okay, yeah, if you can send me the new password, then I should be able to…

35 00:04:38.090 00:04:38.870 Casie Aviles: Alright.

36 00:04:40.660 00:04:44.979 Casie Aviles: Oh, this is for Google, you’re… it should be Microsoft.

37 00:04:49.820 00:04:52.010 Casie Aviles: And this one, I’ll delete the old one.

38 00:05:13.230 00:05:15.969 Shreya Chowdhury: Is there a verification code?

39 00:05:18.030 00:05:20.140 Casie Aviles: Yes, yes, there’s fine.

40 00:05:34.880 00:05:35.530 Shreya Chowdhury: Okay.

41 00:05:35.820 00:05:38.450 Shreya Chowdhury: I will… this is the link.

42 00:05:39.000 00:05:42.020 Shreya Chowdhury: With the marketing performance email tracker.

43 00:05:46.650 00:05:51.449 Casie Aviles: Yeah, this is the tracker that they use, and then we also update it here.

44 00:05:52.940 00:05:54.199 Casie Aviles: I put it in a…

45 00:05:54.350 00:06:02.820 Casie Aviles: I put the data that I pulled in, in our automation sheet, I didn’t copy it there.

46 00:06:03.460 00:06:04.230 Shreya Chowdhury: Okay.

47 00:06:05.410 00:06:14.949 Shreya Chowdhury: Where… the thing is, though, in this sheet, now I only see data starting on September 3rd, 2025.

48 00:06:15.470 00:06:17.670 Shreya Chowdhury: Do you know where all of the old data went?

49 00:06:21.670 00:06:24.269 Casie Aviles: Oh, this one, I think they have a filter on.

50 00:06:25.790 00:06:28.350 Casie Aviles: So, we can remove the filter.

51 00:06:30.890 00:06:32.549 Casie Aviles: Yeah, can you see it?

52 00:06:32.990 00:06:34.740 Casie Aviles: If you remove the filter.

53 00:06:35.620 00:06:37.420 Shreya Chowdhury: Let me… let me try.

54 00:06:42.770 00:06:46.240 Shreya Chowdhury: Yes. Okay, now I can see all of it.

55 00:06:47.310 00:06:50.190 Shreya Chowdhury: Yeah.

56 00:06:52.360 00:06:56.480 Shreya Chowdhury: Okay, that should be fine, and…

57 00:06:56.680 00:07:02.600 Shreya Chowdhury: You said we could only go so far back for…

58 00:07:03.490 00:07:10.279 Shreya Chowdhury: The data for subject lines and open rates, is that… or subject lines and clicks, is that correct?

59 00:07:11.530 00:07:14.159 Casie Aviles: Yeah, if we go to Braze…

60 00:07:14.860 00:07:19.810 Casie Aviles: If you go to… if you go to, like, one of the old… Campaigns…

61 00:07:20.430 00:07:22.930 Casie Aviles: For example, this one.

62 00:07:23.040 00:07:25.770 Casie Aviles: I’ll share… I’m sharing it on my screen.

63 00:07:28.630 00:07:31.249 Casie Aviles: It’s going to be, like, it’s expired.

64 00:07:31.410 00:07:35.679 Casie Aviles: Right? You can… can you see this? Stop campaign, and then…

65 00:07:36.430 00:07:39.390 Casie Aviles: We only have estimated audience, but…

66 00:07:40.720 00:07:45.210 Casie Aviles: The rest of the data is… Not being pulled.

67 00:07:47.450 00:07:57.130 Shreya Chowdhury: Okay, so let me just write that down so I can explain that. So, interaction data… expired… on,

68 00:07:57.450 00:08:00.960 Shreya Chowdhury: Do you know how far back we can… we are able to go, though?

69 00:08:05.480 00:08:14.730 Shreya Chowdhury: Like, it says here May 22, 2024, so are we able to get data for the months after May, up until now?

70 00:08:20.420 00:08:26.699 Casie Aviles: Sure, for that. I’ll have to check the sheets, I’m not sure why it got deleted.

71 00:08:30.950 00:08:35.419 Casie Aviles: I have… I added here, like, the Braze campaigns, test,

72 00:08:40.120 00:08:42.470 Casie Aviles: I’m sorry about this.

73 00:08:42.470 00:08:43.610 Shreya Chowdhury: No, that’s okay.

74 00:08:44.110 00:08:47.589 Shreya Chowdhury: But that should be an easy fix and add, right?

75 00:08:49.660 00:08:54.210 Casie Aviles: Yeah, I’m just looking for which version I added here.

76 00:08:56.430 00:09:03.229 Casie Aviles: Because I sent you the… Sent it to you on Tuesday, my time.

77 00:09:04.720 00:09:06.970 Casie Aviles: So that’s 23rd.

78 00:09:07.590 00:09:08.840 Casie Aviles: So sometime…

79 00:09:11.940 00:09:18.290 Casie Aviles: Hmm… I can’t find it anymore. The daily, it should be the Braze Campaigns Test.

80 00:09:19.020 00:09:19.910 Casie Aviles: sheet.

81 00:09:23.200 00:09:26.890 Shreya Chowdhury: Yeah, I see Brace Campaigns 2024.

82 00:09:31.460 00:09:32.769 Shreya Chowdhury: Let me see…

83 00:09:39.260 00:09:40.780 Casie Aviles: It should be…

84 00:09:44.380 00:09:46.420 Shreya Chowdhury: Yeah, I’m looking at the same…

85 00:09:48.380 00:09:53.390 Shreya Chowdhury: sheet that you are. Is it this one? Let me see…

86 00:10:20.230 00:10:30.270 Casie Aviles: Oh, yeah, this one is the active one that we are getting live. This one doesn’t have the rates yet, or I mean, the clicks.

87 00:10:31.520 00:10:32.370 Shreya Chowdhury: Okay.

88 00:10:34.870 00:10:41.189 Shreya Chowdhury: So, did you send me one with the clicks? Because the link that I’m looking at, the immediate export that you sent.

89 00:10:41.440 00:10:44.140 Shreya Chowdhury: Doesn’t seem to have it.

90 00:10:45.580 00:10:54.989 Casie Aviles: Yeah, I think it got overwritten, but… but if you check the image that I sent, that was it. That was the one with the image, with the clicks.

91 00:10:54.990 00:10:59.159 Shreya Chowdhury: Yeah, I see the image, but I won’t be able to pull…

92 00:10:59.390 00:11:02.300 Shreya Chowdhury: The data, or analyze it from that.

93 00:11:02.460 00:11:03.349 Casie Aviles: Yeah, yeah.

94 00:11:03.350 00:11:06.429 Shreya Chowdhury: Make sure that this sheet is updated with the proper data.

95 00:11:06.790 00:11:15.449 Shreya Chowdhury: Why don’t we just make a new sheet with all of this content as it is, and then add the clicks and subject line to it?

96 00:11:15.690 00:11:18.650 Casie Aviles: Yeah, I’ll just have to rerun the script.

97 00:11:18.650 00:11:19.050 Shreya Chowdhury: Okay.

98 00:11:19.050 00:11:20.460 Casie Aviles: Probably lost it.

99 00:11:22.870 00:11:27.020 Casie Aviles: Okay, I’ll just rerun the script that I pulled… that pulled the data.

100 00:11:28.370 00:11:30.340 Shreya Chowdhury: Okay, yeah, let’s do that.

101 00:11:32.460 00:11:39.640 Casie Aviles: Alright, so… is there anything else we need to, like, validate for, like, these ones? The ones without the clicks?

102 00:11:40.030 00:11:46.620 Shreya Chowdhury: Okay, yeah, so now we have this sheet, right, with all the data?

103 00:11:47.850 00:11:56.110 Casie Aviles: Yeah, this one has… The Breeze campaign sheet has everything except for the clicks and the subject.

104 00:11:57.350 00:12:01.560 Shreya Chowdhury: Okay, do you know when I’ll be able to… Have that.

105 00:12:03.020 00:12:05.790 Casie Aviles: Yeah, it should be today, I’ll just run it.

106 00:12:05.910 00:12:09.000 Casie Aviles: the script, and then I’ll…

107 00:12:11.640 00:12:14.870 Casie Aviles: Yeah, right after this call, I should be able to get this.

108 00:12:15.190 00:12:16.360 Casie Aviles: Okay.

109 00:12:16.680 00:12:29.220 Shreya Chowdhury: Okay. Yeah, ideally in the next couple of hours, because I do have to do some work for the October campaign, and it’ll be using this data, so I’m hoping to get that done by tomorrow.

110 00:12:31.320 00:12:41.100 Shreya Chowdhury: So… Yeah, let’s make sure that we get that in a couple of hours, and then,

111 00:12:50.740 00:12:54.190 Shreya Chowdhury: The other thing is,

112 00:12:57.210 00:13:09.050 Shreya Chowdhury: So, I’m gonna send you a couple of things that I’m looking at. So, this is what I’m seeing for year-over-year open rates.

113 00:13:13.250 00:13:20.299 Shreya Chowdhury: Basically, Insomnia wanted to look at… they have this assumption that open rates are going up.

114 00:13:20.420 00:13:34.420 Shreya Chowdhury: Right? And when I looked at the data, I was like, oh, this is actually not the case. Like, maybe in the last month or something it has gone up, but year over year overall, the open rate has not gone up.

115 00:13:34.660 00:13:38.029 Shreya Chowdhury: They shot this down as…

116 00:13:38.190 00:13:43.739 Shreya Chowdhury: just being wrong, but I ran the numbers a couple of times and checked this.

117 00:13:43.970 00:13:52.149 Shreya Chowdhury: And this is what I got each time for the month-over-month open rate. So Robert was saying that we,

118 00:13:52.840 00:14:04.349 Shreya Chowdhury: we maintain this report, so if it’s wrong, it’s on us. So he was saying to spot check, your work on the sheet maintenance. We can just check,

119 00:14:05.520 00:14:11.710 Shreya Chowdhury: like, I don’t know, we can check from 9-18 to 9-21.

120 00:14:13.490 00:14:16.010 Casie Aviles: Okay, 918 to 921.

121 00:14:16.010 00:14:17.000 Shreya Chowdhury: Yeah.

122 00:14:20.030 00:14:28.000 Casie Aviles: Alright, I will… so this is the sheet that we’re… that we used for that, right? This marketing performance tracker, okay.

123 00:14:33.190 00:14:36.210 Casie Aviles: Oldest, newest, oh, I just sorted it.

124 00:14:45.830 00:14:53.770 Casie Aviles: Okay, and then… so I will just… so, to spot check, I will just go to Braze and then check the campaigns, right?

125 00:14:55.880 00:15:02.269 Shreya Chowdhury: 918 to 921, and then, can you check it for 2024 and 2025?

126 00:15:05.500 00:15:08.339 Casie Aviles: Yeah, this is for 2025.

127 00:15:08.710 00:15:09.939 Shreya Chowdhury: Oh, okay, yeah.

128 00:15:12.360 00:15:16.620 Casie Aviles: Alright, so… I’m just gonna do random ones.

129 00:15:44.970 00:15:47.950 Casie Aviles: Okay, so for the open rate…

130 00:15:48.890 00:15:54.419 Casie Aviles: Right now, it’s at 43.94, we have 43.77 here.

131 00:15:55.830 00:16:01.090 Casie Aviles: 1.73, and then… We have 2873.

132 00:16:03.520 00:16:14.020 Casie Aviles: for the revenue. So what, what typically happens is… Depending on… When we last refreshed this.

133 00:16:16.250 00:16:18.729 Casie Aviles: It will have bumped up higher.

134 00:16:19.010 00:16:28.349 Casie Aviles: For that date, so… I know I have, like, another column here, which should show…

135 00:16:29.810 00:16:31.700 Casie Aviles: When we last updated it.

136 00:16:37.170 00:16:39.020 Casie Aviles: Might have been eating right now.

137 00:16:50.090 00:16:51.439 Casie Aviles: Okay, there we go.

138 00:16:57.220 00:17:02.230 Casie Aviles: Yeah, so… I updated this around… Hmm.

139 00:17:02.500 00:17:05.460 Casie Aviles: Earlier, so it might have changed already.

140 00:17:05.770 00:17:12.290 Casie Aviles: So… What do you think about that? Do we need it to be…

141 00:17:12.520 00:17:15.770 Casie Aviles: Always, like, as fresh as salt.

142 00:17:16.030 00:17:18.680 Casie Aviles: Because we only update this once in the day.

143 00:17:19.079 00:17:21.700 Casie Aviles: And this can bump up a little higher.

144 00:17:25.040 00:17:29.069 Casie Aviles: Do we need it to be, like, every hour we need to refresh it, or…

145 00:17:35.820 00:17:38.939 Shreya Chowdhury: percentage is too much, but I just want to make sure that…

146 00:17:39.340 00:17:50.690 Shreya Chowdhury: as I’m analyzing this data, this is correct, because when I looked at the open rates, I saw that they were actually going down, not up, and they said, no, this is plain wrong.

147 00:17:50.850 00:17:54.819 Shreya Chowdhury: So I’m gonna run the numbers again today.

148 00:17:55.110 00:18:04.130 Shreya Chowdhury: and see, but yeah, let’s make sure that they’re… As accurate as possible.

149 00:18:09.300 00:18:15.009 Casie Aviles: Yeah, because I can, like, if you run the script right now, it will probably get, like.

150 00:18:15.210 00:18:18.270 Casie Aviles: refreshed data, so…

151 00:18:22.980 00:18:26.620 Casie Aviles: Well, so let’s spot check something else.

152 00:18:26.720 00:18:30.630 Casie Aviles: Over here to 9… 21st…

153 00:18:41.270 00:18:44.759 Casie Aviles: Okay, so this one for push iOS, so this one is correct.

154 00:18:45.740 00:18:48.709 Casie Aviles: So it means this one hasn’t really changed much.

155 00:18:49.910 00:18:52.889 Casie Aviles: For the open rate, the conversion rate changed.

156 00:18:53.020 00:18:54.419 Casie Aviles: That was not there.

157 00:18:55.460 00:19:02.809 Casie Aviles: And then the revenue, 7632, so it bumped up higher than last time.

158 00:19:03.250 00:19:04.969 Shreya Chowdhury: The revenue or the open rate?

159 00:19:06.100 00:19:10.630 Casie Aviles: Yeah, the revenue and the conversion rate, but the open rate is the same.

160 00:19:10.850 00:19:16.410 Shreya Chowdhury: Yeah, okay. And, sorry, say that again? What, that was for which… which date?

161 00:19:17.740 00:19:20.799 Casie Aviles: 9.21 for this push.

162 00:19:21.160 00:19:23.160 Casie Aviles: Rewards last day of summer.

163 00:19:23.320 00:19:28.000 Shreya Chowdhury: Okay, so… Yeah.

164 00:19:28.970 00:19:32.570 Shreya Chowdhury: Okay, so our data is correct, then, is that…

165 00:19:34.560 00:19:39.779 Casie Aviles: Yeah, I would say it’s correct, it’s just that depending on which time I…

166 00:19:39.990 00:19:47.039 Casie Aviles: we updated this. Of course, when we check here on Braze, it’s going to change, so it’s gonna go up.

167 00:19:50.070 00:19:58.730 Casie Aviles: So… so, yeah, for example, I, I, refresh this, like… 3 hours ago, and then…

168 00:19:59.060 00:20:01.110 Casie Aviles: Now that we’re checking it now…

169 00:20:01.790 00:20:05.759 Casie Aviles: It’s going to bump up here on brace, but not here, necessarily.

170 00:20:06.130 00:20:10.310 Shreya Chowdhury: Okay, yeah. Is there a way we can set this up so that…

171 00:20:10.590 00:20:16.070 Shreya Chowdhury: when we refresh it, most of these updates. So, like, for example, if, like.

172 00:20:16.340 00:20:20.299 Shreya Chowdhury: I want to look at last month’s data, then it’ll be, like.

173 00:20:21.000 00:20:24.980 Shreya Chowdhury: fully refreshed? Like, are we able to run a daily refresh on this?

174 00:20:26.010 00:20:30.550 Casie Aviles: Yeah, we’re doing it daily, it’s just, we’re doing it, 9…

175 00:20:30.670 00:20:36.050 Casie Aviles: 9 AM for Eastern Time, so it’s only updated by then.

176 00:20:36.310 00:20:38.999 Shreya Chowdhury: Okay That’s fine, I think.

177 00:20:43.100 00:20:46.240 Shreya Chowdhury: But then, if… yeah, if it’s refresh day, hopefully…

178 00:20:49.680 00:20:52.090 Casie Aviles: Yeah, it is being refreshed daily.

179 00:20:54.800 00:20:56.830 Shreya Chowdhury: Yeah, okay.

180 00:21:02.060 00:21:05.480 Shreya Chowdhury: Okay, can you send me a screenshot of…

181 00:21:05.660 00:21:16.299 Shreya Chowdhury: the summary of our spot checking 918 to 921. I’m just gonna update the linear ticket with those screenshots. Or just, like, screenshots, or, like, if you can send me a brief message with, like.

182 00:21:16.530 00:21:29.029 Shreya Chowdhury: what numbers we’re seeing, and the difference in numbers, or whatever it is. Then I can close out that ticket, or just at least, like, update Robert and say, like, we went ahead and took a look at this.

183 00:21:30.310 00:21:33.170 Casie Aviles: Okay, so I’ll just, write there that…

184 00:21:33.830 00:21:37.280 Casie Aviles: Yeah, okay. What we talked about today, right? Okay.

185 00:21:37.280 00:21:49.579 Shreya Chowdhury: Yeah, that should be great. Just, like, yeah, just a brief summary of the specific spot checking and, like, what was refreshed, the data update that we saw. And you can just send that over to me, and I’ll close out the ticket for us.

186 00:21:49.930 00:21:57.830 Shreya Chowdhury: And you can do that after, like, this call, so maybe in the next couple of hours, if you’re able to get me,

187 00:21:58.190 00:22:04.039 Shreya Chowdhury: the data with the subject line and clicks, and then also that summary. Is that okay?

188 00:22:04.800 00:22:06.859 Casie Aviles: Yes, yes, I should be able to do that.

189 00:22:06.860 00:22:09.159 Shreya Chowdhury: Okay, sounds good. Thank you so much.

190 00:22:10.100 00:22:11.899 Casie Aviles: Yeah, I’m really sorry about that.

191 00:22:11.900 00:22:27.089 Shreya Chowdhury: No, that’s okay. It’s just… it’s just, this one I wanna… because they’re doing October planning, and it’s already the end of September, so that analysis I really have to finish by tomorrow, and, yeah, I just wanna… without this data, I’m not… I’m a little bit blocked on that.

192 00:22:27.590 00:22:29.320 Casie Aviles: Yeah, okay.

193 00:22:29.810 00:22:33.450 Shreya Chowdhury: But yeah, if you can get both of those to me in the next couple of hours, that would be great.

194 00:22:34.870 00:22:36.170 Casie Aviles: Okay, great. Thank you.

195 00:22:36.170 00:22:37.109 Shreya Chowdhury: Thank you so much.

196 00:22:37.760 00:22:39.039 Casie Aviles: Alright, thank you, Shreya.

197 00:22:39.040 00:22:39.830 Shreya Chowdhury: Yeah, bye.