Meeting Title: ReadMe Experiment Planning Check-in Date: 2025-08-08 Meeting participants: Robert Tseng, Phoebe Miller
WEBVTT
1 00:00:16.650 ⇒ 00:00:17.530 Robert Tseng: Hey! Phoebe!
2 00:00:17.530 ⇒ 00:00:18.350 Phoebe Miller: Hi.
3 00:00:19.710 ⇒ 00:00:20.550 Robert Tseng: How’s it going.
4 00:00:20.550 ⇒ 00:00:25.470 Phoebe Miller: My-, my dog is bark. Yeah, that cool
5 00:00:26.086 ⇒ 00:00:33.370 Phoebe Miller: we’re we’re. I’m good. I’m out on Long Island with family so dogs and people, and it’s a little bit.
6 00:00:33.370 ⇒ 00:00:33.950 Robert Tseng: Yeah.
7 00:00:34.120 ⇒ 00:00:41.980 Phoebe Miller: But good other than that, and just getting back from a couple of weeks being away from the office. Sorry. Kick him out of here one second.
8 00:00:41.980 ⇒ 00:00:43.179 Robert Tseng: Yeah. Yeah. No worries.
9 00:00:55.490 ⇒ 00:00:57.889 Phoebe Miller: Okay. How are you?
10 00:00:58.480 ⇒ 00:01:06.755 Robert Tseng: I’m good. I guess. Yeah. It’s been like almost a month, ish, since we last caught up. I was
11 00:01:08.188 ⇒ 00:01:14.349 Robert Tseng: we went on a little bit of a conference kind of tour, I guess, Lasf Denver, and came back.
12 00:01:14.350 ⇒ 00:01:14.729 Phoebe Miller: I don’t know.
13 00:01:15.070 ⇒ 00:01:19.359 Robert Tseng: Yeah. So those were good. Glad to be back last couple of weeks.
14 00:01:19.810 ⇒ 00:01:35.865 Robert Tseng: yeah. So I mean, the weather in New York is amazing. They got like the summer streets on Saturdays this month. So so nice and like, it’s crazy that it’s August. And it’s not that hot outside. So yeah, it’s a. It’s a really good time to be here.
15 00:01:36.180 ⇒ 00:01:42.329 Phoebe Miller: Perfect this weekend. I’m so excited we’re we’re actually we’re moving to 89th
16 00:01:42.760 ⇒ 00:01:46.420 Phoebe Miller: and Amsterdam in like 3, 4 weeks, so I’ll be.
17 00:01:46.420 ⇒ 00:01:47.640 Robert Tseng: Oh, no. Way. Yeah. Okay.
18 00:01:47.640 ⇒ 00:01:51.470 Phoebe Miller: From, you know, and my my husband’s starting at Columbia. So.
19 00:01:51.880 ⇒ 00:01:52.800 Robert Tseng: Oh, yeah. Yeah. Yeah.
20 00:01:52.800 ⇒ 00:01:55.660 Phoebe Miller: Getting closer. Yeah, I’m excited.
21 00:01:55.850 ⇒ 00:01:59.616 Robert Tseng: Yeah, yeah, you’re you’ll be just 20 blocks up for me.
22 00:02:00.204 ⇒ 00:02:11.200 Phoebe Miller: But yeah, the I can’t remember if the last time we chatted was before. So we I’ve been on a tear as well, because we had that launch week where we like drove across the country, and I got to.
23 00:02:11.200 ⇒ 00:02:11.620 Robert Tseng: Yeah.
24 00:02:12.750 ⇒ 00:02:18.710 Phoebe Miller: See your partner. And then you came to the New York based one where you saw Greg’s magic trick right? And then.
25 00:02:18.710 ⇒ 00:02:19.170 Robert Tseng: Yeah.
26 00:02:19.983 ⇒ 00:02:27.060 Phoebe Miller: And then I had like a week or 2 home, and then we went to Montana for our company. Retreat.
27 00:02:27.370 ⇒ 00:02:27.850 Robert Tseng: Cool.
28 00:02:27.850 ⇒ 00:02:34.249 Phoebe Miller: And then I was just in Greece and Italy the last like
29 00:02:34.580 ⇒ 00:02:39.670 Phoebe Miller: week and a half straight from Montana. So it’s been like a whirlwind of a Yeah.
30 00:02:39.670 ⇒ 00:02:40.920 Robert Tseng: Busy summer.
31 00:02:40.920 ⇒ 00:02:49.850 Phoebe Miller: Summer. Yeah, but it feels like now, you know, people are back and and focus. And so appreciate your patience as we figure out kind of like what the next
32 00:02:50.520 ⇒ 00:02:53.468 Phoebe Miller: stage of this engagement might look like.
33 00:02:53.890 ⇒ 00:02:54.460 Robert Tseng: Yeah.
34 00:02:55.000 ⇒ 00:03:00.423 Phoebe Miller: I guess so from your perspective. Currently,
35 00:03:02.350 ⇒ 00:03:08.229 Phoebe Miller: amplitude is implemented as much as well as it can be, or are there still little Nits.
36 00:03:08.650 ⇒ 00:03:33.150 Robert Tseng: Yeah, I mean, I think, the bases are covered, like, you know, we’re at a foundational place now, like, I’m I think there’s probably a need for just kind of like maintenance. Keep that momentum going, kind of keep making tweaks to reports and stuff, and start to just regularly read out on the insights so that it becomes like a ritual for your team. But yeah, I think there’s definitely enough there to kind of keep keep asking questions and digging into things.
37 00:03:33.702 ⇒ 00:03:37.680 Robert Tseng: Yeah, I mean, obviously, over time, you know, there’s
38 00:03:37.790 ⇒ 00:03:43.630 Robert Tseng: more adjustments that you can make because we kind of did the very basic like auto tracker. But if you want to like.
39 00:03:44.000 ⇒ 00:04:11.209 Robert Tseng: you know, have a higher degree of confidence for some of these like especially payment events, or anything that’s like a strong conversion kind of like signal like you might need to change the tracking not from like kind of the way that it’s implemented right now, but actually do some server side tracking. So there’s like some adjustments in terms of like that you can build along the way. But this is, I think this is a good good start. There’s like, I’m sure it’s been collecting a lot of data. I haven’t looked at it in a in a while. But yeah.
40 00:04:12.091 ⇒ 00:04:27.079 Phoebe Miller: Okay? And so the my plan, now that I’m like back in focus, is to start churning out more experiments with a higher frequency. And so I guess what I would hope
41 00:04:27.280 ⇒ 00:04:32.670 Phoebe Miller: you all could help with is like, as I think through those experiments you then help
42 00:04:33.020 ⇒ 00:04:44.839 Phoebe Miller: track what it is that we are implementing and then report on the success. And I don’t know if it it’s we can chat through like what the format of reporting is maybe just like send something to me that I can digest and read out
43 00:04:46.190 ⇒ 00:04:52.360 Phoebe Miller: but that’s kind of like where I see this going. I don’t know how that lines up with what you guys offer.
44 00:04:52.590 ⇒ 00:05:12.617 Robert Tseng: Yeah, no, I think that’s great. I think. That’s a. It’s a good motion to keep keep the product analytics work kind of going. And yeah, I mean, I think that’s you know, we want to be able to give you. I mean, create that feedback loop where you feel like, you can ask questions, actually get answers, because that’s what’s gonna kinda keep growing the the partnership there.
45 00:05:13.260 ⇒ 00:05:32.379 Robert Tseng: But yeah, I mean, I think the obviously self service. Just kind of a small part of the business like there’s other kind of things going around. I don’t know if you there were any like adjustments that were made kind of based off of like, I know you guys did offsite. Maybe some board meeting as well. Are things kind of still kind of what they were before, or any any like kind of pivots that are.
46 00:05:32.480 ⇒ 00:05:33.169 Robert Tseng: You should be aware of.
47 00:05:34.350 ⇒ 00:05:39.230 Phoebe Miller: We are doing more to build
48 00:05:39.838 ⇒ 00:05:46.280 Phoebe Miller: or like position. Read me as a destination for AI like document
49 00:05:47.208 ⇒ 00:05:54.770 Phoebe Miller: apis for the consumption of AI as well as but just like
50 00:05:55.380 ⇒ 00:06:00.068 Phoebe Miller: adding tools on top of documentation. So like, you know, Mcp servers,
51 00:06:01.010 ⇒ 00:06:06.550 Phoebe Miller: AI, and things like that. So that is in progress work. But the thing about
52 00:06:07.070 ⇒ 00:06:09.870 Phoebe Miller: all the stuff besides self serve is that
53 00:06:10.020 ⇒ 00:06:18.780 Phoebe Miller: Greg has such strong opinions that he’s not super interested in insights to drive those hypotheses.
54 00:06:18.780 ⇒ 00:06:19.100 Robert Tseng: Yeah.
55 00:06:20.280 ⇒ 00:06:23.620 Phoebe Miller: It’s really only the self serve where it’s like
56 00:06:24.740 ⇒ 00:06:35.760 Phoebe Miller: we wanna run this kind of like experiment motion. Everything else like Greg is pretty content to. He feels he knows what we need to build. And we’re just gonna go build it. And it’s not.
57 00:06:35.760 ⇒ 00:06:36.290 Robert Tseng: Okay.
58 00:06:36.290 ⇒ 00:06:40.939 Phoebe Miller: Interested in, like the reception from the customers.
59 00:06:41.340 ⇒ 00:07:03.293 Robert Tseng: Sure. Yeah, I know when you met with my partner Utam in Austin, I mean, he’s definitely more kind of on the beating the AI engineering side of our business, and like he’s all about talking how to automate workflows and kind of help. Kind of bring I guess. AI into into teams like yours. So I don’t know if there was anything from there where you felt like we could help with.
60 00:07:03.590 ⇒ 00:07:15.019 Robert Tseng: yeah, I’m just trying to like. I mean, it’d be great. I mean, I think the scope of the product analytics scope. There’s a clear kind of like runway to keep that going, just trying to see if there’s any kind of room for expansion where I can bring other people from my team as well.
61 00:07:15.020 ⇒ 00:07:19.960 Phoebe Miller: Yeah, I don’t think so.
62 00:07:20.500 ⇒ 00:07:27.661 Phoebe Miller: but I I’ll have to think a little bit more about it. At this point. Not not nothing that comes to mind.
63 00:07:27.960 ⇒ 00:07:28.640 Robert Tseng: Okay.
64 00:07:28.880 ⇒ 00:07:32.539 Phoebe Miller: But I guess it would be helpful to hear you know what the
65 00:07:32.850 ⇒ 00:07:35.670 Phoebe Miller: potential solutions that you all can
66 00:07:35.860 ⇒ 00:07:47.080 Phoebe Miller: do like. I don’t. I don’t. There’s nothing there’s nothing like. I don’t have any problems I need solving. That might mean that I just like don’t know what the potential solutions are right.
67 00:07:47.080 ⇒ 00:07:47.710 Robert Tseng: Sure.
68 00:07:48.870 ⇒ 00:07:54.259 Robert Tseng: Yeah, no, it makes sense, I think. Hopefully, as we get into more of a rhythm. And I understand kind of the
69 00:07:54.540 ⇒ 00:08:05.220 Robert Tseng: the things that you and your team are doing like. I mean, we’ve built a lot of solutions for ourselves internally. So I could always just be like, hey, we we do it this way, like, Have you thought about that before? And see if that’s helpful? Yeah.
70 00:08:05.501 ⇒ 00:08:10.849 Phoebe Miller: So how does it work? How would it work? How would you structure the next phase of the engagement.
71 00:08:11.465 ⇒ 00:08:28.920 Robert Tseng: Yeah, I mean, I think if we wanted to, I mean, ideally, I’d like to just have like some predictable like plant capacity. I guess. So. Yeah, if it’s like a bucket of hours that we wanted to do, like 10 to 20 h to start or something a week, and then we can just kind of
72 00:08:29.040 ⇒ 00:08:38.190 Robert Tseng: we can just structure it as a retainer kind of thing where we’re yeah, like, it’s, it’s, you know, we could just keep. Keep something that’s like hourly
73 00:08:38.461 ⇒ 00:09:02.330 Robert Tseng: but if we wanted to do kind of like fixed pricing things, then I think we probably do more do more work upfront to like, really plan out like sprints. And then we kind of just pay paper sprint. And you can be like, Okay, maybe one sprint. We would need to do a lot more, and then maybe other space. We can like wind it down. So that’s like a way to kind of like dial like, I don’t know, like dial dial in the level
74 00:09:02.330 ⇒ 00:09:18.840 Robert Tseng: of work that we want to do. So. It just it really depends on how involved. You want to be on the management side, because for us, like we ticket everything internally and like, I know the capacity of our engineers like. I know my own capacity when I’m on it on a project, and like where? Where I want to plug into so yeah, I think we can.
75 00:09:18.840 ⇒ 00:09:32.457 Robert Tseng: You know, if if this is very much like you want to give me the keys, and we just you give me the questions, and I kind of I I build out the roadmap. I run the tickets by you and everything, and I I think that maybe the we like the the actual
76 00:09:33.370 ⇒ 00:09:38.959 Robert Tseng: like the the hourly set makes more sense. But if you want to be more hands on, I think.
77 00:09:39.080 ⇒ 00:09:50.719 Robert Tseng: and want to be in our sprint planning and like kind of defining like, Hey, like this is the priority for the next 2 weeks or the next 4 weeks. Then, I think maybe the fixed pricing model could end up being better. Yeah.
78 00:09:50.720 ⇒ 00:09:54.629 Phoebe Miller: I don’t have a good concept of how many hours
79 00:09:54.820 ⇒ 00:10:04.023 Phoebe Miller: this the stuff that I will ask of you will take so I don’t know. It might make sense to go hourly for like a month, or whatever
80 00:10:04.710 ⇒ 00:10:08.500 Phoebe Miller: to see what the actual demand is on our side.
81 00:10:08.960 ⇒ 00:10:09.510 Robert Tseng: Okay.
82 00:10:10.990 ⇒ 00:10:14.250 Phoebe Miller: And then we can. We can go to a retainer after that, because.
83 00:10:14.250 ⇒ 00:10:14.610 Robert Tseng: Yes.
84 00:10:14.610 ⇒ 00:10:31.214 Phoebe Miller: You. I mean, you’ve you’ve seen like this hasn’t been my number one priority the last couple of weeks, so I’m not predictable right now. And like the work that I want to get to a place where it is predictable, and we’re in a good like operating rhythm.
85 00:10:31.670 ⇒ 00:10:36.339 Phoebe Miller: And then it might make sense to to put something more recurring on there.
86 00:10:36.620 ⇒ 00:10:51.480 Robert Tseng: Yeah, that makes sense, I think. Yeah, I would still say, this is pretty early on, like, obviously, you’re our main champion. And I like, wanna yeah, appreciate like, kind of the the way you’ve asked for us so far. But like, yeah, I want to make sure that you feel good about the way that we’re kind of crushing it for you. And
87 00:10:52.257 ⇒ 00:10:56.280 Robert Tseng: yeah, I think like that. That’ll we’ll work up to that.
88 00:10:56.280 ⇒ 00:11:09.059 Phoebe Miller: Yeah, cool. So can I just ask while we’re and just, I guess, let me know. Send me a proposal or something of on how the the hourly.
89 00:11:09.290 ⇒ 00:11:09.940 Robert Tseng: Yeah.
90 00:11:09.940 ⇒ 00:11:11.160 Phoebe Miller: Would work.
91 00:11:12.480 ⇒ 00:11:16.785 Phoebe Miller: So when I go into amplitude now,
92 00:11:17.980 ⇒ 00:11:24.949 Phoebe Miller: The reports that you already built is that under is it? Under a space.
93 00:11:26.322 ⇒ 00:11:33.579 Robert Tseng: So yeah, I think because of the way your amplitude environment is, I could I feel like it was.
94 00:11:34.270 ⇒ 00:11:39.299 Robert Tseng: it might be in a private space like I remember there being limited option. Let me just quickly jump in there. Just like kinda
95 00:11:39.300 ⇒ 00:11:43.180 Robert Tseng: I guess. Yeah, what I would love like, what I would love is if there’s a place.
96 00:11:43.400 ⇒ 00:11:57.619 Phoebe Miller: And we can figure out like our ways of working. But if there was a place where I can, because I don’t think you need to join that weekly meeting. It’s probably a waste of your time. But if there’s a a place that I can go on a weekly basis just to like report back
97 00:11:57.770 ⇒ 00:11:59.680 Phoebe Miller: to the team.
98 00:12:00.900 ⇒ 00:12:15.910 Robert Tseng: Yeah. So everything’s in my space right now. I haven’t moved anything to the communal space, the team spaces, I guess. We could. I could just move into one that you want me to, and then I could keep it organized from from there. But so maybe that’d be a better way to get everything shared.
99 00:12:16.200 ⇒ 00:12:18.510 Phoebe Miller: Seen a space called self serve conversion.
100 00:12:18.700 ⇒ 00:12:19.750 Robert Tseng: Okay. Great.
101 00:12:20.010 ⇒ 00:12:21.270 Phoebe Miller: Adding you.
102 00:12:43.490 ⇒ 00:12:56.609 Phoebe Miller: yeah, that’s that’s like what I am at. So basically, we’ve only successfully gotten one experiment off the ground. The change in the onboarding.
103 00:12:56.610 ⇒ 00:12:57.090 Robert Tseng: Yeah.
104 00:12:57.510 ⇒ 00:13:04.980 Phoebe Miller: And then Jacqueline’s working on experiment number experiment number 2 with the coach marks the
105 00:13:09.960 ⇒ 00:13:11.560 Phoebe Miller: Check checklist.
106 00:13:12.266 ⇒ 00:13:20.340 Phoebe Miller: So once that is in place like that would be the next thing to track is like, because the coach marks haven’t been released.
107 00:13:21.110 ⇒ 00:13:31.580 Phoebe Miller: And then all those feature experiments that you kind of set up tracking for. Those haven’t. No, no progress has been made on those. So like we’re talking about like changing
108 00:13:32.335 ⇒ 00:13:40.229 Phoebe Miller: email flows based off of certain action or inaction like nothing’s nothing’s happened there. Things like that.
109 00:13:41.640 ⇒ 00:13:42.330 Robert Tseng: Okay.
110 00:13:42.550 ⇒ 00:13:50.550 Robert Tseng: yeah. I mean, I think you know, I think a natural like progression of, you know. Obviously, we have all the stuff that we can track within the product. But you know, once
111 00:13:51.427 ⇒ 00:14:05.660 Robert Tseng: like the amplitude, I by itself is not great at like account level reporting obviously for the self serve. These are all individual users. Maybe, you know, if we I think that’s kind of where, like a lot of the
112 00:14:05.710 ⇒ 00:14:23.734 Robert Tseng: I I mean, I’m I’m like most of your book of businesses, like from bigger accounts, with many users, right? So like, I think when that when we get to a point where we want to do account level kind of analysis as well. I think that’ll probably need, like other data sources as well. Probably your Crm,
113 00:14:24.520 ⇒ 00:14:50.710 Robert Tseng: yeah. And and I guess I’m trying to think of what other account levels I mean, whatever we’re using for engagement. I don’t know if you use. Obviously, you have stuff in in app. That, like Jacqueline designs and everything. But maybe on the email side, whoever you’re on your lifecycle team is so like I can. I can just see, I kind of foresee that those, maybe those are just new bridges that like I would need to build with people to. Eventually, like.
114 00:14:51.050 ⇒ 00:14:53.690 Robert Tseng: you know, as as the questions get more complex and we’re.
115 00:14:53.690 ⇒ 00:14:54.030 Phoebe Miller: Yeah.
116 00:14:54.030 ⇒ 00:14:57.859 Robert Tseng: Trying to like. Stretch them. I think that’s kind of where this it’ll it’ll head.
117 00:14:58.020 ⇒ 00:15:00.440 Phoebe Miller: Okay, cool. Yeah, I there’s
118 00:15:01.465 ⇒ 00:15:13.589 Phoebe Miller: not like, really any other stakeholder involved. So on the marketing side, I run. I run our marketing on sales our.
119 00:15:13.590 ⇒ 00:15:15.699 Robert Tseng: Did we meet for marketing again? I forgot.
120 00:15:15.700 ⇒ 00:15:16.750 Phoebe Miller: Justina, Justina.
121 00:15:16.750 ⇒ 00:15:17.599 Robert Tseng: Justina, yeah, yeah.
122 00:15:17.600 ⇒ 00:15:19.608 Phoebe Miller: Yeah. So she’s doing like
123 00:15:20.200 ⇒ 00:15:23.099 Phoebe Miller: she’s not doing any demand. Gen, she’s doing.
124 00:15:23.100 ⇒ 00:15:23.750 Robert Tseng: Okay.
125 00:15:23.750 ⇒ 00:15:24.380 Phoebe Miller: Like
126 00:15:25.150 ⇒ 00:15:47.698 Phoebe Miller: it’s it’s, I guess, product marketing. But he really does like Greg. Special projects. Like, ran that launch week. Kind of developed like the putting together the trip. And like all this content that came right with it. She’s not doing any like targeted marketing based off of product usage.
127 00:15:48.980 ⇒ 00:16:07.770 Phoebe Miller: that’s that’s me. I I run, demand Gen. And then on the sales side, like our Vp of sales would have been maybe someone to collaborate with down the line, but he recently left. So I’m running that team right now. So yeah, it’s you and I can do a lot together. I don’t. There’s not.
128 00:16:07.930 ⇒ 00:16:23.440 Phoebe Miller: Maybe a Alicia from my team who you met briefly will help out. But besides us and Jacqueline doing like the design, Greg is gonna lean out a little bit from the self serve work just because he has so many competing priorities. So it’s gonna be a lean team. Which is.
129 00:16:23.440 ⇒ 00:16:29.829 Robert Tseng: Is he the CEO? And CTO, like he runs. He owns the engineer roadmap to. Okay. Gotcha. Yeah. Okay? Makes sense. Yeah.
130 00:16:30.850 ⇒ 00:16:32.480 Robert Tseng: Yeah. Okay.
131 00:16:32.840 ⇒ 00:16:38.542 Robert Tseng: yeah, I mean, yeah, I mean, I I you know, happy to be a thought partner on any of that stuff, I think.
132 00:16:38.930 ⇒ 00:16:44.299 Robert Tseng: go to market teams we’re very familiar with working with. So yeah.
133 00:16:44.570 ⇒ 00:16:58.459 Phoebe Miller: Cool. Alright. Yeah, let’s do it. So let’s let’s start hourly. Just send me a a proposal and I’m still catching up this week. But I think next week I’m I’m gonna be super focused on this on like what the next experiment is, and
134 00:16:58.820 ⇒ 00:17:06.179 Phoebe Miller: putting deadlines on things. Jacqueline is a little slow. So I need to work on pushing her a bit. Cause I think.
135 00:17:06.950 ⇒ 00:17:11.340 Robert Tseng: And it’s it’s I mean, we had to get implement amplitude implemented and all that. But it, yeah.
136 00:17:11.520 ⇒ 00:17:14.860 Phoebe Miller: I want to get her in like a cadence of delivering as well.
137 00:17:15.069 ⇒ 00:17:16.289 Robert Tseng: Yeah, got it?
138 00:17:16.729 ⇒ 00:17:29.950 Robert Tseng: Okay, that sounds good. I think. Yeah. So I’ll send you a couple of options on like hourly kind of like, you know, if we wanted to start smaller, I’ll probably aim for something like 10 h and a 20 h option. We’ll just kind of just see
139 00:17:30.220 ⇒ 00:17:31.009 Phoebe Miller: It’s a month, a month.
140 00:17:31.010 ⇒ 00:17:37.890 Robert Tseng: Yeah, yeah, you’re yeah, something like that. And yeah, well, we can kinda go go from there. Yeah.
141 00:17:37.890 ⇒ 00:17:42.189 Phoebe Miller: I don’t anticipate. I don’t anticipate it being more than like a couple of hours of work a week.
142 00:17:42.400 ⇒ 00:17:43.050 Robert Tseng: Okay.
143 00:17:43.550 ⇒ 00:17:44.240 Phoebe Miller: I’d be surprised.
144 00:17:44.510 ⇒ 00:17:45.459 Phoebe Miller: More than that.
145 00:17:45.930 ⇒ 00:17:46.560 Robert Tseng: Okay.
146 00:17:47.330 ⇒ 00:17:49.280 Phoebe Miller: I mean you, you know better. But like.
147 00:17:49.460 ⇒ 00:18:01.019 Phoebe Miller: how? How long does it typically take you? Once we they’ll just say, roll out a new experiment to like, get in there, figure out the correct events, to be tracking.
148 00:18:01.150 ⇒ 00:18:03.309 Phoebe Miller: spin up a dashboard, or report.
149 00:18:03.690 ⇒ 00:18:15.710 Robert Tseng: Yeah, I think the reporting and tracking is pretty quick. I think it’s really like, so one of my other clients, maybe at a similar stage. We’re at a place now where we’re doing like 10 HA week pretty much. And they just like App. They give me like
150 00:18:16.030 ⇒ 00:18:34.520 Robert Tseng: couple of open ended questions. Yeah. So like, really structuring the analysis and and being able to bring it all the way to insights. Like, I think, you know we can able to answer, like to open ended questions a week but we go pretty deep on it. So I think, that’s what they like with what we’re doing right now.
151 00:18:34.995 ⇒ 00:18:41.360 Robert Tseng: And then, I mean, I think that’s where I would imagine, like we wouldn’t. I mean, I don’t if
152 00:18:41.820 ⇒ 00:18:50.270 Robert Tseng: I don’t really want to just stop at like building the reports, because, honestly, you could probably find somebody to crank them out super fast and keep. But like.
153 00:18:50.380 ⇒ 00:18:55.830 Robert Tseng: I think, being able to interpret things and like, kind of give my 2 cents on, like where I
154 00:18:56.310 ⇒ 00:19:00.749 Robert Tseng: and yeah, just make it more collaborative is kind of where I would. I would like to see things. Yeah.
155 00:19:00.750 ⇒ 00:19:01.970 Phoebe Miller: Yeah. Sweet. Okay.
156 00:19:01.970 ⇒ 00:19:02.580 Robert Tseng: Yeah.
157 00:19:05.820 ⇒ 00:19:16.539 Phoebe Miller: Well, I think the to. In order to get there, we need to get 1st in like a motion of being able to run the experiments. So that’s what I’m focused on, and then layer on like, you know.
158 00:19:17.300 ⇒ 00:19:33.199 Phoebe Miller: the insights from there, cause there’s right now it’s like there’s not very much. Well, that’s not true. There’s a lot of data I just don’t feel like there’s very much for us to talk about until we’re getting into a cycle of like pushing new things out, tracking them, reporting on them, and making sure.
159 00:19:33.200 ⇒ 00:19:44.709 Robert Tseng: Yeah, maybe tell me about like kind of experimentation from your perspective, like, kind of where, like, what is like running experiment, kind of like look like from from your perspective timing wise like how you plan for it. Yeah.
160 00:19:44.710 ⇒ 00:19:45.300 Phoebe Miller: Yeah,
161 00:19:48.570 ⇒ 00:20:03.900 Phoebe Miller: So I think we have a good list of things to try. What? What I need from Jacqueline is her to be able to set timeframes in which she can do the design. Have an engineer do the end work.
162 00:20:06.140 ⇒ 00:20:09.160 Phoebe Miller: Roll it out to customers in a
163 00:20:09.390 ⇒ 00:20:12.540 Phoebe Miller: I don’t. I don’t know. Maybe we we would have her work in a sprint like a.
164 00:20:12.540 ⇒ 00:20:13.140 Robert Tseng: Yeah.
165 00:20:13.760 ⇒ 00:20:19.739 Phoebe Miller: 2 week. Sprint and maybe it’s maybe it’s a 2 week sprint it’s like.
166 00:20:21.400 ⇒ 00:20:26.859 Phoebe Miller: and then I would love if the next sprint overlapped. Right? So it’s like my, my.
167 00:20:27.080 ⇒ 00:20:30.750 Phoebe Miller: my experiment sprint overlaps with her
168 00:20:31.280 ⇒ 00:20:43.750 Phoebe Miller: actioning on the previous experiment. So she’s launching that experiment. We’re ready. We’ve I’ve done at least a week’s worth of like. The next thing to go out is, how about this?
169 00:20:44.520 ⇒ 00:20:59.730 Phoebe Miller: And so I think that you would be helpful in like week, one of my experiment like kind of iter like ideation. And then week, 2 or 3 of like Jack, you know, it’s like at the front end and the back end, and then, like, let let us do the work in the middle.
170 00:20:59.890 ⇒ 00:21:00.600 Robert Tseng: Okay.
171 00:21:01.030 ⇒ 00:21:05.850 Phoebe Miller: Is is right now. But I I we haven’t done that in practice just yet, so I don’t know.
172 00:21:06.270 ⇒ 00:21:08.856 Robert Tseng: Okay, yeah, no. I think that makes sense.
173 00:21:10.090 ⇒ 00:21:13.780 Robert Tseng: yeah, I think, based on like, kind of how the last thing kind of last
174 00:21:14.210 ⇒ 00:21:41.969 Robert Tseng: much work when it was that. That’s kind of how it felt. It was like, I kind of help with the I mean you. You. Obviously you gave me the list of ideas I kind of like helped you kind of prioritize, which ones we actually go after in a reasonable amount of time. With like a very like kind of just more narrow, narrowly defined scope of what to track. And then there was like a waiting period, as things were kind of implemented. And then we kind of just yeah, like, the the back end of it is is pretty fast. So like, yeah.
175 00:21:42.120 ⇒ 00:22:02.479 Phoebe Miller: Yeah, I’m just gonna need to start really pushing Jacqueline because she’s she’s my my design and resource. So she’s kind of the thing I mean, I’m I’ve been holding things up, too, but she’s she’s holding things up so alright. Well, we will like, I said. I’m catching up this week. But plan to really dive in early next week on next steps.
176 00:22:03.040 ⇒ 00:22:09.600 Robert Tseng: Okay, sounds good. Yeah. I’ll try to send you something by the end of the day to review it. And then, yeah, hopefully, we can go from there.
177 00:22:09.600 ⇒ 00:22:11.310 Phoebe Miller: Okay, awesome. Thanks. So much. Again, appreciate.
178 00:22:11.310 ⇒ 00:22:11.760 Robert Tseng: Right.
179 00:22:11.760 ⇒ 00:22:14.769 Phoebe Miller: Since, as we we figured out our next moves.
180 00:22:14.990 ⇒ 00:22:17.169 Robert Tseng: Yeah, okay. Alright. I’ll see you.
181 00:22:17.170 ⇒ 00:22:18.340 Phoebe Miller: Weekend bye.
182 00:22:18.340 ⇒ 00:22:18.810 Robert Tseng: Icv.