Go to Kustomer
Brian Lastovich 20 min

CX Weekly Live: Customer Feedback in Product Development


VP of Product & UI at Fabletics, Melanie Cummings joins Brian Lastovich to chat about how Fabletics uses all of their customer data in improve their membership experience.



0:00

We'll get right into it, Mal, like, well, first, please,

0:03

Mal works at Fabletics, VP of Product in UX.

0:08

So first thing, Mal, like, for those that don't know a little bit about Fablet

0:11

ics, please, like, tell us a little bit about Fabletics.

0:13

And also, I find this fascinating, too, like, your role, and your case,

0:17

what you work on daily, monthly, quarterly basis a little bit.

0:21

This could take the whole meeting, sorry, about that.

0:24

Like, tell us a little bit about that.

0:25

No, no, we're getting big questions.

0:28

Yeah, for those that don't know Fabletics, we are a apparel brand.

0:31

We sell active product for men and women.

0:34

And we also have a shape where I'm lying called Gidey.

0:36

And that we sell for women, which is great.

0:39

I've been at Fabletics for nine years.

0:41

I actually just went through a bit of a role transition as well.

0:43

So I'm actually now head of product and technology.

0:45

I haven't even updated LinkedIn, because it's so fresh.

0:48

Ooh.

0:49

I oversee kind of all product UX, engineering QA for Fabletics Web,

0:55

global app, and retail tech stacks.

0:58

So quite a large swap of things.

1:00

But it's super exciting, and I really enjoy it.

1:03

I'm here for quite a while, so I must.

1:05

That's true, too, to hop on.

1:06

In time.

1:07

We've been with Fabletics.

1:08

It's been nine years now.

1:09

And I actually have, like, a weird journey.

1:11

I started in our retail stores.

1:13

I was the manager of retail ops and project delivery,

1:15

which, like, ridiculous title.

1:17

But it basically meant I handled anything that happened

1:19

within the four walls of the retail store.

1:21

But thank, like, policies, procedures, accounting, security,

1:24

inventory control.

1:26

But then a huge component of that was our technology,

1:29

which, still a city, and it was at the time,

1:31

it's a mobile application that's on an iPod.

1:34

And it's basically a merger of our Facilment Center technology

1:37

and our e-commerce tech.

1:38

We kind of pulled it together, and we have our own app

1:41

that we use to transact and help customers check out.

1:44

So I started doing that with Fabletics the way back in the day.

1:47

And then about seven years ago, I moved into a leadership role

1:50

on the web team over product.

1:52

And I've been kind of doing a version of that here ever since,

1:55

which has been great.

1:56

So one thing I want to call out now is that we've talked

2:00

a several times now.

2:01

And this is what's always intriguing and why I love talking to you

2:04

about it, which is like the customization of Fabletics, right?

2:08

Before we get into customer feedback and stuff,

2:12

tell me a little bit about the philosophy that maybe you have

2:15

as well as the company has about building as opposed to buying

2:19

sometimes, if you don't mind telling a little bit about that.

2:22

Yeah.

2:23

No, it's just a great question.

2:25

Fabletics has been around for about 10 years,

2:28

but we're part of like a larger company that's been around maybe

2:31

15 or a little bit, 15 or 16 years.

2:34

And we started in the subscription and kind of membership space

2:38

way before it was really common.

2:40

Like when I first joined Fabletics 10 years ago or nine years ago,

2:43

like the membership in and of itself just wasn't common in the market.

2:46

People didn't understand it.

2:47

You know, it's not like today where there's so many different

2:50

subscription boxes and things that you can get.

2:52

So we were kind of like speaking a new language to customers.

2:55

We were offering definitely a different type of value and something

2:58

unique in terms of our competitive advantage.

3:01

And we found that a lot of the things that we wanted to provide

3:04

were things that were like off the shelf capable with a lot of

3:07

technology providers, right?

3:08

It would have needed a lot of customization.

3:10

So from the jump, we've really taken that as an opportunity

3:14

to say, hey, if we want to deliver this core membership value as a

3:18

competitive advantage and we want to control that destiny,

3:21

it's better for us to just own that technology and be able to

3:25

drive it and manipulate it go forward.

3:27

So that was really kind of the generation of a lot of our tech

3:31

strategy.

3:32

And for a long time, we pretty much almost exclusively built it

3:35

ourselves because we had a really robust internal team.

3:38

We were able to connect a lot of our strategies to the membership

3:40

directly and we wanted to make sure that that made sense.

3:43

From the perspective that we have hyper customized experiences

3:46

based on if you're shopping with us kind of logged out or as a

3:49

lead customer who hasn't opted into the membership or as an actual

3:52

VIP member with us.

3:54

We started to shift that a little bit over the last two years,

3:57

kind of as some of the technology solutions have caught up with

4:00

where we were at.

4:01

And there's opportunities to plug and play.

4:03

Great example is with personalization.

4:05

There's some fantastic vendors out there that are doing great

4:07

things that we're starting to partner with.

4:09

But a true core competitive advantage for us really is

4:12

the membership technology that we have and our ability to kind of

4:15

manipulate that test things, change it and enhance it on behalf of the

4:18

customer.

4:19

And we'll get into again, like I do want to give in the customer feedback,

4:22

but you always bring up certain points.

4:24

So do you think that it sounds to me like there is this

4:26

little bit of shift that's like, oh, now you may be a little more

4:29

interested to kind of see what else is out there.

4:32

Is that more on the tech side, you think of like maybe more and

4:36

more new product releases, new technology now than ever before?

4:40

Or you think that reason is more on the fabric side is being open to it?

4:44

Seeing it has to be both, right?

4:46

I think philosophically we're a little bit more open because we have a

4:50

hugely robust internal technology team and you kind of start to get to that

4:54

point where you're like, I can't keep adding heads to solve these problems.

4:57

Like that is always the solution.

4:59

It's like build your team and grow it.

5:00

Let's see if it's more cost effective to partner with somebody.

5:03

But we'll say, you know, especially I feel like in the last two years,

5:07

there's been so many advancements in kind of what companies are offering

5:11

and how easy it is to integrate with them.

5:13

Great example is last year we were exploring doing like some social

5:17

proofing on the site.

5:18

So if you were shopping, you could see like extra where people are viewing or

5:22

have recently purchased this item just as like kind of a social validation of the

5:25

product purchase.

5:26

And we had like done a proof of concept internally.

5:29

It's something we absolutely could have done with the team that we had.

5:32

But then we found TagStar as a partner and the integration took like two or

5:36

three weeks. And we were alive before cyber and it was like really low effort and they've

5:40

been great partners.

5:41

So it was such a great example of like, yes, we could have done it.

5:44

But it was probably easier and less half full to go with somebody who is doing

5:48

it professionally.

5:49

And then their ability to help us kind of strategize around it has been

5:51

successful as well.

5:53

Yeah, and footnote on that, which is, I've, that's probably like the third or

5:57

fourth time I've heard it in the last few weeks or more

6:00

less like implementations, migrations.

6:02

I think that the the ability of AI right now like takes a project that might

6:08

have been 10, you know,

6:09

let's say 10 weeks of work and it does make that more of a five week or four

6:13

week plan.

6:14

And so if that's something that I've heard a lot about with implementations.

6:18

Yeah, yeah. And I think like as a technologist like up a trend, I'm also

6:22

noticing is solution providers being more intentional

6:26

about how they build their architecture for integration.

6:29

Like when I was doing this, you know, 10 plus years ago, when I was kind of on

6:32

the Oracle kind of more on the BDB side,

6:34

like that wasn't a thought. We would just kind of be like, here's our solution.

6:37

And like, implementation was almost like an app on the you could kind of upsell

6:40

And like that was part of like the business is like you could kind of get the

6:43

implementation plus the recurring revolution.

6:45

This is description. Now nobody wants to do that.

6:47

And I've seen a lot newer technologies that are smarter about how they do that

6:50

for a simple implementation.

6:51

So it just takes the pressure off.

6:53

100% agree with that.

6:54

Yeah, they think about partnerships and integrations from early on within the

6:57

within the product life cycle there.

7:00

So now I want to get into customer.

7:02

So customer feedback was I think something that I emailed you maybe like a

7:06

month ago or so.

7:07

And again, that's a previous conversation that we had with some examples that

7:10

you shared.

7:11

The first thing that I was asking when you think about customer feedback, you

7:14

know,

7:15

do you mind double clicking into that and sharing like, well, what exactly is

7:19

customer feedback in the world of fabletics?

7:21

Yeah, I mean, for us, it's it's very layered.

7:24

So obviously we're a membership program.

7:26

And I think being a membership program in and of itself creates a higher level

7:30

of expectation and demand from the customer in terms of like your

7:35

who is a brand listening to them hearing their feedback and actioning on it.

7:38

They're kind of investing in us.

7:40

So to speak in the sense that you're opting in a membership, you're choosing

7:43

each month.

7:44

If you want to get build a credit with us or not, you're coming to the site or

7:47

the mobile app or the store to check out our inventory.

7:49

And if you're not listening to the customer, like it's going to present a lot

7:53

more tone death than if it's somebody you're just choosing to purchase that,

7:58

you know, with once in a while, right?

7:59

So we take that kind of like relationship with the customer very seriously and

8:03

that's expectation.

8:04

We hold that to a really high standard because if you don't, then kind of why

8:06

would you have the membership?

8:08

I think it we lose a lot of credibility.

8:10

Is that something that you are setting the expectation yourself with the

8:14

consumer early on?

8:16

Or do you think that the consumers are already expecting that experience from

8:19

the get go?

8:20

I think it's a little bit of both.

8:22

I think again, as the market has kind of come along from a membership and

8:25

subscription perspective, I felt kind of like the pressure dial up, honestly,

8:30

you know, over time, because customers are smart.

8:32

Like they know, like they hear trends about AI, they hear trends about personal

8:35

ization, like they know what we could do for them.

8:39

And they're looking at it as like a choice if you don't.

8:42

So super great example. We do these events in person in our LA office called

8:47

meet the member where we genuinely invite actual members who are, you know,

8:53

part of our program to come to the office and talk to us about different topics

8:57

Usually different departments host different sessions that are focused on

8:59

different things.

9:00

And we did a session earlier this year on personalization.

9:03

And it was very kind of open discussion like we wanted to understand what

9:05

customers were expecting from us when it comes to personalization.

9:08

Like where's the line where gets two personalized what types of personalization

9:12

you're really looking for.

9:14

And there was one customer who I will never forget her because she was so sweet

9:17

, which was also very, very opinionated.

9:20

And she's like, I only buy pocket leggings from you.

9:23

Like why are you emailing me about leggings without pockets? Why are you

9:26

showing me on an upsell leggings without pockets?

9:29

Like I only want the pockets. And it was super honest.

9:32

And she was like almost like a little mad but she was like very energized and

9:36

like I want you to make this tailored to me.

9:39

Don't make me like hunt to find what I want. I'm giving you enough information

9:43

at this point to find it.

9:44

So I think like some of the market trends have really raised the expectation

9:48

level and we're, you know, working to make sure that we're adjusting to meet

9:51

that.

9:52

So getting into technology specifically, you just brought up the example of

9:56

like in person feedback.

9:58

What are you talking about? You have the mobile app, obviously retail,

10:01

obviously the website is well too.

10:03

Talking a little bit about customer feedback and capturing customer feedback

10:07

across other channels outside of in person. How do you do that today?

10:12

Yeah, there's a lot of different strategies that we use.

10:14

We have a couple that are kind of like our recurring. I think it's important to

10:17

have like baseline consistent, expect like consistent ways to get feedback from

10:21

customers on a regular basis.

10:23

So we would really hyper connected to what we call our global member services

10:27

team, GM us.

10:28

We talk with them every week. It was set meeting set deck format with their,

10:32

you know, providing feedback in terms of trends that they're seeing from

10:36

customers calling in or chatting about escalations.

10:40

Those are always really helpful and they actually often feed both like bug

10:43

fixes and like tweaks to the experiences, but also will inform road map

10:47

priorities.

10:49

So, you know, for example, we've had a situation where customers were asking

10:53

why are we not giving the product to them quicker.

10:56

What can we do to be more clear about that? And we actually adjusted our

10:59

shipping time expectations on site because like we just weren't setting a good

11:02

expectation on what the shipping times would be.

11:04

Right? Just good insight. Have no technology solution. Just some copy updates

11:08

right to be more clear of the customer.

11:11

So a huge fan of saying connected to your customer support team. We also do

11:14

really frequent connects with our retail field associates. I'm a huge proponent

11:19

, you know, retail employees are often some of your biggest brand advocates.

11:23

Like they work for the company. They understand the brand. They're interfacing

11:26

with your external customer every day. And you can hear so much insight from

11:30

them.

11:31

So we do monthly call hand style calls with the field to get their feedback.

11:34

And we get that feedback both on like overall brand technology stack and then

11:38

also on the in store technology that we're creating to support their experience

11:42

in helping associate.

11:45

And we also do like standard kind of broader quantitative like checkpoint

11:48

surveys, which provide really good insights and they're very helpful in terms

11:51

of identifying trends.

11:53

So I'm trying that we look out on a regular basis is the website or mobile app

11:57

improving or not improving your perception and experience with the brand. That

12:01

's a really interesting one to monitor.

12:03

Like are we adding value like is the site so great that you want to keep

12:05

shopping with us or is it like such a bummer that you don't like that's

12:09

tangible feedback and it's great to have.

12:11

Is that a question that you were asking like the mobile app or how do you

12:15

getting that feedback when do you ask it?

12:19

So during like our quarterly checkpoint surveys, which we blast out to you know

12:22

all of our members and you actually ask that same question of people who have

12:26

would lead to have an actual shop with us yet that they've given us their email

12:30

and of our VIP members.

12:31

I am totally butchered the language on it like our survey people read it much

12:34

better. But we're essentially asking like is the mobile app helping you hurting

12:38

your perception and is the website helping or hurting your perception of the

12:41

brand.

12:42

And the trend over time is what gets you really good insight to see like if you

12:46

're improving or not improving in that way. And especially when you cut it from

12:51

like an NPS perspective by detractors and promoters right if your detractors

12:55

have like a huge lift in say website issues like that's a huge.

12:59

All the action for us that we have something going on and then we really need

13:02

to dive into things well that that very point helps me or at least gives me the

13:05

opportunity to ask you kind of the follow up question here which is.

13:09

Prioritization I know that's just to say privatization but with all of this

13:13

type of feedback.

13:15

How do you prioritize of like what's most important then to take action on it

13:20

and what the action could be giving it to product or so forth.

13:25

I mean just like anybody who works in technology like the prioritization is so

13:29

challenging right like there's always way more coming at you than can ever

13:33

possibly hope to accomplish in a normal quarter or sprint.

13:37

For us we really try to walk the line and the way I talk about it with the team

13:39

there's kind of like three elements that you're going to prioritize on.

13:43

There's things that are like pure like ROI revenue base like I want to make

13:47

more money or want to get more margin or I want some more things like those are

13:51

the hard business KPI elements that you want to prioritize against.

13:55

There's things you're advocating for on behalf of the customer so it's like

13:57

yeah maybe it's not going to give us more money but we're going to feel better

14:00

about it because we're going to give the customers a way better experience.

14:03

And I think the third element is the things that are like kind of quality of

14:07

life for the technology teams or the organization at large like operational

14:11

things that improve the experience overall.

14:15

The best projects to pick are the ones that are going to hit all three right

14:18

that are going to do the work and benefit everyone.

14:21

And I do my best to try to pull the things in the roadmap that are really going

14:25

to hit all of those angles but you know there's never purity it never it never

14:29

kind of goes that way all the time.

14:31

So what we do within the product or is do our best to try to find those

14:34

customer feedback kind of moments and try to draw the correlations to how they

14:39

're going to either drive the revenue or kind of improve the brand because it

14:44

might start as just like a customer request but usually if you kind of peel the

14:49

onion on it a little bit.

14:51

And there's more to it and there's a lot more you could do with that that

14:55

feedback than just like fix the problem or fix the bug so if I could do an

14:59

example of that one we have an update coming out around how we apply and how we

15:05

work on like the store credit mechanism right now we just kind of always apply

15:10

that to your account.

15:11

And we assume that you always want to use your store credit first we've got

15:14

feedback from customers are like hey maybe I want to say that for later and it

15:17

's like oh well yeah that makes sense like you should be able to choose when you

15:21

want to use your store credit so like we're going to look to see how we can

15:24

improve that experience and of course there's going to be you know implications

15:27

to online and you know in close to customer feedback but it started with

15:31

customers being like why you always do this to me right so it's a good example

15:34

where we kind of heard people are going to make an adjustment.

15:37

Is there a balance between how much customer feedback that then kind of pushes

15:43

you to send that to product development and work on that compared to the

15:49

product team and internally saying we got to work on this or you know is there

15:55

is it all customers is a 50 50 is there a number that you try to do.

15:59

You know I try to look at it's a lot of our friends so when we get feedback

16:02

from our customer service team they're really good about telling us the change

16:05

over time in terms of if that is the feedback for this category is when up or

16:09

down right because there's like there's always a certain amount of customers

16:12

who I don't have a great example but like they're always going to have issues

16:16

like the gift card experience like they don't like how the gift card sale thing

16:19

works right and like we know that we hear you but it's like a small 0.1% we're

16:23

going to live with that.

16:25

Yeah but if we have a situation where you're seeing that rise in customer

16:28

feedback on an item that really is what is our trigger to be like okay what's

16:32

going on here.

16:33

Did we implement a change or is there a change in expectation that's driving us

16:37

to look at this more potentially go ahead and.

16:40

And I also think you know this one's a lot more esoteric and a lot right think

16:44

like the art of road mapping comes into play but it's important to kind of sit

16:49

at the beginning of each quarter and I would do this ongoing but definitely the

16:52

end of each quarter like.

16:53

What are we really trying to accomplish right we've had moments we had one

16:56

earlier this year where we really wanted to do a lot more on like member

17:00

education and building credibility and loyalty for the additional benefits that

17:04

you get as we were part of the membership program so that quarter there's a lot

17:07

of like updates that were around the customer experience adding value to the

17:12

membership program re launching the loyalty program and kind of things around

17:16

that. And that made sense with kind of what we were trying to accomplish is a larger

17:19

organization you don't live in that mode necessarily for forever but I think

17:22

being intentional about like strategically what are we trying to accomplish and

17:26

what projects do we pull in to support that is super super important and then

17:31

as long as you're kind of tweaking that as the business evolves I found that to

17:33

be an effective strategy.

17:35

Do you mind sharing if you think of anything top of mind of anything that's

17:39

trending in terms of customer experience in last six months year that you're

17:44

starting to prioritize or not and I asked that too because I know you've been

17:50

super successful at your position at Weblatics you also have quite a network of

17:54

those around you is there anything that you can share with everyone listening

17:58

and then myself that like you're starting to see the trend really shift I know

18:01

it's broad but yeah yeah.

18:04

I mean I set the cop out to say AI because I feel like it's had such a moment

18:07

and I've really like has been taught on it.

18:10

I think I think for me though it's more about what I've seen more of a trend in

18:14

is like how can we take AI strategies and technologies to amplify strategy we

18:19

're already doing.

18:20

So great example like was just a detail connect in San Diego earlier this week

18:25

and talking to a couple partners and they're using AI more to integrate into

18:31

their existing tools and like make their solutions better supposed to like

18:35

having a like here's a sexy AI tool that stands on its own.

18:38

I think I think we kind of had this weird like phase with AI where people are

18:41

trying to sell the dream unlike you stand alone AI solutions that like did

18:45

nothing and everything at the same time and I never quite could latch on to.

18:48

Versus some partners that I talked to this week I think there it's more about

18:52

how can we amplify what we're already doing that was working with AI solutions.

18:57

So that's probably one that I would I would say that we're looking at a little

19:00

bit the second which I think has been a thing for a while but I'm feeling like

19:03

more pressure on it now is like really building truly credible brand

19:09

experiences that are authentic to the brand.

19:12

I feel like there's been kind of a there's like a lot of like hot things you

19:15

can talk about for a little while but like with people feeling a little bit

19:18

like recession pressure and I think you know a little bit of purchase

19:22

contraction.

19:23

People are looking for brands that are going to be authentic and there's a

19:26

little bit more of like a call out when that's not happening I've noticed that

19:29

trend as well.

19:30

I mean I've been talking about this may been like five months ago but when we

19:35

talked about AI before you had this as an author was an idea or what you want

19:40

to move forward of like AI bots that are super personable where they can inform

19:46

you about the product right that you're looking at in that moment to get more

19:52

information. Everything there is about that product is that still in top of your mind if you

19:56

started implementing stuff like that any other comments on AI for them.

20:01

No, no, we haven't been forward with it. Not that particular solution and part

20:05

of it is because of what I mentioned about like AI having its moment I think we

20:09

had this like they were AI could talk everything it's going to be the one stop

20:13

shop but just like almost any tool out there I feel like AI is only going to be

20:17

as good as the input.

20:18

And what I've learned now is like you're always at the forefront but in this

20:22

manner that's like we're not doing crazy things out there it's still all about

20:26

the customer and like you said creating great customer experiences especially

20:30

member only customer experiences and I think you're doing phenomenal jobs so

20:34

thanks again Mel for just catching up with me here and here thanks all.