Emma Naomi knows her Bridgerton character, Alice Mondrich, has so much to lose if she goes against the Queen’s wishes.

The first part of season 3 finds Alice and her husband Will Mondrich (Martins Imhangbe) having their lives turned upside down when Alice’s great aunt, Lady Kent, leaves her estate to the couple’s young son Nicolas. When Will refuses to give ownership of his gentlemen’s club following their rapid ascent into society, Lady Danbury (Adjoa Andoh) advises Alice that the Queen will not tolerate him continuing to work and she should convince him to change his mind.

“I think it would be a huge statement to go against that advice,” Naomi exclusively tells PEOPLE. “A social, maybe even political statement, to go against that advice. And so, it’s not just a family decision in supporting Will’s dreams at that point, it’s about solidifying our place in this society.”

“I think on one level, she can see it from Will’s point of view,” she continues. “He’s sacrificed so much, we both did, to get where we are now. But at the end of the day, the bigger goal is to support our children and to give them and the whole family a good life. So, it’s a sacrifice that we have to make.”

As for Imhangbe, he also sees what’s at risk for his character if he keeps the club against the Queen’s wishes.

“I think it’s about understanding what’s at stake. If you give up this, how does it impact that?” he explains. “I think at the center of everything for Will is the family. So, as much as you want to have your own pride and sense of self, you kind of have to honor your family at the same time.”

He adds: “I think it’s weighing that up and being able to prioritize what’s more important [to] the family.”

The first part of Bridgerton season 3 is now streaming on Netflix, and part 2 drops on June 13.