Jelena Cankovic marked her return from injury with an FA Cup goal for Albion.
The Serbia midfielder eased any nerves with a stoppage time goal in the 2-0 win over Championship outfit Nottingham Forest.
Her close-range finish added to a penalty converted in first-half added time by Madison Haley, who stepped up despite having seen a spot-kick saved in the win at London City recently.
Albion largely dominated at Broadfield Stadium but had to wait a long time to make the tie safe.
Haley made the breakthrough after Kiko Seike was fouled in the box.
There were further chances in the second half and Rosa Kafaji saw her corner bounce off the post.
Chiamaka Nnadozie made a save near the end before Cankovic pounced after Manuela Vanegas saw her header parried.
Albion now prepare to visit Everton in the WSL on Friday.
Their head coach Dario Vidosic missed the game having stepped aside due to family reasons.
Read more
Albion say there is more to come from Tsunoda after goal at Villa
Albion women's head coach steps aside for 'foreseeable future' for family reasons
Albion boss reveals his wish for transfer window
Assistant boss Chris Roberts, who has taken temporary command in Vidosic’s absence, said: “He's our leader, he’s our boss and the team is very much his and we want to continue the great work that he’s done and hopefully we did him proud today.”
Albion: Nnadozie; Rule (McLauchlan 84), Minami, Vanegas, Olislagers; Symonds, Tsunoda (Cankovic 57); Kafaji (Camacho 72), Noordam, Seike; Haley.