Albion had a number of openings in the first period but couldn't find the opener.
It eventually came in the second half through Tom Fellows - before Albion had to soak up late pressure.
But they couldn't hold out as Joe Allen headed home a 92nd minute equaliser.