Deep into added time, Dylan Morgan was free in the box and slammed the ball home which was a goal that came against the run of play in the second half.
A scrappy start to the game saw chances at a premium, but Slough had to defend well to block LIoyd James’ effort which headed goal bound.
On 20 minutes, the Rebels had their first opening and went close to getting on the scoresheet.
Lee Togwell whipped a ball in from deep which Elliot Benyon met at the back post but glanced the headed effort wide from a tight angle.
Taunton began to assert some authority and pin the Rebels back, providing an ariel bombardment from both sides which Will Dennis did well to relieve pressure by claiming high balls.
On 30, the hosts took the lead in blustery conditions as Jake Wannell towered a header in at the back post.
The Rebels responded well, Johnny Goddard testing Jack Bycroft in goal with a crisp low strike, which the keeper held well.
In first half stoppage time, Slough got the leveller through Matt Lench.
Gabe George whipped a free-kick in from the left, which was flicked on by George Alexander before Lench guided the ball into the roof of the net at the back post.
Slough started the second half well, and on 47 minutes Francis Amartey – a first half replacement for the injured Benyon – forced Bycroft into a reaction save at his near post after tricking his way down the left of the box.
Shortly after, George saw his shot from distance charged down by the Taunton backline as Slough applied sustained pressure.
On 54. Bycroft was forced into smart save from Togwell’s speculative strike with the wind firmly behind it.
The hosts were struggling against the wind but almost found a way through, only for Josh Jackman to make a crucial interception after a dangerous cross from the right by Nick McCootie.
On 67, Slough almost took the lead courtesy of a set play.
Lench delivered a trademark corner from the left, which was flicked on by Togwell, only to be met by Luca Woodhouse ghosting in at the back post but his strike rippled the side-netting.
The chances kept coming - Alexander went close after the ball fell kindly to him in the box, unleashing a goal bound strike which was blocked superbly by Bycroft, having to react quickly to deny the venomous effort.
In the closing stages, Lench whipped a sumptuous and teasing cross which evaded everyone which only required a subtle touch to divert it towards goal.
Slough pushed for a winner but couldn’t find a breakthrough as Taunton rarely posed a threat after the break until Morgan’s winner.
The Rebels are next in action at home to Farnborough this Saturday as they look to bounce back from another late goal on the road.
Taunton Town Lineup
Bycroft, Grimes, Ball, Wannell, Chamberlain, James, McCootie (Smith 88), Stearn (Guest 73), Evans, Sims-Burgess, Morgan. Unused substitute: Irish.