There was nothing between the teams until the last ten minutes when Rodgers cut loose.
First he hammered a tremendous shot against the bar, then he laid on a great chance which Scott Michie squandered and then ran at the home defence who conceded a soft free-kick.
John Adam swung in a teasing cross and Chris McLeod headed it home.
Berwick had dominated the first half and took the lead when Calvin Shand went down the right and found Iain Thompson who whipped the ball past Andy Reid.
Three minutes into the second half Greig Henslee equalised after Rodgers had twice outwitted Neil Campbell to provide the chance for a goal.
The game swung from end to end until the final stages when Rodgers wreaked havoc.
Berwick might have drawn level at the death but Stuart Fraser shot into the side-netting after Steven Noble had set up the chance.