Plymouth Argyle forward Issac Vassell scored on his debut for Bideford as the promoted Robins claimed their first Evo-Stik League Southern Premier Division points of the season.
The 18-year-old headed home Matt Andrew's 65th-minute cross to cancel out Simon Thomas's 55th-minute penalty opener to set Bideford on their way to a 2-1 home win over Chesham United.
Chesham were then reduced to ten men and Bideford took the advantage, with Richard Groves scoring from a 75th minute spot-kick.
Despite the comeback win, Sean Joyce's Robins remain second from bottom. They have an opportunity to move out of the basement two tomorrow when they visit fourth-from-bottom Banbury United, who are also on three points following Saturday's 3-2 defeat at St Neots Town.
Tiverton Town also recorded their first Southern League win of the season, beating Bishop's Cleeve 3-2 in Division One South and West.
The win hoisted Tivvy to 12th in the table, level on four points with Taunton Town, who were 4-1 home winners over Cinderford Town.
Striker Joe Bushin gave Tivvy a fifth-minute lead, but the home side levelled five minutes later. Teenager Owen Howe fired Tiverton back into a 47th-minute lead and then doubled his tally in the 75th minute, after Bushin had been dismissed.
Andy Taylor hit the post from a late penalty for Tivvy, after Bishop's Cleeve had reduced the arrears.
Tiverton will be seeking to build on their first win when they host basement side Yate Town tomorrow at Ladysmead (7.45pm). Yate still have to win a point following Saturday's 3-1 home defeat to pace-setters Poole Town.
Taunton Town visit second-from-bottom Shortwood United tomorrow buoyed by a fine 4-1 home win over Cinderford, who opened the scoring on ten minutes at Wordsworth Drive. Rod Marsh took two minutes to restore parity and Leigh Robinson's Peacocks forged ahead thanks to skipper Simon Ingram's second-half double. Ingram scored from a free kick and a penalty before Craig Herrod put the result beyond doubt late on.
Ilfracombe Town were pipped 1-0 by unbeaten Toolstation League leaders Brislington in their FA Vase first qualifying round tie at Marlborough Park, while Exmouth eased past Elmore 2-0 at Horsdon Park thanks to Ben Shepherd's two goals.
Striker Stan Paxton scored for Willand Rovers in a 4-1 Toolstation League win at his former club Barnstaple Town.