Brandon Sebirumbi and Richard Brown scored 14 points each to lead Furman over Loyola (Ill.) 63-51 on Sunday.
Bryant Irwin added 11 points and Bobby Austin 10 for the Paladins (3-1).
Furman shot 46.7 percent from the field (21 of 45) after connecting on just 24.6 percent of its shots in a 66-46 loss to Mercer on Thursday.
The Paladins trailed 30-31 after Joe Crisman's jumper for the Ramblers with 16:11 to play. Furman then answered with a 15-7 run to go up 48-38 on Austin's free throws with 7:02 remaining.
Loyola (0-4) shot just 38.5 percent from the field (10 of 26) in the second half.
Crisman had 12 points, Christian Thomas 11 and Denzel Brito 10 for the Ramblers, who finished a four-game road trip to open the season for the first time in their 94-year history.