What is there to do around San Juan outside of a Resort?

Im thinking of going to PR in October for about 3-4 days but Im trying to think if its worth the extra money to stay at a resort. Im not a golfer so what else is there to do outside of a resort around San Juan? Im mostly interested in relaxing and eating good food while enjoying nice scenery and beaches. Is there enough things to do that would be time better spent outside of the resort? Ill have a car but dont want to do hours of driving all day, mostly walk and relax.