)
The infused and reinforced longsword I started with (+1 or +2 , I think), was doing a fair amount of damage by itself, so I rarely switched over.
I've just looked on the wiki, and it turns out it's apaprently recommended to go through the cathedral after you defeat the crystal sage, and then do Farron Keep, due to an item that lowers poison damage.