Woven baskets, hammocks and mochilas (a local bag) are all worth a look, as are reproductions of pre-Colombian pottery and gold work.
Try the pricey but high quality Artesanias de Colombia next to the church Iglesia de las Aguas on Carerra 3A, 18-60.