I think Jane already knows who Red John is but does not have enough proof yet and does not want to scare him away and that everything to have happened up to now was just acting to get closer to him. I think the scene where Van Pelt opens up to Stiles was staged and is just meant to tempt Red John to approach her.
