My best thoughts on priors (also the thoughts of some other contributors) are at the Prior Choice Recommendations wiki. And this more theoretical paper should be helpful too. I sent these links in response to a question from Zach Branson about priors for Gaussian processes. Jim Savage also pointed to our paper on simulation-based calibration …