PredictionBook: Feature Request and Bug Report
Introduction
It occurred to me (and ahartell) that it would be convenient if there were a place where we could report bugs and request features for the prediction tracking website PredictionBook. I propose to make this that place. If you post a comment in this thread pointing out a bug or requesting the addition of a new feature, then I will update this article to include that bug or feature.
Disclaimer: This thread isn’t a promise that any particular bug will be fixed or feature added.
Feature Request
1. The ability to tag prediction statements to allow sorting by topic.
(a). Prevent prediction statements that are tagged personal from showing up on the main feed or happenstance.
(b). Allow users to form groups of “friends” that can follow prediction statements tagged as personal.
2. A voting system or flag button to discourage the use of PredictionBook for advertising purposes (and other types of spam).
3. A threaded comment system for discussing particular prediction statements (this will be much more important as the size of the community grows).
4. A Brier score visible on the user’s page.
(a). Brier scores by topic.
(b). Brier score over time (say, quarterly).
5. The ability to compare calibration between users.
6. The ability to delete comments (perhaps, for a certain time period after the comment is made).
7. A button on the login page to reset the user’s password.
8. An option on the user page to sort by judged/unjudged/upcoming.
9. Display a probability for the prediction statement weighed by the users’ calibration scores.
Bug Reports
1. The email notification system appears not to be working.
Ahem: http://github.com/tricycle/predictionbook/issues
Good point. On the other hand, this seems like a better place for discussing the priority or utility of various features than GitHub comments (which seem somewhat clunky since they aren’t threaded and are split into many separate chunks for each feature/bug).
Retracted for being a rationalisation. If I had known of that link before you mentioned it, then I wouldn’t have felt the need to create this thread.
To me the main problem of PB (and why I don’t really use it), is that there are so many predictions which are way too personal (“I’ll go to the swimming pool next week”) so I can’t have any real opinion on them without knowing the person, and the predictions which are general-enough to be interesting are lost in the crowd.
So a topic/tag system would definitely be a great addition.
Personal predictions should be “encouraged” to be kept private.
Would it be rude to start commenting to this effect on personal predictions?
Perhaps a useful feature here would be the ability to share your (personal) prediction with a specific group of users only.
Yeah. You having said that, I’m imagining a “motivation by prediction” group where you can make personal predictions that won’t clutter the main feed but still give a bit more accountability since you won’t want to fail in front of your friends.
Another request: The ability to delete comments maybe? I’m not sure if this would go against the integrity of a prediction site, but maybe it could be set up such that the comments only remained deletable for like 10 minutes (to fight accidental double posts or typos or whatever). Even a retract button like lesswrong has would be an improvement.
I too have observed lack of email notifications, and would like this fixed.
Option to sort by judged/unjudged predictions.
Thanks for posting this. And mentioning me :).
I signed up once for predictionbook, but since forgot my password. I haven’t found way to recover it, and if I want a new account I need to use another email address. Is there any way around this?
Average confidence weighted by each predictor’s calibration score.