The Basics About Arbitration and Review
We’ve had several thousand people join us over the last few months. We are so excited that you have become part of our community of keying contributors. You are doing great work!
This influx of new keyers has created a unique challenge for us, however. We are getting quite the backlog in arbitration and review. Each time I mention that I get a few questions about what that means. Today’s post answers all those questions – or maybe, just some of those questions, with an opportunity to get all of your questions answered.
Quality Assurance
In order to ensure quality control we have in place a system whereby experienced keyers review or arbitrate the work of newer keyers. In addition to this reviewers also update the discussion tab on the project pages in the wiki with information about the common errors they see being made by keyers in order to help us all improve our keying.
Arbitrate
Some projects are double-blind keyed and then arbitrated. This means two contributors key the same image set without seeing the work of the other. Once submitted, an automatic process determines which fields match and which fields don’t. An arbitrator then looks at the fields that don’t match, determines which keyer is correct or keys in the correct answer themselves.
Review
Some projects are only keyed once and then reviewed. This means that after the keyer has submitted a completed image set the reviewer is required to check every single field to ensure that it was keyed accurately.
Eligibility
Current eligibility requirements to become an arbitrator/reviewer are that you have keyed a minimum of 2000 records in the past 90 days that have been arbitrated/reviewed and have maintained an accuracy rating of exceptional.
Invitation
That’s the basics of how it works. If you think you might be eligible to be an arbitrator or a reviewer and want to learn more, we are offering a couple of informational sessions this week to answer all your questions. Both sessions will be held this Wednesday (June 29th). The first one will be at 11:00 am Mountain Time (5:00 pm GMT). The second one will be held at 6:00 pm Mountain Time (12:00 am GMT). Each session will last about 45-50 min and you will be able to ask whatever questions you have about how arbitration and review work.
If you are interested in joining us for one of those sessions, please send an email to us at WorldArchivesProject@ancestry.com and be sure to indicate which time works best for you. We will then send you a link to the meeting.
Until next time – Happy Keying!
While the arbitration process doesn’t make you check every line. I’ve found its better if you do. And actually easier for long unsorted lists of names. It’s too easy to lose your place when the tool simply skips matching entries.
Also the automatic matching isn’t quite correct, the wrong entries are often chosen when the difference is in punctuation, capitalization and spacing.
To set this up go to tools – options – and check the box that says “review all fields in arbitration”.