We’ve worked with a representative group of your peers over the last several months to test and implement some changes to the Keying Tool. Many of these changes are things you have requested. Some of these changes are process changes that we feel will allow your contribution to have an even greater impact.
We expect the new Keying Tool to be available within the next 24 hours. So, watch for a download and install the next time you open your keying tool. The major changes are as follows:
Historically our process has included a double-blind key with an arbitrator reviewing the differences. Our assumption has always been that this process provided the best quality. After extensive testing and review of data we have discovered that indexing quality is most affected by the expertise of the last person who touches the record – whether they are the first and only person or the twelfth person makes no difference.
With that in mind, we have decided that going forward most projects keyed in the Ancestry World Archives Project will be indexed in the following manner. One person will key an image set. A second, more experienced keyer, will review 100% of the fields keyed per image set.
This also brings us to the conclusion that a more experienced keyer, who has proven their level of quality, does not need all of their keying reviewed. So, with these changes, we have also implemented a process we are calling Trusted Keyer. This means that, after keying a significant volume of records with high quality, most of the records keyed by a Trusted Keyer will pass through the system without additional review. This will be administered on a per project basis. Occasional review will still be performed on their work to ensure that they continue to qualify as a Trusted Keyer.
By doing this the time and effort you put into keying now has a greater impact on the volume of records being produced.
At this same time we are introducing a much requested feedback feature. This feature allows reviewers to choose a pre-selected piece of feedback to submit with each image set. Phase one of this feedback feature allows us to aggregate this information on a per project basis. Additionally, we will be providing you with personalized quality accuracy per project. We will begin collecting this information immediately with each image set reviewed but expect to see this feeback available on the Project Pages in early February.
If you are an arbitrator, we invite you to try out the new reivew and feedback processes as soon as the new tool has been automatically installed on Thursday. If you have questions or comments about any of these changes, please leave them here. We will address them in the coming days.
Until next time – Happy Keying!
P.S. – A complete list of all feature changes and bug fixes in the new release of the Keying Tool is coming soon.