• Who sums and averages the appraisers’ scores?
  The DI Scoring Program sums each individual appraiser’s scores for each challenge element.
• Who enters the scores into the DI Scoring Program and where do they do it?
  The appraisers can type their scores into the DI Scoring Program or an onsite computer operator can collect paper forms from the appraisers and type the scores into the DI Scoring Program. With this strategy, all scores are typed into the computer at the challenge site and then transferred to the scoring room electronically or with removable media.
• Which scores are entered into the DI Scoring Program?
  Each appraiser’s score for each element of the challenge is typed into the DI Scoring Program.
  

  

  (See the score sheet)

Costs and Benefits

Benefits

This method minimizes manual calculation and its resulting errors. Fewer people are required (no need to verify calculations or type data from paper forms). Scoring errors are detected at the challenge site, where they are most easily resolved.

Costs

This method requires many computers. Additional computer operators (or the appraisers) must be trained to use some features of the DI Scoring Program. Data collected at the challenge site (from one or more computers) must be transferred to the scoring room. The scoring room must utilize methods to merge the data from each challenge site into the DI Scoring Program.