Annex B: Project Evaluation Criteria
[This annex may be modified by a majority vote of
the SAB members responding approve/disapprove in a
30 day electronic ballot.]
The following criteria shall be considered by CS
sponsors when evaluating project proposals. These may
be a basis for denial of sponsorship, but projects that
do not meet these may be approved for sponsorship after
due consideration.
1. Broad market potential
consider: broad set(s) of applications
multiple suppliers, and users
Schools, employers and training managers need to be able to define, track
and exchange competency data, using a standard format with common
assumptions. Competency data includes data that describes or identifies
learning objectives, skills and general competencies.
Large potential market exists for selling learning management systems that
exploit competency data to these schools, employers and training managers.
2. Compatibility with related standards
Complements IEEE 1484.12 learning objects metadata in the sense that
metadata can reference competencies defined using IEEE 1484.20
Complements IEEE 1484.2 Learner Model by in the sense that learner
model data can reference competencies defined using IEEE 1484.20
3. Distinct identity
consider: substantially different from other projects
unique solution for scope/purpose
easy for document reader to select relevant specification
Covers a data model area not covered in other IEEE 1484 projects; also
provides a missing link that can be referenced by multiple other projects
such as 1484.12 learning objects metadata and IEEE 1484.2 Learner Model, and
1484.11 Computer Managed Instruction.
4. Technical feasibility
consider: demonstrated feasibility
proven technology
confidence in reliability
Relies on proven, simple data modeling techniques also used in other IEEE
1484 projects such as IEEE.12 learning object metadata
5. Viable volunteer leadership & participation
consider: identified project leader,
project editor
employer support
sufficient active participants
Claude Ostyn is project leader and has support from his employer click2learn.com, inc.
(formerly Asymetrix Learning Systems. Inc.)
Claude Ostyn is project editor.
Membership will draw from existing IEEE 1484 members, several of which have
already expressed interest in participating and are directly involved in
work related to this standard. Expected participation: at least 8
participants from commercial, academic, and user organizations.
6. Realistic objectives
consider: scope of work and focus
timeframe for completion
potential for "subdivision" into deliverables
Work may be extended and improved through revisions over the years.
However, first release of standard will concentrate on a mimimal set
that meets the needs of commercial vendors.
This standard will concentrate on a minimum data model for practical,
economically implementable systems. Deliverables may include a data model
specification and a separate binding specification.
7. Opportunity to establish new areas of expertise within the
Computer Society
consider: emerging technology
providing a focal point for diverse interests
avoiding conflict with other standards development groups
Should attract technically-oriented educators. Will focus on a solution
based on proven technical standards for a problem that is becoming more
obvious with ongoing progress on the other learning technology standards.
No conflicts foreseen with other groups.