MODIFICATION
A -- Cognitive Information Processing Technology
- Notice Date
- 7/22/2003
- Notice Type
- Modification
- Contracting Office
- Other Defense Agencies, Defense Advanced Research Projects Agency, Contracts Management Office, 3701 North Fairfax Drive, Arlington, VA, 22203-1714
- ZIP Code
- 22203-1714
- Solicitation Number
- BAA02-21
- Response Due
- 6/7/2004
- Point of Contact
- Ronald Brachman, Information Processing Technology Office (IPTO), Phone none, Fax (703) 741-7804, - Barbara Yoon, Information Processing Technology Office (IPTO), Phone none, Fax (703) 741-7804,
- E-Mail Address
-
none, none
- Description
- The above referenced BAA is modified to include a new Focal Challenge: Cognitive Systems Evaluation, (CSE) to plan, design, administer, and analyze structured evaluations of cognitive systems. During the life of this BAA, other Focal Challenges may be introduced. The Cognitive Systems Evaluation Focal Challenge is an addition to the areas of interest described in the basic BAA and subsequent modifications. The intent of this Focal Challenge is to drive the creation of a new capability to evaluate cognitive systems. The objective of this effort is to provide independent evaluations of cognitive system prototypes and related R&D performed for DARPA/IPTO. In general, the purpose of these evaluations is to provide the necessary empirical evidence that research progress is being made toward the specific objectives of each relevant IPTO program. Please refer to the Proposer Information Pamphlet (PIP), particularly the final section, Cognitive Systems Evaluation Addendum for further details on the description, scope, tasks, and deliverables for this effort. SCOPE AND TASKS OF THE COGNITIVE SYSTEMS EVALUATION FOCAL CHALLENGE. The offeror will plan, design, and administer experiments as well as analyze the collected data for each evaluation. The evaluation offeror will assess all aspects of the cognitive systems under development, including but not limited to reasoning, perception, learning, advice taking, explanation, adaptation to new situations and intelligent responses and other program specific aspects. Together with the various IPTO development contractors, the evaluation offeror will develop appropriate specifications, evaluation criteria, metrics and tests. Tasks for all evaluations: Task 1; Design, Specify, and Plan the Annual Evaluation: The offeror will specify the annual evaluations to be conducted for each IPTO R&D program in cognitive systems. Task 2; Develop Evaluation Materials and Detailed Planning: The offeror shall plan, schedule, and develop appropriate evaluation materials for each annual evaluation activity and milestone and provide a more detailed evaluation plan during this task. Task 3; Administer Evaluations: The offeror shall prepare and execute the evaluation as well as perform the preliminary data summarization and validation. Task 4; Analyze and Interpret Results: The offeror will analyze and interpret the results of the evaluations to identify the degree to which each program and technology claim has been substantiated. The initial task of this solicited effort will be to provide independent evaluation of the PAL (Perceptive Assistant that Learns) program. PAL is a long-term DARPA R&D program that focuses on developing an enduring personalized cognitive assistant – a computer system that will learn to adapt to the user instead of the other way around. SRI International and Carnegie Mellon University (CMU) are being funded by DARPA to design and develop prototype cognitive assistants. SRI’s CALO and CMU’s RADAR efforts, specific descriptions of the CMU and SRI testing efforts, and greater description of the PAL program can be found in the CSE Addendum to the PIP and at http://www.darpa.mil/ipto/solicitations/open/02-21_Mod6.htm. CSE tasks specifically for the PAL program are listed below. These task descriptions modify or supplement those provided above and do not replace them altogether. Task 1: Design, Specify, and Plan the Annual Evaluation: SRI and CMU have established an evaluation framework and are contracted to administer their own respective evaluations. The independent evaluator will specify detailed evaluation conditions, evaluation questions and related material within the respective SRI and CMU frameworks. The independent evaluator will develop a refined Evaluation Design, Specification, and Plan jointly with CMU and SRI. Task 2: Develop Evaluation Materials and Detailed Planning: No modification to Task 2 above. Task 3: Administer Evaluations: T NOTE: THIS NOTICE WAS NOT POSTED TO FEDBIZOPPS.GOV ON THE DATE INDICATED IN THE NOTICE ITSELF (22-JUL-2003). IT ACTUALLY APPEARED OR REAPPEARED ON THE FEDBIZOPPS SYSTEM ON 12-NOV-2003. PLEASE CONTACT fbo.support@gsa.gov REGARDING THIS ISSUE.
- Web Link
-
Link to FedBizOpps document.
(http://www.eps.gov/spg/ODA/DARPA/CMO/BAA02-21/listing.html)
- Record
- SN00468453-F 20031114/031112212913 (fbodaily.com)
- Source
-
FedBizOpps.gov Link to This Notice
(may not be valid after Archive Date)
| FSG Index | This Issue's Index | Today's FBO Daily Index Page |