{"id":48989,"topic":"ai","source":"National Institute of Standards and Technology (.gov)","title":"Announcing NIST's Artificial Intelligence Technology Evaluation (AITE) - National Institute of Standards and Technology (.gov)","url":"https://www.nist.gov/news-events/news/2026/07/announcing-nists-artificial-intelligence-technology-evaluation-aite","url_hash":"9d26eb7241b7d66198b4db12dcb31d2eda02057a","author":"","summary":"<a href=\"https://news.google.com/rss/articles/CBMiswFBVV95cUxQS0NneTFyOFk3R1AzMkdHY1c5dlZSZUlrVDFZNWlNR2ZDLW55R3Y0U1N3UmZGM0ZETUl2Rk1rNE54dTFFQ0RVNHl3aUZKeGlXYTU1cE9tN2RDZ2Z5NDR2ZTRUWUhidVpDejBVVHVsSnZ3eHpBT2FIQlpFN3k4R3phbENTUk1iQm9NWXhheWIwZE5oSUlROXBXSF9GeU1OZzFPOUh2MWpSdWt4NmFlblM0NlVLbw?oc=5\" target=\"_blank\">Announcing NIST's Artificial Intelligence Technology Evaluation (AITE)</a>&nbsp;&nbsp;<font color=\"#6f6f6f\">National Institute of Standards and Technology (.gov)</font>","content":"The Technology Test and Evaluation Division at NIST is launching a new program to provide researchers with a sequestered testbed environment for the evaluation of AI model performance in a variety of meaningful tasks across diverse datasets, modalities, and domains.\nThe Artificial Intelligence Technology Evaluation (AITE) provides volunteer testing of AI models on blind data and its sequestered environment mitigates the risk of train/test data contamination to ensure rigorous, objective assessment. The three initial tasks focus on image analysis using large vision language models (VLMs) in the context of (1) quantum science, (2) genomics, (3) public safety. Additional tasks will be added over time. The infrastructure provided by NIST will provide common data, metrics and scoring to help developers understand the performance of their models.\nAITE will rely on engagement from participants in two different tracks, each offering distinct advantages:\nParticipation is open to all who wish to engage in one of the ways described above, and who can abide by the AITE Participation Agreement and rules. To request participation or ask questions, contact us at aite-poc [at] list.nist.gov (aite-poc[at]list[dot]nist[dot]gov).\nTo learn more, we invite you to explore the AITE evaluation overview and specifications for the initial three tasks. These resources can be found by clicking the button below.\nLearn More","image_url":"https://www.nist.gov/themes/custom/nist_www/img/homepage/nist_mark.png","lang":"en","published_at":"2026-07-27T12:00:00+00:00","fetched_at":"2026-07-29T15:15:04+00:00","status":"read","starred":0,"extract_state":"ok","summary_auto":"The Technology Test and Evaluation Division at NIST is launching a new program to provide researchers with a sequestered testbed environment for the evaluation of AI model performance in a variety of meaningful tasks across diverse datasets, modalities, and domains. The Artificial Intelligence Technology Evaluation (AITE) provides volunteer testing of AI models on blind data and its sequestered environment mitigates the risk of train/test data contamination to ensure rigorous, objective assessment.","cluster_id":null,"extract_retries":0,"extract_error":null,"contract_version":"news_item.v1","format_contract_version":"news_item_formats.v1","dedup_url":"https://www.nist.gov/news-events/news/2026/07/announcing-nists-artificial-intelligence-technology-evaluation-aite","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 1417 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":1417,"summary_length":503,"usable_text_length":1417,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":1417,"summary_length":503}},"news_item":{"id":48989,"canonical_url":"https://www.nist.gov/news-events/news/2026/07/announcing-nists-artificial-intelligence-technology-evaluation-aite","source_url":"https://www.nist.gov/news-events/news/2026/07/announcing-nists-artificial-intelligence-technology-evaluation-aite","title":"Announcing NIST's Artificial Intelligence Technology Evaluation (AITE) - National Institute of Standards and Technology (.gov)","source_name":"National Institute of Standards and Technology (.gov)","author":null,"published_at":"2026-07-27T12:00:00+00:00","locale":"en","topic":"ai","tags":[],"rss_summary":"<a href=\"https://news.google.com/rss/articles/CBMiswFBVV95cUxQS0NneTFyOFk3R1AzMkdHY1c5dlZSZUlrVDFZNWlNR2ZDLW55R3Y0U1N3UmZGM0ZETUl2Rk1rNE54dTFFQ0RVNHl3aUZKeGlXYTU1cE9tN2RDZ2Z5NDR2ZTRUWUhidVpDejBVVHVsSnZ3eHpBT2FIQlpFN3k4R3phbENTUk1iQm9NWXhheWIwZE5oSUlROXBXSF9GeU1OZzFPOUh2MWpSdWt4NmFlblM0NlVLbw?oc=5\" target=\"_blank\">Announcing NIST's Artificial Intelligence Technology Evaluation (AITE)</a>&nbsp;&nbsp;<font color=\"#6f6f6f\">National Institute of Standards and Technology (.gov)</font>","full_text":"The Technology Test and Evaluation Division at NIST is launching a new program to provide researchers with a sequestered testbed environment for the evaluation of AI model performance in a variety of meaningful tasks across diverse datasets, modalities, and domains.\nThe Artificial Intelligence Technology Evaluation (AITE) provides volunteer testing of AI models on blind data and its sequestered environment mitigates the risk of train/test data contamination to ensure rigorous, objective assessment. The three initial tasks focus on image analysis using large vision language models (VLMs) in the context of (1) quantum science, (2) genomics, (3) public safety. Additional tasks will be added over time. The infrastructure provided by NIST will provide common data, metrics and scoring to help developers understand the performance of their models.\nAITE will rely on engagement from participants in two different tracks, each offering distinct advantages:\nParticipation is open to all who wish to engage in one of the ways described above, and who can abide by the AITE Participation Agreement and rules. To request participation or ask questions, contact us at aite-poc [at] list.nist.gov (aite-poc[at]list[dot]nist[dot]gov).\nTo learn more, we invite you to explore the AITE evaluation overview and specifications for the initial three tasks. These resources can be found by clicking the button below.\nLearn More","excerpt":"The Technology Test and Evaluation Division at NIST is launching a new program to provide researchers with a sequestered testbed environment for the evaluation of AI model performance in a variety of meaningful tasks across diverse datasets, modalities, and domains. The Artificial Intelligence Technology Evaluation (AITE) provides volunteer testing of AI models on blind data and its sequestered environment mitigates the risk of train/test data contamination to ensure rigorous, objective assessment.","extraction":{"state":"ok","confidence":0.9,"error":null,"explanation":"High confidence: full text extraction produced 1417 characters.","diagnostics_url":"/api/diagnose?url=https%3A//www.nist.gov/news-events/news/2026/07/announcing-nists-artificial-intelligence-technology-evaluation-aite","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 1417 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":1417,"summary_length":503,"usable_text_length":1417,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":1417,"summary_length":503}}},"display_formats":["compact","card","full","digest_section","json"]},"daily_stack_record":{"title":"Announcing NIST's Artificial Intelligence Technology Evaluation (AITE) - National Institute of Standards and Technology (.gov)","url":"https://www.nist.gov/news-events/news/2026/07/announcing-nists-artificial-intelligence-technology-evaluation-aite","summary":"The Technology Test and Evaluation Division at NIST is launching a new program to provide researchers with a sequestered testbed environment for the evaluation of AI model performance in a variety of meaningful tasks across diverse datasets, modalities, and domains. The Artificial Intelligence Technology Evaluation (AITE) provides volunteer testing of AI models on blind data and its sequestered environment mitigates the risk of train/test data contamination to ensure rigorous, objective assessment.","source":"National Institute of Standards and Technology (.gov)","date":"2026-07-27T12:00:00+00:00","content":"The Technology Test and Evaluation Division at NIST is launching a new program to provide researchers with a sequestered testbed environment for the evaluation of AI model performance in a variety of meaningful tasks across diverse datasets, modalities, and domains.\nThe Artificial Intelligence Technology Evaluation (AITE) provides volunteer testing of AI models on blind data and its sequestered environment mitigates the risk of train/test data contamination to ensure rigorous, objective assessment. The three initial tasks focus on image analysis using large vision language models (VLMs) in the context of (1) quantum science, (2) genomics, (3) public safety. Additional tasks will be added over time. The infrastructure provided by NIST will provide common data, metrics and scoring to help developers understand the performance of their models.\nAITE will rely on engagement from participants in two different tracks, each offering distinct advantages:\nParticipation is open to all who wish to engage in one of the ways described above, and who can abide by the AITE Participation Agreement and rules. To request participation or ask questions, contact us at aite-poc [at] list.nist.gov (aite-poc[at]list[dot]nist[dot]gov).\nTo learn more, we invite you to explore the AITE evaluation overview and specifications for the initial three tasks. These resources can be found by clicking the button below.\nLearn More","confidence":0.9,"diagnostics_url":"/api/diagnose?url=https%3A//www.nist.gov/news-events/news/2026/07/announcing-nists-artificial-intelligence-technology-evaluation-aite","quality_bucket":"high","failure_kind":"none","retryable":false,"quality_reason":"High confidence: full text extraction produced 1417 characters.","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 1417 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":1417,"summary_length":503,"usable_text_length":1417,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":1417,"summary_length":503}},"tags":[]},"fallback_formats":["markdown","json","html"],"actions":{"read":"/item/48989","export_markdown":"/api/items/48989/export?format=markdown","export_json":"/api/items/48989/export?format=json","diagnose":"/api/diagnose?url=https%3A//www.nist.gov/news-events/news/2026/07/announcing-nists-artificial-intelligence-technology-evaluation-aite"},"formats":{"full":{"id":48989,"title":"Announcing NIST's Artificial Intelligence Technology Evaluation (AITE) - National Institute of Standards and Technology (.gov)","url":"https://www.nist.gov/news-events/news/2026/07/announcing-nists-artificial-intelligence-technology-evaluation-aite","source":"National Institute of Standards and Technology (.gov)","author":null,"published_at":"2026-07-27T12:00:00+00:00","locale":"en","topic":"ai","tags":[],"excerpt":"The Technology Test and Evaluation Division at NIST is launching a new program to provide researchers with a sequestered testbed environment for the evaluation of AI model performance in a variety of meaningful tasks across diverse datasets, modalities, and domains. The Artificial Intelligence Technology Evaluation (AITE) provides volunteer testing of AI models on blind data and its sequestered environment mitigates the risk of train/test data contamination to ensure rigorous, objective assessment.","full_text":"The Technology Test and Evaluation Division at NIST is launching a new program to provide researchers with a sequestered testbed environment for the evaluation of AI model performance in a variety of meaningful tasks across diverse datasets, modalities, and domains.\nThe Artificial Intelligence Technology Evaluation (AITE) provides volunteer testing of AI models on blind data and its sequestered environment mitigates the risk of train/test data contamination to ensure rigorous, objective assessment. The three initial tasks focus on image analysis using large vision language models (VLMs) in the context of (1) quantum science, (2) genomics, (3) public safety. Additional tasks will be added over time. The infrastructure provided by NIST will provide common data, metrics and scoring to help developers understand the performance of their models.\nAITE will rely on engagement from participants in two different tracks, each offering distinct advantages:\nParticipation is open to all who wish to engage in one of the ways described above, and who can abide by the AITE Participation Agreement and rules. To request participation or ask questions, contact us at aite-poc [at] list.nist.gov (aite-poc[at]list[dot]nist[dot]gov).\nTo learn more, we invite you to explore the AITE evaluation overview and specifications for the initial three tasks. These resources can be found by clicking the button below.\nLearn More","reading_time_min":1,"extraction":{"state":"ok","confidence":0.9,"error":null,"explanation":"High confidence: full text extraction produced 1417 characters.","diagnostics_url":"/api/diagnose?url=https%3A//www.nist.gov/news-events/news/2026/07/announcing-nists-artificial-intelligence-technology-evaluation-aite","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 1417 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":1417,"summary_length":503,"usable_text_length":1417,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":1417,"summary_length":503}}},"quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 1417 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":1417,"summary_length":503,"usable_text_length":1417,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":1417,"summary_length":503}},"actions":{"read":"/item/48989","export_markdown":"/api/items/48989/export?format=markdown","export_json":"/api/items/48989/export?format=json","diagnose":"/api/diagnose?url=https%3A//www.nist.gov/news-events/news/2026/07/announcing-nists-artificial-intelligence-technology-evaluation-aite"}},"digest":{"id":48989,"title":"Announcing NIST's Artificial Intelligence Technology Evaluation (AITE) - National Institute of Standards and Technology (.gov)","url":"https://www.nist.gov/news-events/news/2026/07/announcing-nists-artificial-intelligence-technology-evaluation-aite","source":"National Institute of Standards and Technology (.gov)","topic":"ai","published_at":"2026-07-27T12:00:00+00:00","excerpt":"The Technology Test and Evaluation Division at NIST is launching a new program to provide researchers with a sequestered testbed environment for the evaluation of AI model performance in a variety of meaningful tasks across diverse datasets, modalities, and domains. The…","quality_bucket":"high","quality_reason":"High confidence: full text extraction produced 1417 characters.","reading_time_min":1,"cluster_id":null},"card":{"display_title":"Announcing NIST's Artificial Intelligence Technology Evaluation (AITE) - National Institute of Standards and Technology (.gov)","subtitle":"National Institute of Standards and Technology (.gov) · 2026-07-27","summary":"The Technology Test and Evaluation Division at NIST is launching a new program to provide researchers with a sequestered testbed environment for the evaluation of AI model performance in a variety of meaningful tasks…","badges":["quality:high"],"links":{"read":"/item/48989","original":"https://www.nist.gov/news-events/news/2026/07/announcing-nists-artificial-intelligence-technology-evaluation-aite","diagnose":"/api/diagnose?url=https%3A//www.nist.gov/news-events/news/2026/07/announcing-nists-artificial-intelligence-technology-evaluation-aite"},"quality_warning":null},"export":{"title":"Announcing NIST's Artificial Intelligence Technology Evaluation (AITE) - National Institute of Standards and Technology (.gov)","url":"https://www.nist.gov/news-events/news/2026/07/announcing-nists-artificial-intelligence-technology-evaluation-aite","summary":"The Technology Test and Evaluation Division at NIST is launching a new program to provide researchers with a sequestered testbed environment for the evaluation of AI model performance in a variety of meaningful tasks across diverse datasets, modalities, and domains. The Artificial Intelligence Technology Evaluation (AITE) provides volunteer testing of AI models on blind data and its sequestered environment mitigates the risk of train/test data contamination to ensure rigorous, objective assessment.","source":"National Institute of Standards and Technology (.gov)","date":"2026-07-27T12:00:00+00:00","content":"The Technology Test and Evaluation Division at NIST is launching a new program to provide researchers with a sequestered testbed environment for the evaluation of AI model performance in a variety of meaningful tasks across diverse datasets, modalities, and domains.\nThe Artificial Intelligence Technology Evaluation (AITE) provides volunteer testing of AI models on blind data and its sequestered environment mitigates the risk of train/test data contamination to ensure rigorous, objective assessment. The three initial tasks focus on image analysis using large vision language models (VLMs) in the context of (1) quantum science, (2) genomics, (3) public safety. Additional tasks will be added over time. The infrastructure provided by NIST will provide common data, metrics and scoring to help developers understand the performance of their models.\nAITE will rely on engagement from participants in two different tracks, each offering distinct advantages:\nParticipation is open to all who wish to engage in one of the ways described above, and who can abide by the AITE Participation Agreement and rules. To request participation or ask questions, contact us at aite-poc [at] list.nist.gov (aite-poc[at]list[dot]nist[dot]gov).\nTo learn more, we invite you to explore the AITE evaluation overview and specifications for the initial three tasks. These resources can be found by clicking the button below.\nLearn More","confidence":0.9,"diagnostics_url":"/api/diagnose?url=https%3A//www.nist.gov/news-events/news/2026/07/announcing-nists-artificial-intelligence-technology-evaluation-aite","quality_bucket":"high","failure_kind":"none","retryable":false,"quality_reason":"High confidence: full text extraction produced 1417 characters.","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 1417 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":1417,"summary_length":503,"usable_text_length":1417,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":1417,"summary_length":503}},"tags":[],"format_contract_version":"news_item_formats.v1"}}}