{"id":47443,"topic":"ai","source":"MeriTalk","title":"NIST Launches AI Technology Evaluation Program - MeriTalk","url":"https://www.meritalk.com/articles/nist-launches-ai-technology-evaluation-program/","url_hash":"3c405aace46d0481ddbba89778c6c2e46c5cafeb","author":"","summary":"<a href=\"https://news.google.com/rss/articles/CBMiiAFBVV95cUxPNnFPS0s0T2NaQlRWYzhOVUZwMUFGaG5ud2lPNk9IMGdBTVJGTlRoOUZnWG41dzh2OXVQcDdRdlZrTExXRUdWeVN3NTJQVWctRm1aODF4T3Y4RXRHMTJSTE13dlAwclFqTE9LdERsMTRxb0VIdC00NVY1ZDBXdHEydndMbHJOUHlQ?oc=5\" target=\"_blank\">NIST Launches AI Technology Evaluation Program</a>&nbsp;&nbsp;<font color=\"#6f6f6f\">MeriTalk</font>","content":"The National Institute of Standards and Technology (NIST) has launched a new Artificial Intelligence Technology Evaluation (AITE) program that will provide researchers and developers with a sequestered testing environment to evaluate artificial intelligence (AI) models on blind datasets across multiple domains.\nAccording to a July 27 NIST bulletin, the program is designed to provide more rigorous and objective assessments of AI model performance by preventing test data from being incorporated into model training.\nThe initiative is being led by NIST’s Technology Test and Evaluation Division and will initially evaluate large vision language models (VLMs) on tasks spanning quantum science, genomics, and public safety. Additional evaluation tasks are planned over time.\n“The infrastructure provided by NIST will provide common data, metrics, and scoring to help developers understand the performance of their models,” NIST said.\nThe program includes two participation tracks.\nUnder one track, data providers can submit original datasets and associated evaluation tasks in their areas of expertise. NIST said those participants will receive performance measurements of leading AI models evaluated against their datasets.\nUnder the other track, model providers can submit AI models for testing against the growing collection of datasets and tasks. NIST said participants will receive information on how their models perform across multiple domains and how those results compare with other models using the same metrics “while ensuring the evaluation data is not used for training any model.”\nParticipation is open to organizations and individuals that agree to the program’s participation agreement and rules. NIST said interested participants can request participation or ask questions by contacting the agency at aite-poc@list.nist.gov.\nFor more information, prospective participants can check out the agency’s overview of the AITE program.","image_url":"https://www.meritalk.com/wp-content/uploads/2019/11/NIST-1-min.jpg","lang":"en","published_at":"2026-07-27T20:05:33+00:00","fetched_at":"2026-07-27T20:15:08+00:00","status":"read","starred":0,"extract_state":"ok","summary_auto":"The National Institute of Standards and Technology (NIST) has launched a new Artificial Intelligence Technology Evaluation (AITE) program that will provide researchers and developers with a sequestered testing environment to evaluate artificial intelligence (AI) models on blind datasets across multiple domains. According to a July 27 NIST bulletin, the program is designed to provide more rigorous and objective assessments of AI model performance by preventing test data from being incorporated into model training.","cluster_id":null,"extract_retries":0,"extract_error":null,"contract_version":"news_item.v1","format_contract_version":"news_item_formats.v1","dedup_url":"https://www.meritalk.com/articles/nist-launches-ai-technology-evaluation-program/","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 1946 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":1946,"summary_length":518,"usable_text_length":1946,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":1946,"summary_length":518}},"news_item":{"id":47443,"canonical_url":"https://www.meritalk.com/articles/nist-launches-ai-technology-evaluation-program/","source_url":"https://www.meritalk.com/articles/nist-launches-ai-technology-evaluation-program/","title":"NIST Launches AI Technology Evaluation Program - MeriTalk","source_name":"MeriTalk","author":null,"published_at":"2026-07-27T20:05:33+00:00","locale":"en","topic":"ai","tags":[],"rss_summary":"<a href=\"https://news.google.com/rss/articles/CBMiiAFBVV95cUxPNnFPS0s0T2NaQlRWYzhOVUZwMUFGaG5ud2lPNk9IMGdBTVJGTlRoOUZnWG41dzh2OXVQcDdRdlZrTExXRUdWeVN3NTJQVWctRm1aODF4T3Y4RXRHMTJSTE13dlAwclFqTE9LdERsMTRxb0VIdC00NVY1ZDBXdHEydndMbHJOUHlQ?oc=5\" target=\"_blank\">NIST Launches AI Technology Evaluation Program</a>&nbsp;&nbsp;<font color=\"#6f6f6f\">MeriTalk</font>","full_text":"The National Institute of Standards and Technology (NIST) has launched a new Artificial Intelligence Technology Evaluation (AITE) program that will provide researchers and developers with a sequestered testing environment to evaluate artificial intelligence (AI) models on blind datasets across multiple domains.\nAccording to a July 27 NIST bulletin, the program is designed to provide more rigorous and objective assessments of AI model performance by preventing test data from being incorporated into model training.\nThe initiative is being led by NIST’s Technology Test and Evaluation Division and will initially evaluate large vision language models (VLMs) on tasks spanning quantum science, genomics, and public safety. Additional evaluation tasks are planned over time.\n“The infrastructure provided by NIST will provide common data, metrics, and scoring to help developers understand the performance of their models,” NIST said.\nThe program includes two participation tracks.\nUnder one track, data providers can submit original datasets and associated evaluation tasks in their areas of expertise. NIST said those participants will receive performance measurements of leading AI models evaluated against their datasets.\nUnder the other track, model providers can submit AI models for testing against the growing collection of datasets and tasks. NIST said participants will receive information on how their models perform across multiple domains and how those results compare with other models using the same metrics “while ensuring the evaluation data is not used for training any model.”\nParticipation is open to organizations and individuals that agree to the program’s participation agreement and rules. NIST said interested participants can request participation or ask questions by contacting the agency at aite-poc@list.nist.gov.\nFor more information, prospective participants can check out the agency’s overview of the AITE program.","excerpt":"The National Institute of Standards and Technology (NIST) has launched a new Artificial Intelligence Technology Evaluation (AITE) program that will provide researchers and developers with a sequestered testing environment to evaluate artificial intelligence (AI) models on blind datasets across multiple domains. According to a July 27 NIST bulletin, the program is designed to provide more rigorous and objective assessments of AI model performance by preventing test data from being incorporated into model training.","extraction":{"state":"ok","confidence":0.9,"error":null,"explanation":"High confidence: full text extraction produced 1946 characters.","diagnostics_url":"/api/diagnose?url=https%3A//www.meritalk.com/articles/nist-launches-ai-technology-evaluation-program/","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 1946 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":1946,"summary_length":518,"usable_text_length":1946,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":1946,"summary_length":518}}},"display_formats":["compact","card","full","digest_section","json"]},"daily_stack_record":{"title":"NIST Launches AI Technology Evaluation Program - MeriTalk","url":"https://www.meritalk.com/articles/nist-launches-ai-technology-evaluation-program/","summary":"The National Institute of Standards and Technology (NIST) has launched a new Artificial Intelligence Technology Evaluation (AITE) program that will provide researchers and developers with a sequestered testing environment to evaluate artificial intelligence (AI) models on blind datasets across multiple domains. According to a July 27 NIST bulletin, the program is designed to provide more rigorous and objective assessments of AI model performance by preventing test data from being incorporated into model training.","source":"MeriTalk","date":"2026-07-27T20:05:33+00:00","content":"The National Institute of Standards and Technology (NIST) has launched a new Artificial Intelligence Technology Evaluation (AITE) program that will provide researchers and developers with a sequestered testing environment to evaluate artificial intelligence (AI) models on blind datasets across multiple domains.\nAccording to a July 27 NIST bulletin, the program is designed to provide more rigorous and objective assessments of AI model performance by preventing test data from being incorporated into model training.\nThe initiative is being led by NIST’s Technology Test and Evaluation Division and will initially evaluate large vision language models (VLMs) on tasks spanning quantum science, genomics, and public safety. Additional evaluation tasks are planned over time.\n“The infrastructure provided by NIST will provide common data, metrics, and scoring to help developers understand the performance of their models,” NIST said.\nThe program includes two participation tracks.\nUnder one track, data providers can submit original datasets and associated evaluation tasks in their areas of expertise. NIST said those participants will receive performance measurements of leading AI models evaluated against their datasets.\nUnder the other track, model providers can submit AI models for testing against the growing collection of datasets and tasks. NIST said participants will receive information on how their models perform across multiple domains and how those results compare with other models using the same metrics “while ensuring the evaluation data is not used for training any model.”\nParticipation is open to organizations and individuals that agree to the program’s participation agreement and rules. NIST said interested participants can request participation or ask questions by contacting the agency at aite-poc@list.nist.gov.\nFor more information, prospective participants can check out the agency’s overview of the AITE program.","confidence":0.9,"diagnostics_url":"/api/diagnose?url=https%3A//www.meritalk.com/articles/nist-launches-ai-technology-evaluation-program/","quality_bucket":"high","failure_kind":"none","retryable":false,"quality_reason":"High confidence: full text extraction produced 1946 characters.","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 1946 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":1946,"summary_length":518,"usable_text_length":1946,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":1946,"summary_length":518}},"tags":[]},"fallback_formats":["markdown","json","html"],"actions":{"read":"/item/47443","export_markdown":"/api/items/47443/export?format=markdown","export_json":"/api/items/47443/export?format=json","diagnose":"/api/diagnose?url=https%3A//www.meritalk.com/articles/nist-launches-ai-technology-evaluation-program/"},"formats":{"full":{"id":47443,"title":"NIST Launches AI Technology Evaluation Program - MeriTalk","url":"https://www.meritalk.com/articles/nist-launches-ai-technology-evaluation-program/","source":"MeriTalk","author":null,"published_at":"2026-07-27T20:05:33+00:00","locale":"en","topic":"ai","tags":[],"excerpt":"The National Institute of Standards and Technology (NIST) has launched a new Artificial Intelligence Technology Evaluation (AITE) program that will provide researchers and developers with a sequestered testing environment to evaluate artificial intelligence (AI) models on blind datasets across multiple domains. According to a July 27 NIST bulletin, the program is designed to provide more rigorous and objective assessments of AI model performance by preventing test data from being incorporated into model training.","full_text":"The National Institute of Standards and Technology (NIST) has launched a new Artificial Intelligence Technology Evaluation (AITE) program that will provide researchers and developers with a sequestered testing environment to evaluate artificial intelligence (AI) models on blind datasets across multiple domains.\nAccording to a July 27 NIST bulletin, the program is designed to provide more rigorous and objective assessments of AI model performance by preventing test data from being incorporated into model training.\nThe initiative is being led by NIST’s Technology Test and Evaluation Division and will initially evaluate large vision language models (VLMs) on tasks spanning quantum science, genomics, and public safety. Additional evaluation tasks are planned over time.\n“The infrastructure provided by NIST will provide common data, metrics, and scoring to help developers understand the performance of their models,” NIST said.\nThe program includes two participation tracks.\nUnder one track, data providers can submit original datasets and associated evaluation tasks in their areas of expertise. NIST said those participants will receive performance measurements of leading AI models evaluated against their datasets.\nUnder the other track, model providers can submit AI models for testing against the growing collection of datasets and tasks. NIST said participants will receive information on how their models perform across multiple domains and how those results compare with other models using the same metrics “while ensuring the evaluation data is not used for training any model.”\nParticipation is open to organizations and individuals that agree to the program’s participation agreement and rules. NIST said interested participants can request participation or ask questions by contacting the agency at aite-poc@list.nist.gov.\nFor more information, prospective participants can check out the agency’s overview of the AITE program.","reading_time_min":1,"extraction":{"state":"ok","confidence":0.9,"error":null,"explanation":"High confidence: full text extraction produced 1946 characters.","diagnostics_url":"/api/diagnose?url=https%3A//www.meritalk.com/articles/nist-launches-ai-technology-evaluation-program/","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 1946 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":1946,"summary_length":518,"usable_text_length":1946,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":1946,"summary_length":518}}},"quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 1946 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":1946,"summary_length":518,"usable_text_length":1946,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":1946,"summary_length":518}},"actions":{"read":"/item/47443","export_markdown":"/api/items/47443/export?format=markdown","export_json":"/api/items/47443/export?format=json","diagnose":"/api/diagnose?url=https%3A//www.meritalk.com/articles/nist-launches-ai-technology-evaluation-program/"}},"digest":{"id":47443,"title":"NIST Launches AI Technology Evaluation Program - MeriTalk","url":"https://www.meritalk.com/articles/nist-launches-ai-technology-evaluation-program/","source":"MeriTalk","topic":"ai","published_at":"2026-07-27T20:05:33+00:00","excerpt":"The National Institute of Standards and Technology (NIST) has launched a new Artificial Intelligence Technology Evaluation (AITE) program that will provide researchers and developers with a sequestered testing environment to evaluate artificial intelligence (AI) models on blind…","quality_bucket":"high","quality_reason":"High confidence: full text extraction produced 1946 characters.","reading_time_min":1,"cluster_id":null},"card":{"display_title":"NIST Launches AI Technology Evaluation Program - MeriTalk","subtitle":"MeriTalk · 2026-07-27","summary":"The National Institute of Standards and Technology (NIST) has launched a new Artificial Intelligence Technology Evaluation (AITE) program that will provide researchers and developers with a sequestered testing…","badges":["quality:high"],"links":{"read":"/item/47443","original":"https://www.meritalk.com/articles/nist-launches-ai-technology-evaluation-program/","diagnose":"/api/diagnose?url=https%3A//www.meritalk.com/articles/nist-launches-ai-technology-evaluation-program/"},"quality_warning":null},"export":{"title":"NIST Launches AI Technology Evaluation Program - MeriTalk","url":"https://www.meritalk.com/articles/nist-launches-ai-technology-evaluation-program/","summary":"The National Institute of Standards and Technology (NIST) has launched a new Artificial Intelligence Technology Evaluation (AITE) program that will provide researchers and developers with a sequestered testing environment to evaluate artificial intelligence (AI) models on blind datasets across multiple domains. According to a July 27 NIST bulletin, the program is designed to provide more rigorous and objective assessments of AI model performance by preventing test data from being incorporated into model training.","source":"MeriTalk","date":"2026-07-27T20:05:33+00:00","content":"The National Institute of Standards and Technology (NIST) has launched a new Artificial Intelligence Technology Evaluation (AITE) program that will provide researchers and developers with a sequestered testing environment to evaluate artificial intelligence (AI) models on blind datasets across multiple domains.\nAccording to a July 27 NIST bulletin, the program is designed to provide more rigorous and objective assessments of AI model performance by preventing test data from being incorporated into model training.\nThe initiative is being led by NIST’s Technology Test and Evaluation Division and will initially evaluate large vision language models (VLMs) on tasks spanning quantum science, genomics, and public safety. Additional evaluation tasks are planned over time.\n“The infrastructure provided by NIST will provide common data, metrics, and scoring to help developers understand the performance of their models,” NIST said.\nThe program includes two participation tracks.\nUnder one track, data providers can submit original datasets and associated evaluation tasks in their areas of expertise. NIST said those participants will receive performance measurements of leading AI models evaluated against their datasets.\nUnder the other track, model providers can submit AI models for testing against the growing collection of datasets and tasks. NIST said participants will receive information on how their models perform across multiple domains and how those results compare with other models using the same metrics “while ensuring the evaluation data is not used for training any model.”\nParticipation is open to organizations and individuals that agree to the program’s participation agreement and rules. NIST said interested participants can request participation or ask questions by contacting the agency at aite-poc@list.nist.gov.\nFor more information, prospective participants can check out the agency’s overview of the AITE program.","confidence":0.9,"diagnostics_url":"/api/diagnose?url=https%3A//www.meritalk.com/articles/nist-launches-ai-technology-evaluation-program/","quality_bucket":"high","failure_kind":"none","retryable":false,"quality_reason":"High confidence: full text extraction produced 1946 characters.","quality_profile":{"profile_version":"extraction_quality.v2","bucket":"high","confidence":0.9,"failure_kind":"none","retryable":false,"retry_after_attempts":0,"reason":"High confidence: full text extraction produced 1946 characters.","operator_guidance":{"severity":"ok","recommended_action":"trust_full_text","next_step":"Use the extracted full text as the primary article source.","operator_label":"Ready","can_retry":false,"can_use_summary":false,"diagnostics_required":false},"content_depth":{"contract_version":"content_depth.v1","category":"full_text","label":"Full text","has_full_text":true,"has_summary":true,"content_length":1946,"summary_length":518,"usable_text_length":1946,"source_field":"content"},"legacy_collapsed":false,"signals":{"extract_state":"ok","extract_error":null,"extract_retries":0,"content_length":1946,"summary_length":518}},"tags":[],"format_contract_version":"news_item_formats.v1"}}}