# Nemotron

This NVIDIA article traces how agent evaluation moved from scoring a single function call to scoring whole-task completion, proposes a framework built on an execution environment, two scoring layers (step-level process and end-to-end outcome), and a fixed Benchmark to Trial to Task to Turn to Step hierarchy, and uses a real SWE-bench Verified trace for pytest-dev__pytest-5262 (E2E score 1, step-level 3/4, tool-call precision 3/4, argument accuracy 4/4) to show how each metric should be read, alongside a workflow of setting a public floor and building domain evals from your own tickets and APIs.

This NVIDIA article traces how agent evaluation moved from scoring a single function call to scoring whole-task completion, proposes a framework built on an execution environment, two scoring layers (step-level process and end-to-end outcome), and a fixed Benchmark to Trial to Task to Turn to Step hierarchy, and uses a real SWE-bench Verified trace for pytest-dev__pytest-5262 (E2E score 1, step-level 3/4, tool-call precision 3/4, argument accuracy 4/4) to show how each metric should be read, alongside a workflow of setting a public floor and building domain evals from your own tickets and APIs.

This NVIDIA tutorial adapts a Cache-Aware FastConformer-RNNT multilingual streaming ASR model to Najdi and Hijazi Saudi dialects using minimal curation of SADA 2022 (retaining 103,559 of 125,490 utterances, 133.7 hours, 82.5%), a weighted replay mix of 90% Saudi speech with 7% English and 3% Arabic FLEURS, and duration bucketing, training for 12,000 steps in about 4.5 hours on two GPUs, which lowers Najdi+Hijazi test WER from 55.05% to 29.96% and CER from 31.63% to 12.18%, full SADA WER from 58.84% to 35.61%, while FLEURS English WER falls from 11.04% to 10.42% and Arabic WER from 12.67% to 11.41%; it also compares encoder unfreezing depths (top 6 at 33.42%, top 8 at 32.32%, all 24 layers at 29.96%) and inference-time settings ([56,13] attention context gains 1.

This NVIDIA tutorial adapts a Cache-Aware FastConformer-RNNT multilingual streaming ASR model to Najdi and Hijazi Saudi dialects using minimal curation of SADA 2022 (retaining 103,559 of 125,490 utterances, 133.7 hours, 82.5%), a weighted replay mix of 90% Saudi speech with 7% English and 3% Arabic FLEURS, and duration bucketing, training for 12,000 steps in about 4.5 hours on two GPUs, which lowers Najdi+Hijazi test WER from 55.05% to 29.96% and CER from 31.63% to 12.18%, full SADA WER from 58.84% to 35.61%, while FLEURS English WER falls from 11.04% to 10.42% and Arabic WER from 12.67% to 11.41%; it also compares encoder unfreezing depths (top 6 at 33.42%, top 8 at 32.32%, all 24 layers at 29.96%) and inference-time settings ([56,13] attention context gains 1.

This NVIDIA event report summarizes the Southeast Asia AI developments announced at NVIDIA AI Day Singapore, held Sept. 22-23 at the Raffles City Convention Centre: NVIDIA and partners including Singapore's HTX, NCS, ST Engineering, Malaysia's YTL AI Labs and ITMAX, Vietnam's Viettel AI and FPT Smart Cloud, Thailand's Big Data Institute, iApp Technology and AS-TECH, Brunei's Antrique, plus AI Singapore and Hummingbird Bioscience with LynxKite, are adapting Nemotron open models, NeMo tools, Cosmos world models and the VSS Blueprint for public-sector, citizen-service, legal, smart-city, traffic and drug-discovery use cases; Sea Limited becomes the first enterprise in ASEAN to adopt the NVIDIA Vera Rubin platform for scaling AI across Shopee, Monee and Garena.

This NVIDIA event report summarizes the Southeast Asia AI developments announced at NVIDIA AI Day Singapore, held Sept. 22-23 at the Raffles City Convention Centre: NVIDIA and partners including Singapore's HTX, NCS, ST Engineering, Malaysia's YTL AI Labs and ITMAX, Vietnam's Viettel AI and FPT Smart Cloud, Thailand's Big Data Institute, iApp Technology and AS-TECH, Brunei's Antrique, plus AI Singapore and Hummingbird Bioscience with LynxKite, are adapting Nemotron open models, NeMo tools, Cosmos world models and the VSS Blueprint for public-sector, citizen-service, legal, smart-city, traffic and drug-discovery use cases; Sea Limited becomes the first enterprise in ASEAN to adopt the NVIDIA Vera Rubin platform for scaling AI across Shopee, Monee and Garena.