# Continued Pretraining

Preferred Networks released PLaMo 3.0 Fin, an 8B-parameter language model specialized for finance, built from PLaMo 3 NICT 8B Base through continued pretraining on financial corpora, supervised fine-tuning and direct preference optimization, with Japanese reasoning traces and external tool calls. Its average score on the Japanese financial-knowledge benchmark japanese-lm-fin-harness rose from 48.0 for the base model to 55.8, above Gemma 4 E4B and gpt-oss-20b and below Qwen3.5-9B and Ministral 3 14B under PFN's own measurement setup.

Preferred Networks released PLaMo 3.0 Fin, an 8B-parameter language model specialized for finance, built from PLaMo 3 NICT 8B Base through continued pretraining on financial corpora, supervised fine-tuning and direct preference optimization, with Japanese reasoning traces and external tool calls. Its average score on the Japanese financial-knowledge benchmark japanese-lm-fin-harness rose from 48.0 for the base model to 55.8, above Gemma 4 E4B and gpt-oss-20b and below Qwen3.5-9B and Ministral 3 14B under PFN's own measurement setup.