microsoft

/

Phi-4-mini-instruct

like 654

Follow

Microsoft 17.6k

same here impossible to import module via transformers..

try downgrading trl and transformers

pip install transformers==4.53.3
pip install trl==0.20.0

I think LossKwargs removed from transformers==4.54.0
https://github.com/sgl-project/sglang/issues/8004#issuecomment-3148397838

i have same problem here
.

try downgrading trl and transformers

pip install transformers==4.53.3
pip install trl==0.20.0

I think LossKwargs removed from transformers==4.54.0
https://github.com/sgl-project/sglang/issues/8004#issuecomment-3148397838

Unfortunately, that didn't help on my end

That's worded for me:

🔧 Step-by-Step Fix

1. Clear the Hugging Face cache
   Sometimes an old copy of modeling_phi3.py with the bad import is cached:

   rm -rf ~/.cache/huggingface/hub/models--microsoft--Phi-4-mini-instruct
   

   (On Windows, delete the folder:
   %USERPROFILE%\.cache\huggingface\hub\models--microsoft--Phi-4-mini-instruct).

2. Try loading without remote code
   If your transformers version already supports Phi models:

   from transformers import AutoModelForCausalLM
   
   model = AutoModelForCausalLM.from_pretrained(
       "microsoft/Phi-4-mini-instruct",
       trust_remote_code=False
   )
   

   → This bypasses the buggy modeling_phi3.py.

3. If you still need trust_remote_code=True

   • Download the model locally (snapshot_download or git clone).

   • Edit modeling_phi3.py and replace:

     from transformers.utils import LossKwargs
     

     with:

     try:
         from transformers.utils import LossKwargs
     except ImportError:
         from transformers.loss.loss_utils import LossKwargs
     

   • Load from the local path:

     model = AutoModelForCausalLM.from_pretrained(
         "./Phi-4-mini-instruct",
         trust_remote_code=True
     )
     

4. Ensure a compatible transformers version
   The model repo may have been written for a specific release. Pin it explicitly:

   pip install "transformers==4.45.0"
   

   or with uv:

   uv add transformers==4.45.0
   uv sync
   

✅ Quickest fix: clear the cache + try with trust_remote_code=False.
🛠️ If you must use remote code: patch the import in modeling_phi3.py.

Do you want me to also give you a ready one-liner PowerShell command to clear the Hugging Face cache on Windows?

transformers version 4.50.0 worked for me

try downgrading trl and transformers

pip install transformers==4.53.3
pip install trl==0.20.0

I think LossKwargs removed from transformers==4.54.0
https://github.com/sgl-project/sglang/issues/8004#issuecomment-3148397838

Unfortunately, that didn't help on my end

transformers==4.53.3 this version works for me! Thank you!