Skip to main content

All Questions

Tagged with
0 votes
1 answer
337 views

How can I make my Hugging Face fine-tuned model's config.json file reference a specific revision/commit from the original pretrained model?

I uploaded this model: https://huggingface.co/pamessina/CXRFE, which is a fine-tuned version of this model: https://huggingface.co/microsoft/BiomedVLP-CXR-BERT-specialized Unfortunately, CXR-BERT-...
Pablo Messina's user avatar
0 votes
0 answers
2k views

How to Load an Already Instantiated Hugging Face Model into vLLM for Inference?

I am working on a project where I need to utilize a model that has already been loaded and instantiated on the GPU using Hugging Face's Transformers library. The goal is to pass this loaded model into ...
Charlie Parker's user avatar
0 votes
1 answer
2k views

Flash attention argument throwing error while finetuning falcon_7b_instruct

I am exploring the flash attention in my code to fine-tune the falcon-7b-instruct model as it is explained on the huggingface. I am getting an error: TypeError: FalconForCausalLM.__init__() got an ...
Srishino's user avatar
1 vote
0 answers
2k views

ConnectionError: HTTPSConnectionPool(host='cdn-lfs.huggingface.co', port=443): Read timed out

While running the code, model stops loading in between and gives the following error. from getpass import getpass import os HUGGINGFACE_API_TOKEN = getpass() os.environ[...
Rishabh Gupta's user avatar
0 votes
1 answer
844 views

Hugging face HTTP request on data from parquet format when the only way to get it is from the website's data viewer, how to fix?

Due to Hugging Face datasets disappearing, I've had to get the data from their data viewer using the parquet option. But when I try to run it, there is some sort of HTTP error. I've tried downloading ...
Charlie Parker's user avatar