Skip to content

add support for Falcon LLM - #72

Open
ydli-ai wants to merge 53 commits into
Tencent:mainfrom
ydli-ai:falcon_dev
Open

ydli-ai wants to merge 53 commits into
Tencent:mainfrom
ydli-ai:falcon_dev

Conversation

@ydli-ai

@ydli-ai ydli-ai commented Jun 10, 2023

Copy link
Copy Markdown
Collaborator

convert

python3 scripts/convert_falcon_from_huggingface_to_tencentpretrain.py --input_model_path ../falcon-7b/ --output_model_path models/falcon-7b.bin

test

python3 scripts/generate_lm.py
--load_model_path models/falcon-7b.bin
--vocab_path ../falcon-7b/ --tokenizer hfpretrained
--config_path models/falcon/7b_config.json
--test_path beginning.txt --prediction_path result.txt

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

1 participant