You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
gpt4all/gpt4all-training/GPT-J_MAP.md

367 B

Inference on Training Data

Run Inference

torchrun --master_port=29085 --nproc-per-node 8 inference.py --config=configs/inference/gptj.yaml

Visualizations

python build_map.py

will build a map in Atlas, one using the internal clustering algorithm provided by Nomic and one using the embeddings generated by the finetuned model.