Skip to content
Snippets Groups Projects
Unverified Commit 3f2c33e4 authored by Less Wright's avatar Less Wright Committed by GitHub
Browse files

Update finetuning.py - remove nightly check

this check is blocking AWS from running as it enforces not just min version but that it is a dev release instead of released version.
parent b15ffeea
No related branches found
No related tags found
No related merge requests found
......@@ -76,11 +76,6 @@ def main(**kwargs):
model alone would consume 2+TB cpu mem (70 * 4 * 8). This will add some comms
overhead and currently requires latest nightly.
"""
v = packaging.version.parse(torch.__version__)
verify_latest_nightly = v.is_devrelease and v.dev >= 20230701
if not verify_latest_nightly:
raise Exception("latest pytorch nightly build is required to run with low_cpu_fsdp config, "
"please install latest nightly.")
if rank == 0:
model = LlamaForCausalLM.from_pretrained(
train_config.model_name,
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment