WARNING:torch.distributed.run:
*****************************************
Setting OMP_NUM_THREADS environment variable for each process to be 1 in default, to avoid your system being overloaded, please further tune the variable for optimal performance in your application as needed. 
*****************************************

===================================BUG REPORT===================================
Welcome to bitsandbytes. For bug reports, please run

python -m bitsandbytes

 and submit this information together with your error trace to: https://github.com/TimDettmers/bitsandbytes/issues
================================================================================

===================================BUG REPORT===================================
Welcome to bitsandbytes. For bug reports, please run

python -m bitsandbytes

 and submit this information together with your error trace to: https://github.com/TimDettmers/bitsandbytes/issues
================================================================================
bin /nfs4/llm/h2o-llm/env/lib/python3.10/site-packages/bitsandbytes/libbitsandbytes_cuda117.so
bin /nfs4/llm/h2o-llm/env/lib/python3.10/site-packages/bitsandbytes/libbitsandbytes_cuda117.so
CUDA SETUP: CUDA runtime path found: /usr/local/cuda-11/lib64/libcudart.so.11.0
CUDA SETUP: Highest compute capability among GPUs detected: 8.9
CUDA SETUP: Detected CUDA version 117
CUDA SETUP: Loading binary /nfs4/llm/h2o-llm/env/lib/python3.10/site-packages/bitsandbytes/libbitsandbytes_cuda117.so...
CUDA SETUP: CUDA runtime path found: /usr/local/cuda-11/lib64/libcudart.so.11.0
CUDA SETUP: Highest compute capability among GPUs detected: 8.9
CUDA SETUP: Detected CUDA version 117
CUDA SETUP: Loading binary /nfs4/llm/h2o-llm/env/lib/python3.10/site-packages/bitsandbytes/libbitsandbytes_cuda117.so...
local_rank: 1
global rank: 1
No neptune configured, set NEPTUNE_API_TOKEN env var.

    Example runs on 4 GPUs:
    WORLD_SIZE=4 CUDA_VISIBLE_DEVICES="0,1,2,3" torchrun --nproc_per_node=4 finetune.py --base_model='decapoda-research/llama-7b-hf' --data_path=data/config.json --run_id=0 &> 0.log
    WORLD_SIZE=4 CUDA_VISIBLE_DEVICES="0,1,2,3" torchrun --nproc_per_node=4 finetune.py --base_model='decapoda-research/llama-30b-hf' --data_path=data/config.json --batch_size=16 --micro_batch_size=1 --run_id=1 --save_code=True &> 1.log
    WORLD_SIZE=4 CUDA_VISIBLE_DEVICES="0,1,2,3" torchrun --nproc_per_node=4 finetune.py --base_model='EleutherAI/gpt-j-6B' --data_path=data/config.json --run_id=2 &> 2.log
    WORLD_SIZE=4 CUDA_VISIBLE_DEVICES="0,1,2,3" torchrun --nproc_per_node=4 finetune.py --base_model='EleutherAI/gpt-neox-20b' --data_path=data/config.json --run_id=8 --batch_size=16 --micro_batch_size=4 &> 8.log
    WORLD_SIZE=4 CUDA_VISIBLE_DEVICES="0,1,2,3" torchrun --nproc_per_node=4 finetune.py --base_model='togethercomputer/GPT-NeoXT-Chat-Base-20B' --data_path=data/config.json --prompt_type='dai_faq' --run_id=13 --batch_size=16 --micro_batch_size=4 --num_epochs=100 --val_set_size=0 data_mix_in_path='' &> 13.log
    WORLD_SIZE=4 CUDA_VISIBLE_DEVICES="0,1,2,3" torchrun --nproc_per_node=4 finetune.py --base_model='togethercomputer/GPT-NeoXT-Chat-Base-20B' --data_path=data/config.json --run_id=28 --batch_size=16 --micro_batch_size=4 --num_epochs=8 --val_set_size=0 --data_mix_in_factor=0.1 --data_mix_in_prompt_type='human_bot' --save_code=True --cutoff_len=512  &> 28.log

    All metrics:
    CUDA_VISIBLE_DEVICES= finetune.py --data_mix_in_factor=0 --eval_steps=100 --warmup_steps=2 --val_set_size=100 --val_metrics="['bleu', 'rouge', 'sacrebleu', 'meteor']"

    # Fine-tune 20B on 24GB GPUs across 3 nodes with 3+2+2 GPUs
    rippa>
NCCL_P2P_LEVEL=LOC WORLD_SIZE=7 CUDA_VISIBLE_DEVICES="0,1,2" torchrun --node_rank 0 --nproc_per_node=3 --master_port=1234 --nnodes=3 --master_addr=10.10.10.2 finetune.py --data_path=merged_shuffled_OIG_87f6a1e788.json --micro_batch_size=1 --batch_size=7 --cutoff_len=512 --run_id=17 &>log.17.rank0
    ova>
NCCL_P2P_LEVEL=LOC WORLD_SIZE=7 CUDA_VISIBLE_DEVICES="0,1" torchrun --node_rank 1 --nproc_per_node=2 --master_port=1234 --nnodes=3 --master_addr=10.10.10.2 finetune.py --data_path=merged_shuffled_OIG_87f6a1e788.json --micro_batch_size=1 --batch_size=7 --cutoff_len=512 --run_id=17 &>log.17.rank1
    timemachine>
NCCL_P2P_LEVEL=LOC WORLD_SIZE=7 CUDA_VISIBLE_DEVICES="0,1" torchrun --node_rank 2 --nproc_per_node=2 --master_port=1234 --nnodes=3 --master_addr=10.10.10.2 finetune.py --data_path=merged_shuffled_OIG_87f6a1e788.json --micro_batch_size=1 --batch_size=7 --cutoff_len=512 --run_id=17 &>log.17.rank2

    
local_rank: 0
global rank: 0
Training model with params:
save_code: False
run_id: 13
base_model: EleutherAI/pythia-12b
tokenizer_base_model: EleutherAI/pythia-12b
data_path: openassistant_oasst1.json
data_col_dict: None
valid_path: None
data_mix_in_path: 0-hero/OIG-small-chip2
data_mix_in_factor: 0.0
data_mix_in_col_dict: {'user': 'instruction', 'chip2': 'output'}
data_mix_in_prompt_type: instruct
output_dir: pythia-12b.openassistant_oasst1.json.1_epochs.ccc4630fee98c5b838b4357143f7466ec02674c3.13
lora_weights: 
batch_size: 128
micro_batch_size: 4
gradient_checkpointing: False
fp16: True
num_epochs: 1
learning_rate: 0.0003
val_set_size: None
val_metrics: []
eval_steps: None
eval_epochs: None
lora_r: 8
lora_alpha: 16
lora_dropout: 0.05
lora_target_modules: None
llama_type: False
group_by_length: False
resume_from_checkpoint: None
ddp: True
local_files_only: False
resume_download: True
warmup_steps: 100
logging_steps: 1
save_steps: None
add_eos_token: False
world_size: 2
local_rank: 0
rank: 0
gpus: 3
device_map: auto
gradient_accumulation_steps: 32
cutoff_len: 256
prompt_type: plain
train_on_inputs: True
Command: finetune.py --base_model=EleutherAI/pythia-12b --data_path=openassistant_oasst1.json --prompt_type=plain --run_id=13 --cutoff_len=256
Hash: ccc4630fee98c5b838b4357143f7466ec02674c3
Distributed: data parallel

Downloading (…)lve/main/config.json:   0%|          | 0.00/571 [00:00<?, ?B/s]
Downloading (…)lve/main/config.json: 100%|██████████| 571/571 [00:00<00:00, 601kB/s]

Downloading (…)model.bin.index.json:   0%|          | 0.00/47.3k [00:00<?, ?B/s]
Downloading (…)model.bin.index.json: 100%|██████████| 47.3k/47.3k [00:00<00:00, 3.30MB/s]

Downloading shards:   0%|          | 0/3 [00:00<?, ?it/s]
Downloading shards:   0%|          | 0/3 [00:00<?, ?it/s]

Downloading (…)l-00001-of-00003.bin:   0%|          | 0.00/9.81G [00:00<?, ?B/s][A

Downloading (…)l-00001-of-00003.bin:   0%|          | 10.5M/9.81G [00:00<02:11, 74.8MB/s][A

Downloading (…)l-00001-of-00003.bin:   0%|          | 31.5M/9.81G [00:00<01:23, 117MB/s] [A

Downloading (…)l-00001-of-00003.bin:   1%|          | 52.4M/9.81G [00:00<01:11, 136MB/s][A

Downloading (…)l-00001-of-00003.bin:   1%|          | 73.4M/9.81G [00:00<01:05, 148MB/s][A

Downloading (…)l-00001-of-00003.bin:   1%|          | 94.4M/9.81G [00:00<01:02, 155MB/s][A

Downloading (…)l-00001-of-00003.bin:   1%|          | 115M/9.81G [00:00<01:00, 160MB/s] [A

Downloading (…)l-00001-of-00003.bin:   1%|▏         | 136M/9.81G [00:00<01:00, 161MB/s][A

Downloading (…)l-00001-of-00003.bin:   2%|▏         | 157M/9.81G [00:01<01:00, 159MB/s][A

Downloading (…)l-00001-of-00003.bin:   2%|▏         | 178M/9.81G [00:01<01:17, 124MB/s][A

Downloading (…)l-00001-of-00003.bin:   2%|▏         | 199M/9.81G [00:01<01:33, 103MB/s][A

Downloading (…)l-00001-of-00003.bin:   2%|▏         | 220M/9.81G [00:01<01:22, 117MB/s][A

Downloading (…)l-00001-of-00003.bin:   2%|▏         | 241M/9.81G [00:01<01:13, 130MB/s][A

Downloading (…)l-00001-of-00003.bin:   3%|▎         | 262M/9.81G [00:01<01:08, 139MB/s][A

Downloading (…)l-00001-of-00003.bin:   3%|▎         | 283M/9.81G [00:02<01:04, 148MB/s][A

Downloading (…)l-00001-of-00003.bin:   3%|▎         | 304M/9.81G [00:02<01:01, 155MB/s][A

Downloading (…)l-00001-of-00003.bin:   3%|▎         | 325M/9.81G [00:02<01:00, 156MB/s][A

Downloading (…)l-00001-of-00003.bin:   4%|▎         | 346M/9.81G [00:02<00:58, 161MB/s][A

Downloading (…)l-00001-of-00003.bin:   4%|▎         | 367M/9.81G [00:02<00:58, 162MB/s][A

Downloading (…)l-00001-of-00003.bin:   4%|▍         | 388M/9.81G [00:02<01:37, 96.6MB/s][A

Downloading (…)l-00001-of-00003.bin:   4%|▍         | 409M/9.81G [00:03<01:25, 110MB/s] [A

Downloading (…)l-00001-of-00003.bin:   4%|▍         | 430M/9.81G [00:03<01:44, 89.5MB/s][A

Downloading (…)l-00001-of-00003.bin:   5%|▍         | 451M/9.81G [00:03<01:31, 102MB/s] [A

Downloading (…)l-00001-of-00003.bin:   5%|▍         | 472M/9.81G [00:03<01:19, 117MB/s][A

Downloading (…)l-00001-of-00003.bin:   5%|▌         | 493M/9.81G [00:03<01:12, 129MB/s][A

Downloading (…)l-00001-of-00003.bin:   5%|▌         | 514M/9.81G [00:03<01:06, 139MB/s][A

Downloading (…)l-00001-of-00003.bin:   5%|▌         | 535M/9.81G [00:04<01:05, 141MB/s][A

Downloading (…)l-00001-of-00003.bin:   6%|▌         | 556M/9.81G [00:04<01:03, 145MB/s][A

Downloading (…)l-00001-of-00003.bin:   6%|▌         | 577M/9.81G [00:04<01:02, 148MB/s][A

Downloading (…)l-00001-of-00003.bin:   6%|▌         | 598M/9.81G [00:04<01:03, 145MB/s][A

Downloading (…)l-00001-of-00003.bin:   6%|▋         | 619M/9.81G [00:04<01:39, 92.3MB/s][A

Downloading (…)l-00001-of-00003.bin:   7%|▋         | 640M/9.81G [00:05<01:26, 106MB/s] [A

Downloading (…)l-00001-of-00003.bin:   7%|▋         | 661M/9.81G [00:05<01:17, 119MB/s][A

Downloading (…)l-00001-of-00003.bin:   7%|▋         | 682M/9.81G [00:05<01:10, 130MB/s][A

Downloading (…)l-00001-of-00003.bin:   7%|▋         | 703M/9.81G [00:05<01:07, 136MB/s][A

Downloading (…)l-00001-of-00003.bin:   7%|▋         | 724M/9.81G [00:05<01:05, 140MB/s][A

Downloading (…)l-00001-of-00003.bin:   8%|▊         | 744M/9.81G [00:05<01:02, 144MB/s][A

Downloading (…)l-00001-of-00003.bin:   8%|▊         | 765M/9.81G [00:05<01:00, 149MB/s][A

Downloading (…)l-00001-of-00003.bin:   8%|▊         | 786M/9.81G [00:06<01:02, 145MB/s][A

Downloading (…)l-00001-of-00003.bin:   8%|▊         | 807M/9.81G [00:06<01:47, 83.9MB/s][A

Downloading (…)l-00001-of-00003.bin:   8%|▊         | 828M/9.81G [00:06<01:42, 87.2MB/s][A

Downloading (…)l-00001-of-00003.bin:   9%|▊         | 849M/9.81G [00:06<01:28, 101MB/s] [A

Downloading (…)l-00001-of-00003.bin:   9%|▉         | 870M/9.81G [00:07<01:18, 114MB/s][A

Downloading (…)l-00001-of-00003.bin:   9%|▉         | 891M/9.81G [00:07<01:11, 124MB/s][A

Downloading (…)l-00001-of-00003.bin:   9%|▉         | 912M/9.81G [00:07<01:05, 135MB/s][A

Downloading (…)l-00001-of-00003.bin:  10%|▉         | 933M/9.81G [00:07<01:02, 143MB/s][A

Downloading (…)l-00001-of-00003.bin:  10%|▉         | 954M/9.81G [00:07<01:00, 145MB/s][A

Downloading (…)l-00001-of-00003.bin:  10%|▉         | 975M/9.81G [00:07<00:57, 153MB/s][A

Downloading (…)l-00001-of-00003.bin:  10%|█         | 996M/9.81G [00:07<01:03, 140MB/s][A

Downloading (…)l-00001-of-00003.bin:  10%|█         | 1.02G/9.81G [00:08<02:02, 71.8MB/s][A

Downloading (…)l-00001-of-00003.bin:  11%|█         | 1.04G/9.81G [00:08<01:47, 81.8MB/s][A

Downloading (…)l-00001-of-00003.bin:  11%|█         | 1.06G/9.81G [00:08<01:35, 91.9MB/s][A

Downloading (…)l-00001-of-00003.bin:  11%|█         | 1.08G/9.81G [00:08<01:26, 100MB/s] [A

Downloading (…)l-00001-of-00003.bin:  11%|█         | 1.10G/9.81G [00:09<01:22, 105MB/s][A

Downloading (…)l-00001-of-00003.bin:  11%|█▏        | 1.12G/9.81G [00:09<01:22, 106MB/s][A

Downloading (…)l-00001-of-00003.bin:  12%|█▏        | 1.14G/9.81G [00:09<01:18, 110MB/s][A

Downloading (…)l-00001-of-00003.bin:  12%|█▏        | 1.16G/9.81G [00:09<01:21, 106MB/s][A

Downloading (…)l-00001-of-00003.bin:  12%|█▏        | 1.18G/9.81G [00:09<01:15, 114MB/s][A

Downloading (…)l-00001-of-00003.bin:  12%|█▏        | 1.21G/9.81G [00:09<01:09, 123MB/s][A

Downloading (…)l-00001-of-00003.bin:  13%|█▎        | 1.23G/9.81G [00:10<01:34, 91.2MB/s][A

Downloading (…)l-00001-of-00003.bin:  13%|█▎        | 1.25G/9.81G [00:10<01:25, 99.9MB/s][A

Downloading (…)l-00001-of-00003.bin:  13%|█▎        | 1.27G/9.81G [00:10<01:17, 110MB/s] [A

Downloading (…)l-00001-of-00003.bin:  13%|█▎        | 1.29G/9.81G [00:10<01:13, 116MB/s][A

Downloading (…)l-00001-of-00003.bin:  13%|█▎        | 1.31G/9.81G [00:10<01:09, 122MB/s][A

Downloading (…)l-00001-of-00003.bin:  14%|█▎        | 1.33G/9.81G [00:11<01:47, 79.2MB/s][A

Downloading (…)l-00001-of-00003.bin:  14%|█▍        | 1.35G/9.81G [00:11<01:31, 92.8MB/s][A

Downloading (…)l-00001-of-00003.bin:  14%|█▍        | 1.37G/9.81G [00:11<01:18, 107MB/s] [A

Downloading (…)l-00001-of-00003.bin:  14%|█▍        | 1.39G/9.81G [00:11<01:10, 119MB/s][A

Downloading (…)l-00001-of-00003.bin:  14%|█▍        | 1.42G/9.81G [00:11<01:03, 131MB/s][A

Downloading (…)l-00001-of-00003.bin:  15%|█▍        | 1.44G/9.81G [00:12<01:00, 139MB/s][A

Downloading (…)l-00001-of-00003.bin:  15%|█▍        | 1.46G/9.81G [00:12<00:59, 140MB/s][A

Downloading (…)l-00001-of-00003.bin:  15%|█▌        | 1.48G/9.81G [00:12<00:57, 144MB/s][A

Downloading (…)l-00001-of-00003.bin:  15%|█▌        | 1.50G/9.81G [00:12<00:55, 151MB/s][A

Downloading (…)l-00001-of-00003.bin:  15%|█▌        | 1.52G/9.81G [00:12<01:30, 91.3MB/s][A

Downloading (…)l-00001-of-00003.bin:  16%|█▌        | 1.54G/9.81G [00:13<01:19, 105MB/s] [A

Downloading (…)l-00001-of-00003.bin:  16%|█▌        | 1.56G/9.81G [00:13<01:10, 117MB/s][A

Downloading (…)l-00001-of-00003.bin:  16%|█▌        | 1.58G/9.81G [00:13<01:04, 128MB/s][A

Downloading (…)l-00001-of-00003.bin:  16%|█▋        | 1.60G/9.81G [00:13<00:59, 139MB/s][A

Downloading (…)l-00001-of-00003.bin:  17%|█▋        | 1.63G/9.81G [00:13<00:55, 148MB/s][A

Downloading (…)l-00001-of-00003.bin:  17%|█▋        | 1.65G/9.81G [00:13<00:53, 153MB/s][A

Downloading (…)l-00001-of-00003.bin:  17%|█▋        | 1.67G/9.81G [00:13<00:51, 158MB/s][A

Downloading (…)l-00001-of-00003.bin:  17%|█▋        | 1.69G/9.81G [00:13<00:49, 163MB/s][A

Downloading (…)l-00001-of-00003.bin:  17%|█▋        | 1.71G/9.81G [00:14<01:04, 126MB/s][A

Downloading (…)l-00001-of-00003.bin:  18%|█▊        | 1.73G/9.81G [00:14<01:11, 112MB/s][A

Downloading (…)l-00001-of-00003.bin:  18%|█▊        | 1.75G/9.81G [00:14<01:04, 124MB/s][A

Downloading (…)l-00001-of-00003.bin:  18%|█▊        | 1.77G/9.81G [00:14<01:07, 119MB/s][A

Downloading (…)l-00001-of-00003.bin:  18%|█▊        | 1.79G/9.81G [00:14<01:01, 130MB/s][A

Downloading (…)l-00001-of-00003.bin:  18%|█▊        | 1.81G/9.81G [00:15<00:57, 139MB/s][A

Downloading (…)l-00001-of-00003.bin:  19%|█▊        | 1.84G/9.81G [00:15<00:57, 139MB/s][A

Downloading (…)l-00001-of-00003.bin:  19%|█▉        | 1.86G/9.81G [00:15<00:56, 140MB/s][A

Downloading (…)l-00001-of-00003.bin:  19%|█▉        | 1.88G/9.81G [00:15<00:54, 147MB/s][A

Downloading (…)l-00001-of-00003.bin:  19%|█▉        | 1.90G/9.81G [00:15<00:52, 149MB/s][A

Downloading (…)l-00001-of-00003.bin:  20%|█▉        | 1.92G/9.81G [00:15<00:52, 149MB/s][A

Downloading (…)l-00001-of-00003.bin:  20%|█▉        | 1.94G/9.81G [00:15<00:59, 133MB/s][A

Downloading (…)l-00001-of-00003.bin:  20%|█▉        | 1.96G/9.81G [00:16<01:33, 83.8MB/s][A

Downloading (…)l-00001-of-00003.bin:  20%|██        | 1.98G/9.81G [00:16<01:20, 97.1MB/s][A

Downloading (…)l-00001-of-00003.bin:  20%|██        | 2.00G/9.81G [00:16<01:12, 108MB/s] [A

Downloading (…)l-00001-of-00003.bin:  21%|██        | 2.02G/9.81G [00:16<01:05, 119MB/s][A

Downloading (…)l-00001-of-00003.bin:  21%|██        | 2.04G/9.81G [00:16<01:00, 129MB/s][A

Downloading (…)l-00001-of-00003.bin:  21%|██        | 2.07G/9.81G [00:17<00:57, 136MB/s][A

Downloading (…)l-00001-of-00003.bin:  21%|██▏       | 2.09G/9.81G [00:17<00:53, 144MB/s][A

Downloading (…)l-00001-of-00003.bin:  21%|██▏       | 2.11G/9.81G [00:17<00:51, 150MB/s][A

Downloading (…)l-00001-of-00003.bin:  22%|██▏       | 2.13G/9.81G [00:17<00:57, 133MB/s][A

Downloading (…)l-00001-of-00003.bin:  22%|██▏       | 2.15G/9.81G [00:17<01:05, 116MB/s][A

Downloading (…)l-00001-of-00003.bin:  22%|██▏       | 2.17G/9.81G [00:17<01:13, 104MB/s][A

Downloading (…)l-00001-of-00003.bin:  22%|██▏       | 2.19G/9.81G [00:18<01:04, 118MB/s][A

Downloading (…)l-00001-of-00003.bin:  23%|██▎       | 2.21G/9.81G [00:18<00:57, 131MB/s][A

Downloading (…)l-00001-of-00003.bin:  23%|██▎       | 2.23G/9.81G [00:18<00:56, 134MB/s][A

Downloading (…)l-00001-of-00003.bin:  23%|██▎       | 2.25G/9.81G [00:18<00:56, 134MB/s][A

Downloading (…)l-00001-of-00003.bin:  23%|██▎       | 2.28G/9.81G [00:18<00:54, 138MB/s][A

Downloading (…)l-00001-of-00003.bin:  23%|██▎       | 2.30G/9.81G [00:18<00:52, 143MB/s][A

Downloading (…)l-00001-of-00003.bin:  24%|██▎       | 2.32G/9.81G [00:18<00:52, 144MB/s][A

Downloading (…)l-00001-of-00003.bin:  24%|██▍       | 2.34G/9.81G [00:19<00:52, 143MB/s][A

Downloading (…)l-00001-of-00003.bin:  24%|██▍       | 2.36G/9.81G [00:19<01:15, 98.4MB/s][A

Downloading (…)l-00001-of-00003.bin:  24%|██▍       | 2.38G/9.81G [00:19<01:11, 105MB/s] [A

Downloading (…)l-00001-of-00003.bin:  24%|██▍       | 2.40G/9.81G [00:19<01:02, 118MB/s][A

Downloading (…)l-00001-of-00003.bin:  25%|██▍       | 2.42G/9.81G [00:19<00:58, 125MB/s][A

Downloading (…)l-00001-of-00003.bin:  25%|██▍       | 2.44G/9.81G [00:20<00:55, 132MB/s][A

Downloading (…)l-00001-of-00003.bin:  25%|██▌       | 2.46G/9.81G [00:20<00:53, 138MB/s][A

Downloading (…)l-00001-of-00003.bin:  25%|██▌       | 2.49G/9.81G [00:20<01:28, 82.4MB/s][A

Downloading (…)l-00001-of-00003.bin:  26%|██▌       | 2.51G/9.81G [00:20<01:25, 85.1MB/s][A

Downloading (…)l-00001-of-00003.bin:  26%|██▌       | 2.53G/9.81G [00:21<01:15, 96.2MB/s][A

Downloading (…)l-00001-of-00003.bin:  26%|██▌       | 2.55G/9.81G [00:21<01:07, 108MB/s] [A

Downloading (…)l-00001-of-00003.bin:  26%|██▌       | 2.57G/9.81G [00:21<01:03, 114MB/s][A

Downloading (…)l-00001-of-00003.bin:  26%|██▋       | 2.59G/9.81G [00:21<00:59, 121MB/s][A

Downloading (…)l-00001-of-00003.bin:  27%|██▋       | 2.61G/9.81G [00:21<00:55, 130MB/s][A

Downloading (…)l-00001-of-00003.bin:  27%|██▋       | 2.63G/9.81G [00:21<00:54, 132MB/s][A

Downloading (…)l-00001-of-00003.bin:  27%|██▋       | 2.65G/9.81G [00:21<00:51, 140MB/s][A

Downloading (…)l-00001-of-00003.bin:  27%|██▋       | 2.67G/9.81G [00:22<01:17, 92.5MB/s][A

Downloading (…)l-00001-of-00003.bin:  27%|██▋       | 2.69G/9.81G [00:22<01:08, 103MB/s] [A

Downloading (…)l-00001-of-00003.bin:  28%|██▊       | 2.72G/9.81G [00:22<01:05, 109MB/s][A

Downloading (…)l-00001-of-00003.bin:  28%|██▊       | 2.74G/9.81G [00:22<00:59, 119MB/s][A

Downloading (…)l-00001-of-00003.bin:  28%|██▊       | 2.76G/9.81G [00:22<00:54, 129MB/s][A

Downloading (…)l-00001-of-00003.bin:  28%|██▊       | 2.78G/9.81G [00:23<00:51, 137MB/s][A

Downloading (…)l-00001-of-00003.bin:  29%|██▊       | 2.80G/9.81G [00:23<00:50, 140MB/s][A

Downloading (…)l-00001-of-00003.bin:  29%|██▊       | 2.82G/9.81G [00:23<00:48, 146MB/s][A

Downloading (…)l-00001-of-00003.bin:  29%|██▉       | 2.84G/9.81G [00:23<00:45, 153MB/s][A

Downloading (…)l-00001-of-00003.bin:  29%|██▉       | 2.86G/9.81G [00:23<00:44, 154MB/s][A

Downloading (…)l-00001-of-00003.bin:  29%|██▉       | 2.88G/9.81G [00:23<00:50, 137MB/s][A

Downloading (…)l-00001-of-00003.bin:  30%|██▉       | 2.90G/9.81G [00:23<00:56, 123MB/s][A

Downloading (…)l-00001-of-00003.bin:  30%|██▉       | 2.93G/9.81G [00:24<01:16, 89.8MB/s][A

Downloading (…)l-00001-of-00003.bin:  30%|███       | 2.95G/9.81G [00:24<01:06, 103MB/s] [A

Downloading (…)l-00001-of-00003.bin:  30%|███       | 2.97G/9.81G [00:24<00:59, 114MB/s][A

Downloading (…)l-00001-of-00003.bin:  30%|███       | 2.99G/9.81G [00:24<00:54, 124MB/s][A

Downloading (…)l-00001-of-00003.bin:  31%|███       | 3.01G/9.81G [00:24<00:52, 129MB/s][A

Downloading (…)l-00001-of-00003.bin:  31%|███       | 3.03G/9.81G [00:25<00:50, 135MB/s][A

Downloading (…)l-00001-of-00003.bin:  31%|███       | 3.05G/9.81G [00:25<00:48, 141MB/s][A

Downloading (…)l-00001-of-00003.bin:  31%|███▏      | 3.07G/9.81G [00:25<00:46, 145MB/s][A

Downloading (…)l-00001-of-00003.bin:  32%|███▏      | 3.09G/9.81G [00:25<01:03, 106MB/s][A

Downloading (…)l-00001-of-00003.bin:  32%|███▏      | 3.11G/9.81G [00:25<01:07, 98.5MB/s][A

Downloading (…)l-00001-of-00003.bin:  32%|███▏      | 3.14G/9.81G [00:26<01:01, 109MB/s] [A

Downloading (…)l-00001-of-00003.bin:  32%|███▏      | 3.16G/9.81G [00:26<00:59, 112MB/s][A

Downloading (…)l-00001-of-00003.bin:  32%|███▏      | 3.18G/9.81G [00:26<00:53, 123MB/s][A

Downloading (…)l-00001-of-00003.bin:  33%|███▎      | 3.20G/9.81G [00:26<00:53, 123MB/s][A

Downloading (…)l-00001-of-00003.bin:  33%|███▎      | 3.22G/9.81G [00:26<00:50, 132MB/s][A

Downloading (…)l-00001-of-00003.bin:  33%|███▎      | 3.24G/9.81G [00:26<00:49, 132MB/s][A

Downloading (…)l-00001-of-00003.bin:  33%|███▎      | 3.26G/9.81G [00:26<00:47, 138MB/s][A

Downloading (…)l-00001-of-00003.bin:  33%|███▎      | 3.28G/9.81G [00:27<00:48, 136MB/s][A

Downloading (…)l-00001-of-00003.bin:  34%|███▎      | 3.30G/9.81G [00:27<01:20, 81.2MB/s][A

Downloading (…)l-00001-of-00003.bin:  34%|███▍      | 3.32G/9.81G [00:27<01:10, 91.8MB/s][A

Downloading (…)l-00001-of-00003.bin:  34%|███▍      | 3.34G/9.81G [00:27<01:03, 103MB/s] [A

Downloading (…)l-00001-of-00003.bin:  34%|███▍      | 3.37G/9.81G [00:28<00:58, 110MB/s][A

Downloading (…)l-00001-of-00003.bin:  35%|███▍      | 3.39G/9.81G [00:28<00:54, 119MB/s][A

Downloading (…)l-00001-of-00003.bin:  35%|███▍      | 3.41G/9.81G [00:28<00:50, 126MB/s][A

Downloading (…)l-00001-of-00003.bin:  35%|███▍      | 3.43G/9.81G [00:28<00:47, 134MB/s][A

Downloading (…)l-00001-of-00003.bin:  35%|███▌      | 3.45G/9.81G [00:28<00:45, 141MB/s][A

Downloading (…)l-00001-of-00003.bin:  35%|███▌      | 3.47G/9.81G [00:29<01:21, 77.3MB/s][A

Downloading (…)l-00001-of-00003.bin:  36%|███▌      | 3.49G/9.81G [00:29<01:08, 92.3MB/s][A

Downloading (…)l-00001-of-00003.bin:  36%|███▌      | 3.51G/9.81G [00:29<00:59, 105MB/s] [A

Downloading (…)l-00001-of-00003.bin:  36%|███▌      | 3.53G/9.81G [00:29<00:53, 117MB/s][A

Downloading (…)l-00001-of-00003.bin:  36%|███▌      | 3.55G/9.81G [00:29<00:48, 129MB/s][A

Downloading (…)l-00001-of-00003.bin:  36%|███▋      | 3.58G/9.81G [00:29<00:44, 139MB/s][A

Downloading (…)l-00001-of-00003.bin:  37%|███▋      | 3.60G/9.81G [00:29<00:43, 144MB/s][A

Downloading (…)l-00001-of-00003.bin:  37%|███▋      | 3.62G/9.81G [00:30<00:40, 151MB/s][A

Downloading (…)l-00001-of-00003.bin:  37%|███▋      | 3.64G/9.81G [00:30<00:39, 157MB/s][A

Downloading (…)l-00001-of-00003.bin:  37%|███▋      | 3.66G/9.81G [00:30<00:59, 103MB/s][A

Downloading (…)l-00001-of-00003.bin:  38%|███▊      | 3.68G/9.81G [00:30<01:20, 75.8MB/s][A

Downloading (…)l-00001-of-00003.bin:  38%|███▊      | 3.70G/9.81G [00:31<01:31, 66.9MB/s][A

Downloading (…)l-00001-of-00003.bin:  38%|███▊      | 3.72G/9.81G [00:31<01:17, 78.9MB/s][A

Downloading (…)l-00001-of-00003.bin:  38%|███▊      | 3.74G/9.81G [00:31<01:07, 89.3MB/s][A

Downloading (…)l-00001-of-00003.bin:  38%|███▊      | 3.76G/9.81G [00:31<00:58, 103MB/s] [A

Downloading (…)l-00001-of-00003.bin:  39%|███▊      | 3.79G/9.81G [00:31<00:51, 117MB/s][A

Downloading (…)l-00001-of-00003.bin:  39%|███▉      | 3.81G/9.81G [00:32<01:16, 79.0MB/s][A

Downloading (…)l-00001-of-00003.bin:  39%|███▉      | 3.83G/9.81G [00:32<01:06, 90.3MB/s][A

Downloading (…)l-00001-of-00003.bin:  39%|███▉      | 3.85G/9.81G [00:32<00:59, 101MB/s] [A

Downloading (…)l-00001-of-00003.bin:  39%|███▉      | 3.87G/9.81G [00:32<00:51, 114MB/s][A

Downloading (…)l-00001-of-00003.bin:  40%|███▉      | 3.89G/9.81G [00:32<00:47, 125MB/s][A

Downloading (…)l-00001-of-00003.bin:  40%|███▉      | 3.91G/9.81G [00:33<00:44, 133MB/s][A

Downloading (…)l-00001-of-00003.bin:  40%|████      | 3.93G/9.81G [00:33<00:42, 139MB/s][A

Downloading (…)l-00001-of-00003.bin:  40%|████      | 3.95G/9.81G [00:33<00:40, 146MB/s][A

Downloading (…)l-00001-of-00003.bin:  41%|████      | 3.97G/9.81G [00:33<00:40, 143MB/s][A

Downloading (…)l-00001-of-00003.bin:  41%|████      | 4.00G/9.81G [00:34<01:18, 73.9MB/s][A

Downloading (…)l-00001-of-00003.bin:  41%|████      | 4.02G/9.81G [00:34<01:07, 85.5MB/s][A

Downloading (…)l-00001-of-00003.bin:  41%|████      | 4.04G/9.81G [00:34<01:00, 95.4MB/s][A

Downloading (…)l-00001-of-00003.bin:  41%|████▏     | 4.06G/9.81G [00:34<00:55, 103MB/s] [A

Downloading (…)l-00001-of-00003.bin:  42%|████▏     | 4.08G/9.81G [00:34<00:51, 112MB/s][A

Downloading (…)l-00001-of-00003.bin:  42%|████▏     | 4.10G/9.81G [00:34<00:47, 120MB/s][A

Downloading (…)l-00001-of-00003.bin:  42%|████▏     | 4.12G/9.81G [00:35<00:44, 128MB/s][A

Downloading (…)l-00001-of-00003.bin:  42%|████▏     | 4.14G/9.81G [00:35<00:40, 139MB/s][A

Downloading (…)l-00001-of-00003.bin:  42%|████▏     | 4.16G/9.81G [00:35<00:48, 116MB/s][A

Downloading (…)l-00001-of-00003.bin:  43%|████▎     | 4.18G/9.81G [00:35<01:08, 81.7MB/s][A

Downloading (…)l-00001-of-00003.bin:  43%|████▎     | 4.20G/9.81G [00:36<01:00, 92.6MB/s][A

Downloading (…)l-00001-of-00003.bin:  43%|████▎     | 4.23G/9.81G [00:36<00:53, 105MB/s] [A

Downloading (…)l-00001-of-00003.bin:  43%|████▎     | 4.25G/9.81G [00:36<00:49, 113MB/s][A

Downloading (…)l-00001-of-00003.bin:  43%|████▎     | 4.27G/9.81G [00:36<00:45, 121MB/s][A

Downloading (…)l-00001-of-00003.bin:  44%|████▎     | 4.29G/9.81G [00:36<00:43, 128MB/s][A

Downloading (…)l-00001-of-00003.bin:  44%|████▍     | 4.31G/9.81G [00:36<00:42, 129MB/s][A

Downloading (…)l-00001-of-00003.bin:  44%|████▍     | 4.33G/9.81G [00:36<00:39, 140MB/s][A

Downloading (…)l-00001-of-00003.bin:  44%|████▍     | 4.35G/9.81G [00:37<01:10, 77.8MB/s][A

Downloading (…)l-00001-of-00003.bin:  45%|████▍     | 4.37G/9.81G [00:37<00:58, 92.5MB/s][A

Downloading (…)l-00001-of-00003.bin:  45%|████▍     | 4.39G/9.81G [00:37<00:51, 105MB/s] [A

Downloading (…)l-00001-of-00003.bin:  45%|████▍     | 4.41G/9.81G [00:37<00:47, 114MB/s][A

Downloading (…)l-00001-of-00003.bin:  45%|████▌     | 4.44G/9.81G [00:37<00:45, 119MB/s][A

Downloading (…)l-00001-of-00003.bin:  45%|████▌     | 4.46G/9.81G [00:38<00:41, 130MB/s][A

Downloading (…)l-00001-of-00003.bin:  46%|████▌     | 4.48G/9.81G [00:38<00:40, 132MB/s][A

Downloading (…)l-00001-of-00003.bin:  46%|████▌     | 4.50G/9.81G [00:38<00:37, 141MB/s][A

Downloading (…)l-00001-of-00003.bin:  46%|████▌     | 4.52G/9.81G [00:38<00:52, 101MB/s][A

Downloading (…)l-00001-of-00003.bin:  46%|████▋     | 4.54G/9.81G [00:39<01:02, 84.0MB/s][A

Downloading (…)l-00001-of-00003.bin:  46%|████▋     | 4.56G/9.81G [00:39<00:56, 92.2MB/s][A

Downloading (…)l-00001-of-00003.bin:  47%|████▋     | 4.58G/9.81G [00:39<00:51, 102MB/s] [A

Downloading (…)l-00001-of-00003.bin:  47%|████▋     | 4.60G/9.81G [00:39<00:47, 109MB/s][A

Downloading (…)l-00001-of-00003.bin:  47%|████▋     | 4.62G/9.81G [00:39<00:45, 114MB/s][A

Downloading (…)l-00001-of-00003.bin:  47%|████▋     | 4.65G/9.81G [00:39<00:43, 119MB/s][A

Downloading (…)l-00001-of-00003.bin:  48%|████▊     | 4.67G/9.81G [00:40<00:42, 122MB/s][A

Downloading (…)l-00001-of-00003.bin:  48%|████▊     | 4.69G/9.81G [00:40<00:41, 124MB/s][A

Downloading (…)l-00001-of-00003.bin:  48%|████▊     | 4.71G/9.81G [00:40<01:03, 80.6MB/s][A

Downloading (…)l-00001-of-00003.bin:  48%|████▊     | 4.73G/9.81G [00:40<00:52, 95.9MB/s][A

Downloading (…)l-00001-of-00003.bin:  48%|████▊     | 4.75G/9.81G [00:40<00:45, 110MB/s] [A

Downloading (…)l-00001-of-00003.bin:  49%|████▊     | 4.77G/9.81G [00:41<00:40, 124MB/s][A

Downloading (…)l-00001-of-00003.bin:  49%|████▉     | 4.79G/9.81G [00:41<00:38, 131MB/s][A

Downloading (…)l-00001-of-00003.bin:  49%|████▉     | 4.81G/9.81G [00:41<00:35, 141MB/s][A

Downloading (…)l-00001-of-00003.bin:  49%|████▉     | 4.83G/9.81G [00:41<00:33, 148MB/s][A

Downloading (…)l-00001-of-00003.bin:  49%|████▉     | 4.85G/9.81G [00:41<00:32, 155MB/s][A

Downloading (…)l-00001-of-00003.bin:  50%|████▉     | 4.88G/9.81G [00:41<00:31, 158MB/s][A

Downloading (…)l-00001-of-00003.bin:  50%|████▉     | 4.90G/9.81G [00:41<00:38, 128MB/s][A

Downloading (…)l-00001-of-00003.bin:  50%|█████     | 4.92G/9.81G [00:42<00:41, 117MB/s][A

Downloading (…)l-00001-of-00003.bin:  50%|█████     | 4.94G/9.81G [00:42<00:44, 109MB/s][A

Downloading (…)l-00001-of-00003.bin:  51%|█████     | 4.96G/9.81G [00:42<00:59, 81.5MB/s][A

Downloading (…)l-00001-of-00003.bin:  51%|█████     | 4.98G/9.81G [00:42<00:50, 96.3MB/s][A

Downloading (…)l-00001-of-00003.bin:  51%|█████     | 5.00G/9.81G [00:43<00:43, 110MB/s] [A

Downloading (…)l-00001-of-00003.bin:  51%|█████     | 5.02G/9.81G [00:43<00:38, 123MB/s][A

Downloading (…)l-00001-of-00003.bin:  51%|█████▏    | 5.04G/9.81G [00:43<00:35, 135MB/s][A

Downloading (…)l-00001-of-00003.bin:  52%|█████▏    | 5.06G/9.81G [00:43<00:33, 142MB/s][A

Downloading (…)l-00001-of-00003.bin:  52%|█████▏    | 5.09G/9.81G [00:43<00:32, 146MB/s][A

Downloading (…)l-00001-of-00003.bin:  52%|█████▏    | 5.11G/9.81G [00:43<00:30, 152MB/s][A

Downloading (…)l-00001-of-00003.bin:  52%|█████▏    | 5.13G/9.81G [00:44<00:53, 86.9MB/s][A

Downloading (…)l-00001-of-00003.bin:  52%|█████▏    | 5.15G/9.81G [00:44<00:51, 91.3MB/s][A

Downloading (…)l-00001-of-00003.bin:  53%|█████▎    | 5.17G/9.81G [00:44<00:45, 103MB/s] [A

Downloading (…)l-00001-of-00003.bin:  53%|█████▎    | 5.19G/9.81G [00:44<00:41, 112MB/s][A

Downloading (…)l-00001-of-00003.bin:  53%|█████▎    | 5.21G/9.81G [00:44<00:39, 116MB/s][A

Downloading (…)l-00001-of-00003.bin:  53%|█████▎    | 5.23G/9.81G [00:44<00:38, 120MB/s][A

Downloading (…)l-00001-of-00003.bin:  54%|█████▎    | 5.25G/9.81G [00:45<00:36, 124MB/s][A

Downloading (…)l-00001-of-00003.bin:  54%|█████▍    | 5.27G/9.81G [00:45<00:34, 133MB/s][A

Downloading (…)l-00001-of-00003.bin:  54%|█████▍    | 5.30G/9.81G [00:45<00:44, 102MB/s][A

Downloading (…)l-00001-of-00003.bin:  54%|█████▍    | 5.32G/9.81G [00:45<00:47, 95.3MB/s][A

Downloading (…)l-00001-of-00003.bin:  54%|█████▍    | 5.34G/9.81G [00:45<00:41, 108MB/s] [A

Downloading (…)l-00001-of-00003.bin:  55%|█████▍    | 5.36G/9.81G [00:46<00:36, 122MB/s][A

Downloading (…)l-00001-of-00003.bin:  55%|█████▍    | 5.38G/9.81G [00:46<00:33, 133MB/s][A

Downloading (…)l-00001-of-00003.bin:  55%|█████▌    | 5.40G/9.81G [00:46<00:31, 141MB/s][A

Downloading (…)l-00001-of-00003.bin:  55%|█████▌    | 5.42G/9.81G [00:46<00:29, 147MB/s][A

Downloading (…)l-00001-of-00003.bin:  55%|█████▌    | 5.44G/9.81G [00:46<00:29, 147MB/s][A

Downloading (…)l-00001-of-00003.bin:  56%|█████▌    | 5.46G/9.81G [00:46<00:28, 154MB/s][A

Downloading (…)l-00001-of-00003.bin:  56%|█████▌    | 5.48G/9.81G [00:46<00:27, 157MB/s][A

Downloading (…)l-00001-of-00003.bin:  56%|█████▌    | 5.51G/9.81G [00:47<00:45, 95.3MB/s][A

Downloading (…)l-00001-of-00003.bin:  56%|█████▋    | 5.53G/9.81G [00:47<00:39, 108MB/s] [A

Downloading (…)l-00001-of-00003.bin:  57%|█████▋    | 5.55G/9.81G [00:47<00:35, 121MB/s][A

Downloading (…)l-00001-of-00003.bin:  57%|█████▋    | 5.57G/9.81G [00:47<00:32, 131MB/s][A

Downloading (…)l-00001-of-00003.bin:  57%|█████▋    | 5.59G/9.81G [00:47<00:29, 141MB/s][A

Downloading (…)l-00001-of-00003.bin:  57%|█████▋    | 5.61G/9.81G [00:47<00:28, 147MB/s][A

Downloading (…)l-00001-of-00003.bin:  57%|█████▋    | 5.63G/9.81G [00:48<00:27, 152MB/s][A

Downloading (…)l-00001-of-00003.bin:  58%|█████▊    | 5.65G/9.81G [00:48<00:26, 156MB/s][A

Downloading (…)l-00001-of-00003.bin:  58%|█████▊    | 5.67G/9.81G [00:48<00:26, 156MB/s][A

Downloading (…)l-00001-of-00003.bin:  58%|█████▊    | 5.69G/9.81G [00:48<00:53, 76.4MB/s][A

Downloading (…)l-00001-of-00003.bin:  58%|█████▊    | 5.71G/9.81G [00:49<00:44, 91.2MB/s][A

Downloading (…)l-00001-of-00003.bin:  58%|█████▊    | 5.74G/9.81G [00:49<00:39, 104MB/s] [A

Downloading (…)l-00001-of-00003.bin:  59%|█████▊    | 5.76G/9.81G [00:49<00:34, 117MB/s][A

Downloading (…)l-00001-of-00003.bin:  59%|█████▉    | 5.78G/9.81G [00:49<00:31, 128MB/s][A

Downloading (…)l-00001-of-00003.bin:  59%|█████▉    | 5.80G/9.81G [00:49<00:30, 133MB/s][A

Downloading (…)l-00001-of-00003.bin:  59%|█████▉    | 5.82G/9.81G [00:49<00:29, 135MB/s][A

Downloading (…)l-00001-of-00003.bin:  60%|█████▉    | 5.84G/9.81G [00:49<00:28, 137MB/s][A

Downloading (…)l-00001-of-00003.bin:  60%|█████▉    | 5.86G/9.81G [00:50<00:31, 127MB/s][A

Downloading (…)l-00001-of-00003.bin:  60%|█████▉    | 5.88G/9.81G [00:50<00:35, 110MB/s][A

Downloading (…)l-00001-of-00003.bin:  60%|██████    | 5.90G/9.81G [00:50<00:31, 123MB/s][A

Downloading (…)l-00001-of-00003.bin:  60%|██████    | 5.92G/9.81G [00:50<00:29, 130MB/s][A

Downloading (…)l-00001-of-00003.bin:  61%|██████    | 5.95G/9.81G [00:50<00:28, 137MB/s][A

Downloading (…)l-00001-of-00003.bin:  61%|██████    | 5.97G/9.81G [00:50<00:26, 143MB/s][A

Downloading (…)l-00001-of-00003.bin:  61%|██████    | 5.99G/9.81G [00:50<00:25, 148MB/s][A

Downloading (…)l-00001-of-00003.bin:  61%|██████    | 6.01G/9.81G [00:51<00:24, 154MB/s][A

Downloading (…)l-00001-of-00003.bin:  61%|██████▏   | 6.03G/9.81G [00:51<00:24, 157MB/s][A

Downloading (…)l-00001-of-00003.bin:  62%|██████▏   | 6.05G/9.81G [00:51<00:23, 159MB/s][A

Downloading (…)l-00001-of-00003.bin:  62%|██████▏   | 6.07G/9.81G [00:51<00:23, 158MB/s][A

Downloading (…)l-00001-of-00003.bin:  62%|██████▏   | 6.09G/9.81G [00:52<00:48, 76.7MB/s][A

Downloading (…)l-00001-of-00003.bin:  62%|██████▏   | 6.11G/9.81G [00:52<00:40, 91.6MB/s][A

Downloading (…)l-00001-of-00003.bin:  63%|██████▎   | 6.13G/9.81G [00:52<00:35, 105MB/s] [A

Downloading (…)l-00001-of-00003.bin:  63%|██████▎   | 6.16G/9.81G [00:52<00:31, 118MB/s][A

Downloading (…)l-00001-of-00003.bin:  63%|██████▎   | 6.18G/9.81G [00:52<00:28, 129MB/s][A

Downloading (…)l-00001-of-00003.bin:  63%|██████▎   | 6.20G/9.81G [00:52<00:26, 139MB/s][A

Downloading (…)l-00001-of-00003.bin:  63%|██████▎   | 6.22G/9.81G [00:52<00:24, 146MB/s][A

Downloading (…)l-00001-of-00003.bin:  64%|██████▎   | 6.24G/9.81G [00:52<00:24, 146MB/s][A

Downloading (…)l-00001-of-00003.bin:  64%|██████▍   | 6.26G/9.81G [00:53<00:24, 143MB/s][A

Downloading (…)l-00001-of-00003.bin:  64%|██████▍   | 6.28G/9.81G [00:53<00:48, 73.0MB/s][A

Downloading (…)l-00001-of-00003.bin:  64%|██████▍   | 6.30G/9.81G [00:53<00:40, 85.7MB/s][A

Downloading (…)l-00001-of-00003.bin:  64%|██████▍   | 6.32G/9.81G [00:54<00:46, 74.3MB/s][A

Downloading (…)l-00001-of-00003.bin:  65%|██████▍   | 6.34G/9.81G [00:54<00:39, 88.7MB/s][A

Downloading (…)l-00001-of-00003.bin:  65%|██████▍   | 6.36G/9.81G [00:54<00:34, 101MB/s] [A

Downloading (…)l-00001-of-00003.bin:  65%|██████▌   | 6.39G/9.81G [00:54<00:30, 111MB/s][A

Downloading (…)l-00001-of-00003.bin:  65%|██████▌   | 6.41G/9.81G [00:54<00:28, 120MB/s][A

Downloading (…)l-00001-of-00003.bin:  66%|██████▌   | 6.43G/9.81G [00:55<00:31, 107MB/s][A

Downloading (…)l-00001-of-00003.bin:  66%|██████▌   | 6.45G/9.81G [00:55<00:38, 86.4MB/s][A

Downloading (…)l-00001-of-00003.bin:  66%|██████▌   | 6.47G/9.81G [00:55<00:33, 100MB/s] [A

Downloading (…)l-00001-of-00003.bin:  66%|██████▌   | 6.49G/9.81G [00:55<00:29, 111MB/s][A

Downloading (…)l-00001-of-00003.bin:  66%|██████▋   | 6.51G/9.81G [00:55<00:26, 123MB/s][A

Downloading (…)l-00001-of-00003.bin:  67%|██████▋   | 6.53G/9.81G [00:55<00:25, 131MB/s][A

Downloading (…)l-00001-of-00003.bin:  67%|██████▋   | 6.55G/9.81G [00:56<00:23, 141MB/s][A

Downloading (…)l-00001-of-00003.bin:  67%|██████▋   | 6.57G/9.81G [00:56<00:22, 142MB/s][A

Downloading (…)l-00001-of-00003.bin:  67%|██████▋   | 6.60G/9.81G [00:56<00:22, 145MB/s][A

Downloading (…)l-00001-of-00003.bin:  67%|██████▋   | 6.62G/9.81G [00:56<00:33, 94.2MB/s][A

Downloading (…)l-00001-of-00003.bin:  68%|██████▊   | 6.64G/9.81G [00:57<00:38, 83.4MB/s][A

Downloading (…)l-00001-of-00003.bin:  68%|██████▊   | 6.66G/9.81G [00:57<00:32, 98.3MB/s][A

Downloading (…)l-00001-of-00003.bin:  68%|██████▊   | 6.68G/9.81G [00:57<00:27, 113MB/s] [A

Downloading (…)l-00001-of-00003.bin:  68%|██████▊   | 6.70G/9.81G [00:57<00:24, 126MB/s][A

Downloading (…)l-00001-of-00003.bin:  69%|██████▊   | 6.72G/9.81G [00:57<00:23, 133MB/s][A

Downloading (…)l-00001-of-00003.bin:  69%|██████▊   | 6.74G/9.81G [00:57<00:22, 136MB/s][A

Downloading (…)l-00001-of-00003.bin:  69%|██████▉   | 6.76G/9.81G [00:57<00:21, 140MB/s][A

Downloading (…)l-00001-of-00003.bin:  69%|██████▉   | 6.78G/9.81G [00:58<00:20, 145MB/s][A

Downloading (…)l-00001-of-00003.bin:  69%|██████▉   | 6.81G/9.81G [00:58<00:23, 130MB/s][A

Downloading (…)l-00001-of-00003.bin:  70%|██████▉   | 6.83G/9.81G [00:58<00:30, 96.4MB/s][A

Downloading (…)l-00001-of-00003.bin:  70%|██████▉   | 6.85G/9.81G [00:58<00:34, 86.7MB/s][A

Downloading (…)l-00001-of-00003.bin:  70%|███████   | 6.87G/9.81G [00:59<00:30, 97.5MB/s][A

Downloading (…)l-00001-of-00003.bin:  70%|███████   | 6.89G/9.81G [00:59<00:26, 110MB/s] [A

Downloading (…)l-00001-of-00003.bin:  70%|███████   | 6.91G/9.81G [00:59<00:23, 123MB/s][A

Downloading (…)l-00001-of-00003.bin:  71%|███████   | 6.93G/9.81G [00:59<00:21, 134MB/s][A

Downloading (…)l-00001-of-00003.bin:  71%|███████   | 6.95G/9.81G [00:59<00:20, 141MB/s][A

Downloading (…)l-00001-of-00003.bin:  71%|███████   | 6.97G/9.81G [00:59<00:19, 148MB/s][A

Downloading (…)l-00001-of-00003.bin:  71%|███████▏  | 6.99G/9.81G [00:59<00:18, 154MB/s][A

Downloading (…)l-00001-of-00003.bin:  71%|███████▏  | 7.01G/9.81G [01:00<00:21, 129MB/s][A

Downloading (…)l-00001-of-00003.bin:  72%|███████▏  | 7.04G/9.81G [01:00<00:38, 71.5MB/s][A

Downloading (…)l-00001-of-00003.bin:  72%|███████▏  | 7.06G/9.81G [01:00<00:35, 78.3MB/s][A

Downloading (…)l-00001-of-00003.bin:  72%|███████▏  | 7.08G/9.81G [01:00<00:30, 90.7MB/s][A

Downloading (…)l-00001-of-00003.bin:  72%|███████▏  | 7.10G/9.81G [01:01<00:25, 104MB/s] [A

Downloading (…)l-00001-of-00003.bin:  73%|███████▎  | 7.12G/9.81G [01:01<00:22, 119MB/s][A

Downloading (…)l-00001-of-00003.bin:  73%|███████▎  | 7.14G/9.81G [01:01<00:20, 130MB/s][A

Downloading (…)l-00001-of-00003.bin:  73%|███████▎  | 7.16G/9.81G [01:01<00:19, 135MB/s][A

Downloading (…)l-00001-of-00003.bin:  73%|███████▎  | 7.18G/9.81G [01:01<00:18, 145MB/s][A

Downloading (…)l-00001-of-00003.bin:  73%|███████▎  | 7.20G/9.81G [01:01<00:21, 122MB/s][A

Downloading (…)l-00001-of-00003.bin:  74%|███████▎  | 7.22G/9.81G [01:02<00:31, 81.0MB/s][A

Downloading (…)l-00001-of-00003.bin:  74%|███████▍  | 7.25G/9.81G [01:02<00:27, 91.9MB/s][A

Downloading (…)l-00001-of-00003.bin:  74%|███████▍  | 7.27G/9.81G [01:02<00:24, 103MB/s] [A

Downloading (…)l-00001-of-00003.bin:  74%|███████▍  | 7.29G/9.81G [01:02<00:22, 113MB/s][A

Downloading (…)l-00001-of-00003.bin:  74%|███████▍  | 7.31G/9.81G [01:02<00:20, 124MB/s][A

Downloading (…)l-00001-of-00003.bin:  75%|███████▍  | 7.33G/9.81G [01:02<00:18, 134MB/s][A

Downloading (…)l-00001-of-00003.bin:  75%|███████▍  | 7.35G/9.81G [01:03<00:17, 140MB/s][A

Downloading (…)l-00001-of-00003.bin:  75%|███████▌  | 7.37G/9.81G [01:03<00:16, 147MB/s][A

Downloading (…)l-00001-of-00003.bin:  75%|███████▌  | 7.39G/9.81G [01:03<00:31, 75.7MB/s][A

Downloading (…)l-00001-of-00003.bin:  76%|███████▌  | 7.41G/9.81G [01:03<00:27, 87.2MB/s][A

Downloading (…)l-00001-of-00003.bin:  76%|███████▌  | 7.43G/9.81G [01:04<00:23, 102MB/s] [A

Downloading (…)l-00001-of-00003.bin:  76%|███████▌  | 7.46G/9.81G [01:04<00:20, 115MB/s][A

Downloading (…)l-00001-of-00003.bin:  76%|███████▌  | 7.48G/9.81G [01:04<00:18, 125MB/s][A

Downloading (…)l-00001-of-00003.bin:  76%|███████▋  | 7.50G/9.81G [01:04<00:17, 136MB/s][A

Downloading (…)l-00001-of-00003.bin:  77%|███████▋  | 7.52G/9.81G [01:04<00:16, 143MB/s][A

Downloading (…)l-00001-of-00003.bin:  77%|███████▋  | 7.54G/9.81G [01:04<00:15, 149MB/s][A

Downloading (…)l-00001-of-00003.bin:  77%|███████▋  | 7.56G/9.81G [01:04<00:14, 152MB/s][A

Downloading (…)l-00001-of-00003.bin:  77%|███████▋  | 7.58G/9.81G [01:05<00:18, 120MB/s][A

Downloading (…)l-00001-of-00003.bin:  77%|███████▋  | 7.60G/9.81G [01:05<00:30, 71.8MB/s][A

Downloading (…)l-00001-of-00003.bin:  78%|███████▊  | 7.62G/9.81G [01:05<00:25, 86.0MB/s][A

Downloading (…)l-00001-of-00003.bin:  78%|███████▊  | 7.64G/9.81G [01:05<00:21, 101MB/s] [A

Downloading (…)l-00001-of-00003.bin:  78%|███████▊  | 7.67G/9.81G [01:06<00:18, 115MB/s][A

Downloading (…)l-00001-of-00003.bin:  78%|███████▊  | 7.69G/9.81G [01:06<00:16, 127MB/s][A

Downloading (…)l-00001-of-00003.bin:  79%|███████▊  | 7.71G/9.81G [01:06<00:15, 136MB/s][A

Downloading (…)l-00001-of-00003.bin:  79%|███████▉  | 7.73G/9.81G [01:06<00:14, 142MB/s][A

Downloading (…)l-00001-of-00003.bin:  79%|███████▉  | 7.75G/9.81G [01:06<00:14, 147MB/s][A

Downloading (…)l-00001-of-00003.bin:  79%|███████▉  | 7.77G/9.81G [01:06<00:13, 151MB/s][A

Downloading (…)l-00001-of-00003.bin:  79%|███████▉  | 7.79G/9.81G [01:07<00:20, 98.4MB/s][A

Downloading (…)l-00001-of-00003.bin:  80%|███████▉  | 7.81G/9.81G [01:07<00:26, 74.4MB/s][A

Downloading (…)l-00001-of-00003.bin:  80%|███████▉  | 7.82G/9.81G [01:07<00:25, 78.2MB/s][A

Downloading (…)l-00001-of-00003.bin:  80%|███████▉  | 7.84G/9.81G [01:07<00:22, 87.3MB/s][A

Downloading (…)l-00001-of-00003.bin:  80%|████████  | 7.86G/9.81G [01:08<00:19, 97.6MB/s][A

Downloading (…)l-00001-of-00003.bin:  80%|████████  | 7.89G/9.81G [01:08<00:17, 108MB/s] [A

Downloading (…)l-00001-of-00003.bin:  81%|████████  | 7.91G/9.81G [01:08<00:15, 120MB/s][A

Downloading (…)l-00001-of-00003.bin:  81%|████████  | 7.93G/9.81G [01:08<00:14, 132MB/s][A

Downloading (…)l-00001-of-00003.bin:  81%|████████  | 7.95G/9.81G [01:08<00:13, 140MB/s][A

Downloading (…)l-00001-of-00003.bin:  81%|████████  | 7.97G/9.81G [01:08<00:15, 122MB/s][A

Downloading (…)l-00001-of-00003.bin:  81%|████████▏ | 7.99G/9.81G [01:09<00:22, 82.5MB/s][A

Downloading (…)l-00001-of-00003.bin:  82%|████████▏ | 8.01G/9.81G [01:09<00:19, 91.8MB/s][A

Downloading (…)l-00001-of-00003.bin:  82%|████████▏ | 8.03G/9.81G [01:09<00:17, 103MB/s] [A

Downloading (…)l-00001-of-00003.bin:  82%|████████▏ | 8.05G/9.81G [01:09<00:15, 113MB/s][A

Downloading (…)l-00001-of-00003.bin:  82%|████████▏ | 8.07G/9.81G [01:09<00:13, 126MB/s][A

Downloading (…)l-00001-of-00003.bin:  83%|████████▎ | 8.10G/9.81G [01:09<00:12, 136MB/s][A

Downloading (…)l-00001-of-00003.bin:  83%|████████▎ | 8.12G/9.81G [01:10<00:11, 142MB/s][A

Downloading (…)l-00001-of-00003.bin:  83%|████████▎ | 8.14G/9.81G [01:10<00:11, 142MB/s][A

Downloading (…)l-00001-of-00003.bin:  83%|████████▎ | 8.16G/9.81G [01:10<00:15, 108MB/s][A

Downloading (…)l-00001-of-00003.bin:  83%|████████▎ | 8.18G/9.81G [01:10<00:15, 104MB/s][A

Downloading (…)l-00001-of-00003.bin:  84%|████████▎ | 8.20G/9.81G [01:10<00:14, 111MB/s][A

Downloading (…)l-00001-of-00003.bin:  84%|████████▍ | 8.22G/9.81G [01:11<00:13, 117MB/s][A

Downloading (…)l-00001-of-00003.bin:  84%|████████▍ | 8.24G/9.81G [01:11<00:12, 125MB/s][A

Downloading (…)l-00001-of-00003.bin:  84%|████████▍ | 8.26G/9.81G [01:11<00:11, 135MB/s][A

Downloading (…)l-00001-of-00003.bin:  84%|████████▍ | 8.28G/9.81G [01:11<00:10, 143MB/s][A

Downloading (…)l-00001-of-00003.bin:  85%|████████▍ | 8.30G/9.81G [01:11<00:10, 146MB/s][A

Downloading (…)l-00001-of-00003.bin:  85%|████████▍ | 8.33G/9.81G [01:11<00:09, 151MB/s][A

Downloading (…)l-00001-of-00003.bin:  85%|████████▌ | 8.35G/9.81G [01:11<00:12, 122MB/s][A

Downloading (…)l-00001-of-00003.bin:  85%|████████▌ | 8.37G/9.81G [01:12<00:10, 131MB/s][A

Downloading (…)l-00001-of-00003.bin:  85%|████████▌ | 8.39G/9.81G [01:12<00:10, 134MB/s][A

Downloading (…)l-00001-of-00003.bin:  86%|████████▌ | 8.41G/9.81G [01:12<00:09, 142MB/s][A

Downloading (…)l-00001-of-00003.bin:  86%|████████▌ | 8.43G/9.81G [01:12<00:09, 146MB/s][A

Downloading (…)l-00001-of-00003.bin:  86%|████████▌ | 8.45G/9.81G [01:12<00:09, 148MB/s][A

Downloading (…)l-00001-of-00003.bin:  86%|████████▋ | 8.47G/9.81G [01:12<00:09, 146MB/s][A

Downloading (…)l-00001-of-00003.bin:  87%|████████▋ | 8.49G/9.81G [01:12<00:08, 152MB/s][A

Downloading (…)l-00001-of-00003.bin:  87%|████████▋ | 8.51G/9.81G [01:13<00:08, 158MB/s][A

Downloading (…)l-00001-of-00003.bin:  87%|████████▋ | 8.54G/9.81G [01:13<00:15, 84.1MB/s][A

Downloading (…)l-00001-of-00003.bin:  87%|████████▋ | 8.56G/9.81G [01:14<00:19, 65.0MB/s][A

Downloading (…)l-00001-of-00003.bin:  87%|████████▋ | 8.58G/9.81G [01:14<00:15, 78.2MB/s][A

Downloading (…)l-00001-of-00003.bin:  88%|████████▊ | 8.60G/9.81G [01:14<00:12, 93.4MB/s][A

Downloading (…)l-00001-of-00003.bin:  88%|████████▊ | 8.62G/9.81G [01:14<00:11, 106MB/s] [A

Downloading (…)l-00001-of-00003.bin:  88%|████████▊ | 8.64G/9.81G [01:14<00:09, 119MB/s][A

Downloading (…)l-00001-of-00003.bin:  88%|████████▊ | 8.66G/9.81G [01:14<00:08, 129MB/s][A

Downloading (…)l-00001-of-00003.bin:  88%|████████▊ | 8.68G/9.81G [01:14<00:08, 137MB/s][A

Downloading (…)l-00001-of-00003.bin:  89%|████████▊ | 8.70G/9.81G [01:15<00:13, 83.1MB/s][A

Downloading (…)l-00001-of-00003.bin:  89%|████████▉ | 8.72G/9.81G [01:15<00:11, 94.0MB/s][A

Downloading (…)l-00001-of-00003.bin:  89%|████████▉ | 8.75G/9.81G [01:15<00:10, 104MB/s] [A

Downloading (…)l-00001-of-00003.bin:  89%|████████▉ | 8.77G/9.81G [01:15<00:09, 109MB/s][A

Downloading (…)l-00001-of-00003.bin:  90%|████████▉ | 8.79G/9.81G [01:15<00:08, 121MB/s][A

Downloading (…)l-00001-of-00003.bin:  90%|████████▉ | 8.81G/9.81G [01:16<00:07, 131MB/s][A

Downloading (…)l-00001-of-00003.bin:  90%|████████▉ | 8.83G/9.81G [01:16<00:07, 139MB/s][A

Downloading (…)l-00001-of-00003.bin:  90%|█████████ | 8.85G/9.81G [01:16<00:06, 147MB/s][A

Downloading (…)l-00001-of-00003.bin:  90%|█████████ | 8.87G/9.81G [01:16<00:06, 151MB/s][A

Downloading (…)l-00001-of-00003.bin:  91%|█████████ | 8.89G/9.81G [01:17<00:11, 78.3MB/s][A

Downloading (…)l-00001-of-00003.bin:  91%|█████████ | 8.91G/9.81G [01:17<00:10, 86.7MB/s][A

Downloading (…)l-00001-of-00003.bin:  91%|█████████ | 8.93G/9.81G [01:17<00:09, 96.7MB/s][A

Downloading (…)l-00001-of-00003.bin:  91%|█████████▏| 8.95G/9.81G [01:17<00:07, 109MB/s] [A

Downloading (…)l-00001-of-00003.bin:  91%|█████████▏| 8.98G/9.81G [01:17<00:06, 122MB/s][A

Downloading (…)l-00001-of-00003.bin:  92%|█████████▏| 9.00G/9.81G [01:17<00:06, 133MB/s][A

Downloading (…)l-00001-of-00003.bin:  92%|█████████▏| 9.02G/9.81G [01:17<00:05, 141MB/s][A

Downloading (…)l-00001-of-00003.bin:  92%|█████████▏| 9.04G/9.81G [01:17<00:05, 143MB/s][A

Downloading (…)l-00001-of-00003.bin:  92%|█████████▏| 9.06G/9.81G [01:18<00:06, 120MB/s][A

Downloading (…)l-00001-of-00003.bin:  93%|█████████▎| 9.08G/9.81G [01:18<00:06, 119MB/s][A

Downloading (…)l-00001-of-00003.bin:  93%|█████████▎| 9.10G/9.81G [01:18<00:05, 132MB/s][A

Downloading (…)l-00001-of-00003.bin:  93%|█████████▎| 9.12G/9.81G [01:18<00:04, 141MB/s][A

Downloading (…)l-00001-of-00003.bin:  93%|█████████▎| 9.14G/9.81G [01:18<00:04, 149MB/s][A

Downloading (…)l-00001-of-00003.bin:  93%|█████████▎| 9.16G/9.81G [01:18<00:04, 153MB/s][A

Downloading (…)l-00001-of-00003.bin:  94%|█████████▎| 9.19G/9.81G [01:19<00:04, 154MB/s][A

Downloading (…)l-00001-of-00003.bin:  94%|█████████▍| 9.21G/9.81G [01:19<00:03, 159MB/s][A

Downloading (…)l-00001-of-00003.bin:  94%|█████████▍| 9.23G/9.81G [01:19<00:03, 157MB/s][A

Downloading (…)l-00001-of-00003.bin:  94%|█████████▍| 9.25G/9.81G [01:19<00:03, 158MB/s][A

Downloading (…)l-00001-of-00003.bin:  94%|█████████▍| 9.27G/9.81G [01:20<00:07, 71.1MB/s][A

Downloading (…)l-00001-of-00003.bin:  95%|█████████▍| 9.29G/9.81G [01:20<00:06, 84.3MB/s][A

Downloading (…)l-00001-of-00003.bin:  95%|█████████▍| 9.31G/9.81G [01:20<00:05, 96.3MB/s][A

Downloading (…)l-00001-of-00003.bin:  95%|█████████▌| 9.33G/9.81G [01:20<00:04, 108MB/s] [A

Downloading (…)l-00001-of-00003.bin:  95%|█████████▌| 9.35G/9.81G [01:20<00:03, 120MB/s][A

Downloading (…)l-00001-of-00003.bin:  96%|█████████▌| 9.37G/9.81G [01:20<00:03, 125MB/s][A

Downloading (…)l-00001-of-00003.bin:  96%|█████████▌| 9.40G/9.81G [01:20<00:03, 131MB/s][A

Downloading (…)l-00001-of-00003.bin:  96%|█████████▌| 9.42G/9.81G [01:21<00:02, 137MB/s][A

Downloading (…)l-00001-of-00003.bin:  96%|█████████▌| 9.44G/9.81G [01:21<00:02, 146MB/s][A

Downloading (…)l-00001-of-00003.bin:  96%|█████████▋| 9.46G/9.81G [01:21<00:02, 144MB/s][A

Downloading (…)l-00001-of-00003.bin:  97%|█████████▋| 9.48G/9.81G [01:21<00:02, 137MB/s][A

Downloading (…)l-00001-of-00003.bin:  97%|█████████▋| 9.50G/9.81G [01:21<00:02, 146MB/s][A

Downloading (…)l-00001-of-00003.bin:  97%|█████████▋| 9.52G/9.81G [01:21<00:01, 149MB/s][A

Downloading (…)l-00001-of-00003.bin:  97%|█████████▋| 9.54G/9.81G [01:21<00:01, 150MB/s][A

Downloading (…)l-00001-of-00003.bin:  97%|█████████▋| 9.56G/9.81G [01:22<00:01, 151MB/s][A

Downloading (…)l-00001-of-00003.bin:  98%|█████████▊| 9.58G/9.81G [01:22<00:01, 156MB/s][A

Downloading (…)l-00001-of-00003.bin:  98%|█████████▊| 9.60G/9.81G [01:22<00:01, 159MB/s][A

Downloading (…)l-00001-of-00003.bin:  98%|█████████▊| 9.63G/9.81G [01:22<00:01, 164MB/s][A

Downloading (…)l-00001-of-00003.bin:  98%|█████████▊| 9.65G/9.81G [01:22<00:01, 162MB/s][A

Downloading (…)l-00001-of-00003.bin:  99%|█████████▊| 9.67G/9.81G [01:22<00:00, 166MB/s][A

Downloading (…)l-00001-of-00003.bin:  99%|█████████▊| 9.69G/9.81G [01:22<00:00, 168MB/s][A

Downloading (…)l-00001-of-00003.bin:  99%|█████████▉| 9.71G/9.81G [01:22<00:00, 170MB/s][A

Downloading (…)l-00001-of-00003.bin:  99%|█████████▉| 9.73G/9.81G [01:23<00:00, 170MB/s][A

Downloading (…)l-00001-of-00003.bin:  99%|█████████▉| 9.75G/9.81G [01:23<00:00, 169MB/s][A

Downloading (…)l-00001-of-00003.bin: 100%|█████████▉| 9.77G/9.81G [01:23<00:00, 169MB/s][A

Downloading (…)l-00001-of-00003.bin: 100%|█████████▉| 9.79G/9.81G [01:23<00:00, 165MB/s][A

Downloading (…)l-00001-of-00003.bin: 100%|██████████| 9.81G/9.81G [01:23<00:00, 162MB/s][A
Downloading (…)l-00001-of-00003.bin: 100%|██████████| 9.81G/9.81G [01:23<00:00, 117MB/s]

Downloading shards:  33%|███▎      | 1/3 [01:26<02:53, 86.51s/it]
Downloading shards:  33%|███▎      | 1/3 [01:26<02:53, 86.52s/it]

Downloading (…)l-00002-of-00003.bin:   0%|          | 0.00/9.93G [00:00<?, ?B/s][A

Downloading (…)l-00002-of-00003.bin:   0%|          | 10.5M/9.93G [00:00<02:17, 72.3MB/s][A

Downloading (…)l-00002-of-00003.bin:   0%|          | 31.5M/9.93G [00:00<01:28, 112MB/s] [A

Downloading (…)l-00002-of-00003.bin:   1%|          | 52.4M/9.93G [00:00<01:16, 130MB/s][A

Downloading (…)l-00002-of-00003.bin:   1%|          | 73.4M/9.93G [00:00<01:09, 142MB/s][A

Downloading (…)l-00002-of-00003.bin:   1%|          | 94.4M/9.93G [00:00<01:09, 142MB/s][A

Downloading (…)l-00002-of-00003.bin:   1%|          | 115M/9.93G [00:00<01:08, 143MB/s] [A

Downloading (…)l-00002-of-00003.bin:   1%|▏         | 136M/9.93G [00:01<01:08, 143MB/s][A

Downloading (…)l-00002-of-00003.bin:   2%|▏         | 157M/9.93G [00:01<01:10, 139MB/s][A

Downloading (…)l-00002-of-00003.bin:   2%|▏         | 178M/9.93G [00:01<01:22, 118MB/s][A

Downloading (…)l-00002-of-00003.bin:   2%|▏         | 199M/9.93G [00:01<01:46, 91.3MB/s][A

Downloading (…)l-00002-of-00003.bin:   2%|▏         | 220M/9.93G [00:01<01:34, 103MB/s] [A

Downloading (…)l-00002-of-00003.bin:   2%|▏         | 241M/9.93G [00:02<01:23, 116MB/s][A

Downloading (…)l-00002-of-00003.bin:   3%|▎         | 262M/9.93G [00:02<01:15, 127MB/s][A

Downloading (…)l-00002-of-00003.bin:   3%|▎         | 283M/9.93G [00:02<01:13, 131MB/s][A

Downloading (…)l-00002-of-00003.bin:   3%|▎         | 304M/9.93G [00:02<01:09, 139MB/s][A

Downloading (…)l-00002-of-00003.bin:   3%|▎         | 325M/9.93G [00:02<01:09, 139MB/s][A

Downloading (…)l-00002-of-00003.bin:   3%|▎         | 346M/9.93G [00:02<01:06, 144MB/s][A

Downloading (…)l-00002-of-00003.bin:   4%|▎         | 367M/9.93G [00:03<01:26, 110MB/s][A

Downloading (…)l-00002-of-00003.bin:   4%|▍         | 388M/9.93G [00:03<01:48, 87.8MB/s][A

Downloading (…)l-00002-of-00003.bin:   4%|▍         | 409M/9.93G [00:03<01:57, 81.3MB/s][A

Downloading (…)l-00002-of-00003.bin:   4%|▍         | 430M/9.93G [00:03<01:46, 89.0MB/s][A

Downloading (…)l-00002-of-00003.bin:   5%|▍         | 451M/9.93G [00:04<01:36, 97.9MB/s][A

Downloading (…)l-00002-of-00003.bin:   5%|▍         | 472M/9.93G [00:04<01:28, 107MB/s] [A

Downloading (…)l-00002-of-00003.bin:   5%|▍         | 493M/9.93G [00:04<01:22, 114MB/s][A

Downloading (…)l-00002-of-00003.bin:   5%|▌         | 514M/9.93G [00:04<01:19, 119MB/s][A

Downloading (…)l-00002-of-00003.bin:   5%|▌         | 535M/9.93G [00:04<01:14, 126MB/s][A

Downloading (…)l-00002-of-00003.bin:   6%|▌         | 556M/9.93G [00:04<01:27, 107MB/s][A

Downloading (…)l-00002-of-00003.bin:   6%|▌         | 577M/9.93G [00:05<01:48, 86.1MB/s][A

Downloading (…)l-00002-of-00003.bin:   6%|▌         | 598M/9.93G [00:05<01:36, 96.4MB/s][A

Downloading (…)l-00002-of-00003.bin:   6%|▌         | 619M/9.93G [00:05<01:29, 104MB/s] [A

Downloading (…)l-00002-of-00003.bin:   6%|▋         | 640M/9.93G [00:05<01:24, 110MB/s][A

Downloading (…)l-00002-of-00003.bin:   7%|▋         | 661M/9.93G [00:05<01:20, 116MB/s][A

Downloading (…)l-00002-of-00003.bin:   7%|▋         | 682M/9.93G [00:06<01:15, 123MB/s][A

Downloading (…)l-00002-of-00003.bin:   7%|▋         | 703M/9.93G [00:06<01:10, 131MB/s][A

Downloading (…)l-00002-of-00003.bin:   7%|▋         | 724M/9.93G [00:06<01:08, 134MB/s][A

Downloading (…)l-00002-of-00003.bin:   8%|▊         | 744M/9.93G [00:06<01:42, 89.9MB/s][A

Downloading (…)l-00002-of-00003.bin:   8%|▊         | 765M/9.93G [00:07<01:54, 79.8MB/s][A

Downloading (…)l-00002-of-00003.bin:   8%|▊         | 786M/9.93G [00:07<01:41, 90.0MB/s][A

Downloading (…)l-00002-of-00003.bin:   8%|▊         | 807M/9.93G [00:07<01:33, 97.3MB/s][A

Downloading (…)l-00002-of-00003.bin:   8%|▊         | 828M/9.93G [00:07<01:27, 104MB/s] [A

Downloading (…)l-00002-of-00003.bin:   9%|▊         | 849M/9.93G [00:07<01:23, 108MB/s][A

Downloading (…)l-00002-of-00003.bin:   9%|▉         | 870M/9.93G [00:07<01:17, 117MB/s][A

Downloading (…)l-00002-of-00003.bin:   9%|▉         | 891M/9.93G [00:08<01:12, 125MB/s][A

Downloading (…)l-00002-of-00003.bin:   9%|▉         | 912M/9.93G [00:08<01:40, 89.6MB/s][A

Downloading (…)l-00002-of-00003.bin:   9%|▉         | 933M/9.93G [00:08<02:02, 73.7MB/s][A

Downloading (…)l-00002-of-00003.bin:  10%|▉         | 954M/9.93G [00:09<01:49, 82.1MB/s][A

Downloading (…)l-00002-of-00003.bin:  10%|▉         | 975M/9.93G [00:09<01:38, 90.4MB/s][A

Downloading (…)l-00002-of-00003.bin:  10%|█         | 996M/9.93G [00:09<01:29, 99.5MB/s][A

Downloading (…)l-00002-of-00003.bin:  10%|█         | 1.02G/9.93G [00:09<01:23, 107MB/s][A

Downloading (…)l-00002-of-00003.bin:  10%|█         | 1.04G/9.93G [00:09<01:20, 111MB/s][A

Downloading (…)l-00002-of-00003.bin:  11%|█         | 1.06G/9.93G [00:09<01:14, 120MB/s][A

Downloading (…)l-00002-of-00003.bin:  11%|█         | 1.08G/9.93G [00:10<01:50, 80.1MB/s][A

Downloading (…)l-00002-of-00003.bin:  11%|█         | 1.09G/9.93G [00:10<01:51, 79.1MB/s][A

Downloading (…)l-00002-of-00003.bin:  11%|█         | 1.11G/9.93G [00:10<01:35, 92.7MB/s][A

Downloading (…)l-00002-of-00003.bin:  11%|█▏        | 1.13G/9.93G [00:10<01:21, 107MB/s] [A

Downloading (…)l-00002-of-00003.bin:  12%|█▏        | 1.15G/9.93G [00:10<01:14, 118MB/s][A

Downloading (…)l-00002-of-00003.bin:  12%|█▏        | 1.17G/9.93G [00:10<01:09, 126MB/s][A

Downloading (…)l-00002-of-00003.bin:  12%|█▏        | 1.20G/9.93G [00:11<01:09, 126MB/s][A

Downloading (…)l-00002-of-00003.bin:  12%|█▏        | 1.22G/9.93G [00:11<01:05, 132MB/s][A

Downloading (…)l-00002-of-00003.bin:  12%|█▏        | 1.24G/9.93G [00:11<01:04, 135MB/s][A

Downloading (…)l-00002-of-00003.bin:  13%|█▎        | 1.26G/9.93G [00:11<01:30, 96.0MB/s][A

Downloading (…)l-00002-of-00003.bin:  13%|█▎        | 1.28G/9.93G [00:12<01:51, 77.6MB/s][A

Downloading (…)l-00002-of-00003.bin:  13%|█▎        | 1.30G/9.93G [00:12<01:36, 89.5MB/s][A

Downloading (…)l-00002-of-00003.bin:  13%|█▎        | 1.32G/9.93G [00:12<01:26, 99.2MB/s][A

Downloading (…)l-00002-of-00003.bin:  14%|█▎        | 1.34G/9.93G [00:12<01:18, 109MB/s] [A

Downloading (…)l-00002-of-00003.bin:  14%|█▎        | 1.36G/9.93G [00:12<01:13, 117MB/s][A

Downloading (…)l-00002-of-00003.bin:  14%|█▍        | 1.38G/9.93G [00:12<01:10, 122MB/s][A

Downloading (…)l-00002-of-00003.bin:  14%|█▍        | 1.41G/9.93G [00:13<01:08, 125MB/s][A

Downloading (…)l-00002-of-00003.bin:  14%|█▍        | 1.43G/9.93G [00:13<01:25, 99.1MB/s][A

Downloading (…)l-00002-of-00003.bin:  15%|█▍        | 1.45G/9.93G [00:13<01:49, 77.1MB/s][A

Downloading (…)l-00002-of-00003.bin:  15%|█▍        | 1.47G/9.93G [00:13<01:33, 90.6MB/s][A

Downloading (…)l-00002-of-00003.bin:  15%|█▌        | 1.49G/9.93G [00:14<01:23, 101MB/s] [A

Downloading (…)l-00002-of-00003.bin:  15%|█▌        | 1.51G/9.93G [00:14<01:17, 109MB/s][A

Downloading (…)l-00002-of-00003.bin:  15%|█▌        | 1.53G/9.93G [00:14<01:10, 120MB/s][A

Downloading (…)l-00002-of-00003.bin:  16%|█▌        | 1.55G/9.93G [00:14<01:05, 127MB/s][A

Downloading (…)l-00002-of-00003.bin:  16%|█▌        | 1.57G/9.93G [00:14<01:05, 128MB/s][A

Downloading (…)l-00002-of-00003.bin:  16%|█▌        | 1.59G/9.93G [00:14<01:01, 136MB/s][A

Downloading (…)l-00002-of-00003.bin:  16%|█▋        | 1.61G/9.93G [00:15<01:36, 86.0MB/s][A

Downloading (…)l-00002-of-00003.bin:  16%|█▋        | 1.64G/9.93G [00:15<01:55, 72.0MB/s][A

Downloading (…)l-00002-of-00003.bin:  17%|█▋        | 1.65G/9.93G [00:15<01:51, 74.0MB/s][A

Downloading (…)l-00002-of-00003.bin:  17%|█▋        | 1.66G/9.93G [00:15<01:46, 77.9MB/s][A

Downloading (…)l-00002-of-00003.bin:  17%|█▋        | 1.68G/9.93G [00:16<01:35, 86.6MB/s][A

Downloading (…)l-00002-of-00003.bin:  17%|█▋        | 1.70G/9.93G [00:16<01:25, 96.7MB/s][A

Downloading (…)l-00002-of-00003.bin:  17%|█▋        | 1.72G/9.93G [00:16<01:19, 103MB/s] [A

Downloading (…)l-00002-of-00003.bin:  18%|█▊        | 1.74G/9.93G [00:16<01:13, 111MB/s][A

Downloading (…)l-00002-of-00003.bin:  18%|█▊        | 1.76G/9.93G [00:17<01:40, 81.6MB/s][A

Downloading (…)l-00002-of-00003.bin:  18%|█▊        | 1.78G/9.93G [00:17<01:30, 89.6MB/s][A

Downloading (…)l-00002-of-00003.bin:  18%|█▊        | 1.80G/9.93G [00:17<01:19, 102MB/s] [A

Downloading (…)l-00002-of-00003.bin:  18%|█▊        | 1.82G/9.93G [00:17<01:14, 109MB/s][A

Downloading (…)l-00002-of-00003.bin:  19%|█▊        | 1.85G/9.93G [00:17<01:07, 120MB/s][A

Downloading (…)l-00002-of-00003.bin:  19%|█▉        | 1.87G/9.93G [00:17<01:04, 125MB/s][A

Downloading (…)l-00002-of-00003.bin:  19%|█▉        | 1.89G/9.93G [00:17<01:03, 127MB/s][A

Downloading (…)l-00002-of-00003.bin:  19%|█▉        | 1.91G/9.93G [00:18<01:01, 130MB/s][A

Downloading (…)l-00002-of-00003.bin:  19%|█▉        | 1.93G/9.93G [00:18<01:05, 122MB/s][A

Downloading (…)l-00002-of-00003.bin:  20%|█▉        | 1.95G/9.93G [00:18<01:52, 71.1MB/s][A

Downloading (…)l-00002-of-00003.bin:  20%|█▉        | 1.96G/9.93G [00:19<01:47, 73.8MB/s][A

Downloading (…)l-00002-of-00003.bin:  20%|█▉        | 1.98G/9.93G [00:19<01:34, 84.0MB/s][A

Downloading (…)l-00002-of-00003.bin:  20%|██        | 2.00G/9.93G [00:19<01:20, 98.4MB/s][A

Downloading (…)l-00002-of-00003.bin:  20%|██        | 2.02G/9.93G [00:19<01:11, 110MB/s] [A

Downloading (…)l-00002-of-00003.bin:  21%|██        | 2.04G/9.93G [00:19<01:05, 120MB/s][A

Downloading (…)l-00002-of-00003.bin:  21%|██        | 2.07G/9.93G [00:19<01:02, 126MB/s][A

Downloading (…)l-00002-of-00003.bin:  21%|██        | 2.09G/9.93G [00:19<01:00, 129MB/s][A

Downloading (…)l-00002-of-00003.bin:  21%|██        | 2.11G/9.93G [00:20<01:06, 117MB/s][A

Downloading (…)l-00002-of-00003.bin:  21%|██▏       | 2.13G/9.93G [00:20<01:38, 79.0MB/s][A

Downloading (…)l-00002-of-00003.bin:  22%|██▏       | 2.14G/9.93G [00:20<01:35, 81.9MB/s][A

Downloading (…)l-00002-of-00003.bin:  22%|██▏       | 2.16G/9.93G [00:20<01:22, 94.5MB/s][A

Downloading (…)l-00002-of-00003.bin:  22%|██▏       | 2.18G/9.93G [00:21<01:13, 105MB/s] [A

Downloading (…)l-00002-of-00003.bin:  22%|██▏       | 2.20G/9.93G [00:21<01:07, 114MB/s][A

Downloading (…)l-00002-of-00003.bin:  22%|██▏       | 2.22G/9.93G [00:21<01:03, 121MB/s][A

Downloading (…)l-00002-of-00003.bin:  23%|██▎       | 2.24G/9.93G [00:21<01:00, 127MB/s][A

Downloading (…)l-00002-of-00003.bin:  23%|██▎       | 2.26G/9.93G [00:21<01:23, 91.7MB/s][A

Downloading (…)l-00002-of-00003.bin:  23%|██▎       | 2.29G/9.93G [00:22<01:29, 85.6MB/s][A

Downloading (…)l-00002-of-00003.bin:  23%|██▎       | 2.30G/9.93G [00:22<01:45, 72.5MB/s][A

Downloading (…)l-00002-of-00003.bin:  23%|██▎       | 2.32G/9.93G [00:22<01:28, 85.8MB/s][A

Downloading (…)l-00002-of-00003.bin:  24%|██▎       | 2.34G/9.93G [00:22<01:16, 99.5MB/s][A

Downloading (…)l-00002-of-00003.bin:  24%|██▍       | 2.36G/9.93G [00:22<01:07, 113MB/s] [A

Downloading (…)l-00002-of-00003.bin:  24%|██▍       | 2.38G/9.93G [00:22<01:00, 125MB/s][A

Downloading (…)l-00002-of-00003.bin:  24%|██▍       | 2.40G/9.93G [00:23<00:55, 136MB/s][A

Downloading (…)l-00002-of-00003.bin:  24%|██▍       | 2.42G/9.93G [00:23<00:53, 141MB/s][A

Downloading (…)l-00002-of-00003.bin:  25%|██▍       | 2.44G/9.93G [00:23<00:52, 144MB/s][A

Downloading (…)l-00002-of-00003.bin:  25%|██▍       | 2.46G/9.93G [00:23<00:51, 144MB/s][A

Downloading (…)l-00002-of-00003.bin:  25%|██▌       | 2.49G/9.93G [00:23<01:26, 85.7MB/s][A

Downloading (…)l-00002-of-00003.bin:  25%|██▌       | 2.51G/9.93G [00:24<01:38, 75.1MB/s][A

Downloading (…)l-00002-of-00003.bin:  25%|██▌       | 2.53G/9.93G [00:24<01:24, 87.5MB/s][A

Downloading (…)l-00002-of-00003.bin:  26%|██▌       | 2.55G/9.93G [00:24<01:13, 100MB/s] [A

Downloading (…)l-00002-of-00003.bin:  26%|██▌       | 2.57G/9.93G [00:24<01:04, 114MB/s][A

Downloading (…)l-00002-of-00003.bin:  26%|██▌       | 2.59G/9.93G [00:24<00:58, 125MB/s][A

Downloading (…)l-00002-of-00003.bin:  26%|██▋       | 2.61G/9.93G [00:24<00:55, 131MB/s][A

Downloading (…)l-00002-of-00003.bin:  27%|██▋       | 2.63G/9.93G [00:25<00:53, 135MB/s][A

Downloading (…)l-00002-of-00003.bin:  27%|██▋       | 2.65G/9.93G [00:25<00:54, 134MB/s][A

Downloading (…)l-00002-of-00003.bin:  27%|██▋       | 2.67G/9.93G [00:25<01:38, 73.8MB/s][A

Downloading (…)l-00002-of-00003.bin:  27%|██▋       | 2.69G/9.93G [00:26<01:25, 84.2MB/s][A

Downloading (…)l-00002-of-00003.bin:  27%|██▋       | 2.72G/9.93G [00:26<01:12, 99.4MB/s][A

Downloading (…)l-00002-of-00003.bin:  28%|██▊       | 2.74G/9.93G [00:26<01:05, 110MB/s] [A

Downloading (…)l-00002-of-00003.bin:  28%|██▊       | 2.76G/9.93G [00:26<00:59, 120MB/s][A

Downloading (…)l-00002-of-00003.bin:  28%|██▊       | 2.78G/9.93G [00:26<00:54, 131MB/s][A

Downloading (…)l-00002-of-00003.bin:  28%|██▊       | 2.80G/9.93G [00:26<00:51, 138MB/s][A

Downloading (…)l-00002-of-00003.bin:  28%|██▊       | 2.82G/9.93G [00:26<00:49, 143MB/s][A

Downloading (…)l-00002-of-00003.bin:  29%|██▊       | 2.84G/9.93G [00:26<00:47, 150MB/s][A

Downloading (…)l-00002-of-00003.bin:  29%|██▉       | 2.86G/9.93G [00:27<00:54, 130MB/s][A

Downloading (…)l-00002-of-00003.bin:  29%|██▉       | 2.88G/9.93G [00:27<01:06, 106MB/s][A

Downloading (…)l-00002-of-00003.bin:  29%|██▉       | 2.90G/9.93G [00:27<01:34, 74.3MB/s][A

Downloading (…)l-00002-of-00003.bin:  29%|██▉       | 2.92G/9.93G [00:28<01:29, 77.9MB/s][A

Downloading (…)l-00002-of-00003.bin:  30%|██▉       | 2.94G/9.93G [00:28<01:18, 89.0MB/s][A

Downloading (…)l-00002-of-00003.bin:  30%|██▉       | 2.96G/9.93G [00:28<01:10, 99.3MB/s][A

Downloading (…)l-00002-of-00003.bin:  30%|███       | 2.98G/9.93G [00:28<01:01, 113MB/s] [A

Downloading (…)l-00002-of-00003.bin:  30%|███       | 3.00G/9.93G [00:28<00:55, 125MB/s][A

Downloading (…)l-00002-of-00003.bin:  30%|███       | 3.02G/9.93G [00:28<00:50, 136MB/s][A

Downloading (…)l-00002-of-00003.bin:  31%|███       | 3.04G/9.93G [00:28<00:48, 143MB/s][A

Downloading (…)l-00002-of-00003.bin:  31%|███       | 3.06G/9.93G [00:29<00:52, 130MB/s][A

Downloading (…)l-00002-of-00003.bin:  31%|███       | 3.08G/9.93G [00:29<01:32, 74.2MB/s][A

Downloading (…)l-00002-of-00003.bin:  31%|███▏      | 3.10G/9.93G [00:29<01:23, 81.8MB/s][A

Downloading (…)l-00002-of-00003.bin:  31%|███▏      | 3.12G/9.93G [00:29<01:11, 95.7MB/s][A

Downloading (…)l-00002-of-00003.bin:  32%|███▏      | 3.15G/9.93G [00:30<01:02, 108MB/s] [A

Downloading (…)l-00002-of-00003.bin:  32%|███▏      | 3.17G/9.93G [00:30<00:57, 118MB/s][A

Downloading (…)l-00002-of-00003.bin:  32%|███▏      | 3.19G/9.93G [00:30<00:52, 129MB/s][A

Downloading (…)l-00002-of-00003.bin:  32%|███▏      | 3.21G/9.93G [00:30<00:49, 135MB/s][A

Downloading (…)l-00002-of-00003.bin:  33%|███▎      | 3.23G/9.93G [00:30<00:48, 138MB/s][A

Downloading (…)l-00002-of-00003.bin:  33%|███▎      | 3.25G/9.93G [00:30<01:00, 111MB/s][A

Downloading (…)l-00002-of-00003.bin:  33%|███▎      | 3.27G/9.93G [00:31<01:25, 77.9MB/s][A

Downloading (…)l-00002-of-00003.bin:  33%|███▎      | 3.28G/9.93G [00:31<01:23, 79.9MB/s][A

Downloading (…)l-00002-of-00003.bin:  33%|███▎      | 3.30G/9.93G [00:31<01:13, 89.8MB/s][A

Downloading (…)l-00002-of-00003.bin:  33%|███▎      | 3.32G/9.93G [00:32<01:30, 73.1MB/s][A

Downloading (…)l-00002-of-00003.bin:  34%|███▎      | 3.33G/9.93G [00:32<01:26, 76.6MB/s][A

Downloading (…)l-00002-of-00003.bin:  34%|███▎      | 3.34G/9.93G [00:32<01:21, 81.0MB/s][A

Downloading (…)l-00002-of-00003.bin:  34%|███▍      | 3.37G/9.93G [00:32<01:11, 91.9MB/s][A

Downloading (…)l-00002-of-00003.bin:  34%|███▍      | 3.38G/9.93G [00:32<01:22, 79.4MB/s][A

Downloading (…)l-00002-of-00003.bin:  34%|███▍      | 3.39G/9.93G [00:32<01:25, 76.3MB/s][A

Downloading (…)l-00002-of-00003.bin:  34%|███▍      | 3.41G/9.93G [00:32<01:09, 93.1MB/s][A

Downloading (…)l-00002-of-00003.bin:  35%|███▍      | 3.43G/9.93G [00:33<00:58, 110MB/s] [A

Downloading (…)l-00002-of-00003.bin:  35%|███▍      | 3.45G/9.93G [00:33<00:54, 119MB/s][A

Downloading (…)l-00002-of-00003.bin:  35%|███▍      | 3.47G/9.93G [00:33<00:50, 127MB/s][A

Downloading (…)l-00002-of-00003.bin:  35%|███▌      | 3.49G/9.93G [00:33<00:48, 131MB/s][A

Downloading (…)l-00002-of-00003.bin:  35%|███▌      | 3.51G/9.93G [00:33<00:48, 133MB/s][A

Downloading (…)l-00002-of-00003.bin:  36%|███▌      | 3.53G/9.93G [00:33<00:46, 139MB/s][A

Downloading (…)l-00002-of-00003.bin:  36%|███▌      | 3.55G/9.93G [00:34<01:06, 95.2MB/s][A

Downloading (…)l-00002-of-00003.bin:  36%|███▌      | 3.58G/9.93G [00:34<01:23, 76.2MB/s][A

Downloading (…)l-00002-of-00003.bin:  36%|███▌      | 3.60G/9.93G [00:34<01:11, 88.0MB/s][A

Downloading (…)l-00002-of-00003.bin:  36%|███▋      | 3.62G/9.93G [00:34<01:03, 99.7MB/s][A

Downloading (…)l-00002-of-00003.bin:  37%|███▋      | 3.64G/9.93G [00:35<00:56, 111MB/s] [A

Downloading (…)l-00002-of-00003.bin:  37%|███▋      | 3.66G/9.93G [00:35<00:52, 119MB/s][A

Downloading (…)l-00002-of-00003.bin:  37%|███▋      | 3.68G/9.93G [00:35<00:50, 125MB/s][A

Downloading (…)l-00002-of-00003.bin:  37%|███▋      | 3.70G/9.93G [00:35<00:48, 129MB/s][A

Downloading (…)l-00002-of-00003.bin:  38%|███▊      | 3.72G/9.93G [00:35<00:45, 135MB/s][A

Downloading (…)l-00002-of-00003.bin:  38%|███▊      | 3.74G/9.93G [00:36<01:23, 74.1MB/s][A

Downloading (…)l-00002-of-00003.bin:  38%|███▊      | 3.76G/9.93G [00:36<01:16, 80.8MB/s][A

Downloading (…)l-00002-of-00003.bin:  38%|███▊      | 3.79G/9.93G [00:36<01:07, 90.9MB/s][A

Downloading (…)l-00002-of-00003.bin:  38%|███▊      | 3.81G/9.93G [00:36<01:01, 100MB/s] [A

Downloading (…)l-00002-of-00003.bin:  39%|███▊      | 3.83G/9.93G [00:36<00:55, 110MB/s][A

Downloading (…)l-00002-of-00003.bin:  39%|███▉      | 3.85G/9.93G [00:37<00:52, 116MB/s][A

Downloading (…)l-00002-of-00003.bin:  39%|███▉      | 3.87G/9.93G [00:37<00:49, 121MB/s][A

Downloading (…)l-00002-of-00003.bin:  39%|███▉      | 3.89G/9.93G [00:37<00:54, 110MB/s][A

Downloading (…)l-00002-of-00003.bin:  39%|███▉      | 3.91G/9.93G [00:37<00:50, 118MB/s][A

Downloading (…)l-00002-of-00003.bin:  40%|███▉      | 3.93G/9.93G [00:37<00:49, 122MB/s][A

Downloading (…)l-00002-of-00003.bin:  40%|███▉      | 3.95G/9.93G [00:37<00:49, 121MB/s][A

Downloading (…)l-00002-of-00003.bin:  40%|████      | 3.97G/9.93G [00:38<00:48, 123MB/s][A

Downloading (…)l-00002-of-00003.bin:  40%|████      | 4.00G/9.93G [00:38<00:48, 123MB/s][A

Downloading (…)l-00002-of-00003.bin:  40%|████      | 4.02G/9.93G [00:38<00:46, 127MB/s][A

Downloading (…)l-00002-of-00003.bin:  41%|████      | 4.04G/9.93G [00:38<00:42, 137MB/s][A

Downloading (…)l-00002-of-00003.bin:  41%|████      | 4.06G/9.93G [00:38<00:43, 136MB/s][A

Downloading (…)l-00002-of-00003.bin:  41%|████      | 4.08G/9.93G [00:38<00:45, 129MB/s][A

Downloading (…)l-00002-of-00003.bin:  41%|████▏     | 4.10G/9.93G [00:38<00:42, 138MB/s][A

Downloading (…)l-00002-of-00003.bin:  42%|████▏     | 4.12G/9.93G [00:39<00:41, 139MB/s][A

Downloading (…)l-00002-of-00003.bin:  42%|████▏     | 4.14G/9.93G [00:39<00:41, 140MB/s][A

Downloading (…)l-00002-of-00003.bin:  42%|████▏     | 4.16G/9.93G [00:39<00:40, 144MB/s][A

Downloading (…)l-00002-of-00003.bin:  42%|████▏     | 4.18G/9.93G [00:39<00:40, 141MB/s][A

Downloading (…)l-00002-of-00003.bin:  42%|████▏     | 4.20G/9.93G [00:39<00:39, 145MB/s][A

Downloading (…)l-00002-of-00003.bin:  43%|████▎     | 4.23G/9.93G [00:39<00:39, 143MB/s][A

Downloading (…)l-00002-of-00003.bin:  43%|████▎     | 4.25G/9.93G [00:40<00:39, 144MB/s][A

Downloading (…)l-00002-of-00003.bin:  43%|████▎     | 4.27G/9.93G [00:40<01:16, 74.2MB/s][A

Downloading (…)l-00002-of-00003.bin:  43%|████▎     | 4.29G/9.93G [00:40<01:04, 86.9MB/s][A

Downloading (…)l-00002-of-00003.bin:  43%|████▎     | 4.31G/9.93G [00:40<00:55, 101MB/s] [A

Downloading (…)l-00002-of-00003.bin:  44%|████▎     | 4.33G/9.93G [00:41<00:51, 109MB/s][A

Downloading (…)l-00002-of-00003.bin:  44%|████▍     | 4.35G/9.93G [00:41<00:47, 118MB/s][A

Downloading (…)l-00002-of-00003.bin:  44%|████▍     | 4.37G/9.93G [00:41<00:43, 128MB/s][A

Downloading (…)l-00002-of-00003.bin:  44%|████▍     | 4.39G/9.93G [00:41<00:41, 135MB/s][A

Downloading (…)l-00002-of-00003.bin:  44%|████▍     | 4.41G/9.93G [00:41<00:39, 138MB/s][A

Downloading (…)l-00002-of-00003.bin:  45%|████▍     | 4.44G/9.93G [00:42<01:03, 86.3MB/s][A

Downloading (…)l-00002-of-00003.bin:  45%|████▍     | 4.46G/9.93G [00:42<01:14, 73.3MB/s][A

Downloading (…)l-00002-of-00003.bin:  45%|████▌     | 4.48G/9.93G [00:42<01:04, 84.8MB/s][A

Downloading (…)l-00002-of-00003.bin:  45%|████▌     | 4.50G/9.93G [00:42<00:56, 95.7MB/s][A

Downloading (…)l-00002-of-00003.bin:  46%|████▌     | 4.52G/9.93G [00:42<00:52, 103MB/s] [A

Downloading (…)l-00002-of-00003.bin:  46%|████▌     | 4.54G/9.93G [00:43<00:47, 114MB/s][A

Downloading (…)l-00002-of-00003.bin:  46%|████▌     | 4.56G/9.93G [00:43<00:44, 120MB/s][A

Downloading (…)l-00002-of-00003.bin:  46%|████▌     | 4.58G/9.93G [00:43<00:42, 126MB/s][A

Downloading (…)l-00002-of-00003.bin:  46%|████▋     | 4.60G/9.93G [00:43<00:40, 131MB/s][A

Downloading (…)l-00002-of-00003.bin:  47%|████▋     | 4.62G/9.93G [00:43<00:40, 131MB/s][A

Downloading (…)l-00002-of-00003.bin:  47%|████▋     | 4.65G/9.93G [00:43<00:38, 136MB/s][A

Downloading (…)l-00002-of-00003.bin:  47%|████▋     | 4.67G/9.93G [00:43<00:39, 133MB/s][A

Downloading (…)l-00002-of-00003.bin:  47%|████▋     | 4.69G/9.93G [00:44<00:37, 138MB/s][A

Downloading (…)l-00002-of-00003.bin:  47%|████▋     | 4.71G/9.93G [00:44<00:37, 138MB/s][A

Downloading (…)l-00002-of-00003.bin:  48%|████▊     | 4.73G/9.93G [00:44<00:36, 142MB/s][A

Downloading (…)l-00002-of-00003.bin:  48%|████▊     | 4.75G/9.93G [00:44<00:35, 147MB/s][A

Downloading (…)l-00002-of-00003.bin:  48%|████▊     | 4.77G/9.93G [00:44<00:35, 145MB/s][A

Downloading (…)l-00002-of-00003.bin:  48%|████▊     | 4.79G/9.93G [00:44<00:49, 105MB/s][A

Downloading (…)l-00002-of-00003.bin:  48%|████▊     | 4.81G/9.93G [00:45<00:44, 115MB/s][A

Downloading (…)l-00002-of-00003.bin:  49%|████▊     | 4.83G/9.93G [00:45<00:41, 122MB/s][A

Downloading (…)l-00002-of-00003.bin:  49%|████▉     | 4.85G/9.93G [00:45<00:39, 127MB/s][A

Downloading (…)l-00002-of-00003.bin:  49%|████▉     | 4.88G/9.93G [00:45<00:38, 132MB/s][A

Downloading (…)l-00002-of-00003.bin:  49%|████▉     | 4.90G/9.93G [00:45<00:38, 131MB/s][A

Downloading (…)l-00002-of-00003.bin:  50%|████▉     | 4.92G/9.93G [00:45<00:38, 129MB/s][A

Downloading (…)l-00002-of-00003.bin:  50%|████▉     | 4.94G/9.93G [00:46<00:36, 136MB/s][A

Downloading (…)l-00002-of-00003.bin:  50%|████▉     | 4.96G/9.93G [00:46<00:48, 102MB/s][A

Downloading (…)l-00002-of-00003.bin:  50%|█████     | 4.98G/9.93G [00:46<01:04, 76.5MB/s][A

Downloading (…)l-00002-of-00003.bin:  50%|█████     | 5.00G/9.93G [00:46<00:54, 89.8MB/s][A

Downloading (…)l-00002-of-00003.bin:  51%|█████     | 5.02G/9.93G [00:47<00:48, 101MB/s] [A

Downloading (…)l-00002-of-00003.bin:  51%|█████     | 5.04G/9.93G [00:47<00:43, 111MB/s][A

Downloading (…)l-00002-of-00003.bin:  51%|█████     | 5.06G/9.93G [00:47<00:40, 119MB/s][A

Downloading (…)l-00002-of-00003.bin:  51%|█████     | 5.09G/9.93G [00:47<00:39, 123MB/s][A

Downloading (…)l-00002-of-00003.bin:  51%|█████▏    | 5.11G/9.93G [00:47<00:38, 126MB/s][A

Downloading (…)l-00002-of-00003.bin:  52%|█████▏    | 5.13G/9.93G [00:47<00:37, 126MB/s][A

Downloading (…)l-00002-of-00003.bin:  52%|█████▏    | 5.15G/9.93G [00:48<00:56, 85.2MB/s][A

Downloading (…)l-00002-of-00003.bin:  52%|█████▏    | 5.17G/9.93G [00:48<00:57, 83.0MB/s][A

Downloading (…)l-00002-of-00003.bin:  52%|█████▏    | 5.18G/9.93G [00:48<00:55, 85.1MB/s][A

Downloading (…)l-00002-of-00003.bin:  52%|█████▏    | 5.20G/9.93G [00:48<00:49, 96.4MB/s][A

Downloading (…)l-00002-of-00003.bin:  53%|█████▎    | 5.22G/9.93G [00:48<00:42, 110MB/s] [A

Downloading (…)l-00002-of-00003.bin:  53%|█████▎    | 5.24G/9.93G [00:49<00:37, 123MB/s][A

Downloading (…)l-00002-of-00003.bin:  53%|█████▎    | 5.26G/9.93G [00:49<00:35, 132MB/s][A

Downloading (…)l-00002-of-00003.bin:  53%|█████▎    | 5.28G/9.93G [00:49<00:33, 138MB/s][A

Downloading (…)l-00002-of-00003.bin:  53%|█████▎    | 5.31G/9.93G [00:49<00:32, 144MB/s][A

Downloading (…)l-00002-of-00003.bin:  54%|█████▎    | 5.33G/9.93G [00:49<00:31, 145MB/s][A

Downloading (…)l-00002-of-00003.bin:  54%|█████▍    | 5.35G/9.93G [00:49<00:31, 143MB/s][A

Downloading (…)l-00002-of-00003.bin:  54%|█████▍    | 5.37G/9.93G [00:49<00:31, 146MB/s][A

Downloading (…)l-00002-of-00003.bin:  54%|█████▍    | 5.39G/9.93G [00:50<00:30, 151MB/s][A

Downloading (…)l-00002-of-00003.bin:  55%|█████▍    | 5.41G/9.93G [00:50<00:28, 157MB/s][A

Downloading (…)l-00002-of-00003.bin:  55%|█████▍    | 5.43G/9.93G [00:50<00:28, 158MB/s][A

Downloading (…)l-00002-of-00003.bin:  55%|█████▍    | 5.45G/9.93G [00:50<00:29, 149MB/s][A

Downloading (…)l-00002-of-00003.bin:  55%|█████▌    | 5.47G/9.93G [00:50<00:42, 104MB/s][A

Downloading (…)l-00002-of-00003.bin:  55%|█████▌    | 5.49G/9.93G [00:51<01:01, 72.0MB/s][A

Downloading (…)l-00002-of-00003.bin:  56%|█████▌    | 5.52G/9.93G [00:51<00:53, 82.1MB/s][A

Downloading (…)l-00002-of-00003.bin:  56%|█████▌    | 5.54G/9.93G [00:51<00:47, 93.2MB/s][A

Downloading (…)l-00002-of-00003.bin:  56%|█████▌    | 5.56G/9.93G [00:51<00:41, 104MB/s] [A

Downloading (…)l-00002-of-00003.bin:  56%|█████▌    | 5.58G/9.93G [00:51<00:38, 112MB/s][A

Downloading (…)l-00002-of-00003.bin:  56%|█████▋    | 5.60G/9.93G [00:52<00:36, 120MB/s][A

Downloading (…)l-00002-of-00003.bin:  57%|█████▋    | 5.62G/9.93G [00:52<00:35, 122MB/s][A

Downloading (…)l-00002-of-00003.bin:  57%|█████▋    | 5.64G/9.93G [00:52<00:39, 108MB/s][A

Downloading (…)l-00002-of-00003.bin:  57%|█████▋    | 5.66G/9.93G [00:52<00:56, 75.2MB/s][A

Downloading (…)l-00002-of-00003.bin:  57%|█████▋    | 5.68G/9.93G [00:53<00:47, 88.6MB/s][A

Downloading (…)l-00002-of-00003.bin:  57%|█████▋    | 5.70G/9.93G [00:53<00:41, 101MB/s] [A

Downloading (…)l-00002-of-00003.bin:  58%|█████▊    | 5.73G/9.93G [00:53<00:37, 111MB/s][A

Downloading (…)l-00002-of-00003.bin:  58%|█████▊    | 5.75G/9.93G [00:53<00:34, 120MB/s][A

Downloading (…)l-00002-of-00003.bin:  58%|█████▊    | 5.77G/9.93G [00:53<00:32, 129MB/s][A

Downloading (…)l-00002-of-00003.bin:  58%|█████▊    | 5.79G/9.93G [00:53<00:30, 135MB/s][A

Downloading (…)l-00002-of-00003.bin:  59%|█████▊    | 5.81G/9.93G [00:53<00:29, 139MB/s][A

Downloading (…)l-00002-of-00003.bin:  59%|█████▊    | 5.83G/9.93G [00:54<00:29, 141MB/s][A

Downloading (…)l-00002-of-00003.bin:  59%|█████▉    | 5.85G/9.93G [00:54<00:58, 69.1MB/s][A

Downloading (…)l-00002-of-00003.bin:  59%|█████▉    | 5.87G/9.93G [00:54<00:49, 81.9MB/s][A

Downloading (…)l-00002-of-00003.bin:  59%|█████▉    | 5.89G/9.93G [00:55<00:42, 95.6MB/s][A

Downloading (…)l-00002-of-00003.bin:  60%|█████▉    | 5.91G/9.93G [00:55<00:38, 105MB/s] [A

Downloading (…)l-00002-of-00003.bin:  60%|█████▉    | 5.93G/9.93G [00:55<00:35, 114MB/s][A

Downloading (…)l-00002-of-00003.bin:  60%|██████    | 5.96G/9.93G [00:55<00:33, 120MB/s][A

Downloading (…)l-00002-of-00003.bin:  60%|██████    | 5.98G/9.93G [00:55<00:32, 122MB/s][A

Downloading (…)l-00002-of-00003.bin:  60%|██████    | 6.00G/9.93G [00:55<00:31, 126MB/s][A

Downloading (…)l-00002-of-00003.bin:  61%|██████    | 6.02G/9.93G [00:56<00:43, 89.4MB/s][A

Downloading (…)l-00002-of-00003.bin:  61%|██████    | 6.04G/9.93G [00:56<00:38, 101MB/s] [A

Downloading (…)l-00002-of-00003.bin:  61%|██████    | 6.06G/9.93G [00:56<00:34, 112MB/s][A

Downloading (…)l-00002-of-00003.bin:  61%|██████▏   | 6.08G/9.93G [00:56<00:31, 122MB/s][A

Downloading (…)l-00002-of-00003.bin:  61%|██████▏   | 6.10G/9.93G [00:56<00:29, 129MB/s][A

Downloading (…)l-00002-of-00003.bin:  62%|██████▏   | 6.12G/9.93G [00:56<00:28, 133MB/s][A

Downloading (…)l-00002-of-00003.bin:  62%|██████▏   | 6.14G/9.93G [00:57<00:26, 141MB/s][A

Downloading (…)l-00002-of-00003.bin:  62%|██████▏   | 6.17G/9.93G [00:57<00:25, 148MB/s][A

Downloading (…)l-00002-of-00003.bin:  62%|██████▏   | 6.19G/9.93G [00:57<00:24, 152MB/s][A

Downloading (…)l-00002-of-00003.bin:  63%|██████▎   | 6.21G/9.93G [00:57<00:25, 146MB/s][A

Downloading (…)l-00002-of-00003.bin:  63%|██████▎   | 6.23G/9.93G [00:57<00:25, 143MB/s][A

Downloading (…)l-00002-of-00003.bin:  63%|██████▎   | 6.25G/9.93G [00:57<00:25, 141MB/s][A

Downloading (…)l-00002-of-00003.bin:  63%|██████▎   | 6.27G/9.93G [00:57<00:25, 144MB/s][A

Downloading (…)l-00002-of-00003.bin:  63%|██████▎   | 6.29G/9.93G [00:58<00:24, 148MB/s][A

Downloading (…)l-00002-of-00003.bin:  64%|██████▎   | 6.31G/9.93G [00:58<00:23, 151MB/s][A

Downloading (…)l-00002-of-00003.bin:  64%|██████▍   | 6.33G/9.93G [00:58<00:23, 153MB/s][A

Downloading (…)l-00002-of-00003.bin:  64%|██████▍   | 6.35G/9.93G [00:58<00:22, 156MB/s][A

Downloading (…)l-00002-of-00003.bin:  64%|██████▍   | 6.38G/9.93G [00:58<00:22, 161MB/s][A

Downloading (…)l-00002-of-00003.bin:  64%|██████▍   | 6.40G/9.93G [00:59<00:38, 91.1MB/s][A

Downloading (…)l-00002-of-00003.bin:  65%|██████▍   | 6.42G/9.93G [00:59<00:33, 103MB/s] [A

Downloading (…)l-00002-of-00003.bin:  65%|██████▍   | 6.44G/9.93G [00:59<00:29, 117MB/s][A

Downloading (…)l-00002-of-00003.bin:  65%|██████▌   | 6.46G/9.93G [00:59<00:26, 129MB/s][A

Downloading (…)l-00002-of-00003.bin:  65%|██████▌   | 6.48G/9.93G [00:59<00:24, 140MB/s][A

Downloading (…)l-00002-of-00003.bin:  65%|██████▌   | 6.50G/9.93G [00:59<00:23, 145MB/s][A

Downloading (…)l-00002-of-00003.bin:  66%|██████▌   | 6.52G/9.93G [00:59<00:22, 150MB/s][A

Downloading (…)l-00002-of-00003.bin:  66%|██████▌   | 6.54G/9.93G [00:59<00:22, 150MB/s][A

Downloading (…)l-00002-of-00003.bin:  66%|██████▌   | 6.56G/9.93G [01:00<00:21, 153MB/s][A

Downloading (…)l-00002-of-00003.bin:  66%|██████▋   | 6.59G/9.93G [01:00<00:21, 153MB/s][A

Downloading (…)l-00002-of-00003.bin:  67%|██████▋   | 6.61G/9.93G [01:00<00:21, 153MB/s][A

Downloading (…)l-00002-of-00003.bin:  67%|██████▋   | 6.63G/9.93G [01:00<00:21, 151MB/s][A

Downloading (…)l-00002-of-00003.bin:  67%|██████▋   | 6.65G/9.93G [01:00<00:22, 146MB/s][A

Downloading (…)l-00002-of-00003.bin:  67%|██████▋   | 6.67G/9.93G [01:00<00:22, 145MB/s][A

Downloading (…)l-00002-of-00003.bin:  67%|██████▋   | 6.69G/9.93G [01:00<00:22, 146MB/s][A

Downloading (…)l-00002-of-00003.bin:  68%|██████▊   | 6.71G/9.93G [01:01<00:21, 148MB/s][A

Downloading (…)l-00002-of-00003.bin:  68%|██████▊   | 6.73G/9.93G [01:01<00:31, 100MB/s][A

Downloading (…)l-00002-of-00003.bin:  68%|██████▊   | 6.75G/9.93G [01:01<00:27, 114MB/s][A

Downloading (…)l-00002-of-00003.bin:  68%|██████▊   | 6.77G/9.93G [01:01<00:25, 126MB/s][A

Downloading (…)l-00002-of-00003.bin:  68%|██████▊   | 6.79G/9.93G [01:01<00:23, 131MB/s][A

Downloading (…)l-00002-of-00003.bin:  69%|██████▊   | 6.82G/9.93G [01:01<00:22, 139MB/s][A

Downloading (…)l-00002-of-00003.bin:  69%|██████▉   | 6.84G/9.93G [01:02<00:21, 147MB/s][A

Downloading (…)l-00002-of-00003.bin:  69%|██████▉   | 6.86G/9.93G [01:02<00:20, 150MB/s][A

Downloading (…)l-00002-of-00003.bin:  69%|██████▉   | 6.88G/9.93G [01:02<00:19, 154MB/s][A

Downloading (…)l-00002-of-00003.bin:  70%|██████▉   | 6.90G/9.93G [01:02<00:19, 158MB/s][A

Downloading (…)l-00002-of-00003.bin:  70%|██████▉   | 6.92G/9.93G [01:02<00:18, 160MB/s][A

Downloading (…)l-00002-of-00003.bin:  70%|██████▉   | 6.94G/9.93G [01:02<00:19, 157MB/s][A

Downloading (…)l-00002-of-00003.bin:  70%|███████   | 6.96G/9.93G [01:02<00:18, 157MB/s][A

Downloading (…)l-00002-of-00003.bin:  70%|███████   | 6.98G/9.93G [01:02<00:18, 158MB/s][A

Downloading (…)l-00002-of-00003.bin:  71%|███████   | 7.00G/9.93G [01:03<00:18, 158MB/s][A

Downloading (…)l-00002-of-00003.bin:  71%|███████   | 7.03G/9.93G [01:03<00:17, 162MB/s][A

Downloading (…)l-00002-of-00003.bin:  71%|███████   | 7.05G/9.93G [01:03<00:17, 161MB/s][A

Downloading (…)l-00002-of-00003.bin:  71%|███████   | 7.07G/9.93G [01:03<00:17, 160MB/s][A

Downloading (…)l-00002-of-00003.bin:  71%|███████▏  | 7.09G/9.93G [01:03<00:17, 160MB/s][A

Downloading (…)l-00002-of-00003.bin:  72%|███████▏  | 7.11G/9.93G [01:03<00:18, 151MB/s][A

Downloading (…)l-00002-of-00003.bin:  72%|███████▏  | 7.13G/9.93G [01:03<00:18, 151MB/s][A

Downloading (…)l-00002-of-00003.bin:  72%|███████▏  | 7.15G/9.93G [01:04<00:18, 151MB/s][A

Downloading (…)l-00002-of-00003.bin:  72%|███████▏  | 7.17G/9.93G [01:04<00:17, 153MB/s][A

Downloading (…)l-00002-of-00003.bin:  72%|███████▏  | 7.19G/9.93G [01:04<00:17, 153MB/s][A

Downloading (…)l-00002-of-00003.bin:  73%|███████▎  | 7.21G/9.93G [01:04<00:33, 81.6MB/s][A

Downloading (…)l-00002-of-00003.bin:  73%|███████▎  | 7.24G/9.93G [01:05<00:31, 84.6MB/s][A

Downloading (…)l-00002-of-00003.bin:  73%|███████▎  | 7.26G/9.93G [01:05<00:27, 96.5MB/s][A

Downloading (…)l-00002-of-00003.bin:  73%|███████▎  | 7.28G/9.93G [01:05<00:24, 109MB/s] [A

Downloading (…)l-00002-of-00003.bin:  74%|███████▎  | 7.30G/9.93G [01:05<00:21, 121MB/s][A

Downloading (…)l-00002-of-00003.bin:  74%|███████▎  | 7.32G/9.93G [01:05<00:20, 127MB/s][A

Downloading (…)l-00002-of-00003.bin:  74%|███████▍  | 7.34G/9.93G [01:05<00:19, 132MB/s][A

Downloading (…)l-00002-of-00003.bin:  74%|███████▍  | 7.36G/9.93G [01:05<00:18, 138MB/s][A

Downloading (…)l-00002-of-00003.bin:  74%|███████▍  | 7.38G/9.93G [01:06<00:18, 136MB/s][A

Downloading (…)l-00002-of-00003.bin:  75%|███████▍  | 7.40G/9.93G [01:06<00:31, 81.3MB/s][A

Downloading (…)l-00002-of-00003.bin:  75%|███████▍  | 7.42G/9.93G [01:06<00:33, 74.0MB/s][A

Downloading (…)l-00002-of-00003.bin:  75%|███████▌  | 7.44G/9.93G [01:07<00:28, 86.2MB/s][A

Downloading (…)l-00002-of-00003.bin:  75%|███████▌  | 7.47G/9.93G [01:07<00:25, 97.1MB/s][A

Downloading (…)l-00002-of-00003.bin:  75%|███████▌  | 7.49G/9.93G [01:07<00:22, 108MB/s] [A

Downloading (…)l-00002-of-00003.bin:  76%|███████▌  | 7.51G/9.93G [01:07<00:21, 115MB/s][A

Downloading (…)l-00002-of-00003.bin:  76%|███████▌  | 7.53G/9.93G [01:07<00:19, 123MB/s][A

Downloading (…)l-00002-of-00003.bin:  76%|███████▌  | 7.55G/9.93G [01:07<00:18, 132MB/s][A

Downloading (…)l-00002-of-00003.bin:  76%|███████▋  | 7.57G/9.93G [01:08<00:23, 102MB/s][A

Downloading (…)l-00002-of-00003.bin:  76%|███████▋  | 7.59G/9.93G [01:08<00:20, 112MB/s][A

Downloading (…)l-00002-of-00003.bin:  77%|███████▋  | 7.61G/9.93G [01:08<00:19, 120MB/s][A

Downloading (…)l-00002-of-00003.bin:  77%|███████▋  | 7.63G/9.93G [01:08<00:17, 128MB/s][A

Downloading (…)l-00002-of-00003.bin:  77%|███████▋  | 7.65G/9.93G [01:08<00:17, 133MB/s][A

Downloading (…)l-00002-of-00003.bin:  77%|███████▋  | 7.68G/9.93G [01:08<00:16, 140MB/s][A

Downloading (…)l-00002-of-00003.bin:  78%|███████▊  | 7.70G/9.93G [01:08<00:15, 147MB/s][A

Downloading (…)l-00002-of-00003.bin:  78%|███████▊  | 7.72G/9.93G [01:09<00:15, 147MB/s][A

Downloading (…)l-00002-of-00003.bin:  78%|███████▊  | 7.74G/9.93G [01:09<00:14, 152MB/s][A

Downloading (…)l-00002-of-00003.bin:  78%|███████▊  | 7.76G/9.93G [01:09<00:19, 110MB/s][A

Downloading (…)l-00002-of-00003.bin:  78%|███████▊  | 7.78G/9.93G [01:09<00:18, 119MB/s][A

Downloading (…)l-00002-of-00003.bin:  79%|███████▊  | 7.80G/9.93G [01:09<00:16, 130MB/s][A

Downloading (…)l-00002-of-00003.bin:  79%|███████▉  | 7.82G/9.93G [01:09<00:15, 135MB/s][A

Downloading (…)l-00002-of-00003.bin:  79%|███████▉  | 7.84G/9.93G [01:10<00:15, 137MB/s][A

Downloading (…)l-00002-of-00003.bin:  79%|███████▉  | 7.86G/9.93G [01:10<00:14, 147MB/s][A

Downloading (…)l-00002-of-00003.bin:  79%|███████▉  | 7.89G/9.93G [01:10<00:13, 151MB/s][A

Downloading (…)l-00002-of-00003.bin:  80%|███████▉  | 7.91G/9.93G [01:10<00:12, 157MB/s][A

Downloading (…)l-00002-of-00003.bin:  80%|███████▉  | 7.93G/9.93G [01:10<00:12, 159MB/s][A

Downloading (…)l-00002-of-00003.bin:  80%|████████  | 7.95G/9.93G [01:10<00:14, 135MB/s][A

Downloading (…)l-00002-of-00003.bin:  80%|████████  | 7.97G/9.93G [01:10<00:14, 132MB/s][A

Downloading (…)l-00002-of-00003.bin:  80%|████████  | 7.99G/9.93G [01:11<00:14, 133MB/s][A

Downloading (…)l-00002-of-00003.bin:  81%|████████  | 8.01G/9.93G [01:11<00:14, 135MB/s][A

Downloading (…)l-00002-of-00003.bin:  81%|████████  | 8.03G/9.93G [01:11<00:20, 92.7MB/s][A

Downloading (…)l-00002-of-00003.bin:  81%|████████  | 8.05G/9.93G [01:11<00:17, 104MB/s] [A

Downloading (…)l-00002-of-00003.bin:  81%|████████▏ | 8.07G/9.93G [01:11<00:16, 115MB/s][A

Downloading (…)l-00002-of-00003.bin:  82%|████████▏ | 8.10G/9.93G [01:12<00:14, 124MB/s][A

Downloading (…)l-00002-of-00003.bin:  82%|████████▏ | 8.12G/9.93G [01:12<00:13, 131MB/s][A

Downloading (…)l-00002-of-00003.bin:  82%|████████▏ | 8.14G/9.93G [01:12<00:13, 137MB/s][A

Downloading (…)l-00002-of-00003.bin:  82%|████████▏ | 8.16G/9.93G [01:12<00:12, 144MB/s][A

Downloading (…)l-00002-of-00003.bin:  82%|████████▏ | 8.18G/9.93G [01:12<00:11, 148MB/s][A

Downloading (…)l-00002-of-00003.bin:  83%|████████▎ | 8.20G/9.93G [01:12<00:11, 153MB/s][A

Downloading (…)l-00002-of-00003.bin:  83%|████████▎ | 8.22G/9.93G [01:12<00:11, 155MB/s][A

Downloading (…)l-00002-of-00003.bin:  83%|████████▎ | 8.24G/9.93G [01:13<00:11, 152MB/s][A

Downloading (…)l-00002-of-00003.bin:  83%|████████▎ | 8.26G/9.93G [01:13<00:10, 155MB/s][A

Downloading (…)l-00002-of-00003.bin:  83%|████████▎ | 8.28G/9.93G [01:13<00:10, 158MB/s][A

Downloading (…)l-00002-of-00003.bin:  84%|████████▎ | 8.30G/9.93G [01:13<00:09, 163MB/s][A

Downloading (…)l-00002-of-00003.bin:  84%|████████▍ | 8.33G/9.93G [01:13<00:09, 165MB/s][A

Downloading (…)l-00002-of-00003.bin:  84%|████████▍ | 8.35G/9.93G [01:13<00:09, 162MB/s][A

Downloading (…)l-00002-of-00003.bin:  84%|████████▍ | 8.37G/9.93G [01:13<00:09, 162MB/s][A

Downloading (…)l-00002-of-00003.bin:  85%|████████▍ | 8.39G/9.93G [01:14<00:12, 127MB/s][A

Downloading (…)l-00002-of-00003.bin:  85%|████████▍ | 8.41G/9.93G [01:14<00:11, 137MB/s][A

Downloading (…)l-00002-of-00003.bin:  85%|████████▍ | 8.43G/9.93G [01:14<00:10, 144MB/s][A

Downloading (…)l-00002-of-00003.bin:  85%|████████▌ | 8.45G/9.93G [01:14<00:09, 149MB/s][A

Downloading (…)l-00002-of-00003.bin:  85%|████████▌ | 8.47G/9.93G [01:14<00:09, 154MB/s][A

Downloading (…)l-00002-of-00003.bin:  86%|████████▌ | 8.49G/9.93G [01:14<00:09, 150MB/s][A

Downloading (…)l-00002-of-00003.bin:  86%|████████▌ | 8.51G/9.93G [01:14<00:09, 154MB/s][A

Downloading (…)l-00002-of-00003.bin:  86%|████████▌ | 8.54G/9.93G [01:14<00:08, 157MB/s][A

Downloading (…)l-00002-of-00003.bin:  86%|████████▌ | 8.56G/9.93G [01:15<00:08, 158MB/s][A

Downloading (…)l-00002-of-00003.bin:  86%|████████▋ | 8.58G/9.93G [01:15<00:10, 126MB/s][A

Downloading (…)l-00002-of-00003.bin:  87%|████████▋ | 8.60G/9.93G [01:15<00:09, 135MB/s][A

Downloading (…)l-00002-of-00003.bin:  87%|████████▋ | 8.62G/9.93G [01:15<00:09, 144MB/s][A

Downloading (…)l-00002-of-00003.bin:  87%|████████▋ | 8.64G/9.93G [01:15<00:08, 145MB/s][A

Downloading (…)l-00002-of-00003.bin:  87%|████████▋ | 8.66G/9.93G [01:15<00:08, 148MB/s][A

Downloading (…)l-00002-of-00003.bin:  87%|████████▋ | 8.68G/9.93G [01:16<00:08, 145MB/s][A

Downloading (…)l-00002-of-00003.bin:  88%|████████▊ | 8.70G/9.93G [01:16<00:08, 143MB/s][A

Downloading (…)l-00002-of-00003.bin:  88%|████████▊ | 8.72G/9.93G [01:16<00:08, 136MB/s][A

Downloading (…)l-00002-of-00003.bin:  88%|████████▊ | 8.75G/9.93G [01:16<00:08, 137MB/s][A

Downloading (…)l-00002-of-00003.bin:  88%|████████▊ | 8.77G/9.93G [01:16<00:08, 140MB/s][A

Downloading (…)l-00002-of-00003.bin:  89%|████████▊ | 8.79G/9.93G [01:16<00:08, 138MB/s][A

Downloading (…)l-00002-of-00003.bin:  89%|████████▊ | 8.81G/9.93G [01:16<00:07, 141MB/s][A

Downloading (…)l-00002-of-00003.bin:  89%|████████▉ | 8.83G/9.93G [01:17<00:07, 145MB/s][A

Downloading (…)l-00002-of-00003.bin:  89%|████████▉ | 8.85G/9.93G [01:17<00:07, 146MB/s][A

Downloading (…)l-00002-of-00003.bin:  89%|████████▉ | 8.87G/9.93G [01:17<00:07, 149MB/s][A

Downloading (…)l-00002-of-00003.bin:  90%|████████▉ | 8.89G/9.93G [01:17<00:06, 149MB/s][A

Downloading (…)l-00002-of-00003.bin:  90%|████████▉ | 8.91G/9.93G [01:17<00:07, 135MB/s][A

Downloading (…)l-00002-of-00003.bin:  90%|█████████ | 8.93G/9.93G [01:17<00:07, 142MB/s][A

Downloading (…)l-00002-of-00003.bin:  90%|█████████ | 8.95G/9.93G [01:17<00:06, 145MB/s][A

Downloading (…)l-00002-of-00003.bin:  90%|█████████ | 8.98G/9.93G [01:18<00:06, 152MB/s][A

Downloading (…)l-00002-of-00003.bin:  91%|█████████ | 9.00G/9.93G [01:18<00:06, 154MB/s][A

Downloading (…)l-00002-of-00003.bin:  91%|█████████ | 9.02G/9.93G [01:18<00:05, 158MB/s][A

Downloading (…)l-00002-of-00003.bin:  91%|█████████ | 9.04G/9.93G [01:18<00:05, 163MB/s][A

Downloading (…)l-00002-of-00003.bin:  91%|█████████▏| 9.06G/9.93G [01:18<00:05, 163MB/s][A

Downloading (…)l-00002-of-00003.bin:  91%|█████████▏| 9.08G/9.93G [01:18<00:05, 165MB/s][A

Downloading (…)l-00002-of-00003.bin:  92%|█████████▏| 9.10G/9.93G [01:18<00:05, 159MB/s][A

Downloading (…)l-00002-of-00003.bin:  92%|█████████▏| 9.12G/9.93G [01:18<00:04, 161MB/s][A

Downloading (…)l-00002-of-00003.bin:  92%|█████████▏| 9.14G/9.93G [01:19<00:04, 162MB/s][A

Downloading (…)l-00002-of-00003.bin:  92%|█████████▏| 9.16G/9.93G [01:19<00:04, 163MB/s][A

Downloading (…)l-00002-of-00003.bin:  93%|█████████▎| 9.19G/9.93G [01:19<00:04, 159MB/s][A

Downloading (…)l-00002-of-00003.bin:  93%|█████████▎| 9.21G/9.93G [01:19<00:04, 159MB/s][A

Downloading (…)l-00002-of-00003.bin:  93%|█████████▎| 9.23G/9.93G [01:19<00:04, 155MB/s][A

Downloading (…)l-00002-of-00003.bin:  93%|█████████▎| 9.25G/9.93G [01:19<00:04, 154MB/s][A

Downloading (…)l-00002-of-00003.bin:  93%|█████████▎| 9.27G/9.93G [01:19<00:04, 156MB/s][A

Downloading (…)l-00002-of-00003.bin:  94%|█████████▎| 9.29G/9.93G [01:20<00:04, 152MB/s][A

Downloading (…)l-00002-of-00003.bin:  94%|█████████▍| 9.31G/9.93G [01:20<00:03, 155MB/s][A

Downloading (…)l-00002-of-00003.bin:  94%|█████████▍| 9.33G/9.93G [01:20<00:03, 159MB/s][A

Downloading (…)l-00002-of-00003.bin:  94%|█████████▍| 9.35G/9.93G [01:20<00:03, 159MB/s][A

Downloading (…)l-00002-of-00003.bin:  94%|█████████▍| 9.37G/9.93G [01:20<00:03, 162MB/s][A

Downloading (…)l-00002-of-00003.bin:  95%|█████████▍| 9.40G/9.93G [01:20<00:03, 159MB/s][A

Downloading (…)l-00002-of-00003.bin:  95%|█████████▍| 9.42G/9.93G [01:20<00:03, 163MB/s][A

Downloading (…)l-00002-of-00003.bin:  95%|█████████▌| 9.44G/9.93G [01:20<00:02, 166MB/s][A

Downloading (…)l-00002-of-00003.bin:  95%|█████████▌| 9.46G/9.93G [01:21<00:02, 157MB/s][A

Downloading (…)l-00002-of-00003.bin:  95%|█████████▌| 9.48G/9.93G [01:21<00:03, 146MB/s][A

Downloading (…)l-00002-of-00003.bin:  96%|█████████▌| 9.50G/9.93G [01:21<00:02, 147MB/s][A

Downloading (…)l-00002-of-00003.bin:  96%|█████████▌| 9.52G/9.93G [01:21<00:02, 141MB/s][A

Downloading (…)l-00002-of-00003.bin:  96%|█████████▌| 9.54G/9.93G [01:21<00:04, 91.7MB/s][A

Downloading (…)l-00002-of-00003.bin:  96%|█████████▋| 9.56G/9.93G [01:22<00:03, 96.1MB/s][A

Downloading (…)l-00002-of-00003.bin:  97%|█████████▋| 9.58G/9.93G [01:22<00:03, 106MB/s] [A

Downloading (…)l-00002-of-00003.bin:  97%|█████████▋| 9.60G/9.93G [01:22<00:02, 117MB/s][A

Downloading (…)l-00002-of-00003.bin:  97%|█████████▋| 9.63G/9.93G [01:22<00:02, 126MB/s][A

Downloading (…)l-00002-of-00003.bin:  97%|█████████▋| 9.65G/9.93G [01:22<00:02, 135MB/s][A

Downloading (…)l-00002-of-00003.bin:  97%|█████████▋| 9.67G/9.93G [01:22<00:01, 139MB/s][A

Downloading (…)l-00002-of-00003.bin:  98%|█████████▊| 9.69G/9.93G [01:22<00:01, 144MB/s][A

Downloading (…)l-00002-of-00003.bin:  98%|█████████▊| 9.71G/9.93G [01:23<00:01, 150MB/s][A

Downloading (…)l-00002-of-00003.bin:  98%|█████████▊| 9.73G/9.93G [01:23<00:01, 154MB/s][A

Downloading (…)l-00002-of-00003.bin:  98%|█████████▊| 9.75G/9.93G [01:23<00:01, 156MB/s][A

Downloading (…)l-00002-of-00003.bin:  98%|█████████▊| 9.77G/9.93G [01:23<00:00, 155MB/s][A

Downloading (…)l-00002-of-00003.bin:  99%|█████████▊| 9.79G/9.93G [01:23<00:00, 153MB/s][A

Downloading (…)l-00002-of-00003.bin:  99%|█████████▉| 9.81G/9.93G [01:23<00:00, 152MB/s][A

Downloading (…)l-00002-of-00003.bin:  99%|█████████▉| 9.84G/9.93G [01:23<00:00, 147MB/s][A

Downloading (…)l-00002-of-00003.bin:  99%|█████████▉| 9.86G/9.93G [01:24<00:00, 145MB/s][A

Downloading (…)l-00002-of-00003.bin: 100%|█████████▉| 9.88G/9.93G [01:24<00:00, 147MB/s][A

Downloading (…)l-00002-of-00003.bin: 100%|█████████▉| 9.90G/9.93G [01:24<00:00, 145MB/s][A

Downloading (…)l-00002-of-00003.bin: 100%|█████████▉| 9.92G/9.93G [01:24<00:00, 148MB/s][A
Downloading (…)l-00002-of-00003.bin: 100%|██████████| 9.93G/9.93G [01:24<00:00, 117MB/s]

Downloading shards:  67%|██████▋   | 2/3 [02:53<01:26, 86.82s/it]
Downloading shards:  67%|██████▋   | 2/3 [02:53<01:26, 86.81s/it]

Downloading (…)l-00003-of-00003.bin:   0%|          | 0.00/4.11G [00:00<?, ?B/s][A

Downloading (…)l-00003-of-00003.bin:   0%|          | 10.5M/4.11G [00:00<00:42, 97.5MB/s][A

Downloading (…)l-00003-of-00003.bin:   1%|          | 31.5M/4.11G [00:00<00:28, 144MB/s] [A

Downloading (…)l-00003-of-00003.bin:   1%|▏         | 52.4M/4.11G [00:00<00:25, 159MB/s][A

Downloading (…)l-00003-of-00003.bin:   2%|▏         | 73.4M/4.11G [00:00<00:24, 165MB/s][A

Downloading (…)l-00003-of-00003.bin:   2%|▏         | 94.4M/4.11G [00:00<00:24, 165MB/s][A

Downloading (…)l-00003-of-00003.bin:   3%|▎         | 115M/4.11G [00:00<00:23, 168MB/s] [A

Downloading (…)l-00003-of-00003.bin:   3%|▎         | 136M/4.11G [00:00<00:24, 161MB/s][A

Downloading (…)l-00003-of-00003.bin:   4%|▍         | 157M/4.11G [00:00<00:24, 162MB/s][A

Downloading (…)l-00003-of-00003.bin:   4%|▍         | 178M/4.11G [00:01<00:24, 162MB/s][A

Downloading (…)l-00003-of-00003.bin:   5%|▍         | 199M/4.11G [00:01<00:40, 96.3MB/s][A

Downloading (…)l-00003-of-00003.bin:   5%|▌         | 220M/4.11G [00:01<00:40, 95.6MB/s][A

Downloading (…)l-00003-of-00003.bin:   6%|▌         | 241M/4.11G [00:01<00:39, 97.5MB/s][A

Downloading (…)l-00003-of-00003.bin:   6%|▋         | 262M/4.11G [00:02<00:34, 111MB/s] [A

Downloading (…)l-00003-of-00003.bin:   7%|▋         | 283M/4.11G [00:02<00:31, 121MB/s][A

Downloading (…)l-00003-of-00003.bin:   7%|▋         | 304M/4.11G [00:02<00:28, 133MB/s][A

Downloading (…)l-00003-of-00003.bin:   8%|▊         | 325M/4.11G [00:02<00:26, 141MB/s][A

Downloading (…)l-00003-of-00003.bin:   8%|▊         | 346M/4.11G [00:02<00:25, 148MB/s][A

Downloading (…)l-00003-of-00003.bin:   9%|▉         | 367M/4.11G [00:02<00:24, 154MB/s][A

Downloading (…)l-00003-of-00003.bin:   9%|▉         | 388M/4.11G [00:02<00:23, 156MB/s][A

Downloading (…)l-00003-of-00003.bin:  10%|▉         | 409M/4.11G [00:02<00:23, 159MB/s][A

Downloading (…)l-00003-of-00003.bin:  10%|█         | 430M/4.11G [00:03<00:27, 133MB/s][A

Downloading (…)l-00003-of-00003.bin:  11%|█         | 451M/4.11G [00:03<00:25, 141MB/s][A

Downloading (…)l-00003-of-00003.bin:  11%|█▏        | 472M/4.11G [00:03<00:24, 149MB/s][A

Downloading (…)l-00003-of-00003.bin:  12%|█▏        | 493M/4.11G [00:03<00:23, 156MB/s][A

Downloading (…)l-00003-of-00003.bin:  13%|█▎        | 514M/4.11G [00:03<00:22, 161MB/s][A

Downloading (…)l-00003-of-00003.bin:  13%|█▎        | 535M/4.11G [00:03<00:21, 166MB/s][A

Downloading (…)l-00003-of-00003.bin:  14%|█▎        | 556M/4.11G [00:03<00:21, 165MB/s][A

Downloading (…)l-00003-of-00003.bin:  14%|█▍        | 577M/4.11G [00:04<00:21, 166MB/s][A

Downloading (…)l-00003-of-00003.bin:  15%|█▍        | 598M/4.11G [00:04<00:21, 164MB/s][A

Downloading (…)l-00003-of-00003.bin:  15%|█▌        | 619M/4.11G [00:04<00:24, 145MB/s][A

Downloading (…)l-00003-of-00003.bin:  16%|█▌        | 640M/4.11G [00:04<00:34, 101MB/s][A

Downloading (…)l-00003-of-00003.bin:  16%|█▌        | 661M/4.11G [00:04<00:30, 112MB/s][A

Downloading (…)l-00003-of-00003.bin:  17%|█▋        | 682M/4.11G [00:04<00:27, 123MB/s][A

Downloading (…)l-00003-of-00003.bin:  17%|█▋        | 703M/4.11G [00:05<00:25, 133MB/s][A

Downloading (…)l-00003-of-00003.bin:  18%|█▊        | 724M/4.11G [00:05<00:23, 142MB/s][A

Downloading (…)l-00003-of-00003.bin:  18%|█▊        | 744M/4.11G [00:05<00:22, 147MB/s][A

Downloading (…)l-00003-of-00003.bin:  19%|█▊        | 765M/4.11G [00:05<00:22, 150MB/s][A

Downloading (…)l-00003-of-00003.bin:  19%|█▉        | 786M/4.11G [00:05<00:22, 151MB/s][A

Downloading (…)l-00003-of-00003.bin:  20%|█▉        | 807M/4.11G [00:05<00:21, 155MB/s][A

Downloading (…)l-00003-of-00003.bin:  20%|██        | 828M/4.11G [00:06<00:25, 129MB/s][A

Downloading (…)l-00003-of-00003.bin:  21%|██        | 849M/4.11G [00:06<00:23, 137MB/s][A

Downloading (…)l-00003-of-00003.bin:  21%|██        | 870M/4.11G [00:06<00:33, 97.3MB/s][A

Downloading (…)l-00003-of-00003.bin:  22%|██▏       | 891M/4.11G [00:06<00:29, 107MB/s] [A

Downloading (…)l-00003-of-00003.bin:  22%|██▏       | 912M/4.11G [00:06<00:27, 116MB/s][A

Downloading (…)l-00003-of-00003.bin:  23%|██▎       | 933M/4.11G [00:06<00:24, 128MB/s][A

Downloading (…)l-00003-of-00003.bin:  23%|██▎       | 954M/4.11G [00:07<00:23, 135MB/s][A

Downloading (…)l-00003-of-00003.bin:  24%|██▍       | 975M/4.11G [00:07<00:21, 143MB/s][A

Downloading (…)l-00003-of-00003.bin:  24%|██▍       | 996M/4.11G [00:07<00:20, 152MB/s][A

Downloading (…)l-00003-of-00003.bin:  25%|██▍       | 1.02G/4.11G [00:07<00:19, 158MB/s][A

Downloading (…)l-00003-of-00003.bin:  25%|██▌       | 1.04G/4.11G [00:07<00:19, 161MB/s][A

Downloading (…)l-00003-of-00003.bin:  26%|██▌       | 1.06G/4.11G [00:07<00:26, 115MB/s][A

Downloading (…)l-00003-of-00003.bin:  26%|██▋       | 1.08G/4.11G [00:08<00:31, 96.8MB/s][A

Downloading (…)l-00003-of-00003.bin:  27%|██▋       | 1.10G/4.11G [00:08<00:26, 111MB/s] [A

Downloading (…)l-00003-of-00003.bin:  27%|██▋       | 1.12G/4.11G [00:08<00:24, 122MB/s][A

Downloading (…)l-00003-of-00003.bin:  28%|██▊       | 1.14G/4.11G [00:08<00:22, 131MB/s][A

Downloading (…)l-00003-of-00003.bin:  28%|██▊       | 1.16G/4.11G [00:08<00:20, 141MB/s][A

Downloading (…)l-00003-of-00003.bin:  29%|██▉       | 1.18G/4.11G [00:08<00:20, 145MB/s][A

Downloading (…)l-00003-of-00003.bin:  29%|██▉       | 1.21G/4.11G [00:08<00:19, 145MB/s][A

Downloading (…)l-00003-of-00003.bin:  30%|██▉       | 1.23G/4.11G [00:09<00:19, 146MB/s][A

Downloading (…)l-00003-of-00003.bin:  30%|███       | 1.25G/4.11G [00:09<00:19, 150MB/s][A

Downloading (…)l-00003-of-00003.bin:  31%|███       | 1.27G/4.11G [00:09<00:19, 146MB/s][A

Downloading (…)l-00003-of-00003.bin:  31%|███▏      | 1.29G/4.11G [00:09<00:19, 148MB/s][A

Downloading (…)l-00003-of-00003.bin:  32%|███▏      | 1.31G/4.11G [00:09<00:18, 149MB/s][A

Downloading (…)l-00003-of-00003.bin:  32%|███▏      | 1.33G/4.11G [00:09<00:18, 150MB/s][A

Downloading (…)l-00003-of-00003.bin:  33%|███▎      | 1.35G/4.11G [00:09<00:17, 154MB/s][A

Downloading (…)l-00003-of-00003.bin:  33%|███▎      | 1.37G/4.11G [00:10<00:17, 159MB/s][A

Downloading (…)l-00003-of-00003.bin:  34%|███▍      | 1.39G/4.11G [00:10<00:26, 103MB/s][A

Downloading (…)l-00003-of-00003.bin:  34%|███▍      | 1.42G/4.11G [00:10<00:23, 117MB/s][A

Downloading (…)l-00003-of-00003.bin:  35%|███▍      | 1.44G/4.11G [00:10<00:20, 128MB/s][A

Downloading (…)l-00003-of-00003.bin:  35%|███▌      | 1.46G/4.11G [00:11<00:30, 87.3MB/s][A

Downloading (…)l-00003-of-00003.bin:  36%|███▌      | 1.48G/4.11G [00:11<00:30, 85.9MB/s][A

Downloading (…)l-00003-of-00003.bin:  37%|███▋      | 1.50G/4.11G [00:11<00:26, 97.5MB/s][A

Downloading (…)l-00003-of-00003.bin:  37%|███▋      | 1.52G/4.11G [00:11<00:23, 111MB/s] [A

Downloading (…)l-00003-of-00003.bin:  38%|███▊      | 1.54G/4.11G [00:11<00:20, 124MB/s][A

Downloading (…)l-00003-of-00003.bin:  38%|███▊      | 1.56G/4.11G [00:11<00:19, 131MB/s][A

Downloading (…)l-00003-of-00003.bin:  39%|███▊      | 1.58G/4.11G [00:11<00:18, 139MB/s][A

Downloading (…)l-00003-of-00003.bin:  39%|███▉      | 1.60G/4.11G [00:12<00:16, 148MB/s][A

Downloading (…)l-00003-of-00003.bin:  40%|███▉      | 1.63G/4.11G [00:12<00:16, 152MB/s][A

Downloading (…)l-00003-of-00003.bin:  40%|████      | 1.65G/4.11G [00:12<00:17, 144MB/s][A

Downloading (…)l-00003-of-00003.bin:  41%|████      | 1.67G/4.11G [00:12<00:22, 107MB/s][A

Downloading (…)l-00003-of-00003.bin:  41%|████      | 1.69G/4.11G [00:12<00:20, 120MB/s][A

Downloading (…)l-00003-of-00003.bin:  42%|████▏     | 1.71G/4.11G [00:12<00:18, 130MB/s][A

Downloading (…)l-00003-of-00003.bin:  42%|████▏     | 1.73G/4.11G [00:13<00:17, 139MB/s][A

Downloading (…)l-00003-of-00003.bin:  43%|████▎     | 1.75G/4.11G [00:13<00:16, 145MB/s][A

Downloading (…)l-00003-of-00003.bin:  43%|████▎     | 1.77G/4.11G [00:13<00:15, 151MB/s][A

Downloading (…)l-00003-of-00003.bin:  44%|████▎     | 1.79G/4.11G [00:13<00:15, 152MB/s][A

Downloading (…)l-00003-of-00003.bin:  44%|████▍     | 1.81G/4.11G [00:13<00:14, 156MB/s][A

Downloading (…)l-00003-of-00003.bin:  45%|████▍     | 1.84G/4.11G [00:13<00:14, 157MB/s][A

Downloading (…)l-00003-of-00003.bin:  45%|████▌     | 1.86G/4.11G [00:13<00:14, 158MB/s][A

Downloading (…)l-00003-of-00003.bin:  46%|████▌     | 1.88G/4.11G [00:13<00:13, 162MB/s][A

Downloading (…)l-00003-of-00003.bin:  46%|████▌     | 1.90G/4.11G [00:14<00:13, 164MB/s][A

Downloading (…)l-00003-of-00003.bin:  47%|████▋     | 1.92G/4.11G [00:14<00:13, 165MB/s][A

Downloading (…)l-00003-of-00003.bin:  47%|████▋     | 1.94G/4.11G [00:14<00:13, 164MB/s][A

Downloading (…)l-00003-of-00003.bin:  48%|████▊     | 1.96G/4.11G [00:14<00:12, 167MB/s][A

Downloading (…)l-00003-of-00003.bin:  48%|████▊     | 1.98G/4.11G [00:14<00:12, 169MB/s][A

Downloading (…)l-00003-of-00003.bin:  49%|████▉     | 2.00G/4.11G [00:14<00:12, 169MB/s][A

Downloading (…)l-00003-of-00003.bin:  49%|████▉     | 2.02G/4.11G [00:14<00:12, 171MB/s][A

Downloading (…)l-00003-of-00003.bin:  50%|████▉     | 2.04G/4.11G [00:14<00:11, 172MB/s][A

Downloading (…)l-00003-of-00003.bin:  50%|█████     | 2.07G/4.11G [00:15<00:11, 172MB/s][A

Downloading (…)l-00003-of-00003.bin:  51%|█████     | 2.09G/4.11G [00:15<00:11, 170MB/s][A

Downloading (…)l-00003-of-00003.bin:  51%|█████▏    | 2.11G/4.11G [00:15<00:11, 171MB/s][A

Downloading (…)l-00003-of-00003.bin:  52%|█████▏    | 2.13G/4.11G [00:15<00:11, 172MB/s][A

Downloading (…)l-00003-of-00003.bin:  52%|█████▏    | 2.15G/4.11G [00:15<00:11, 171MB/s][A

Downloading (…)l-00003-of-00003.bin:  53%|█████▎    | 2.17G/4.11G [00:15<00:11, 169MB/s][A

Downloading (…)l-00003-of-00003.bin:  53%|█████▎    | 2.19G/4.11G [00:15<00:11, 165MB/s][A

Downloading (…)l-00003-of-00003.bin:  54%|█████▍    | 2.21G/4.11G [00:15<00:11, 166MB/s][A

Downloading (…)l-00003-of-00003.bin:  54%|█████▍    | 2.23G/4.11G [00:16<00:11, 164MB/s][A

Downloading (…)l-00003-of-00003.bin:  55%|█████▍    | 2.25G/4.11G [00:16<00:11, 161MB/s][A

Downloading (…)l-00003-of-00003.bin:  55%|█████▌    | 2.28G/4.11G [00:16<00:11, 161MB/s][A

Downloading (…)l-00003-of-00003.bin:  56%|█████▌    | 2.30G/4.11G [00:16<00:11, 162MB/s][A

Downloading (…)l-00003-of-00003.bin:  56%|█████▋    | 2.32G/4.11G [00:16<00:10, 164MB/s][A

Downloading (…)l-00003-of-00003.bin:  57%|█████▋    | 2.34G/4.11G [00:16<00:10, 165MB/s][A

Downloading (…)l-00003-of-00003.bin:  57%|█████▋    | 2.36G/4.11G [00:16<00:10, 164MB/s][A

Downloading (…)l-00003-of-00003.bin:  58%|█████▊    | 2.38G/4.11G [00:17<00:10, 159MB/s][A

Downloading (…)l-00003-of-00003.bin:  58%|█████▊    | 2.40G/4.11G [00:17<00:10, 159MB/s][A

Downloading (…)l-00003-of-00003.bin:  59%|█████▉    | 2.42G/4.11G [00:17<00:10, 163MB/s][A

Downloading (…)l-00003-of-00003.bin:  60%|█████▉    | 2.44G/4.11G [00:17<00:10, 166MB/s][A

Downloading (…)l-00003-of-00003.bin:  60%|██████    | 2.46G/4.11G [00:17<00:18, 89.2MB/s][A

Downloading (…)l-00003-of-00003.bin:  61%|██████    | 2.49G/4.11G [00:18<00:15, 103MB/s] [A

Downloading (…)l-00003-of-00003.bin:  61%|██████    | 2.51G/4.11G [00:18<00:13, 115MB/s][A

Downloading (…)l-00003-of-00003.bin:  62%|██████▏   | 2.53G/4.11G [00:18<00:12, 126MB/s][A

Downloading (…)l-00003-of-00003.bin:  62%|██████▏   | 2.55G/4.11G [00:18<00:11, 134MB/s][A

Downloading (…)l-00003-of-00003.bin:  63%|██████▎   | 2.57G/4.11G [00:18<00:10, 142MB/s][A

Downloading (…)l-00003-of-00003.bin:  63%|██████▎   | 2.59G/4.11G [00:18<00:10, 149MB/s][A

Downloading (…)l-00003-of-00003.bin:  64%|██████▎   | 2.61G/4.11G [00:18<00:09, 154MB/s][A

Downloading (…)l-00003-of-00003.bin:  64%|██████▍   | 2.63G/4.11G [00:18<00:09, 158MB/s][A

Downloading (…)l-00003-of-00003.bin:  65%|██████▍   | 2.65G/4.11G [00:19<00:11, 129MB/s][A

Downloading (…)l-00003-of-00003.bin:  65%|██████▌   | 2.67G/4.11G [00:19<00:12, 112MB/s][A

Downloading (…)l-00003-of-00003.bin:  66%|██████▌   | 2.69G/4.11G [00:19<00:11, 124MB/s][A

Downloading (…)l-00003-of-00003.bin:  66%|██████▌   | 2.72G/4.11G [00:19<00:11, 123MB/s][A

Downloading (…)l-00003-of-00003.bin:  67%|██████▋   | 2.74G/4.11G [00:19<00:10, 135MB/s][A

Downloading (…)l-00003-of-00003.bin:  67%|██████▋   | 2.76G/4.11G [00:19<00:09, 142MB/s][A

Downloading (…)l-00003-of-00003.bin:  68%|██████▊   | 2.78G/4.11G [00:20<00:09, 147MB/s][A

Downloading (…)l-00003-of-00003.bin:  68%|██████▊   | 2.80G/4.11G [00:20<00:08, 151MB/s][A

Downloading (…)l-00003-of-00003.bin:  69%|██████▊   | 2.82G/4.11G [00:20<00:12, 102MB/s][A

Downloading (…)l-00003-of-00003.bin:  69%|██████▉   | 2.84G/4.11G [00:20<00:11, 111MB/s][A

Downloading (…)l-00003-of-00003.bin:  70%|██████▉   | 2.86G/4.11G [00:20<00:10, 118MB/s][A

Downloading (…)l-00003-of-00003.bin:  70%|███████   | 2.88G/4.11G [00:21<00:11, 103MB/s][A

Downloading (…)l-00003-of-00003.bin:  71%|███████   | 2.90G/4.11G [00:21<00:11, 106MB/s][A

Downloading (…)l-00003-of-00003.bin:  71%|███████▏  | 2.93G/4.11G [00:21<00:09, 119MB/s][A

Downloading (…)l-00003-of-00003.bin:  72%|███████▏  | 2.95G/4.11G [00:21<00:08, 131MB/s][A

Downloading (…)l-00003-of-00003.bin:  72%|███████▏  | 2.97G/4.11G [00:21<00:08, 142MB/s][A

Downloading (…)l-00003-of-00003.bin:  73%|███████▎  | 2.99G/4.11G [00:21<00:07, 150MB/s][A

Downloading (…)l-00003-of-00003.bin:  73%|███████▎  | 3.01G/4.11G [00:21<00:07, 155MB/s][A

Downloading (…)l-00003-of-00003.bin:  74%|███████▍  | 3.03G/4.11G [00:22<00:06, 158MB/s][A

Downloading (…)l-00003-of-00003.bin:  74%|███████▍  | 3.05G/4.11G [00:22<00:06, 159MB/s][A

Downloading (…)l-00003-of-00003.bin:  75%|███████▍  | 3.07G/4.11G [00:22<00:09, 106MB/s][A

Downloading (…)l-00003-of-00003.bin:  75%|███████▌  | 3.09G/4.11G [00:22<00:11, 91.2MB/s][A

Downloading (…)l-00003-of-00003.bin:  76%|███████▌  | 3.11G/4.11G [00:23<00:11, 90.0MB/s][A

Downloading (…)l-00003-of-00003.bin:  76%|███████▋  | 3.14G/4.11G [00:23<00:09, 104MB/s] [A

Downloading (…)l-00003-of-00003.bin:  77%|███████▋  | 3.16G/4.11G [00:23<00:08, 115MB/s][A

Downloading (…)l-00003-of-00003.bin:  77%|███████▋  | 3.18G/4.11G [00:23<00:07, 123MB/s][A

Downloading (…)l-00003-of-00003.bin:  78%|███████▊  | 3.20G/4.11G [00:23<00:06, 130MB/s][A

Downloading (…)l-00003-of-00003.bin:  78%|███████▊  | 3.22G/4.11G [00:23<00:06, 139MB/s][A

Downloading (…)l-00003-of-00003.bin:  79%|███████▉  | 3.24G/4.11G [00:23<00:05, 145MB/s][A

Downloading (…)l-00003-of-00003.bin:  79%|███████▉  | 3.26G/4.11G [00:24<00:05, 153MB/s][A

Downloading (…)l-00003-of-00003.bin:  80%|███████▉  | 3.28G/4.11G [00:24<00:06, 127MB/s][A

Downloading (…)l-00003-of-00003.bin:  80%|████████  | 3.30G/4.11G [00:24<00:08, 92.5MB/s][A

Downloading (…)l-00003-of-00003.bin:  81%|████████  | 3.32G/4.11G [00:24<00:08, 94.0MB/s][A

Downloading (…)l-00003-of-00003.bin:  81%|████████▏ | 3.34G/4.11G [00:24<00:07, 107MB/s] [A

Downloading (…)l-00003-of-00003.bin:  82%|████████▏ | 3.37G/4.11G [00:25<00:06, 117MB/s][A

Downloading (…)l-00003-of-00003.bin:  82%|████████▏ | 3.39G/4.11G [00:25<00:05, 128MB/s][A

Downloading (…)l-00003-of-00003.bin:  83%|████████▎ | 3.41G/4.11G [00:25<00:05, 137MB/s][A

Downloading (…)l-00003-of-00003.bin:  84%|████████▎ | 3.43G/4.11G [00:25<00:04, 146MB/s][A

Downloading (…)l-00003-of-00003.bin:  84%|████████▍ | 3.45G/4.11G [00:25<00:04, 150MB/s][A

Downloading (…)l-00003-of-00003.bin:  85%|████████▍ | 3.47G/4.11G [00:25<00:04, 153MB/s][A

Downloading (…)l-00003-of-00003.bin:  85%|████████▌ | 3.49G/4.11G [00:25<00:04, 129MB/s][A

Downloading (…)l-00003-of-00003.bin:  86%|████████▌ | 3.51G/4.11G [00:26<00:05, 105MB/s][A

Downloading (…)l-00003-of-00003.bin:  86%|████████▌ | 3.53G/4.11G [00:26<00:05, 98.9MB/s][A

Downloading (…)l-00003-of-00003.bin:  87%|████████▋ | 3.55G/4.11G [00:26<00:05, 108MB/s] [A

Downloading (…)l-00003-of-00003.bin:  87%|████████▋ | 3.58G/4.11G [00:26<00:04, 119MB/s][A

Downloading (…)l-00003-of-00003.bin:  88%|████████▊ | 3.60G/4.11G [00:26<00:03, 131MB/s][A

Downloading (…)l-00003-of-00003.bin:  88%|████████▊ | 3.62G/4.11G [00:27<00:03, 141MB/s][A

Downloading (…)l-00003-of-00003.bin:  89%|████████▊ | 3.64G/4.11G [00:27<00:03, 145MB/s][A

Downloading (…)l-00003-of-00003.bin:  89%|████████▉ | 3.66G/4.11G [00:27<00:02, 153MB/s][A

Downloading (…)l-00003-of-00003.bin:  90%|████████▉ | 3.68G/4.11G [00:27<00:02, 158MB/s][A

Downloading (…)l-00003-of-00003.bin:  90%|█████████ | 3.70G/4.11G [00:27<00:02, 159MB/s][A

Downloading (…)l-00003-of-00003.bin:  91%|█████████ | 3.72G/4.11G [00:27<00:02, 164MB/s][A

Downloading (…)l-00003-of-00003.bin:  91%|█████████ | 3.74G/4.11G [00:28<00:03, 92.5MB/s][A

Downloading (…)l-00003-of-00003.bin:  92%|█████████▏| 3.76G/4.11G [00:28<00:03, 93.4MB/s][A

Downloading (…)l-00003-of-00003.bin:  92%|█████████▏| 3.79G/4.11G [00:28<00:02, 108MB/s] [A

Downloading (…)l-00003-of-00003.bin:  93%|█████████▎| 3.81G/4.11G [00:28<00:02, 120MB/s][A

Downloading (…)l-00003-of-00003.bin:  93%|█████████▎| 3.83G/4.11G [00:28<00:02, 131MB/s][A

Downloading (…)l-00003-of-00003.bin:  94%|█████████▎| 3.85G/4.11G [00:28<00:01, 140MB/s][A

Downloading (…)l-00003-of-00003.bin:  94%|█████████▍| 3.87G/4.11G [00:28<00:01, 145MB/s][A

Downloading (…)l-00003-of-00003.bin:  95%|█████████▍| 3.89G/4.11G [00:29<00:01, 151MB/s][A

Downloading (…)l-00003-of-00003.bin:  95%|█████████▌| 3.91G/4.11G [00:29<00:01, 156MB/s][A

Downloading (…)l-00003-of-00003.bin:  96%|█████████▌| 3.93G/4.11G [00:29<00:01, 161MB/s][A

Downloading (…)l-00003-of-00003.bin:  96%|█████████▋| 3.95G/4.11G [00:29<00:01, 141MB/s][A

Downloading (…)l-00003-of-00003.bin:  97%|█████████▋| 3.97G/4.11G [00:29<00:01, 122MB/s][A

Downloading (…)l-00003-of-00003.bin:  97%|█████████▋| 4.00G/4.11G [00:29<00:00, 132MB/s][A

Downloading (…)l-00003-of-00003.bin:  98%|█████████▊| 4.02G/4.11G [00:29<00:00, 140MB/s][A

Downloading (…)l-00003-of-00003.bin:  98%|█████████▊| 4.04G/4.11G [00:30<00:00, 148MB/s][A

Downloading (…)l-00003-of-00003.bin:  99%|█████████▉| 4.06G/4.11G [00:30<00:00, 150MB/s][A

Downloading (…)l-00003-of-00003.bin:  99%|█████████▉| 4.08G/4.11G [00:30<00:00, 147MB/s][A

Downloading (…)l-00003-of-00003.bin: 100%|█████████▉| 4.10G/4.11G [00:30<00:00, 103MB/s][A
Downloading (…)l-00003-of-00003.bin: 100%|██████████| 4.11G/4.11G [00:30<00:00, 133MB/s]

Downloading shards: 100%|██████████| 3/3 [03:40<00:00, 68.46s/it]
Downloading shards: 100%|██████████| 3/3 [03:40<00:00, 73.39s/it]

Downloading shards: 100%|██████████| 3/3 [03:40<00:00, 68.49s/it]
Downloading shards: 100%|██████████| 3/3 [03:40<00:00, 73.40s/it]

Loading checkpoint shards:   0%|          | 0/3 [00:00<?, ?it/s]
Loading checkpoint shards:   0%|          | 0/3 [00:00<?, ?it/s]
Loading checkpoint shards:  33%|███▎      | 1/3 [00:22<00:45, 22.82s/it]
Loading checkpoint shards:  33%|███▎      | 1/3 [00:22<00:45, 22.94s/it]
Loading checkpoint shards:  67%|██████▋   | 2/3 [00:44<00:22, 22.31s/it]
Loading checkpoint shards:  67%|██████▋   | 2/3 [00:44<00:22, 22.36s/it]
Loading checkpoint shards: 100%|██████████| 3/3 [00:52<00:00, 15.56s/it]
Loading checkpoint shards: 100%|██████████| 3/3 [00:52<00:00, 17.44s/it]

Loading checkpoint shards: 100%|██████████| 3/3 [00:52<00:00, 15.59s/it]
Loading checkpoint shards: 100%|██████████| 3/3 [00:52<00:00, 17.48s/it]

Downloading (…)okenizer_config.json:   0%|          | 0.00/396 [00:00<?, ?B/s]
Downloading (…)okenizer_config.json: 100%|██████████| 396/396 [00:00<00:00, 896kB/s]

Downloading (…)/main/tokenizer.json:   0%|          | 0.00/2.11M [00:00<?, ?B/s]
Downloading (…)/main/tokenizer.json: 100%|██████████| 2.11M/2.11M [00:00<00:00, 9.11MB/s]
Downloading (…)/main/tokenizer.json: 100%|██████████| 2.11M/2.11M [00:00<00:00, 9.04MB/s]

Downloading (…)cial_tokens_map.json:   0%|          | 0.00/99.0 [00:00<?, ?B/s]
Downloading (…)cial_tokens_map.json: 100%|██████████| 99.0/99.0 [00:00<00:00, 141kB/s]
PeftModelForCausalLM(
  (base_model): LoraModel(
    (model): GPTNeoXForCausalLM(
      (gpt_neox): GPTNeoXModel(
        (embed_in): Embedding(50688, 5120)
        (layers): ModuleList(
          (0-35): 36 x GPTNeoXLayer(
            (input_layernorm): LayerNorm((5120,), eps=1e-05, elementwise_affine=True)
            (post_attention_layernorm): LayerNorm((5120,), eps=1e-05, elementwise_affine=True)
            (attention): GPTNeoXAttention(
              (rotary_emb): RotaryEmbedding()
              (query_key_value): MergedLinear8bitLt(
                in_features=5120, out_features=15360, bias=True
                (lora_dropout): Dropout(p=0.05, inplace=False)
                (lora_A): Linear(in_features=5120, out_features=16, bias=False)
                (lora_B): Conv1d(16, 10240, kernel_size=(1,), stride=(1,), groups=2, bias=False)
              )
              (dense): Linear8bitLt(in_features=5120, out_features=5120, bias=True)
            )
            (mlp): GPTNeoXMLP(
              (dense_h_to_4h): Linear8bitLt(in_features=5120, out_features=20480, bias=True)
              (dense_4h_to_h): Linear8bitLt(in_features=20480, out_features=5120, bias=True)
              (act): GELUActivation()
            )
          )
        )
        (final_layer_norm): LayerNorm((5120,), eps=1e-05, elementwise_affine=True)
      )
      (embed_out): Linear(in_features=5120, out_features=50688, bias=False)
    )
  )
)
trainable params: 5898240 || all params: 11851970560 || trainable%: 0.04976590154473013
PeftModelForCausalLM(
  (base_model): LoraModel(
    (model): GPTNeoXForCausalLM(
      (gpt_neox): GPTNeoXModel(
        (embed_in): Embedding(50688, 5120)
        (layers): ModuleList(
          (0-35): 36 x GPTNeoXLayer(
            (input_layernorm): LayerNorm((5120,), eps=1e-05, elementwise_affine=True)
            (post_attention_layernorm): LayerNorm((5120,), eps=1e-05, elementwise_affine=True)
            (attention): GPTNeoXAttention(
              (rotary_emb): RotaryEmbedding()
              (query_key_value): MergedLinear8bitLt(
                in_features=5120, out_features=15360, bias=True
                (lora_dropout): Dropout(p=0.05, inplace=False)
                (lora_A): Linear(in_features=5120, out_features=16, bias=False)
                (lora_B): Conv1d(16, 10240, kernel_size=(1,), stride=(1,), groups=2, bias=False)
              )
              (dense): Linear8bitLt(in_features=5120, out_features=5120, bias=True)
            )
            (mlp): GPTNeoXMLP(
              (dense_h_to_4h): Linear8bitLt(in_features=5120, out_features=20480, bias=True)
              (dense_4h_to_h): Linear8bitLt(in_features=20480, out_features=5120, bias=True)
              (act): GELUActivation()
            )
          )
        )
        (final_layer_norm): LayerNorm((5120,), eps=1e-05, elementwise_affine=True)
      )
      (embed_out): Linear(in_features=5120, out_features=50688, bias=False)
    )
  )
)
trainable params: 5898240 || all params: 11851970560 || trainable%: 0.04976590154473013
Using Validation Metrics: []
Supported Metrics: ['bleu', 'rouge', 'sacrebleu', 'meteor']
Auto set val_set_size 1000
Found cached dataset json (/home/arno/.cache/huggingface/datasets/json/default-cdbbb11a140d3908/0.0.0/0f7e3662623656454fcd2b650f34e886a7db4b9104504885bd462096cc7a9f51)

  0%|          | 0/1 [00:00<?, ?it/s]Found cached dataset json (/home/arno/.cache/huggingface/datasets/json/default-cdbbb11a140d3908/0.0.0/0f7e3662623656454fcd2b650f34e886a7db4b9104504885bd462096cc7a9f51)

  0%|          | 0/1 [00:00<?, ?it/s]
100%|██████████| 1/1 [00:00<00:00, 29.83it/s]
100%|██████████| 1/1 [00:00<00:00, 14.58it/s]


Map (num_proc=21):   0%|          | 0/46283 [00:00<?, ? examples/s]
Map (num_proc=21):   0%|          | 0/46283 [00:00<?, ? examples/s]
Map (num_proc=21):   0%|          | 1/46283 [00:00<2:21:24,  5.46 examples/s]
Map (num_proc=21):   0%|          | 1/46283 [00:00<2:46:47,  4.62 examples/s]
Map (num_proc=21):   0%|          | 120/46283 [00:00<01:32, 496.93 examples/s]
Map (num_proc=21):   0%|          | 167/46283 [00:00<01:16, 599.13 examples/s]
Map (num_proc=21):   2%|▏         | 782/46283 [00:00<00:18, 2520.64 examples/s]
Map (num_proc=21):   2%|▏         | 712/46283 [00:00<00:20, 2244.29 examples/s]
Map (num_proc=21):   4%|▍         | 1963/46283 [00:00<00:08, 5514.25 examples/s]
Map (num_proc=21):   4%|▍         | 1858/46283 [00:00<00:08, 5061.89 examples/s]
Map (num_proc=21):   7%|▋         | 3273/46283 [00:00<00:05, 7891.73 examples/s]
Map (num_proc=21):   7%|▋         | 3146/46283 [00:00<00:05, 7470.74 examples/s]
Map (num_proc=21):  10%|█         | 4759/46283 [00:00<00:04, 10014.62 examples/s]
Map (num_proc=21):  10%|▉         | 4511/46283 [00:00<00:04, 9334.49 examples/s]
Map (num_proc=21):  14%|█▍        | 6452/46283 [00:00<00:03, 12093.53 examples/s]
Map (num_proc=21):  14%|█▎        | 6305/46283 [00:00<00:03, 11911.19 examples/s]
Map (num_proc=21):  18%|█▊        | 8301/46283 [00:00<00:02, 13938.37 examples/s]
Map (num_proc=21):  18%|█▊        | 8156/46283 [00:00<00:02, 13844.38 examples/s]
Map (num_proc=21):  22%|██▏       | 10126/46283 [00:01<00:02, 15113.94 examples/s]
Map (num_proc=21):  22%|██▏       | 10072/46283 [00:01<00:02, 15409.07 examples/s]
Map (num_proc=21):  26%|██▌       | 11943/46283 [00:01<00:02, 15925.87 examples/s]
Map (num_proc=21):  26%|██▌       | 12016/46283 [00:01<00:02, 16562.78 examples/s]
Map (num_proc=21):  29%|██▉       | 13625/46283 [00:01<00:02, 16160.30 examples/s]
Map (num_proc=21):  30%|███       | 13894/46283 [00:01<00:01, 17124.05 examples/s]
Map (num_proc=21):  33%|███▎      | 15321/46283 [00:01<00:01, 16331.92 examples/s]
Map (num_proc=21):  34%|███▍      | 15767/46283 [00:01<00:01, 17554.39 examples/s]
Map (num_proc=21):  37%|███▋      | 17075/46283 [00:01<00:01, 16610.21 examples/s]
Map (num_proc=21):  38%|███▊      | 17659/46283 [00:01<00:01, 17745.49 examples/s]
Map (num_proc=21):  41%|████      | 18876/46283 [00:01<00:01, 16978.88 examples/s]
Map (num_proc=21):  42%|████▏     | 19482/46283 [00:01<00:01, 16368.13 examples/s]
Map (num_proc=21):  45%|████▍     | 20602/46283 [00:01<00:01, 16813.98 examples/s]
Map (num_proc=21):  46%|████▌     | 21156/46283 [00:01<00:01, 16439.08 examples/s]
Map (num_proc=21):  48%|████▊     | 22318/46283 [00:01<00:01, 16771.41 examples/s]
Map (num_proc=21):  49%|████▉     | 22831/46283 [00:01<00:01, 16387.54 examples/s]
Map (num_proc=21):  52%|█████▏    | 24011/46283 [00:01<00:01, 16665.15 examples/s]
Map (num_proc=21):  53%|█████▎    | 24511/46283 [00:01<00:01, 16246.85 examples/s]
Map (num_proc=21):  56%|█████▌    | 25740/46283 [00:01<00:01, 16794.85 examples/s]
Map (num_proc=21):  57%|█████▋    | 26176/46283 [00:02<00:01, 16291.40 examples/s]
Map (num_proc=21):  59%|█████▉    | 27458/46283 [00:02<00:01, 16771.93 examples/s]
Map (num_proc=21):  61%|██████    | 28038/46283 [00:02<00:01, 16906.41 examples/s]
Map (num_proc=21):  63%|██████▎   | 29142/46283 [00:02<00:01, 16536.34 examples/s]
Map (num_proc=21):  65%|██████▍   | 29981/46283 [00:02<00:00, 17609.55 examples/s]
Map (num_proc=21):  67%|██████▋   | 30811/46283 [00:02<00:00, 16525.11 examples/s]
Map (num_proc=21):  69%|██████▉   | 31887/46283 [00:02<00:00, 18004.94 examples/s]
Map (num_proc=21):  70%|███████   | 32570/46283 [00:02<00:00, 16766.64 examples/s]
Map (num_proc=21):  73%|███████▎  | 33788/46283 [00:02<00:00, 18149.54 examples/s]
Map (num_proc=21):  74%|███████▍  | 34294/46283 [00:02<00:00, 16779.36 examples/s]
Map (num_proc=21):  77%|███████▋  | 35727/46283 [00:02<00:00, 18288.96 examples/s]
Map (num_proc=21):  78%|███████▊  | 35977/46283 [00:02<00:00, 16633.31 examples/s]
Map (num_proc=21):  81%|████████  | 37559/46283 [00:02<00:00, 18226.26 examples/s]
Map (num_proc=21):  81%|████████▏ | 37672/46283 [00:02<00:00, 16720.52 examples/s]
Map (num_proc=21):  85%|████████▌ | 39406/46283 [00:02<00:00, 17548.00 examples/s]
Map (num_proc=21):  85%|████████▌ | 39468/46283 [00:02<00:00, 16901.43 examples/s]
Map (num_proc=21):  89%|████████▉ | 41168/46283 [00:02<00:00, 17277.14 examples/s]
Map (num_proc=21):  89%|████████▉ | 41191/46283 [00:02<00:00, 15858.62 examples/s]
Map (num_proc=21):  93%|█████████▎| 42913/46283 [00:02<00:00, 15243.17 examples/s]
Map (num_proc=21):  93%|█████████▎| 42832/46283 [00:03<00:00, 15202.16 examples/s]
Map (num_proc=21):  96%|█████████▌| 44487/46283 [00:03<00:00, 14136.28 examples/s]
Map (num_proc=21):  96%|█████████▌| 44377/46283 [00:03<00:00, 13889.24 examples/s]
Map (num_proc=21):  99%|█████████▉| 45961/46283 [00:03<00:00, 10521.14 examples/s]
Map (num_proc=21):  99%|█████████▉| 45810/46283 [00:03<00:00, 9270.26 examples/s] 
                                                                                  

                                                                                 
Final fine-tuning data:
Train Dataset({
    features: ['input', 'prompt_type', 'source', 'input_ids', 'attention_mask', 'labels'],
    num_rows: 46283
})
Valid None
Sample input: {'input': ["<human>: Provide me with a plan to spend a half-day in cairo\n<bot>: I would start by going to the museum of Islamic art. It's a beautiful museum with an incredible collection of Islamic art and architecture. After that, I would explore the old city and see some of the ancient sites there. And then finish off the day with a trip to the pyramids. It's a truly incredible sight and you can really get a sense of the grandeur of ancient Egypt when you stand next to those massive structures.\n"], 'prompt_type': ['plain'], 'source': ['OpenAssistant/oasst1']}
Auto set eval_steps to 18 out of 361 total training steps
Auto step save_steps to 18
You are adding a <class 'transformers.integrations.TensorBoardCallback'> to the callbacks of this Trainer, but there is already one. The currentlist of callbacks is
:DefaultFlowCallback
TensorBoardCallback
You are adding a <class 'transformers.integrations.TensorBoardCallback'> to the callbacks of this Trainer, but there is already one. The currentlist of callbacks is
:DefaultFlowCallback
TensorBoardCallback
You're using a GPTNeoXTokenizerFast tokenizer. Please note that with a fast tokenizer, using the `__call__` method is faster than using a method to encode the text followed by a call to the `pad` method to get a padded encoding.

  0%|          | 0/361 [00:00<?, ?it/s]/nfs4/llm/h2o-llm/env/lib/python3.10/site-packages/bitsandbytes/autograd/_functions.py:318: UserWarning: MatMul8bitLt: inputs will be cast from torch.float32 to float16 during quantization
  warnings.warn(f"MatMul8bitLt: inputs will be cast from {A.dtype} to float16 during quantization")
You're using a GPTNeoXTokenizerFast tokenizer. Please note that with a fast tokenizer, using the `__call__` method is faster than using a method to encode the text followed by a call to the `pad` method to get a padded encoding.
/nfs4/llm/h2o-llm/env/lib/python3.10/site-packages/bitsandbytes/autograd/_functions.py:318: UserWarning: MatMul8bitLt: inputs will be cast from torch.float32 to float16 during quantization
  warnings.warn(f"MatMul8bitLt: inputs will be cast from {A.dtype} to float16 during quantization")
/nfs4/llm/h2o-llm/env/lib/python3.10/site-packages/transformers/models/gpt_neox/modeling_gpt_neox.py:219: UserWarning: where received a uint8 condition tensor. This behavior is deprecated and will be removed in a future version of PyTorch. Use a boolean condition instead. (Triggered internally at ../aten/src/ATen/native/TensorCompare.cpp:493.)
  attn_scores = torch.where(causal_mask, attn_scores, mask_value)
/nfs4/llm/h2o-llm/env/lib/python3.10/site-packages/transformers/models/gpt_neox/modeling_gpt_neox.py:219: UserWarning: where received a uint8 condition tensor. This behavior is deprecated and will be removed in a future version of PyTorch. Use a boolean condition instead. (Triggered internally at ../aten/src/ATen/native/TensorCompare.cpp:493.)
  attn_scores = torch.where(causal_mask, attn_scores, mask_value)

  0%|          | 1/361 [00:25<2:35:05, 25.85s/it]
                                                 
{'loss': 2.0636, 'learning_rate': 2.9999999999999997e-06, 'epoch': 0.0}

  0%|          | 1/361 [00:25<2:35:05, 25.85s/it]
  1%|          | 2/361 [00:51<2:34:56, 25.90s/it]
                                                 
{'loss': 1.9346, 'learning_rate': 5.999999999999999e-06, 'epoch': 0.01}

  1%|          | 2/361 [00:51<2:34:56, 25.90s/it]
  1%|          | 3/361 [01:18<2:37:10, 26.34s/it]
                                                 
{'loss': 1.9695, 'learning_rate': 8.999999999999999e-06, 'epoch': 0.01}

  1%|          | 3/361 [01:18<2:37:10, 26.34s/it]
  1%|          | 4/361 [01:45<2:38:55, 26.71s/it]
                                                 
{'loss': 1.9597, 'learning_rate': 1.1999999999999999e-05, 'epoch': 0.01}

  1%|          | 4/361 [01:45<2:38:55, 26.71s/it]
  1%|▏         | 5/361 [02:13<2:39:56, 26.96s/it]
                                                 
{'loss': 2.006, 'learning_rate': 1.4999999999999999e-05, 'epoch': 0.01}

  1%|▏         | 5/361 [02:13<2:39:56, 26.96s/it]
  2%|▏         | 6/361 [02:41<2:41:09, 27.24s/it]
                                                 
{'loss': 2.0015, 'learning_rate': 1.7999999999999997e-05, 'epoch': 0.02}

  2%|▏         | 6/361 [02:41<2:41:09, 27.24s/it]
  2%|▏         | 7/361 [03:08<2:40:54, 27.27s/it]
                                                 
{'loss': 1.911, 'learning_rate': 2.1e-05, 'epoch': 0.02}

  2%|▏         | 7/361 [03:08<2:40:54, 27.27s/it]
  2%|▏         | 8/361 [03:35<2:40:31, 27.28s/it]
                                                 
{'loss': 1.9854, 'learning_rate': 2.3999999999999997e-05, 'epoch': 0.02}

  2%|▏         | 8/361 [03:35<2:40:31, 27.28s/it]
  2%|▏         | 9/361 [04:03<2:40:04, 27.29s/it]
                                                 
{'loss': 1.9686, 'learning_rate': 2.6999999999999996e-05, 'epoch': 0.02}

  2%|▏         | 9/361 [04:03<2:40:04, 27.29s/it]
  3%|▎         | 10/361 [04:30<2:39:42, 27.30s/it]
                                                  
{'loss': 1.9898, 'learning_rate': 2.9999999999999997e-05, 'epoch': 0.03}

  3%|▎         | 10/361 [04:30<2:39:42, 27.30s/it]
  3%|▎         | 11/361 [04:57<2:39:12, 27.29s/it]
                                                  
{'loss': 1.9445, 'learning_rate': 3.2999999999999996e-05, 'epoch': 0.03}

  3%|▎         | 11/361 [04:57<2:39:12, 27.29s/it]
  3%|▎         | 12/361 [05:25<2:38:50, 27.31s/it]
                                                  
{'loss': 1.9496, 'learning_rate': 3.5999999999999994e-05, 'epoch': 0.03}

  3%|▎         | 12/361 [05:25<2:38:50, 27.31s/it]
  4%|▎         | 13/361 [05:52<2:38:37, 27.35s/it]
                                                  
{'loss': 1.9456, 'learning_rate': 3.9e-05, 'epoch': 0.04}

  4%|▎         | 13/361 [05:52<2:38:37, 27.35s/it]
  4%|▍         | 14/361 [06:19<2:38:18, 27.37s/it]
                                                  
{'loss': 1.9739, 'learning_rate': 4.2e-05, 'epoch': 0.04}

  4%|▍         | 14/361 [06:19<2:38:18, 27.37s/it]
  4%|▍         | 15/361 [06:46<2:37:06, 27.24s/it]
                                                  
{'loss': 1.8899, 'learning_rate': 4.4999999999999996e-05, 'epoch': 0.04}

  4%|▍         | 15/361 [06:46<2:37:06, 27.24s/it]
  4%|▍         | 16/361 [07:14<2:36:49, 27.27s/it]
                                                  
{'loss': 1.9003, 'learning_rate': 4.7999999999999994e-05, 'epoch': 0.04}

  4%|▍         | 16/361 [07:14<2:36:49, 27.27s/it]
  5%|▍         | 17/361 [07:41<2:36:38, 27.32s/it]
                                                  
{'loss': 1.8436, 'learning_rate': 5.1e-05, 'epoch': 0.05}

  5%|▍         | 17/361 [07:41<2:36:38, 27.32s/it]
  5%|▍         | 18/361 [08:08<2:36:16, 27.34s/it]
                                                  
{'loss': 1.9039, 'learning_rate': 5.399999999999999e-05, 'epoch': 0.05}

  5%|▍         | 18/361 [08:08<2:36:16, 27.34s/it]/nfs4/llm/h2o-llm/env/lib/python3.10/site-packages/bitsandbytes/autograd/_functions.py:318: UserWarning: MatMul8bitLt: inputs will be cast from torch.float32 to float16 during quantization
  warnings.warn(f"MatMul8bitLt: inputs will be cast from {A.dtype} to float16 during quantization")

  5%|▌         | 19/361 [08:36<2:36:02, 27.37s/it]
                                                  
{'loss': 1.8776, 'learning_rate': 5.6999999999999996e-05, 'epoch': 0.05}

  5%|▌         | 19/361 [08:36<2:36:02, 27.37s/it]
  6%|▌         | 20/361 [09:03<2:35:44, 27.40s/it]
                                                  
{'loss': 1.8656, 'learning_rate': 5.9999999999999995e-05, 'epoch': 0.06}

  6%|▌         | 20/361 [09:03<2:35:44, 27.40s/it]
  6%|▌         | 21/361 [09:31<2:35:20, 27.41s/it]
                                                  
{'loss': 1.8824, 'learning_rate': 6.299999999999999e-05, 'epoch': 0.06}

  6%|▌         | 21/361 [09:31<2:35:20, 27.41s/it]
  6%|▌         | 22/361 [09:58<2:34:52, 27.41s/it]
                                                  
{'loss': 1.8078, 'learning_rate': 6.599999999999999e-05, 'epoch': 0.06}

  6%|▌         | 22/361 [09:58<2:34:52, 27.41s/it]
  6%|▋         | 23/361 [10:25<2:33:19, 27.22s/it]
                                                  
{'loss': 1.8098, 'learning_rate': 6.9e-05, 'epoch': 0.06}

  6%|▋         | 23/361 [10:25<2:33:19, 27.22s/it]
  7%|▋         | 24/361 [10:52<2:33:14, 27.28s/it]
                                                  
{'loss': 1.7717, 'learning_rate': 7.199999999999999e-05, 'epoch': 0.07}

  7%|▋         | 24/361 [10:52<2:33:14, 27.28s/it]
  7%|▋         | 25/361 [11:20<2:33:03, 27.33s/it]
                                                  
{'loss': 1.7828, 'learning_rate': 7.5e-05, 'epoch': 0.07}

  7%|▋         | 25/361 [11:20<2:33:03, 27.33s/it]
  7%|▋         | 26/361 [11:47<2:32:18, 27.28s/it]
                                                  
{'loss': 1.85, 'learning_rate': 7.8e-05, 'epoch': 0.07}

  7%|▋         | 26/361 [11:47<2:32:18, 27.28s/it]
  7%|▋         | 27/361 [12:14<2:32:07, 27.33s/it]
                                                  
{'loss': 1.7406, 'learning_rate': 8.1e-05, 'epoch': 0.07}

  7%|▋         | 27/361 [12:14<2:32:07, 27.33s/it]
  8%|▊         | 28/361 [12:42<2:31:49, 27.36s/it]
                                                  
{'loss': 1.6758, 'learning_rate': 8.4e-05, 'epoch': 0.08}

  8%|▊         | 28/361 [12:42<2:31:49, 27.36s/it]
  8%|▊         | 29/361 [13:09<2:31:31, 27.39s/it]
                                                  
{'loss': 1.6981, 'learning_rate': 8.699999999999999e-05, 'epoch': 0.08}

  8%|▊         | 29/361 [13:09<2:31:31, 27.39s/it]
  8%|▊         | 30/361 [13:37<2:31:09, 27.40s/it]
                                                  
{'loss': 1.6731, 'learning_rate': 8.999999999999999e-05, 'epoch': 0.08}

  8%|▊         | 30/361 [13:37<2:31:09, 27.40s/it]
  9%|▊         | 31/361 [14:04<2:29:53, 27.25s/it]
                                                  
{'loss': 1.6915, 'learning_rate': 9.3e-05, 'epoch': 0.09}

  9%|▊         | 31/361 [14:04<2:29:53, 27.25s/it]
  9%|▉         | 32/361 [14:31<2:29:45, 27.31s/it]
                                                  
{'loss': 1.7287, 'learning_rate': 9.599999999999999e-05, 'epoch': 0.09}

  9%|▉         | 32/361 [14:31<2:29:45, 27.31s/it]
  9%|▉         | 33/361 [14:58<2:29:06, 27.28s/it]
                                                  
{'loss': 1.7307, 'learning_rate': 9.9e-05, 'epoch': 0.09}

  9%|▉         | 33/361 [14:58<2:29:06, 27.28s/it]
  9%|▉         | 34/361 [15:26<2:28:53, 27.32s/it]
                                                  
{'loss': 1.6817, 'learning_rate': 0.000102, 'epoch': 0.09}

  9%|▉         | 34/361 [15:26<2:28:53, 27.32s/it]
 10%|▉         | 35/361 [15:53<2:28:37, 27.35s/it]
                                                  
{'loss': 1.6728, 'learning_rate': 0.00010499999999999999, 'epoch': 0.1}

 10%|▉         | 35/361 [15:53<2:28:37, 27.35s/it]
 10%|▉         | 36/361 [16:20<2:27:54, 27.31s/it]
                                                  
{'loss': 1.7245, 'learning_rate': 0.00010799999999999998, 'epoch': 0.1}

 10%|▉         | 36/361 [16:20<2:27:54, 27.31s/it]/nfs4/llm/h2o-llm/env/lib/python3.10/site-packages/bitsandbytes/autograd/_functions.py:318: UserWarning: MatMul8bitLt: inputs will be cast from torch.float32 to float16 during quantization
  warnings.warn(f"MatMul8bitLt: inputs will be cast from {A.dtype} to float16 during quantization")

 10%|█         | 37/361 [16:47<2:26:54, 27.21s/it]
                                                  
{'loss': 1.66, 'learning_rate': 0.00011099999999999999, 'epoch': 0.1}

 10%|█         | 37/361 [16:47<2:26:54, 27.21s/it]
 11%|█         | 38/361 [17:15<2:26:51, 27.28s/it]
                                                  
{'loss': 1.7036, 'learning_rate': 0.00011399999999999999, 'epoch': 0.11}

 11%|█         | 38/361 [17:15<2:26:51, 27.28s/it]
 11%|█         | 39/361 [17:42<2:25:31, 27.11s/it]
                                                  
{'loss': 1.71, 'learning_rate': 0.000117, 'epoch': 0.11}

 11%|█         | 39/361 [17:42<2:25:31, 27.11s/it]
 11%|█         | 40/361 [18:09<2:24:54, 27.09s/it]
                                                  
{'loss': 1.6368, 'learning_rate': 0.00011999999999999999, 'epoch': 0.11}

 11%|█         | 40/361 [18:09<2:24:54, 27.09s/it]
 11%|█▏        | 41/361 [18:36<2:24:16, 27.05s/it]
                                                  
{'loss': 1.6833, 'learning_rate': 0.00012299999999999998, 'epoch': 0.11}

 11%|█▏        | 41/361 [18:36<2:24:16, 27.05s/it]
 12%|█▏        | 42/361 [19:03<2:24:23, 27.16s/it]
                                                  
{'loss': 1.7005, 'learning_rate': 0.00012599999999999997, 'epoch': 0.12}

 12%|█▏        | 42/361 [19:03<2:24:23, 27.16s/it]
 12%|█▏        | 43/361 [19:30<2:24:21, 27.24s/it]
                                                  
{'loss': 1.6738, 'learning_rate': 0.000129, 'epoch': 0.12}

 12%|█▏        | 43/361 [19:30<2:24:21, 27.24s/it]
 12%|█▏        | 44/361 [19:58<2:24:10, 27.29s/it]
                                                  
{'loss': 1.617, 'learning_rate': 0.00013199999999999998, 'epoch': 0.12}

 12%|█▏        | 44/361 [19:58<2:24:10, 27.29s/it]
 12%|█▏        | 45/361 [20:25<2:23:49, 27.31s/it]
                                                  
{'loss': 1.6547, 'learning_rate': 0.000135, 'epoch': 0.12}

 12%|█▏        | 45/361 [20:25<2:23:49, 27.31s/it]
 13%|█▎        | 46/361 [20:52<2:23:07, 27.26s/it]
                                                  
{'loss': 1.6814, 'learning_rate': 0.000138, 'epoch': 0.13}

 13%|█▎        | 46/361 [20:52<2:23:07, 27.26s/it]
 13%|█▎        | 47/361 [21:20<2:22:49, 27.29s/it]
                                                  
{'loss': 1.7394, 'learning_rate': 0.00014099999999999998, 'epoch': 0.13}

 13%|█▎        | 47/361 [21:20<2:22:49, 27.29s/it]
 13%|█▎        | 48/361 [21:46<2:21:35, 27.14s/it]
                                                  
{'loss': 1.6784, 'learning_rate': 0.00014399999999999998, 'epoch': 0.13}

 13%|█▎        | 48/361 [21:46<2:21:35, 27.14s/it]
 14%|█▎        | 49/361 [22:13<2:20:50, 27.08s/it]
                                                  
{'loss': 1.5594, 'learning_rate': 0.000147, 'epoch': 0.14}

 14%|█▎        | 49/361 [22:13<2:20:50, 27.08s/it]
 14%|█▍        | 50/361 [22:40<2:20:05, 27.03s/it]
                                                  
{'loss': 1.6245, 'learning_rate': 0.00015, 'epoch': 0.14}

 14%|█▍        | 50/361 [22:40<2:20:05, 27.03s/it]
 14%|█▍        | 51/361 [23:07<2:19:28, 26.99s/it]
                                                  
{'loss': 1.706, 'learning_rate': 0.00015299999999999998, 'epoch': 0.14}

 14%|█▍        | 51/361 [23:07<2:19:28, 26.99s/it]
 14%|█▍        | 52/361 [23:35<2:19:45, 27.14s/it]
                                                  
{'loss': 1.6858, 'learning_rate': 0.000156, 'epoch': 0.14}

 14%|█▍        | 52/361 [23:35<2:19:45, 27.14s/it]
 15%|█▍        | 53/361 [24:02<2:19:43, 27.22s/it]
                                                  
{'loss': 1.6109, 'learning_rate': 0.000159, 'epoch': 0.15}

 15%|█▍        | 53/361 [24:02<2:19:43, 27.22s/it]
 15%|█▍        | 54/361 [24:29<2:19:33, 27.28s/it]
                                                  
{'loss': 1.6115, 'learning_rate': 0.000162, 'epoch': 0.15}

 15%|█▍        | 54/361 [24:29<2:19:33, 27.28s/it]/nfs4/llm/h2o-llm/env/lib/python3.10/site-packages/bitsandbytes/autograd/_functions.py:318: UserWarning: MatMul8bitLt: inputs will be cast from torch.float32 to float16 during quantization
  warnings.warn(f"MatMul8bitLt: inputs will be cast from {A.dtype} to float16 during quantization")

 15%|█▌        | 55/361 [24:57<2:19:40, 27.39s/it]
                                                  
{'loss': 1.5935, 'learning_rate': 0.000165, 'epoch': 0.15}

 15%|█▌        | 55/361 [24:57<2:19:40, 27.39s/it]
 16%|█▌        | 56/361 [25:25<2:19:22, 27.42s/it]
                                                  
{'loss': 1.7018, 'learning_rate': 0.000168, 'epoch': 0.15}

 16%|█▌        | 56/361 [25:25<2:19:22, 27.42s/it]
 16%|█▌        | 57/361 [25:52<2:18:39, 27.37s/it]
                                                  
{'loss': 1.6428, 'learning_rate': 0.00017099999999999998, 'epoch': 0.16}

 16%|█▌        | 57/361 [25:52<2:18:39, 27.37s/it]
 16%|█▌        | 58/361 [26:19<2:18:17, 27.38s/it]
                                                  
{'loss': 1.6235, 'learning_rate': 0.00017399999999999997, 'epoch': 0.16}

 16%|█▌        | 58/361 [26:19<2:18:17, 27.38s/it]
 16%|█▋        | 59/361 [26:46<2:17:20, 27.29s/it]
                                                  
{'loss': 1.6198, 'learning_rate': 0.00017699999999999997, 'epoch': 0.16}

 16%|█▋        | 59/361 [26:46<2:17:20, 27.29s/it]
 17%|█▋        | 60/361 [27:14<2:17:11, 27.35s/it]
                                                  
{'loss': 1.6213, 'learning_rate': 0.00017999999999999998, 'epoch': 0.17}

 17%|█▋        | 60/361 [27:14<2:17:11, 27.35s/it]
 17%|█▋        | 61/361 [27:41<2:17:01, 27.41s/it]
                                                  
{'loss': 1.6271, 'learning_rate': 0.00018299999999999998, 'epoch': 0.17}

 17%|█▋        | 61/361 [27:41<2:17:01, 27.41s/it]
 17%|█▋        | 62/361 [28:09<2:16:27, 27.38s/it]
                                                  
{'loss': 1.6485, 'learning_rate': 0.000186, 'epoch': 0.17}

 17%|█▋        | 62/361 [28:09<2:16:27, 27.38s/it]
 17%|█▋        | 63/361 [28:36<2:16:10, 27.42s/it]
                                                  
{'loss': 1.6403, 'learning_rate': 0.00018899999999999999, 'epoch': 0.17}

 17%|█▋        | 63/361 [28:36<2:16:10, 27.42s/it]
 18%|█▊        | 64/361 [29:04<2:16:46, 27.63s/it]
                                                  
{'loss': 1.6116, 'learning_rate': 0.00019199999999999998, 'epoch': 0.18}

 18%|█▊        | 64/361 [29:04<2:16:46, 27.63s/it]
 18%|█▊        | 65/361 [29:32<2:15:48, 27.53s/it]
                                                  
{'loss': 1.5732, 'learning_rate': 0.000195, 'epoch': 0.18}

 18%|█▊        | 65/361 [29:32<2:15:48, 27.53s/it]
 18%|█▊        | 66/361 [29:59<2:15:16, 27.51s/it]
                                                  
{'loss': 1.6378, 'learning_rate': 0.000198, 'epoch': 0.18}

 18%|█▊        | 66/361 [29:59<2:15:16, 27.51s/it]
 19%|█▊        | 67/361 [30:27<2:15:58, 27.75s/it]
                                                  
{'loss': 1.5817, 'learning_rate': 0.000201, 'epoch': 0.19}

 19%|█▊        | 67/361 [30:27<2:15:58, 27.75s/it]
 19%|█▉        | 68/361 [30:55<2:15:22, 27.72s/it]
                                                  
{'loss': 1.5965, 'learning_rate': 0.000204, 'epoch': 0.19}

 19%|█▉        | 68/361 [30:55<2:15:22, 27.72s/it]
 19%|█▉        | 69/361 [31:23<2:14:40, 27.67s/it]
                                                  
{'loss': 1.5927, 'learning_rate': 0.00020699999999999996, 'epoch': 0.19}

 19%|█▉        | 69/361 [31:23<2:14:40, 27.67s/it]
 19%|█▉        | 70/361 [31:50<2:13:59, 27.63s/it]
                                                  
{'loss': 1.6046, 'learning_rate': 0.00020999999999999998, 'epoch': 0.19}

 19%|█▉        | 70/361 [31:50<2:13:59, 27.63s/it]
 20%|█▉        | 71/361 [32:18<2:13:34, 27.64s/it]
                                                  
{'loss': 1.5705, 'learning_rate': 0.00021299999999999997, 'epoch': 0.2}

 20%|█▉        | 71/361 [32:18<2:13:34, 27.64s/it]
 20%|█▉        | 72/361 [32:46<2:13:13, 27.66s/it]
                                                  
{'loss': 1.7093, 'learning_rate': 0.00021599999999999996, 'epoch': 0.2}

 20%|█▉        | 72/361 [32:46<2:13:13, 27.66s/it]/nfs4/llm/h2o-llm/env/lib/python3.10/site-packages/bitsandbytes/autograd/_functions.py:318: UserWarning: MatMul8bitLt: inputs will be cast from torch.float32 to float16 during quantization
  warnings.warn(f"MatMul8bitLt: inputs will be cast from {A.dtype} to float16 during quantization")

 20%|██        | 73/361 [33:13<2:12:49, 27.67s/it]
                                                  
{'loss': 1.551, 'learning_rate': 0.00021899999999999998, 'epoch': 0.2}

 20%|██        | 73/361 [33:13<2:12:49, 27.67s/it]
 20%|██        | 74/361 [33:41<2:12:19, 27.66s/it]
                                                  
{'loss': 1.5896, 'learning_rate': 0.00022199999999999998, 'epoch': 0.2}

 20%|██        | 74/361 [33:41<2:12:19, 27.66s/it]
 21%|██        | 75/361 [34:09<2:12:24, 27.78s/it]
                                                  
{'loss': 1.6955, 'learning_rate': 0.000225, 'epoch': 0.21}

 21%|██        | 75/361 [34:09<2:12:24, 27.78s/it]
 21%|██        | 76/361 [34:38<2:13:19, 28.07s/it]
                                                  
{'loss': 1.4711, 'learning_rate': 0.00022799999999999999, 'epoch': 0.21}

 21%|██        | 76/361 [34:38<2:13:19, 28.07s/it]
 21%|██▏       | 77/361 [35:06<2:13:15, 28.15s/it]
                                                  
{'loss': 1.5615, 'learning_rate': 0.00023099999999999998, 'epoch': 0.21}

 21%|██▏       | 77/361 [35:06<2:13:15, 28.15s/it]
 22%|██▏       | 78/361 [35:35<2:13:42, 28.35s/it]
                                                  
{'loss': 1.622, 'learning_rate': 0.000234, 'epoch': 0.22}

 22%|██▏       | 78/361 [35:35<2:13:42, 28.35s/it]
 22%|██▏       | 79/361 [36:02<2:11:24, 27.96s/it]
                                                  
{'loss': 1.6105, 'learning_rate': 0.000237, 'epoch': 0.22}

 22%|██▏       | 79/361 [36:02<2:11:24, 27.96s/it]
 22%|██▏       | 80/361 [36:30<2:10:36, 27.89s/it]
                                                  
{'loss': 1.6093, 'learning_rate': 0.00023999999999999998, 'epoch': 0.22}

 22%|██▏       | 80/361 [36:30<2:10:36, 27.89s/it]
 22%|██▏       | 81/361 [36:57<2:09:48, 27.81s/it]
                                                  
{'loss': 1.6308, 'learning_rate': 0.000243, 'epoch': 0.22}

 22%|██▏       | 81/361 [36:57<2:09:48, 27.81s/it]
 23%|██▎       | 82/361 [37:25<2:09:21, 27.82s/it]
                                                  
{'loss': 1.6095, 'learning_rate': 0.00024599999999999996, 'epoch': 0.23}

 23%|██▎       | 82/361 [37:25<2:09:21, 27.82s/it]
 23%|██▎       | 83/361 [37:52<2:08:09, 27.66s/it]
                                                  
{'loss': 1.6086, 'learning_rate': 0.000249, 'epoch': 0.23}

 23%|██▎       | 83/361 [37:52<2:08:09, 27.66s/it]
 23%|██▎       | 84/361 [38:20<2:07:24, 27.60s/it]
                                                  
{'loss': 1.6235, 'learning_rate': 0.00025199999999999995, 'epoch': 0.23}

 23%|██▎       | 84/361 [38:20<2:07:24, 27.60s/it]
 24%|██▎       | 85/361 [38:47<2:07:02, 27.62s/it]
                                                  
{'loss': 1.6175, 'learning_rate': 0.00025499999999999996, 'epoch': 0.24}

 24%|██▎       | 85/361 [38:47<2:07:02, 27.62s/it]
 24%|██▍       | 86/361 [39:15<2:06:30, 27.60s/it]
                                                  
{'loss': 1.6274, 'learning_rate': 0.000258, 'epoch': 0.24}

 24%|██▍       | 86/361 [39:15<2:06:30, 27.60s/it]
 24%|██▍       | 87/361 [39:43<2:06:00, 27.59s/it]
                                                  
{'loss': 1.6438, 'learning_rate': 0.000261, 'epoch': 0.24}

 24%|██▍       | 87/361 [39:43<2:06:00, 27.59s/it]
 24%|██▍       | 88/361 [40:10<2:05:35, 27.60s/it]
                                                  
{'loss': 1.5622, 'learning_rate': 0.00026399999999999997, 'epoch': 0.24}

 24%|██▍       | 88/361 [40:10<2:05:35, 27.60s/it]
 25%|██▍       | 89/361 [40:38<2:05:19, 27.64s/it]
                                                  
{'loss': 1.6163, 'learning_rate': 0.000267, 'epoch': 0.25}

 25%|██▍       | 89/361 [40:38<2:05:19, 27.64s/it]
 25%|██▍       | 90/361 [41:06<2:04:42, 27.61s/it]
                                                  
{'loss': 1.6598, 'learning_rate': 0.00027, 'epoch': 0.25}

 25%|██▍       | 90/361 [41:06<2:04:42, 27.61s/it]/nfs4/llm/h2o-llm/env/lib/python3.10/site-packages/bitsandbytes/autograd/_functions.py:318: UserWarning: MatMul8bitLt: inputs will be cast from torch.float32 to float16 during quantization
  warnings.warn(f"MatMul8bitLt: inputs will be cast from {A.dtype} to float16 during quantization")

 25%|██▌       | 91/361 [41:33<2:04:15, 27.61s/it]
                                                  
{'loss': 1.5889, 'learning_rate': 0.00027299999999999997, 'epoch': 0.25}

 25%|██▌       | 91/361 [41:33<2:04:15, 27.61s/it]
 25%|██▌       | 92/361 [42:00<2:03:28, 27.54s/it]
                                                  
{'loss': 1.5972, 'learning_rate': 0.000276, 'epoch': 0.25}

 25%|██▌       | 92/361 [42:00<2:03:28, 27.54s/it]
 26%|██▌       | 93/361 [42:28<2:02:32, 27.44s/it]
                                                  
{'loss': 1.6558, 'learning_rate': 0.000279, 'epoch': 0.26}

 26%|██▌       | 93/361 [42:28<2:02:32, 27.44s/it]
 26%|██▌       | 94/361 [42:55<2:02:24, 27.51s/it]
                                                  
{'loss': 1.5858, 'learning_rate': 0.00028199999999999997, 'epoch': 0.26}

 26%|██▌       | 94/361 [42:55<2:02:24, 27.51s/it]
 26%|██▋       | 95/361 [43:23<2:01:49, 27.48s/it]
                                                  
{'loss': 1.6326, 'learning_rate': 0.000285, 'epoch': 0.26}

 26%|██▋       | 95/361 [43:23<2:01:49, 27.48s/it]
 27%|██▋       | 96/361 [43:50<2:01:13, 27.45s/it]
                                                  
{'loss': 1.6233, 'learning_rate': 0.00028799999999999995, 'epoch': 0.27}

 27%|██▋       | 96/361 [43:50<2:01:13, 27.45s/it]
 27%|██▋       | 97/361 [44:18<2:01:05, 27.52s/it]
                                                  
{'loss': 1.6857, 'learning_rate': 0.00029099999999999997, 'epoch': 0.27}

 27%|██▋       | 97/361 [44:18<2:01:05, 27.52s/it]
 27%|██▋       | 98/361 [44:46<2:01:01, 27.61s/it]
                                                  
{'loss': 1.5202, 'learning_rate': 0.000294, 'epoch': 0.27}

 27%|██▋       | 98/361 [44:46<2:01:01, 27.61s/it]
 27%|██▋       | 99/361 [45:13<2:00:39, 27.63s/it]
                                                  
{'loss': 1.6073, 'learning_rate': 0.00029699999999999996, 'epoch': 0.27}

 27%|██▋       | 99/361 [45:13<2:00:39, 27.63s/it]
 28%|██▊       | 100/361 [45:41<1:59:45, 27.53s/it]
                                                   
{'loss': 1.6937, 'learning_rate': 0.0003, 'epoch': 0.28}

 28%|██▊       | 100/361 [45:41<1:59:45, 27.53s/it]
 28%|██▊       | 101/361 [46:08<1:59:35, 27.60s/it]
                                                   
{'loss': 1.5498, 'learning_rate': 0.00029885057471264366, 'epoch': 0.28}

 28%|██▊       | 101/361 [46:08<1:59:35, 27.60s/it]
 28%|██▊       | 102/361 [46:36<1:59:22, 27.66s/it]
                                                   
{'loss': 1.5835, 'learning_rate': 0.00029770114942528734, 'epoch': 0.28}

 28%|██▊       | 102/361 [46:36<1:59:22, 27.66s/it]
 29%|██▊       | 103/361 [47:04<1:58:55, 27.66s/it]
                                                   
{'loss': 1.5961, 'learning_rate': 0.00029655172413793103, 'epoch': 0.28}

 29%|██▊       | 103/361 [47:04<1:58:55, 27.66s/it]
 29%|██▉       | 104/361 [47:32<1:58:38, 27.70s/it]
                                                   
{'loss': 1.5695, 'learning_rate': 0.00029540229885057466, 'epoch': 0.29}

 29%|██▉       | 104/361 [47:32<1:58:38, 27.70s/it]
 29%|██▉       | 105/361 [47:59<1:58:19, 27.73s/it]
                                                   
{'loss': 1.5921, 'learning_rate': 0.00029425287356321835, 'epoch': 0.29}

 29%|██▉       | 105/361 [47:59<1:58:19, 27.73s/it]
 29%|██▉       | 106/361 [48:27<1:57:57, 27.75s/it]
                                                   
{'loss': 1.5812, 'learning_rate': 0.00029310344827586203, 'epoch': 0.29}

 29%|██▉       | 106/361 [48:27<1:57:57, 27.75s/it]
 30%|██▉       | 107/361 [48:55<1:57:30, 27.76s/it]
                                                   
{'loss': 1.5475, 'learning_rate': 0.0002919540229885057, 'epoch': 0.3}

 30%|██▉       | 107/361 [48:55<1:57:30, 27.76s/it]
 30%|██▉       | 108/361 [49:22<1:56:23, 27.60s/it]
                                                   
{'loss': 1.6163, 'learning_rate': 0.0002908045977011494, 'epoch': 0.3}

 30%|██▉       | 108/361 [49:22<1:56:23, 27.60s/it]/nfs4/llm/h2o-llm/env/lib/python3.10/site-packages/bitsandbytes/autograd/_functions.py:318: UserWarning: MatMul8bitLt: inputs will be cast from torch.float32 to float16 during quantization
  warnings.warn(f"MatMul8bitLt: inputs will be cast from {A.dtype} to float16 during quantization")

 30%|███       | 109/361 [49:50<1:56:31, 27.74s/it]
                                                   
{'loss': 1.6514, 'learning_rate': 0.0002896551724137931, 'epoch': 0.3}

 30%|███       | 109/361 [49:50<1:56:31, 27.74s/it]
 30%|███       | 110/361 [50:18<1:55:29, 27.61s/it]
                                                   
{'loss': 1.5918, 'learning_rate': 0.00028850574712643677, 'epoch': 0.3}

 30%|███       | 110/361 [50:18<1:55:29, 27.61s/it]
 31%|███       | 111/361 [50:46<1:55:27, 27.71s/it]
                                                   
{'loss': 1.6001, 'learning_rate': 0.0002873563218390804, 'epoch': 0.31}

 31%|███       | 111/361 [50:46<1:55:27, 27.71s/it]
 31%|███       | 112/361 [51:13<1:55:05, 27.73s/it]
                                                   
{'loss': 1.5836, 'learning_rate': 0.0002862068965517241, 'epoch': 0.31}

 31%|███       | 112/361 [51:13<1:55:05, 27.73s/it]
 31%|███▏      | 113/361 [51:41<1:54:39, 27.74s/it]
                                                   
{'loss': 1.6236, 'learning_rate': 0.00028505747126436777, 'epoch': 0.31}

 31%|███▏      | 113/361 [51:41<1:54:39, 27.74s/it]
 32%|███▏      | 114/361 [52:09<1:54:11, 27.74s/it]
                                                   
{'loss': 1.5913, 'learning_rate': 0.00028390804597701146, 'epoch': 0.32}

 32%|███▏      | 114/361 [52:09<1:54:11, 27.74s/it]
 32%|███▏      | 115/361 [52:36<1:53:33, 27.70s/it]
                                                   
{'loss': 1.5833, 'learning_rate': 0.00028275862068965514, 'epoch': 0.32}

 32%|███▏      | 115/361 [52:36<1:53:33, 27.70s/it]
 32%|███▏      | 116/361 [53:03<1:52:11, 27.48s/it]
                                                   
{'loss': 1.6187, 'learning_rate': 0.00028160919540229883, 'epoch': 0.32}

 32%|███▏      | 116/361 [53:03<1:52:11, 27.48s/it]
 32%|███▏      | 117/361 [53:31<1:52:03, 27.56s/it]
                                                   
{'loss': 1.6057, 'learning_rate': 0.0002804597701149425, 'epoch': 0.32}

 32%|███▏      | 117/361 [53:31<1:52:03, 27.56s/it]
 33%|███▎      | 118/361 [53:59<1:51:48, 27.61s/it]
                                                   
{'loss': 1.6023, 'learning_rate': 0.0002793103448275862, 'epoch': 0.33}

 33%|███▎      | 118/361 [53:59<1:51:48, 27.61s/it]
 33%|███▎      | 119/361 [54:27<1:51:35, 27.67s/it]
                                                   
{'loss': 1.6291, 'learning_rate': 0.0002781609195402299, 'epoch': 0.33}

 33%|███▎      | 119/361 [54:27<1:51:35, 27.67s/it]
 33%|███▎      | 120/361 [54:54<1:50:38, 27.55s/it]
                                                   
{'loss': 1.6262, 'learning_rate': 0.00027701149425287357, 'epoch': 0.33}

 33%|███▎      | 120/361 [54:54<1:50:38, 27.55s/it]
 34%|███▎      | 121/361 [55:22<1:50:33, 27.64s/it]
                                                   
{'loss': 1.579, 'learning_rate': 0.0002758620689655172, 'epoch': 0.33}

 34%|███▎      | 121/361 [55:22<1:50:33, 27.64s/it]
 34%|███▍      | 122/361 [55:49<1:50:05, 27.64s/it]
                                                   
{'loss': 1.5915, 'learning_rate': 0.0002747126436781609, 'epoch': 0.34}

 34%|███▍      | 122/361 [55:49<1:50:05, 27.64s/it]
 34%|███▍      | 123/361 [56:17<1:49:47, 27.68s/it]
                                                   
{'loss': 1.5752, 'learning_rate': 0.00027356321839080457, 'epoch': 0.34}

 34%|███▍      | 123/361 [56:17<1:49:47, 27.68s/it]
 34%|███▍      | 124/361 [56:44<1:48:49, 27.55s/it]
                                                   
{'loss': 1.6326, 'learning_rate': 0.00027241379310344825, 'epoch': 0.34}

 34%|███▍      | 124/361 [56:44<1:48:49, 27.55s/it]
 35%|███▍      | 125/361 [57:12<1:48:31, 27.59s/it]
                                                   
{'loss': 1.566, 'learning_rate': 0.00027126436781609194, 'epoch': 0.35}

 35%|███▍      | 125/361 [57:12<1:48:31, 27.59s/it]
 35%|███▍      | 126/361 [57:39<1:47:46, 27.52s/it]
                                                   
{'loss': 1.5923, 'learning_rate': 0.0002701149425287356, 'epoch': 0.35}

 35%|███▍      | 126/361 [57:39<1:47:46, 27.52s/it]/nfs4/llm/h2o-llm/env/lib/python3.10/site-packages/bitsandbytes/autograd/_functions.py:318: UserWarning: MatMul8bitLt: inputs will be cast from torch.float32 to float16 during quantization
  warnings.warn(f"MatMul8bitLt: inputs will be cast from {A.dtype} to float16 during quantization")

 35%|███▌      | 127/361 [58:08<1:48:02, 27.70s/it]
                                                   
{'loss': 1.5866, 'learning_rate': 0.0002689655172413793, 'epoch': 0.35}

 35%|███▌      | 127/361 [58:08<1:48:02, 27.70s/it]
 35%|███▌      | 128/361 [58:35<1:47:28, 27.67s/it]
                                                   
{'loss': 1.5862, 'learning_rate': 0.00026781609195402294, 'epoch': 0.35}

 35%|███▌      | 128/361 [58:35<1:47:28, 27.67s/it]
 36%|███▌      | 129/361 [59:03<1:47:09, 27.71s/it]
                                                   
{'loss': 1.5903, 'learning_rate': 0.0002666666666666666, 'epoch': 0.36}

 36%|███▌      | 129/361 [59:03<1:47:09, 27.71s/it]
 36%|███▌      | 130/361 [59:31<1:46:49, 27.75s/it]
                                                   
{'loss': 1.5147, 'learning_rate': 0.0002655172413793103, 'epoch': 0.36}

 36%|███▌      | 130/361 [59:31<1:46:49, 27.75s/it]
 36%|███▋      | 131/361 [59:59<1:46:23, 27.75s/it]
                                                   
{'loss': 1.6036, 'learning_rate': 0.000264367816091954, 'epoch': 0.36}

 36%|███▋      | 131/361 [59:59<1:46:23, 27.75s/it]
 37%|███▋      | 132/361 [1:00:27<1:46:08, 27.81s/it]
                                                     
{'loss': 1.5487, 'learning_rate': 0.0002632183908045977, 'epoch': 0.37}

 37%|███▋      | 132/361 [1:00:27<1:46:08, 27.81s/it]
 37%|███▋      | 133/361 [1:00:55<1:46:01, 27.90s/it]
                                                     
{'loss': 1.5122, 'learning_rate': 0.00026206896551724137, 'epoch': 0.37}

 37%|███▋      | 133/361 [1:00:55<1:46:01, 27.90s/it]
 37%|███▋      | 134/361 [1:01:23<1:45:37, 27.92s/it]
                                                     
{'loss': 1.5566, 'learning_rate': 0.00026091954022988505, 'epoch': 0.37}

 37%|███▋      | 134/361 [1:01:23<1:45:37, 27.92s/it]
 37%|███▋      | 135/361 [1:01:50<1:44:57, 27.87s/it]
                                                     
{'loss': 1.6031, 'learning_rate': 0.0002597701149425287, 'epoch': 0.37}

 37%|███▋      | 135/361 [1:01:50<1:44:57, 27.87s/it]
 38%|███▊      | 136/361 [1:02:18<1:44:27, 27.86s/it]
                                                     
{'loss': 1.6208, 'learning_rate': 0.00025862068965517237, 'epoch': 0.38}

 38%|███▊      | 136/361 [1:02:18<1:44:27, 27.86s/it]
 38%|███▊      | 137/361 [1:02:46<1:44:15, 27.93s/it]
                                                     
{'loss': 1.5874, 'learning_rate': 0.00025747126436781605, 'epoch': 0.38}

 38%|███▊      | 137/361 [1:02:46<1:44:15, 27.93s/it]
 38%|███▊      | 138/361 [1:03:14<1:43:45, 27.91s/it]
                                                     
{'loss': 1.6115, 'learning_rate': 0.00025632183908045974, 'epoch': 0.38}

 38%|███▊      | 138/361 [1:03:14<1:43:45, 27.91s/it]
 39%|███▊      | 139/361 [1:03:42<1:42:42, 27.76s/it]
                                                     
{'loss': 1.573, 'learning_rate': 0.0002551724137931034, 'epoch': 0.38}

 39%|███▊      | 139/361 [1:03:42<1:42:42, 27.76s/it]
 39%|███▉      | 140/361 [1:04:09<1:42:19, 27.78s/it]
                                                     
{'loss': 1.6461, 'learning_rate': 0.0002540229885057471, 'epoch': 0.39}

 39%|███▉      | 140/361 [1:04:09<1:42:19, 27.78s/it]
 39%|███▉      | 141/361 [1:04:37<1:42:06, 27.85s/it]
                                                     
{'loss': 1.6277, 'learning_rate': 0.0002528735632183908, 'epoch': 0.39}

 39%|███▉      | 141/361 [1:04:37<1:42:06, 27.85s/it]
 39%|███▉      | 142/361 [1:05:05<1:41:48, 27.89s/it]
                                                     
{'loss': 1.6409, 'learning_rate': 0.0002517241379310345, 'epoch': 0.39}

 39%|███▉      | 142/361 [1:05:05<1:41:48, 27.89s/it]
 40%|███▉      | 143/361 [1:05:34<1:41:46, 28.01s/it]
                                                     
{'loss': 1.5435, 'learning_rate': 0.00025057471264367816, 'epoch': 0.4}

 40%|███▉      | 143/361 [1:05:34<1:41:46, 28.01s/it]
 40%|███▉      | 144/361 [1:06:02<1:41:42, 28.12s/it]
                                                     
{'loss': 1.5973, 'learning_rate': 0.00024942528735632185, 'epoch': 0.4}

 40%|███▉      | 144/361 [1:06:02<1:41:42, 28.12s/it]/nfs4/llm/h2o-llm/env/lib/python3.10/site-packages/bitsandbytes/autograd/_functions.py:318: UserWarning: MatMul8bitLt: inputs will be cast from torch.float32 to float16 during quantization
  warnings.warn(f"MatMul8bitLt: inputs will be cast from {A.dtype} to float16 during quantization")

 40%|████      | 145/361 [1:06:30<1:40:43, 27.98s/it]
                                                     
{'loss': 1.5373, 'learning_rate': 0.0002482758620689655, 'epoch': 0.4}

 40%|████      | 145/361 [1:06:30<1:40:43, 27.98s/it]
 40%|████      | 146/361 [1:06:58<1:40:10, 27.96s/it]
                                                     
{'loss': 1.5288, 'learning_rate': 0.00024712643678160916, 'epoch': 0.4}

 40%|████      | 146/361 [1:06:58<1:40:10, 27.96s/it]
 41%|████      | 147/361 [1:07:25<1:39:34, 27.92s/it]
                                                     
{'loss': 1.6226, 'learning_rate': 0.00024597701149425285, 'epoch': 0.41}

 41%|████      | 147/361 [1:07:25<1:39:34, 27.92s/it]
 41%|████      | 148/361 [1:07:54<1:39:14, 27.95s/it]
                                                     
{'loss': 1.5282, 'learning_rate': 0.00024482758620689653, 'epoch': 0.41}

 41%|████      | 148/361 [1:07:54<1:39:14, 27.95s/it]
 41%|████▏     | 149/361 [1:08:21<1:38:46, 27.96s/it]
                                                     
{'loss': 1.537, 'learning_rate': 0.0002436781609195402, 'epoch': 0.41}

 41%|████▏     | 149/361 [1:08:21<1:38:46, 27.96s/it]
 42%|████▏     | 150/361 [1:08:50<1:38:24, 27.98s/it]
                                                     
{'loss': 1.588, 'learning_rate': 0.0002425287356321839, 'epoch': 0.41}

 42%|████▏     | 150/361 [1:08:50<1:38:24, 27.98s/it]
 42%|████▏     | 151/361 [1:09:18<1:37:55, 27.98s/it]
                                                     
{'loss': 1.5627, 'learning_rate': 0.00024137931034482756, 'epoch': 0.42}

 42%|████▏     | 151/361 [1:09:18<1:37:55, 27.98s/it]
 42%|████▏     | 152/361 [1:09:45<1:36:55, 27.82s/it]
                                                     
{'loss': 1.5433, 'learning_rate': 0.00024022988505747125, 'epoch': 0.42}

 42%|████▏     | 152/361 [1:09:45<1:36:55, 27.82s/it]
 42%|████▏     | 153/361 [1:10:13<1:36:40, 27.89s/it]
                                                     
{'loss': 1.5526, 'learning_rate': 0.0002390804597701149, 'epoch': 0.42}

 42%|████▏     | 153/361 [1:10:13<1:36:40, 27.89s/it]
 43%|████▎     | 154/361 [1:10:41<1:36:28, 27.96s/it]
                                                     
{'loss': 1.4991, 'learning_rate': 0.00023793103448275862, 'epoch': 0.43}

 43%|████▎     | 154/361 [1:10:41<1:36:28, 27.96s/it]
 43%|████▎     | 155/361 [1:11:09<1:36:07, 28.00s/it]
                                                     
{'loss': 1.5872, 'learning_rate': 0.00023678160919540228, 'epoch': 0.43}

 43%|████▎     | 155/361 [1:11:09<1:36:07, 28.00s/it]
 43%|████▎     | 156/361 [1:11:37<1:35:55, 28.07s/it]
                                                     
{'loss': 1.4915, 'learning_rate': 0.00023563218390804593, 'epoch': 0.43}

 43%|████▎     | 156/361 [1:11:37<1:35:55, 28.07s/it]
 43%|████▎     | 157/361 [1:12:06<1:35:25, 28.07s/it]
                                                     
{'loss': 1.5684, 'learning_rate': 0.00023448275862068965, 'epoch': 0.43}

 43%|████▎     | 157/361 [1:12:06<1:35:25, 28.07s/it]
 44%|████▍     | 158/361 [1:12:34<1:35:06, 28.11s/it]
                                                     
{'loss': 1.5708, 'learning_rate': 0.0002333333333333333, 'epoch': 0.44}

 44%|████▍     | 158/361 [1:12:34<1:35:06, 28.11s/it]
 44%|████▍     | 159/361 [1:13:02<1:34:36, 28.10s/it]
                                                     
{'loss': 1.6061, 'learning_rate': 0.000232183908045977, 'epoch': 0.44}

 44%|████▍     | 159/361 [1:13:02<1:34:36, 28.10s/it]
 44%|████▍     | 160/361 [1:13:30<1:34:13, 28.13s/it]
                                                     
{'loss': 1.6246, 'learning_rate': 0.00023103448275862065, 'epoch': 0.44}

 44%|████▍     | 160/361 [1:13:30<1:34:13, 28.13s/it]
 45%|████▍     | 161/361 [1:13:59<1:34:24, 28.32s/it]
                                                     
{'loss': 1.5285, 'learning_rate': 0.00022988505747126436, 'epoch': 0.45}

 45%|████▍     | 161/361 [1:13:59<1:34:24, 28.32s/it]
 45%|████▍     | 162/361 [1:14:27<1:34:15, 28.42s/it]
                                                     
{'loss': 1.5758, 'learning_rate': 0.00022873563218390802, 'epoch': 0.45}

 45%|████▍     | 162/361 [1:14:27<1:34:15, 28.42s/it]/nfs4/llm/h2o-llm/env/lib/python3.10/site-packages/bitsandbytes/autograd/_functions.py:318: UserWarning: MatMul8bitLt: inputs will be cast from torch.float32 to float16 during quantization
  warnings.warn(f"MatMul8bitLt: inputs will be cast from {A.dtype} to float16 during quantization")

 45%|████▌     | 163/361 [1:14:56<1:33:47, 28.42s/it]
                                                     
{'loss': 1.546, 'learning_rate': 0.0002275862068965517, 'epoch': 0.45}

 45%|████▌     | 163/361 [1:14:56<1:33:47, 28.42s/it]
 45%|████▌     | 164/361 [1:15:24<1:32:53, 28.29s/it]
                                                     
{'loss': 1.5438, 'learning_rate': 0.0002264367816091954, 'epoch': 0.45}

 45%|████▌     | 164/361 [1:15:24<1:32:53, 28.29s/it]
 46%|████▌     | 165/361 [1:15:51<1:31:27, 28.00s/it]
                                                     
{'loss': 1.6035, 'learning_rate': 0.00022528735632183907, 'epoch': 0.46}

 46%|████▌     | 165/361 [1:15:51<1:31:27, 28.00s/it]
 46%|████▌     | 166/361 [1:16:19<1:31:04, 28.02s/it]
                                                     
{'loss': 1.6114, 'learning_rate': 0.00022413793103448273, 'epoch': 0.46}

 46%|████▌     | 166/361 [1:16:19<1:31:04, 28.02s/it]
 46%|████▋     | 167/361 [1:16:47<1:30:25, 27.97s/it]
                                                     
{'loss': 1.5653, 'learning_rate': 0.00022298850574712644, 'epoch': 0.46}

 46%|████▋     | 167/361 [1:16:47<1:30:25, 27.97s/it]
 47%|████▋     | 168/361 [1:17:15<1:29:38, 27.87s/it]
                                                     
{'loss': 1.5622, 'learning_rate': 0.0002218390804597701, 'epoch': 0.46}

 47%|████▋     | 168/361 [1:17:15<1:29:38, 27.87s/it]
 47%|████▋     | 169/361 [1:17:42<1:29:01, 27.82s/it]
                                                     
{'loss': 1.5144, 'learning_rate': 0.00022068965517241376, 'epoch': 0.47}

 47%|████▋     | 169/361 [1:17:42<1:29:01, 27.82s/it]
 47%|████▋     | 170/361 [1:18:11<1:28:50, 27.91s/it]
                                                     
{'loss': 1.5367, 'learning_rate': 0.00021954022988505744, 'epoch': 0.47}

 47%|████▋     | 170/361 [1:18:11<1:28:50, 27.91s/it]
 47%|████▋     | 171/361 [1:18:38<1:28:24, 27.92s/it]
                                                     
{'loss': 1.5273, 'learning_rate': 0.00021839080459770113, 'epoch': 0.47}

 47%|████▋     | 171/361 [1:18:38<1:28:24, 27.92s/it]
 48%|████▊     | 172/361 [1:19:06<1:27:58, 27.93s/it]
                                                     
{'loss': 1.6219, 'learning_rate': 0.00021724137931034481, 'epoch': 0.48}

 48%|████▊     | 172/361 [1:19:06<1:27:58, 27.93s/it]
 48%|████▊     | 173/361 [1:19:35<1:27:45, 28.01s/it]
                                                     
{'loss': 1.5127, 'learning_rate': 0.00021609195402298847, 'epoch': 0.48}

 48%|████▊     | 173/361 [1:19:35<1:27:45, 28.01s/it]
 48%|████▊     | 174/361 [1:20:03<1:27:16, 28.00s/it]
                                                     
{'loss': 1.5708, 'learning_rate': 0.00021494252873563218, 'epoch': 0.48}

 48%|████▊     | 174/361 [1:20:03<1:27:16, 28.00s/it]
 48%|████▊     | 175/361 [1:20:30<1:26:34, 27.93s/it]
                                                     
{'loss': 1.5337, 'learning_rate': 0.00021379310344827584, 'epoch': 0.48}

 48%|████▊     | 175/361 [1:20:30<1:26:34, 27.93s/it]
 49%|████▉     | 176/361 [1:20:58<1:26:11, 27.95s/it]
                                                     
{'loss': 1.5158, 'learning_rate': 0.00021264367816091953, 'epoch': 0.49}

 49%|████▉     | 176/361 [1:20:58<1:26:11, 27.95s/it]
 49%|████▉     | 177/361 [1:21:26<1:25:41, 27.94s/it]
                                                     
{'loss': 1.5736, 'learning_rate': 0.00021149425287356319, 'epoch': 0.49}

 49%|████▉     | 177/361 [1:21:26<1:25:41, 27.94s/it]
 49%|████▉     | 178/361 [1:21:54<1:25:18, 27.97s/it]
                                                     
{'loss': 1.5677, 'learning_rate': 0.0002103448275862069, 'epoch': 0.49}

 49%|████▉     | 178/361 [1:21:54<1:25:18, 27.97s/it]
 50%|████▉     | 179/361 [1:22:22<1:24:23, 27.82s/it]
                                                     
{'loss': 1.5197, 'learning_rate': 0.00020919540229885056, 'epoch': 0.49}

 50%|████▉     | 179/361 [1:22:22<1:24:23, 27.82s/it]
 50%|████▉     | 180/361 [1:22:49<1:23:43, 27.75s/it]
                                                     
{'loss': 1.545, 'learning_rate': 0.00020804597701149421, 'epoch': 0.5}

 50%|████▉     | 180/361 [1:22:49<1:23:43, 27.75s/it]/nfs4/llm/h2o-llm/env/lib/python3.10/site-packages/bitsandbytes/autograd/_functions.py:318: UserWarning: MatMul8bitLt: inputs will be cast from torch.float32 to float16 during quantization
  warnings.warn(f"MatMul8bitLt: inputs will be cast from {A.dtype} to float16 during quantization")

 50%|█████     | 181/361 [1:23:17<1:23:02, 27.68s/it]
                                                     
{'loss': 1.5012, 'learning_rate': 0.00020689655172413793, 'epoch': 0.5}

 50%|█████     | 181/361 [1:23:17<1:23:02, 27.68s/it]
 50%|█████     | 182/361 [1:23:44<1:22:25, 27.63s/it]
                                                     
{'loss': 1.5202, 'learning_rate': 0.00020574712643678158, 'epoch': 0.5}

 50%|█████     | 182/361 [1:23:44<1:22:25, 27.63s/it]
 51%|█████     | 183/361 [1:24:12<1:21:42, 27.54s/it]
                                                     
{'loss': 1.5701, 'learning_rate': 0.00020459770114942527, 'epoch': 0.51}

 51%|█████     | 183/361 [1:24:12<1:21:42, 27.54s/it]
 51%|█████     | 184/361 [1:24:39<1:21:05, 27.49s/it]
                                                     
{'loss': 1.5215, 'learning_rate': 0.00020344827586206893, 'epoch': 0.51}

 51%|█████     | 184/361 [1:24:39<1:21:05, 27.49s/it]
 51%|█████     | 185/361 [1:25:07<1:20:32, 27.46s/it]
                                                     
{'loss': 1.5524, 'learning_rate': 0.00020229885057471264, 'epoch': 0.51}

 51%|█████     | 185/361 [1:25:07<1:20:32, 27.46s/it]
 52%|█████▏    | 186/361 [1:25:34<1:19:40, 27.32s/it]
                                                     
{'loss': 1.5759, 'learning_rate': 0.0002011494252873563, 'epoch': 0.51}

 52%|█████▏    | 186/361 [1:25:34<1:19:40, 27.32s/it]
 52%|█████▏    | 187/361 [1:26:01<1:19:24, 27.38s/it]
                                                     
{'loss': 1.6308, 'learning_rate': 0.00019999999999999998, 'epoch': 0.52}

 52%|█████▏    | 187/361 [1:26:01<1:19:24, 27.38s/it]
 52%|█████▏    | 188/361 [1:26:28<1:18:57, 27.38s/it]
                                                     
{'loss': 1.6175, 'learning_rate': 0.00019885057471264367, 'epoch': 0.52}

 52%|█████▏    | 188/361 [1:26:28<1:18:57, 27.38s/it]
 52%|█████▏    | 189/361 [1:26:56<1:18:45, 27.47s/it]
                                                     
{'loss': 1.6349, 'learning_rate': 0.00019770114942528735, 'epoch': 0.52}

 52%|█████▏    | 189/361 [1:26:56<1:18:45, 27.47s/it]
 53%|█████▎    | 190/361 [1:27:24<1:18:39, 27.60s/it]
                                                     
{'loss': 1.5808, 'learning_rate': 0.000196551724137931, 'epoch': 0.53}

 53%|█████▎    | 190/361 [1:27:24<1:18:39, 27.60s/it]
 53%|█████▎    | 191/361 [1:27:51<1:17:56, 27.51s/it]
                                                     
{'loss': 1.5337, 'learning_rate': 0.00019540229885057467, 'epoch': 0.53}

 53%|█████▎    | 191/361 [1:27:51<1:17:56, 27.51s/it]
 53%|█████▎    | 192/361 [1:28:18<1:16:51, 27.29s/it]
                                                     
{'loss': 1.5846, 'learning_rate': 0.00019425287356321838, 'epoch': 0.53}

 53%|█████▎    | 192/361 [1:28:18<1:16:51, 27.29s/it]
 53%|█████▎    | 193/361 [1:28:46<1:16:35, 27.35s/it]
                                                     
{'loss': 1.574, 'learning_rate': 0.00019310344827586204, 'epoch': 0.53}

 53%|█████▎    | 193/361 [1:28:46<1:16:35, 27.35s/it]
 54%|█████▎    | 194/361 [1:29:13<1:16:13, 27.38s/it]
                                                     
{'loss': 1.5385, 'learning_rate': 0.00019195402298850572, 'epoch': 0.54}

 54%|█████▎    | 194/361 [1:29:13<1:16:13, 27.38s/it]
 54%|█████▍    | 195/361 [1:29:40<1:15:47, 27.40s/it]
                                                     
{'loss': 1.5578, 'learning_rate': 0.0001908045977011494, 'epoch': 0.54}

 54%|█████▍    | 195/361 [1:29:40<1:15:47, 27.40s/it]
 54%|█████▍    | 196/361 [1:30:08<1:15:15, 27.37s/it]
                                                     
{'loss': 1.5967, 'learning_rate': 0.0001896551724137931, 'epoch': 0.54}

 54%|█████▍    | 196/361 [1:30:08<1:15:15, 27.37s/it]
 55%|█████▍    | 197/361 [1:30:35<1:15:00, 27.44s/it]
                                                     
{'loss': 1.5328, 'learning_rate': 0.00018850574712643675, 'epoch': 0.54}

 55%|█████▍    | 197/361 [1:30:35<1:15:00, 27.44s/it]
 55%|█████▍    | 198/361 [1:31:03<1:14:41, 27.50s/it]
                                                     
{'loss': 1.6542, 'learning_rate': 0.00018735632183908046, 'epoch': 0.55}

 55%|█████▍    | 198/361 [1:31:03<1:14:41, 27.50s/it]/nfs4/llm/h2o-llm/env/lib/python3.10/site-packages/bitsandbytes/autograd/_functions.py:318: UserWarning: MatMul8bitLt: inputs will be cast from torch.float32 to float16 during quantization
  warnings.warn(f"MatMul8bitLt: inputs will be cast from {A.dtype} to float16 during quantization")

 55%|█████▌    | 199/361 [1:31:30<1:13:47, 27.33s/it]
                                                     
{'loss': 1.6053, 'learning_rate': 0.00018620689655172412, 'epoch': 0.55}

 55%|█████▌    | 199/361 [1:31:30<1:13:47, 27.33s/it]
 55%|█████▌    | 200/361 [1:31:58<1:13:39, 27.45s/it]
                                                     
{'loss': 1.502, 'learning_rate': 0.0001850574712643678, 'epoch': 0.55}

 55%|█████▌    | 200/361 [1:31:58<1:13:39, 27.45s/it]
 56%|█████▌    | 201/361 [1:32:25<1:13:15, 27.47s/it]
                                                     
{'loss': 1.5688, 'learning_rate': 0.00018390804597701147, 'epoch': 0.56}

 56%|█████▌    | 201/361 [1:32:25<1:13:15, 27.47s/it]
 56%|█████▌    | 202/361 [1:32:53<1:12:40, 27.43s/it]
                                                     
{'loss': 1.5614, 'learning_rate': 0.00018275862068965518, 'epoch': 0.56}

 56%|█████▌    | 202/361 [1:32:53<1:12:40, 27.43s/it]
 56%|█████▌    | 203/361 [1:33:20<1:12:06, 27.38s/it]
                                                     
{'loss': 1.5736, 'learning_rate': 0.00018160919540229884, 'epoch': 0.56}

 56%|█████▌    | 203/361 [1:33:20<1:12:06, 27.38s/it]
 57%|█████▋    | 204/361 [1:33:47<1:11:39, 27.39s/it]
                                                     
{'loss': 1.5242, 'learning_rate': 0.0001804597701149425, 'epoch': 0.56}

 57%|█████▋    | 204/361 [1:33:47<1:11:39, 27.39s/it]
 57%|█████▋    | 205/361 [1:34:15<1:11:16, 27.41s/it]
                                                     
{'loss': 1.6075, 'learning_rate': 0.0001793103448275862, 'epoch': 0.57}

 57%|█████▋    | 205/361 [1:34:15<1:11:16, 27.41s/it]
 57%|█████▋    | 206/361 [1:34:42<1:10:49, 27.42s/it]
                                                     
{'loss': 1.5337, 'learning_rate': 0.00017816091954022986, 'epoch': 0.57}

 57%|█████▋    | 206/361 [1:34:42<1:10:49, 27.42s/it]
 57%|█████▋    | 207/361 [1:35:09<1:10:06, 27.31s/it]
                                                     
{'loss': 1.5866, 'learning_rate': 0.00017701149425287355, 'epoch': 0.57}

 57%|█████▋    | 207/361 [1:35:09<1:10:06, 27.31s/it]
 58%|█████▊    | 208/361 [1:35:37<1:10:11, 27.53s/it]
                                                     
{'loss': 1.5422, 'learning_rate': 0.0001758620689655172, 'epoch': 0.58}

 58%|█████▊    | 208/361 [1:35:37<1:10:11, 27.53s/it]
 58%|█████▊    | 209/361 [1:36:05<1:09:41, 27.51s/it]
                                                     
{'loss': 1.4435, 'learning_rate': 0.00017471264367816092, 'epoch': 0.58}

 58%|█████▊    | 209/361 [1:36:05<1:09:41, 27.51s/it]
 58%|█████▊    | 210/361 [1:36:32<1:09:04, 27.45s/it]
                                                     
{'loss': 1.5431, 'learning_rate': 0.00017356321839080458, 'epoch': 0.58}

 58%|█████▊    | 210/361 [1:36:32<1:09:04, 27.45s/it]
 58%|█████▊    | 211/361 [1:36:59<1:08:40, 27.47s/it]
                                                     
{'loss': 1.5437, 'learning_rate': 0.00017241379310344826, 'epoch': 0.58}

 58%|█████▊    | 211/361 [1:36:59<1:08:40, 27.47s/it]
 59%|█████▊    | 212/361 [1:37:27<1:07:59, 27.38s/it]
                                                     
{'loss': 1.571, 'learning_rate': 0.00017126436781609195, 'epoch': 0.59}

 59%|█████▊    | 212/361 [1:37:27<1:07:59, 27.38s/it]
 59%|█████▉    | 213/361 [1:37:54<1:07:37, 27.41s/it]
                                                     
{'loss': 1.5698, 'learning_rate': 0.00017011494252873563, 'epoch': 0.59}

 59%|█████▉    | 213/361 [1:37:54<1:07:37, 27.41s/it]
 59%|█████▉    | 214/361 [1:38:21<1:07:03, 27.37s/it]
                                                     
{'loss': 1.5073, 'learning_rate': 0.0001689655172413793, 'epoch': 0.59}

 59%|█████▉    | 214/361 [1:38:21<1:07:03, 27.37s/it]
 60%|█████▉    | 215/361 [1:38:49<1:06:38, 27.38s/it]
                                                     
{'loss': 1.5764, 'learning_rate': 0.00016781609195402295, 'epoch': 0.59}

 60%|█████▉    | 215/361 [1:38:49<1:06:38, 27.38s/it]
 60%|█████▉    | 216/361 [1:39:16<1:06:21, 27.46s/it]
                                                     
{'loss': 1.4936, 'learning_rate': 0.00016666666666666666, 'epoch': 0.6}

 60%|█████▉    | 216/361 [1:39:16<1:06:21, 27.46s/it]/nfs4/llm/h2o-llm/env/lib/python3.10/site-packages/bitsandbytes/autograd/_functions.py:318: UserWarning: MatMul8bitLt: inputs will be cast from torch.float32 to float16 during quantization
  warnings.warn(f"MatMul8bitLt: inputs will be cast from {A.dtype} to float16 during quantization")

 60%|██████    | 217/361 [1:39:44<1:06:11, 27.58s/it]
                                                     
{'loss': 1.5832, 'learning_rate': 0.00016551724137931032, 'epoch': 0.6}

 60%|██████    | 217/361 [1:39:44<1:06:11, 27.58s/it]
 60%|██████    | 218/361 [1:40:12<1:05:46, 27.60s/it]
                                                     
{'loss': 1.6351, 'learning_rate': 0.000164367816091954, 'epoch': 0.6}

 60%|██████    | 218/361 [1:40:12<1:05:46, 27.60s/it]
 61%|██████    | 219/361 [1:40:40<1:05:25, 27.64s/it]
                                                     
{'loss': 1.5791, 'learning_rate': 0.0001632183908045977, 'epoch': 0.61}

 61%|██████    | 219/361 [1:40:40<1:05:25, 27.64s/it]
 61%|██████    | 220/361 [1:41:07<1:04:29, 27.44s/it]
                                                     
{'loss': 1.5901, 'learning_rate': 0.00016206896551724137, 'epoch': 0.61}

 61%|██████    | 220/361 [1:41:07<1:04:29, 27.44s/it]
 61%|██████    | 221/361 [1:41:34<1:04:09, 27.50s/it]
                                                     
{'loss': 1.6951, 'learning_rate': 0.00016091954022988503, 'epoch': 0.61}

 61%|██████    | 221/361 [1:41:34<1:04:09, 27.50s/it]
 61%|██████▏   | 222/361 [1:42:02<1:03:47, 27.53s/it]
                                                     
{'loss': 1.6223, 'learning_rate': 0.00015977011494252874, 'epoch': 0.61}

 61%|██████▏   | 222/361 [1:42:02<1:03:47, 27.53s/it]
 62%|██████▏   | 223/361 [1:42:29<1:03:07, 27.45s/it]
                                                     
{'loss': 1.5442, 'learning_rate': 0.0001586206896551724, 'epoch': 0.62}

 62%|██████▏   | 223/361 [1:42:29<1:03:07, 27.45s/it]
 62%|██████▏   | 224/361 [1:42:56<1:02:11, 27.24s/it]
                                                     
{'loss': 1.5388, 'learning_rate': 0.0001574712643678161, 'epoch': 0.62}

 62%|██████▏   | 224/361 [1:42:56<1:02:11, 27.24s/it]
 62%|██████▏   | 225/361 [1:43:23<1:01:54, 27.31s/it]
                                                     
{'loss': 1.5007, 'learning_rate': 0.00015632183908045975, 'epoch': 0.62}

 62%|██████▏   | 225/361 [1:43:23<1:01:54, 27.31s/it]
 63%|██████▎   | 226/361 [1:43:51<1:01:39, 27.41s/it]
                                                     
{'loss': 1.5478, 'learning_rate': 0.00015517241379310346, 'epoch': 0.62}

 63%|██████▎   | 226/361 [1:43:51<1:01:39, 27.41s/it]
 63%|██████▎   | 227/361 [1:44:18<1:01:05, 27.36s/it]
                                                     
{'loss': 1.6059, 'learning_rate': 0.00015402298850574712, 'epoch': 0.63}

 63%|██████▎   | 227/361 [1:44:18<1:01:05, 27.36s/it]
 63%|██████▎   | 228/361 [1:44:46<1:00:46, 27.42s/it]
                                                     
{'loss': 1.5043, 'learning_rate': 0.00015287356321839077, 'epoch': 0.63}

 63%|██████▎   | 228/361 [1:44:46<1:00:46, 27.42s/it]
 63%|██████▎   | 229/361 [1:45:13<1:00:16, 27.40s/it]
                                                     
{'loss': 1.5576, 'learning_rate': 0.00015172413793103449, 'epoch': 0.63}

 63%|██████▎   | 229/361 [1:45:13<1:00:16, 27.40s/it]
 64%|██████▎   | 230/361 [1:45:41<59:53, 27.43s/it]  
                                                   
{'loss': 1.5714, 'learning_rate': 0.00015057471264367814, 'epoch': 0.64}

 64%|██████▎   | 230/361 [1:45:41<59:53, 27.43s/it]
 64%|██████▍   | 231/361 [1:46:08<59:28, 27.45s/it]
                                                   
{'loss': 1.57, 'learning_rate': 0.00014942528735632183, 'epoch': 0.64}

 64%|██████▍   | 231/361 [1:46:08<59:28, 27.45s/it]
 64%|██████▍   | 232/361 [1:46:35<58:44, 27.32s/it]
                                                   
{'loss': 1.5822, 'learning_rate': 0.00014827586206896551, 'epoch': 0.64}

 64%|██████▍   | 232/361 [1:46:35<58:44, 27.32s/it]
 65%|██████▍   | 233/361 [1:47:03<58:19, 27.34s/it]
                                                   
{'loss': 1.4951, 'learning_rate': 0.00014712643678160917, 'epoch': 0.64}

 65%|██████▍   | 233/361 [1:47:03<58:19, 27.34s/it]
 65%|██████▍   | 234/361 [1:47:30<57:52, 27.34s/it]
                                                   
{'loss': 1.5251, 'learning_rate': 0.00014597701149425286, 'epoch': 0.65}

 65%|██████▍   | 234/361 [1:47:30<57:52, 27.34s/it]/nfs4/llm/h2o-llm/env/lib/python3.10/site-packages/bitsandbytes/autograd/_functions.py:318: UserWarning: MatMul8bitLt: inputs will be cast from torch.float32 to float16 during quantization
  warnings.warn(f"MatMul8bitLt: inputs will be cast from {A.dtype} to float16 during quantization")

 65%|██████▌   | 235/361 [1:47:56<56:45, 27.03s/it]
                                                   
{'loss': 1.6191, 'learning_rate': 0.00014482758620689654, 'epoch': 0.65}

 65%|██████▌   | 235/361 [1:47:56<56:45, 27.03s/it]
 65%|██████▌   | 236/361 [1:48:24<56:47, 27.26s/it]
                                                   
{'loss': 1.552, 'learning_rate': 0.0001436781609195402, 'epoch': 0.65}

 65%|██████▌   | 236/361 [1:48:24<56:47, 27.26s/it]
 66%|██████▌   | 237/361 [1:48:51<56:18, 27.25s/it]
                                                   
{'loss': 1.6, 'learning_rate': 0.00014252873563218389, 'epoch': 0.66}

 66%|██████▌   | 237/361 [1:48:51<56:18, 27.25s/it]
 66%|██████▌   | 238/361 [1:49:19<55:58, 27.30s/it]
                                                   
{'loss': 1.5228, 'learning_rate': 0.00014137931034482757, 'epoch': 0.66}

 66%|██████▌   | 238/361 [1:49:19<55:58, 27.30s/it]
 66%|██████▌   | 239/361 [1:49:47<55:57, 27.52s/it]
                                                   
{'loss': 1.6212, 'learning_rate': 0.00014022988505747126, 'epoch': 0.66}

 66%|██████▌   | 239/361 [1:49:47<55:57, 27.52s/it]
 66%|██████▋   | 240/361 [1:50:13<54:57, 27.25s/it]
                                                   
{'loss': 1.6211, 'learning_rate': 0.00013908045977011494, 'epoch': 0.66}

 66%|██████▋   | 240/361 [1:50:13<54:57, 27.25s/it]
 67%|██████▋   | 241/361 [1:50:41<54:40, 27.34s/it]
                                                   
{'loss': 1.6812, 'learning_rate': 0.0001379310344827586, 'epoch': 0.67}

 67%|██████▋   | 241/361 [1:50:41<54:40, 27.34s/it]
 67%|██████▋   | 242/361 [1:51:08<54:15, 27.36s/it]
                                                   
{'loss': 1.6216, 'learning_rate': 0.00013678160919540228, 'epoch': 0.67}

 67%|██████▋   | 242/361 [1:51:08<54:15, 27.36s/it]
 67%|██████▋   | 243/361 [1:51:36<54:03, 27.48s/it]
                                                   
{'loss': 1.566, 'learning_rate': 0.00013563218390804597, 'epoch': 0.67}

 67%|██████▋   | 243/361 [1:51:36<54:03, 27.48s/it]
 68%|██████▊   | 244/361 [1:52:04<54:03, 27.72s/it]
                                                   
{'loss': 1.5805, 'learning_rate': 0.00013448275862068965, 'epoch': 0.67}

 68%|██████▊   | 244/361 [1:52:04<54:03, 27.72s/it]
 68%|██████▊   | 245/361 [1:52:32<53:30, 27.68s/it]
                                                   
{'loss': 1.5381, 'learning_rate': 0.0001333333333333333, 'epoch': 0.68}

 68%|██████▊   | 245/361 [1:52:32<53:30, 27.68s/it]
 68%|██████▊   | 246/361 [1:52:59<52:56, 27.62s/it]
                                                   
{'loss': 1.6062, 'learning_rate': 0.000132183908045977, 'epoch': 0.68}

 68%|██████▊   | 246/361 [1:52:59<52:56, 27.62s/it]
 68%|██████▊   | 247/361 [1:53:27<52:30, 27.64s/it]
                                                   
{'loss': 1.5993, 'learning_rate': 0.00013103448275862068, 'epoch': 0.68}

 68%|██████▊   | 247/361 [1:53:27<52:30, 27.64s/it]
 69%|██████▊   | 248/361 [1:53:55<51:57, 27.59s/it]
                                                   
{'loss': 1.549, 'learning_rate': 0.00012988505747126434, 'epoch': 0.69}

 69%|██████▊   | 248/361 [1:53:55<51:57, 27.59s/it]
 69%|██████▉   | 249/361 [1:54:22<51:38, 27.67s/it]
                                                   
{'loss': 1.5504, 'learning_rate': 0.00012873563218390803, 'epoch': 0.69}

 69%|██████▉   | 249/361 [1:54:22<51:38, 27.67s/it]
 69%|██████▉   | 250/361 [1:54:50<51:09, 27.65s/it]
                                                   
{'loss': 1.5954, 'learning_rate': 0.0001275862068965517, 'epoch': 0.69}

 69%|██████▉   | 250/361 [1:54:50<51:09, 27.65s/it]
 70%|██████▉   | 251/361 [1:55:17<50:22, 27.48s/it]
                                                   
{'loss': 1.5711, 'learning_rate': 0.0001264367816091954, 'epoch': 0.69}

 70%|██████▉   | 251/361 [1:55:17<50:22, 27.48s/it]
 70%|██████▉   | 252/361 [1:55:44<49:43, 27.37s/it]
                                                   
{'loss': 1.5699, 'learning_rate': 0.00012528735632183908, 'epoch': 0.7}

 70%|██████▉   | 252/361 [1:55:44<49:43, 27.37s/it]/nfs4/llm/h2o-llm/env/lib/python3.10/site-packages/bitsandbytes/autograd/_functions.py:318: UserWarning: MatMul8bitLt: inputs will be cast from torch.float32 to float16 during quantization
  warnings.warn(f"MatMul8bitLt: inputs will be cast from {A.dtype} to float16 during quantization")

 70%|███████   | 253/361 [1:56:12<49:41, 27.61s/it]
                                                   
{'loss': 1.5437, 'learning_rate': 0.00012413793103448274, 'epoch': 0.7}

 70%|███████   | 253/361 [1:56:12<49:41, 27.61s/it]
 70%|███████   | 254/361 [1:56:40<49:14, 27.61s/it]
                                                   
{'loss': 1.5369, 'learning_rate': 0.00012298850574712642, 'epoch': 0.7}

 70%|███████   | 254/361 [1:56:40<49:14, 27.61s/it]
 71%|███████   | 255/361 [1:57:07<48:36, 27.51s/it]
                                                   
{'loss': 1.5595, 'learning_rate': 0.0001218390804597701, 'epoch': 0.71}

 71%|███████   | 255/361 [1:57:07<48:36, 27.51s/it]
 71%|███████   | 256/361 [1:57:34<47:55, 27.39s/it]
                                                   
{'loss': 1.5334, 'learning_rate': 0.00012068965517241378, 'epoch': 0.71}

 71%|███████   | 256/361 [1:57:34<47:55, 27.39s/it]
 71%|███████   | 257/361 [1:58:02<47:26, 27.37s/it]
                                                   
{'loss': 1.5456, 'learning_rate': 0.00011954022988505745, 'epoch': 0.71}

 71%|███████   | 257/361 [1:58:02<47:26, 27.37s/it]
 71%|███████▏  | 258/361 [1:58:29<46:55, 27.34s/it]
                                                   
{'loss': 1.4948, 'learning_rate': 0.00011839080459770114, 'epoch': 0.71}

 71%|███████▏  | 258/361 [1:58:29<46:55, 27.34s/it]
 72%|███████▏  | 259/361 [1:58:56<46:28, 27.34s/it]
                                                   
{'loss': 1.559, 'learning_rate': 0.00011724137931034482, 'epoch': 0.72}

 72%|███████▏  | 259/361 [1:58:56<46:28, 27.34s/it]
 72%|███████▏  | 260/361 [1:59:24<46:00, 27.33s/it]
                                                   
{'loss': 1.5895, 'learning_rate': 0.0001160919540229885, 'epoch': 0.72}

 72%|███████▏  | 260/361 [1:59:24<46:00, 27.33s/it]
 72%|███████▏  | 261/361 [1:59:51<45:37, 27.38s/it]
                                                   
{'loss': 1.6013, 'learning_rate': 0.00011494252873563218, 'epoch': 0.72}

 72%|███████▏  | 261/361 [1:59:51<45:37, 27.38s/it]
 73%|███████▎  | 262/361 [2:00:18<45:03, 27.31s/it]
                                                   
{'loss': 1.5465, 'learning_rate': 0.00011379310344827585, 'epoch': 0.72}

 73%|███████▎  | 262/361 [2:00:18<45:03, 27.31s/it]
 73%|███████▎  | 263/361 [2:00:46<44:36, 27.32s/it]
                                                   
{'loss': 1.6163, 'learning_rate': 0.00011264367816091954, 'epoch': 0.73}

 73%|███████▎  | 263/361 [2:00:46<44:36, 27.32s/it]
 73%|███████▎  | 264/361 [2:01:12<43:40, 27.01s/it]
                                                   
{'loss': 1.6535, 'learning_rate': 0.00011149425287356322, 'epoch': 0.73}

 73%|███████▎  | 264/361 [2:01:12<43:40, 27.01s/it]
 73%|███████▎  | 265/361 [2:01:39<43:28, 27.17s/it]
                                                   
{'loss': 1.4502, 'learning_rate': 0.00011034482758620688, 'epoch': 0.73}

 73%|███████▎  | 265/361 [2:01:39<43:28, 27.17s/it]
 74%|███████▎  | 266/361 [2:02:07<43:00, 27.16s/it]
                                                   
{'loss': 1.5597, 'learning_rate': 0.00010919540229885056, 'epoch': 0.74}

 74%|███████▎  | 266/361 [2:02:07<43:00, 27.16s/it]
 74%|███████▍  | 267/361 [2:02:34<42:39, 27.22s/it]
                                                   
{'loss': 1.5264, 'learning_rate': 0.00010804597701149424, 'epoch': 0.74}

 74%|███████▍  | 267/361 [2:02:34<42:39, 27.22s/it]
 74%|███████▍  | 268/361 [2:03:01<42:16, 27.27s/it]
                                                   
{'loss': 1.5645, 'learning_rate': 0.00010689655172413792, 'epoch': 0.74}

 74%|███████▍  | 268/361 [2:03:01<42:16, 27.27s/it]
 75%|███████▍  | 269/361 [2:03:29<41:51, 27.30s/it]
                                                   
{'loss': 1.5351, 'learning_rate': 0.00010574712643678159, 'epoch': 0.74}

 75%|███████▍  | 269/361 [2:03:29<41:51, 27.30s/it]
 75%|███████▍  | 270/361 [2:03:56<41:26, 27.32s/it]
                                                   
{'loss': 1.5584, 'learning_rate': 0.00010459770114942528, 'epoch': 0.75}

 75%|███████▍  | 270/361 [2:03:56<41:26, 27.32s/it]/nfs4/llm/h2o-llm/env/lib/python3.10/site-packages/bitsandbytes/autograd/_functions.py:318: UserWarning: MatMul8bitLt: inputs will be cast from torch.float32 to float16 during quantization
  warnings.warn(f"MatMul8bitLt: inputs will be cast from {A.dtype} to float16 during quantization")

 75%|███████▌  | 271/361 [2:04:23<40:53, 27.26s/it]
                                                   
{'loss': 1.5871, 'learning_rate': 0.00010344827586206896, 'epoch': 0.75}

 75%|███████▌  | 271/361 [2:04:23<40:53, 27.26s/it]
 75%|███████▌  | 272/361 [2:04:51<40:27, 27.27s/it]
                                                   
{'loss': 1.5242, 'learning_rate': 0.00010229885057471263, 'epoch': 0.75}

 75%|███████▌  | 272/361 [2:04:51<40:27, 27.27s/it]
 76%|███████▌  | 273/361 [2:05:18<40:01, 27.28s/it]
                                                   
{'loss': 1.5155, 'learning_rate': 0.00010114942528735632, 'epoch': 0.75}

 76%|███████▌  | 273/361 [2:05:18<40:01, 27.28s/it]
 76%|███████▌  | 274/361 [2:05:44<39:16, 27.08s/it]
                                                   
{'loss': 1.501, 'learning_rate': 9.999999999999999e-05, 'epoch': 0.76}

 76%|███████▌  | 274/361 [2:05:44<39:16, 27.08s/it]
 76%|███████▌  | 275/361 [2:06:12<38:55, 27.15s/it]
                                                   
{'loss': 1.5625, 'learning_rate': 9.885057471264368e-05, 'epoch': 0.76}

 76%|███████▌  | 275/361 [2:06:12<38:55, 27.15s/it]
 76%|███████▋  | 276/361 [2:06:39<38:33, 27.22s/it]
                                                   
{'loss': 1.5849, 'learning_rate': 9.770114942528733e-05, 'epoch': 0.76}

 76%|███████▋  | 276/361 [2:06:39<38:33, 27.22s/it]
 77%|███████▋  | 277/361 [2:07:06<38:10, 27.26s/it]
                                                   
{'loss': 1.5182, 'learning_rate': 9.655172413793102e-05, 'epoch': 0.77}

 77%|███████▋  | 277/361 [2:07:06<38:10, 27.26s/it]
 77%|███████▋  | 278/361 [2:07:34<37:44, 27.28s/it]
                                                   
{'loss': 1.5907, 'learning_rate': 9.54022988505747e-05, 'epoch': 0.77}

 77%|███████▋  | 278/361 [2:07:34<37:44, 27.28s/it]
 77%|███████▋  | 279/361 [2:08:01<37:20, 27.32s/it]
                                                   
{'loss': 1.5562, 'learning_rate': 9.425287356321838e-05, 'epoch': 0.77}

 77%|███████▋  | 279/361 [2:08:01<37:20, 27.32s/it]
 78%|███████▊  | 280/361 [2:08:29<36:52, 27.32s/it]
                                                   
{'loss': 1.5273, 'learning_rate': 9.310344827586206e-05, 'epoch': 0.77}

 78%|███████▊  | 280/361 [2:08:29<36:52, 27.32s/it]
 78%|███████▊  | 281/361 [2:08:55<36:08, 27.10s/it]
                                                   
{'loss': 1.4986, 'learning_rate': 9.195402298850573e-05, 'epoch': 0.78}

 78%|███████▊  | 281/361 [2:08:55<36:08, 27.10s/it]
 78%|███████▊  | 282/361 [2:09:23<35:51, 27.23s/it]
                                                   
{'loss': 1.5058, 'learning_rate': 9.080459770114942e-05, 'epoch': 0.78}

 78%|███████▊  | 282/361 [2:09:23<35:51, 27.23s/it]
 78%|███████▊  | 283/361 [2:09:50<35:23, 27.23s/it]
                                                   
{'loss': 1.5876, 'learning_rate': 8.96551724137931e-05, 'epoch': 0.78}

 78%|███████▊  | 283/361 [2:09:50<35:23, 27.23s/it]
 79%|███████▊  | 284/361 [2:10:17<35:00, 27.28s/it]
                                                   
{'loss': 1.5761, 'learning_rate': 8.850574712643677e-05, 'epoch': 0.79}

 79%|███████▊  | 284/361 [2:10:17<35:00, 27.28s/it]
 79%|███████▉  | 285/361 [2:10:45<34:34, 27.30s/it]
                                                   
{'loss': 1.5445, 'learning_rate': 8.735632183908046e-05, 'epoch': 0.79}

 79%|███████▉  | 285/361 [2:10:45<34:34, 27.30s/it]
 79%|███████▉  | 286/361 [2:11:12<34:07, 27.30s/it]
                                                   
{'loss': 1.5028, 'learning_rate': 8.620689655172413e-05, 'epoch': 0.79}

 79%|███████▉  | 286/361 [2:11:12<34:07, 27.30s/it]
 80%|███████▉  | 287/361 [2:11:39<33:39, 27.29s/it]
                                                   
{'loss': 1.6159, 'learning_rate': 8.505747126436782e-05, 'epoch': 0.79}

 80%|███████▉  | 287/361 [2:11:39<33:39, 27.29s/it]
 80%|███████▉  | 288/361 [2:12:07<33:15, 27.34s/it]
                                                   
{'loss': 1.5121, 'learning_rate': 8.390804597701147e-05, 'epoch': 0.8}

 80%|███████▉  | 288/361 [2:12:07<33:15, 27.34s/it]/nfs4/llm/h2o-llm/env/lib/python3.10/site-packages/bitsandbytes/autograd/_functions.py:318: UserWarning: MatMul8bitLt: inputs will be cast from torch.float32 to float16 during quantization
  warnings.warn(f"MatMul8bitLt: inputs will be cast from {A.dtype} to float16 during quantization")

 80%|████████  | 289/361 [2:12:34<32:53, 27.41s/it]
                                                   
{'loss': 1.5891, 'learning_rate': 8.275862068965516e-05, 'epoch': 0.8}

 80%|████████  | 289/361 [2:12:34<32:53, 27.41s/it]
 80%|████████  | 290/361 [2:13:01<32:15, 27.26s/it]
                                                   
{'loss': 1.5371, 'learning_rate': 8.160919540229884e-05, 'epoch': 0.8}

 80%|████████  | 290/361 [2:13:01<32:15, 27.26s/it]
 81%|████████  | 291/361 [2:13:29<31:50, 27.30s/it]
                                                   
{'loss': 1.5965, 'learning_rate': 8.045977011494252e-05, 'epoch': 0.8}

 81%|████████  | 291/361 [2:13:29<31:50, 27.30s/it]
 81%|████████  | 292/361 [2:13:55<31:15, 27.18s/it]
                                                   
{'loss': 1.5793, 'learning_rate': 7.93103448275862e-05, 'epoch': 0.81}

 81%|████████  | 292/361 [2:13:55<31:15, 27.18s/it]
 81%|████████  | 293/361 [2:14:23<30:51, 27.23s/it]
                                                   
{'loss': 1.5908, 'learning_rate': 7.816091954022987e-05, 'epoch': 0.81}

 81%|████████  | 293/361 [2:14:23<30:51, 27.23s/it]
 81%|████████▏ | 294/361 [2:14:50<30:28, 27.29s/it]
                                                   
{'loss': 1.5343, 'learning_rate': 7.701149425287356e-05, 'epoch': 0.81}

 81%|████████▏ | 294/361 [2:14:50<30:28, 27.29s/it]
 82%|████████▏ | 295/361 [2:15:18<30:04, 27.35s/it]
                                                   
{'loss': 1.5553, 'learning_rate': 7.586206896551724e-05, 'epoch': 0.82}

 82%|████████▏ | 295/361 [2:15:18<30:04, 27.35s/it]
 82%|████████▏ | 296/361 [2:15:45<29:37, 27.35s/it]
                                                   
{'loss': 1.5608, 'learning_rate': 7.471264367816091e-05, 'epoch': 0.82}

 82%|████████▏ | 296/361 [2:15:45<29:37, 27.35s/it]
 82%|████████▏ | 297/361 [2:16:12<29:09, 27.34s/it]
                                                   
{'loss': 1.5824, 'learning_rate': 7.356321839080459e-05, 'epoch': 0.82}

 82%|████████▏ | 297/361 [2:16:12<29:09, 27.34s/it]
 83%|████████▎ | 298/361 [2:16:40<28:41, 27.33s/it]
                                                   
{'loss': 1.5309, 'learning_rate': 7.241379310344827e-05, 'epoch': 0.82}

 83%|████████▎ | 298/361 [2:16:40<28:41, 27.33s/it]
 83%|████████▎ | 299/361 [2:17:07<28:16, 27.36s/it]
                                                   
{'loss': 1.4658, 'learning_rate': 7.126436781609194e-05, 'epoch': 0.83}

 83%|████████▎ | 299/361 [2:17:07<28:16, 27.36s/it]
 83%|████████▎ | 300/361 [2:17:35<27:50, 27.39s/it]
                                                   
{'loss': 1.5112, 'learning_rate': 7.011494252873563e-05, 'epoch': 0.83}

 83%|████████▎ | 300/361 [2:17:35<27:50, 27.39s/it]
 83%|████████▎ | 301/361 [2:18:02<27:22, 27.38s/it]
                                                   
{'loss': 1.6884, 'learning_rate': 6.89655172413793e-05, 'epoch': 0.83}

 83%|████████▎ | 301/361 [2:18:02<27:22, 27.38s/it]
 84%|████████▎ | 302/361 [2:18:29<26:56, 27.40s/it]
                                                   
{'loss': 1.6531, 'learning_rate': 6.781609195402298e-05, 'epoch': 0.84}

 84%|████████▎ | 302/361 [2:18:29<26:56, 27.40s/it]
 84%|████████▍ | 303/361 [2:18:57<26:28, 27.38s/it]
                                                   
{'loss': 1.6061, 'learning_rate': 6.666666666666666e-05, 'epoch': 0.84}

 84%|████████▍ | 303/361 [2:18:57<26:28, 27.38s/it]
 84%|████████▍ | 304/361 [2:19:24<25:58, 27.35s/it]
                                                   
{'loss': 1.6353, 'learning_rate': 6.551724137931034e-05, 'epoch': 0.84}

 84%|████████▍ | 304/361 [2:19:24<25:58, 27.35s/it]
 84%|████████▍ | 305/361 [2:19:52<25:34, 27.41s/it]
                                                   
{'loss': 1.4937, 'learning_rate': 6.436781609195401e-05, 'epoch': 0.84}

 84%|████████▍ | 305/361 [2:19:52<25:34, 27.41s/it]
 85%|████████▍ | 306/361 [2:20:19<25:06, 27.40s/it]
                                                   
{'loss': 1.5381, 'learning_rate': 6.32183908045977e-05, 'epoch': 0.85}

 85%|████████▍ | 306/361 [2:20:19<25:06, 27.40s/it]/nfs4/llm/h2o-llm/env/lib/python3.10/site-packages/bitsandbytes/autograd/_functions.py:318: UserWarning: MatMul8bitLt: inputs will be cast from torch.float32 to float16 during quantization
  warnings.warn(f"MatMul8bitLt: inputs will be cast from {A.dtype} to float16 during quantization")

 85%|████████▌ | 307/361 [2:20:46<24:41, 27.44s/it]
                                                   
{'loss': 1.5272, 'learning_rate': 6.206896551724137e-05, 'epoch': 0.85}

 85%|████████▌ | 307/361 [2:20:46<24:41, 27.44s/it]
 85%|████████▌ | 308/361 [2:21:13<24:02, 27.22s/it]
                                                   
{'loss': 1.6159, 'learning_rate': 6.091954022988505e-05, 'epoch': 0.85}

 85%|████████▌ | 308/361 [2:21:13<24:02, 27.22s/it]
 86%|████████▌ | 309/361 [2:21:41<23:38, 27.28s/it]
                                                   
{'loss': 1.5618, 'learning_rate': 5.9770114942528726e-05, 'epoch': 0.85}

 86%|████████▌ | 309/361 [2:21:41<23:38, 27.28s/it]
 86%|████████▌ | 310/361 [2:22:08<23:12, 27.31s/it]
                                                   
{'loss': 1.5939, 'learning_rate': 5.862068965517241e-05, 'epoch': 0.86}

 86%|████████▌ | 310/361 [2:22:08<23:12, 27.31s/it]
 86%|████████▌ | 311/361 [2:22:35<22:45, 27.30s/it]
                                                   
{'loss': 1.5653, 'learning_rate': 5.747126436781609e-05, 'epoch': 0.86}

 86%|████████▌ | 311/361 [2:22:35<22:45, 27.30s/it]
 86%|████████▋ | 312/361 [2:23:03<22:19, 27.34s/it]
                                                   
{'loss': 1.5785, 'learning_rate': 5.632183908045977e-05, 'epoch': 0.86}

 86%|████████▋ | 312/361 [2:23:03<22:19, 27.34s/it]
 87%|████████▋ | 313/361 [2:23:30<21:52, 27.34s/it]
                                                   
{'loss': 1.6811, 'learning_rate': 5.517241379310344e-05, 'epoch': 0.87}

 87%|████████▋ | 313/361 [2:23:30<21:52, 27.34s/it]
 87%|████████▋ | 314/361 [2:23:57<21:26, 27.37s/it]
                                                   
{'loss': 1.6141, 'learning_rate': 5.402298850574712e-05, 'epoch': 0.87}

 87%|████████▋ | 314/361 [2:23:57<21:26, 27.37s/it]
 87%|████████▋ | 315/361 [2:24:25<20:57, 27.35s/it]
                                                   
{'loss': 1.5659, 'learning_rate': 5.2873563218390796e-05, 'epoch': 0.87}

 87%|████████▋ | 315/361 [2:24:25<20:57, 27.35s/it]
 88%|████████▊ | 316/361 [2:24:52<20:32, 27.38s/it]
                                                   
{'loss': 1.5535, 'learning_rate': 5.172413793103448e-05, 'epoch': 0.87}

 88%|████████▊ | 316/361 [2:24:52<20:32, 27.38s/it]
 88%|████████▊ | 317/361 [2:25:20<20:04, 27.38s/it]
                                                   
{'loss': 1.4452, 'learning_rate': 5.057471264367816e-05, 'epoch': 0.88}

 88%|████████▊ | 317/361 [2:25:20<20:04, 27.38s/it]
 88%|████████▊ | 318/361 [2:25:47<19:39, 27.42s/it]
                                                   
{'loss': 1.4851, 'learning_rate': 4.942528735632184e-05, 'epoch': 0.88}

 88%|████████▊ | 318/361 [2:25:47<19:39, 27.42s/it]
 88%|████████▊ | 319/361 [2:26:14<19:10, 27.40s/it]
                                                   
{'loss': 1.5263, 'learning_rate': 4.827586206896551e-05, 'epoch': 0.88}

 88%|████████▊ | 319/361 [2:26:14<19:10, 27.40s/it]
 89%|████████▊ | 320/361 [2:26:42<18:42, 27.38s/it]
                                                   
{'loss': 1.5237, 'learning_rate': 4.712643678160919e-05, 'epoch': 0.88}

 89%|████████▊ | 320/361 [2:26:42<18:42, 27.38s/it]
 89%|████████▉ | 321/361 [2:27:09<18:15, 27.38s/it]
                                                   
{'loss': 1.5172, 'learning_rate': 4.5977011494252866e-05, 'epoch': 0.89}

 89%|████████▉ | 321/361 [2:27:09<18:15, 27.38s/it]
 89%|████████▉ | 322/361 [2:27:37<17:48, 27.39s/it]
                                                   
{'loss': 1.5913, 'learning_rate': 4.482758620689655e-05, 'epoch': 0.89}

 89%|████████▉ | 322/361 [2:27:37<17:48, 27.39s/it]
 89%|████████▉ | 323/361 [2:28:04<17:21, 27.41s/it]
                                                   
{'loss': 1.5622, 'learning_rate': 4.367816091954023e-05, 'epoch': 0.89}

 89%|████████▉ | 323/361 [2:28:04<17:21, 27.41s/it]
 90%|████████▉ | 324/361 [2:28:31<16:51, 27.34s/it]
                                                   
{'loss': 1.5731, 'learning_rate': 4.252873563218391e-05, 'epoch': 0.9}

 90%|████████▉ | 324/361 [2:28:31<16:51, 27.34s/it]/nfs4/llm/h2o-llm/env/lib/python3.10/site-packages/bitsandbytes/autograd/_functions.py:318: UserWarning: MatMul8bitLt: inputs will be cast from torch.float32 to float16 during quantization
  warnings.warn(f"MatMul8bitLt: inputs will be cast from {A.dtype} to float16 during quantization")

 90%|█████████ | 325/361 [2:28:59<16:25, 27.36s/it]
                                                   
{'loss': 1.5431, 'learning_rate': 4.137931034482758e-05, 'epoch': 0.9}

 90%|█████████ | 325/361 [2:28:59<16:25, 27.36s/it]
 90%|█████████ | 326/361 [2:29:26<15:58, 27.37s/it]
                                                   
{'loss': 1.5677, 'learning_rate': 4.022988505747126e-05, 'epoch': 0.9}

 90%|█████████ | 326/361 [2:29:26<15:58, 27.37s/it]
 91%|█████████ | 327/361 [2:29:53<15:30, 27.37s/it]
                                                   
{'loss': 1.5378, 'learning_rate': 3.9080459770114936e-05, 'epoch': 0.9}

 91%|█████████ | 327/361 [2:29:53<15:30, 27.37s/it]
 91%|█████████ | 328/361 [2:30:21<15:03, 27.38s/it]
                                                   
{'loss': 1.6268, 'learning_rate': 3.793103448275862e-05, 'epoch': 0.91}

 91%|█████████ | 328/361 [2:30:21<15:03, 27.38s/it]
 91%|█████████ | 329/361 [2:30:48<14:35, 27.35s/it]
                                                   
{'loss': 1.5242, 'learning_rate': 3.678160919540229e-05, 'epoch': 0.91}

 91%|█████████ | 329/361 [2:30:48<14:35, 27.35s/it]
 91%|█████████▏| 330/361 [2:31:15<14:08, 27.37s/it]
                                                   
{'loss': 1.5653, 'learning_rate': 3.563218390804597e-05, 'epoch': 0.91}

 91%|█████████▏| 330/361 [2:31:15<14:08, 27.37s/it]
 92%|█████████▏| 331/361 [2:31:43<13:41, 27.38s/it]
                                                   
{'loss': 1.6231, 'learning_rate': 3.448275862068965e-05, 'epoch': 0.92}

 92%|█████████▏| 331/361 [2:31:43<13:41, 27.38s/it]
 92%|█████████▏| 332/361 [2:32:10<13:15, 27.43s/it]
                                                   
{'loss': 1.5373, 'learning_rate': 3.333333333333333e-05, 'epoch': 0.92}

 92%|█████████▏| 332/361 [2:32:10<13:15, 27.43s/it]
 92%|█████████▏| 333/361 [2:32:38<12:49, 27.48s/it]
                                                   
{'loss': 1.5014, 'learning_rate': 3.2183908045977006e-05, 'epoch': 0.92}

 92%|█████████▏| 333/361 [2:32:38<12:49, 27.48s/it]
 93%|█████████▎| 334/361 [2:33:06<12:22, 27.49s/it]
                                                   
{'loss': 1.4983, 'learning_rate': 3.1034482758620685e-05, 'epoch': 0.92}

 93%|█████████▎| 334/361 [2:33:06<12:22, 27.49s/it]
 93%|█████████▎| 335/361 [2:33:33<11:54, 27.48s/it]
                                                   
{'loss': 1.5623, 'learning_rate': 2.9885057471264363e-05, 'epoch': 0.93}

 93%|█████████▎| 335/361 [2:33:33<11:54, 27.48s/it]
 93%|█████████▎| 336/361 [2:34:00<11:26, 27.46s/it]
                                                   
{'loss': 1.5392, 'learning_rate': 2.8735632183908045e-05, 'epoch': 0.93}

 93%|█████████▎| 336/361 [2:34:00<11:26, 27.46s/it]
 93%|█████████▎| 337/361 [2:34:28<10:58, 27.44s/it]
                                                   
{'loss': 1.5472, 'learning_rate': 2.758620689655172e-05, 'epoch': 0.93}

 93%|█████████▎| 337/361 [2:34:28<10:58, 27.44s/it]
 94%|█████████▎| 338/361 [2:34:55<10:29, 27.38s/it]
                                                   
{'loss': 1.5235, 'learning_rate': 2.6436781609195398e-05, 'epoch': 0.93}

 94%|█████████▎| 338/361 [2:34:55<10:29, 27.38s/it]
 94%|█████████▍| 339/361 [2:35:22<10:02, 27.39s/it]
                                                   
{'loss': 1.5377, 'learning_rate': 2.528735632183908e-05, 'epoch': 0.94}

 94%|█████████▍| 339/361 [2:35:22<10:02, 27.39s/it]
 94%|█████████▍| 340/361 [2:35:50<09:35, 27.39s/it]
                                                   
{'loss': 1.6024, 'learning_rate': 2.4137931034482755e-05, 'epoch': 0.94}

 94%|█████████▍| 340/361 [2:35:50<09:35, 27.39s/it]
 94%|█████████▍| 341/361 [2:36:17<09:05, 27.25s/it]
                                                   
{'loss': 1.5805, 'learning_rate': 2.2988505747126433e-05, 'epoch': 0.94}

 94%|█████████▍| 341/361 [2:36:17<09:05, 27.25s/it]
 95%|█████████▍| 342/361 [2:36:44<08:35, 27.15s/it]
                                                   
{'loss': 1.5718, 'learning_rate': 2.1839080459770115e-05, 'epoch': 0.95}

 95%|█████████▍| 342/361 [2:36:44<08:35, 27.15s/it]/nfs4/llm/h2o-llm/env/lib/python3.10/site-packages/bitsandbytes/autograd/_functions.py:318: UserWarning: MatMul8bitLt: inputs will be cast from torch.float32 to float16 during quantization
  warnings.warn(f"MatMul8bitLt: inputs will be cast from {A.dtype} to float16 during quantization")

 95%|█████████▌| 343/361 [2:37:11<08:11, 27.28s/it]
                                                   
{'loss': 1.5822, 'learning_rate': 2.068965517241379e-05, 'epoch': 0.95}

 95%|█████████▌| 343/361 [2:37:11<08:11, 27.28s/it]
 95%|█████████▌| 344/361 [2:37:39<07:44, 27.31s/it]
                                                   
{'loss': 1.5015, 'learning_rate': 1.9540229885057468e-05, 'epoch': 0.95}

 95%|█████████▌| 344/361 [2:37:39<07:44, 27.31s/it]
 96%|█████████▌| 345/361 [2:38:06<07:17, 27.35s/it]
                                                   
{'loss': 1.5522, 'learning_rate': 1.8390804597701147e-05, 'epoch': 0.95}

 96%|█████████▌| 345/361 [2:38:06<07:17, 27.35s/it]
 96%|█████████▌| 346/361 [2:38:33<06:50, 27.35s/it]
                                                   
{'loss': 1.536, 'learning_rate': 1.7241379310344825e-05, 'epoch': 0.96}

 96%|█████████▌| 346/361 [2:38:33<06:50, 27.35s/it]
 96%|█████████▌| 347/361 [2:39:01<06:22, 27.33s/it]
                                                   
{'loss': 1.5451, 'learning_rate': 1.6091954022988503e-05, 'epoch': 0.96}

 96%|█████████▌| 347/361 [2:39:01<06:22, 27.33s/it]
 96%|█████████▋| 348/361 [2:39:28<05:55, 27.33s/it]
                                                   
{'loss': 1.5292, 'learning_rate': 1.4942528735632182e-05, 'epoch': 0.96}

 96%|█████████▋| 348/361 [2:39:28<05:55, 27.33s/it]
 97%|█████████▋| 349/361 [2:39:55<05:28, 27.34s/it]
                                                   
{'loss': 1.5751, 'learning_rate': 1.379310344827586e-05, 'epoch': 0.97}

 97%|█████████▋| 349/361 [2:39:55<05:28, 27.34s/it]
 97%|█████████▋| 350/361 [2:40:23<05:01, 27.40s/it]
                                                   
{'loss': 1.5779, 'learning_rate': 1.264367816091954e-05, 'epoch': 0.97}

 97%|█████████▋| 350/361 [2:40:23<05:01, 27.40s/it]
 97%|█████████▋| 351/361 [2:40:50<04:33, 27.39s/it]
                                                   
{'loss': 1.5603, 'learning_rate': 1.1494252873563217e-05, 'epoch': 0.97}

 97%|█████████▋| 351/361 [2:40:50<04:33, 27.39s/it]
 98%|█████████▊| 352/361 [2:41:18<04:06, 27.38s/it]
                                                   
{'loss': 1.4942, 'learning_rate': 1.0344827586206895e-05, 'epoch': 0.97}

 98%|█████████▊| 352/361 [2:41:18<04:06, 27.38s/it]
 98%|█████████▊| 353/361 [2:41:45<03:39, 27.42s/it]
                                                   
{'loss': 1.5536, 'learning_rate': 9.195402298850573e-06, 'epoch': 0.98}

 98%|█████████▊| 353/361 [2:41:45<03:39, 27.42s/it]
 98%|█████████▊| 354/361 [2:42:13<03:11, 27.41s/it]
                                                   
{'loss': 1.6355, 'learning_rate': 8.045977011494252e-06, 'epoch': 0.98}

 98%|█████████▊| 354/361 [2:42:13<03:11, 27.41s/it]
 98%|█████████▊| 355/361 [2:42:39<02:42, 27.05s/it]
                                                   
{'loss': 1.5691, 'learning_rate': 6.89655172413793e-06, 'epoch': 0.98}

 98%|█████████▊| 355/361 [2:42:39<02:42, 27.05s/it]
 99%|█████████▊| 356/361 [2:43:06<02:15, 27.15s/it]
                                                   
{'loss': 1.5662, 'learning_rate': 5.747126436781608e-06, 'epoch': 0.98}

 99%|█████████▊| 356/361 [2:43:06<02:15, 27.15s/it]
 99%|█████████▉| 357/361 [2:43:34<01:48, 27.24s/it]
                                                   
{'loss': 1.4981, 'learning_rate': 4.597701149425287e-06, 'epoch': 0.99}

 99%|█████████▉| 357/361 [2:43:34<01:48, 27.24s/it]
 99%|█████████▉| 358/361 [2:44:01<01:21, 27.33s/it]
                                                   
{'loss': 1.4792, 'learning_rate': 3.448275862068965e-06, 'epoch': 0.99}

 99%|█████████▉| 358/361 [2:44:01<01:21, 27.33s/it]
 99%|█████████▉| 359/361 [2:44:29<00:54, 27.35s/it]
                                                   
{'loss': 1.5839, 'learning_rate': 2.2988505747126433e-06, 'epoch': 0.99}

 99%|█████████▉| 359/361 [2:44:29<00:54, 27.35s/it]
100%|█████████▉| 360/361 [2:44:56<00:27, 27.41s/it]
                                                   
{'loss': 1.5702, 'learning_rate': 1.1494252873563217e-06, 'epoch': 1.0}

100%|█████████▉| 360/361 [2:44:56<00:27, 27.41s/it]/nfs4/llm/h2o-llm/env/lib/python3.10/site-packages/bitsandbytes/autograd/_functions.py:318: UserWarning: MatMul8bitLt: inputs will be cast from torch.float32 to float16 during quantization
  warnings.warn(f"MatMul8bitLt: inputs will be cast from {A.dtype} to float16 during quantization")

100%|██████████| 361/361 [2:45:23<00:00, 27.39s/it]
                                                   
{'loss': 1.555, 'learning_rate': 0.0, 'epoch': 1.0}

100%|██████████| 361/361 [2:45:23<00:00, 27.39s/it]
                                                   
{'train_runtime': 9925.9213, 'train_samples_per_second': 4.663, 'train_steps_per_second': 0.036, 'train_loss': 1.6055608142445952, 'epoch': 1.0}

100%|██████████| 361/361 [2:45:23<00:00, 27.39s/it]
100%|██████████| 361/361 [2:45:23<00:00, 27.49s/it]

 If there's a warning about missing keys above, please disregard :)
