WARNING:torch.distributed.run:
*****************************************
Setting OMP_NUM_THREADS environment variable for each process to be 1 in default, to avoid your system being overloaded, please further tune the variable for optimal performance in your application as needed. 
*****************************************

===================================BUG REPORT===================================
Welcome to bitsandbytes. For bug reports, please run

python -m bitsandbytes

 and submit this information together with your error trace to: https://github.com/TimDettmers/bitsandbytes/issues
================================================================================
bin /home/ubuntu/miniconda3/envs/h2ollm/lib/python3.10/site-packages/bitsandbytes-0.38.0.post2-py3.10.egg/bitsandbytes/libbitsandbytes_cuda121.so
/home/ubuntu/miniconda3/envs/h2ollm/lib/python3.10/site-packages/bitsandbytes-0.38.0.post2-py3.10.egg/bitsandbytes/cuda_setup/main.py:145: UserWarning: /home/ubuntu/miniconda3/envs/h2ollm did not contain ['libcudart.so', 'libcudart.so.11.0', 'libcudart.so.12.0'] as expected! Searching further paths...
  warn(msg)
CUDA SETUP: CUDA runtime path found: /usr/local/cuda/lib64/libcudart.so
CUDA SETUP: Highest compute capability among GPUs detected: 8.0
CUDA SETUP: Detected CUDA version 121
CUDA SETUP: Loading binary /home/ubuntu/miniconda3/envs/h2ollm/lib/python3.10/site-packages/bitsandbytes-0.38.0.post2-py3.10.egg/bitsandbytes/libbitsandbytes_cuda121.so...

===================================BUG REPORT===================================
Welcome to bitsandbytes. For bug reports, please run

python -m bitsandbytes

 and submit this information together with your error trace to: https://github.com/TimDettmers/bitsandbytes/issues
================================================================================
bin /home/ubuntu/miniconda3/envs/h2ollm/lib/python3.10/site-packages/bitsandbytes-0.38.0.post2-py3.10.egg/bitsandbytes/libbitsandbytes_cuda121.so
/home/ubuntu/miniconda3/envs/h2ollm/lib/python3.10/site-packages/bitsandbytes-0.38.0.post2-py3.10.egg/bitsandbytes/cuda_setup/main.py:145: UserWarning: /home/ubuntu/miniconda3/envs/h2ollm did not contain ['libcudart.so', 'libcudart.so.11.0', 'libcudart.so.12.0'] as expected! Searching further paths...
  warn(msg)
CUDA SETUP: CUDA runtime path found: /usr/local/cuda/lib64/libcudart.so
CUDA SETUP: Highest compute capability among GPUs detected: 8.0
CUDA SETUP: Detected CUDA version 121
CUDA SETUP: Loading binary /home/ubuntu/miniconda3/envs/h2ollm/lib/python3.10/site-packages/bitsandbytes-0.38.0.post2-py3.10.egg/bitsandbytes/libbitsandbytes_cuda121.so...
No neptune configured, set NEPTUNE_API_TOKEN env var.

    Example runs on 4 GPUs:
    WORLD_SIZE=4 CUDA_VISIBLE_DEVICES="0,1,2,3" torchrun --nproc_per_node=4 finetune.py --base_model='decapoda-research/llama-7b-hf' --data_path=data/config.json --run_id=0 &> 0.log
    WORLD_SIZE=4 CUDA_VISIBLE_DEVICES="0,1,2,3" torchrun --nproc_per_node=4 finetune.py --base_model='decapoda-research/llama-30b-hf' --data_path=data/config.json --batch_size=16 --micro_batch_size=1 --run_id=1 --save_code=True &> 1.log
    WORLD_SIZE=4 CUDA_VISIBLE_DEVICES="0,1,2,3" torchrun --nproc_per_node=4 finetune.py --base_model='EleutherAI/gpt-j-6B' --data_path=data/config.json --run_id=2 &> 2.log
    WORLD_SIZE=4 CUDA_VISIBLE_DEVICES="0,1,2,3" torchrun --nproc_per_node=4 finetune.py --base_model='EleutherAI/gpt-neox-20b' --data_path=data/config.json --run_id=8 --batch_size=16 --micro_batch_size=4 &> 8.log
    WORLD_SIZE=4 CUDA_VISIBLE_DEVICES="0,1,2,3" torchrun --nproc_per_node=4 finetune.py --base_model='togethercomputer/GPT-NeoXT-Chat-Base-20B' --data_path=data/config.json --prompt_type='dai_faq' --run_id=13 --batch_size=16 --micro_batch_size=4 --num_epochs=100 --val_set_size=0 data_mix_in_path='' &> 13.log
    WORLD_SIZE=4 CUDA_VISIBLE_DEVICES="0,1,2,3" torchrun --nproc_per_node=4 finetune.py --base_model='togethercomputer/GPT-NeoXT-Chat-Base-20B' --data_path=data/config.json --run_id=28 --batch_size=16 --micro_batch_size=4 --num_epochs=8 --val_set_size=0 --data_mix_in_factor=0.1 --data_mix_in_prompt_type='human_bot' --save_code=True --cutoff_len=512  &> 28.log

    All metrics:
    CUDA_VISIBLE_DEVICES= finetune.py --data_mix_in_factor=0 --eval_steps=100 --warmup_steps=2 --val_set_size=100 --val_metrics="['bleu', 'rouge', 'sacrebleu', 'meteor']"

    # Fine-tune 20B on 24GB GPUs across 3 nodes with 3+2+2 GPUs
    rippa>
NCCL_P2P_LEVEL=LOC WORLD_SIZE=7 CUDA_VISIBLE_DEVICES="0,1,2" torchrun --node_rank 0 --nproc_per_node=3 --master_port=1234 --nnodes=3 --master_addr=10.10.10.2 finetune.py --data_path=merged_shuffled_OIG_87f6a1e788.json --micro_batch_size=1 --batch_size=7 --cutoff_len=512 --run_id=17 &>log.17.rank0
    ova>
NCCL_P2P_LEVEL=LOC WORLD_SIZE=7 CUDA_VISIBLE_DEVICES="0,1" torchrun --node_rank 1 --nproc_per_node=2 --master_port=1234 --nnodes=3 --master_addr=10.10.10.2 finetune.py --data_path=merged_shuffled_OIG_87f6a1e788.json --micro_batch_size=1 --batch_size=7 --cutoff_len=512 --run_id=17 &>log.17.rank1
    timemachine>
NCCL_P2P_LEVEL=LOC WORLD_SIZE=7 CUDA_VISIBLE_DEVICES="0,1" torchrun --node_rank 2 --nproc_per_node=2 --master_port=1234 --nnodes=3 --master_addr=10.10.10.2 finetune.py --data_path=merged_shuffled_OIG_87f6a1e788.json --micro_batch_size=1 --batch_size=7 --cutoff_len=512 --run_id=17 &>log.17.rank2

    
local_rank: 0
global rank: 0
Training model with params:
save_code: False
run_id: 7
base_model: EleutherAI/pythia-6.9b
tokenizer_base_model: EleutherAI/pythia-6.9b
data_path: h2ogpt-oig-oasst1-instruct-cleaned-v1.json
data_col_dict: None
valid_path: None
data_mix_in_path: 0-hero/OIG-small-chip2
data_mix_in_factor: 0.0
data_mix_in_col_dict: {'user': 'instruction', 'chip2': 'output'}
data_mix_in_prompt_type: instruct
output_dir: pythia-6.9b.h2ogpt-oig-oasst1-instruct-cleaned-v1.json.1_epochs.5fc91911bc2bfaaf3b6c2de577c4b0ae45a07a4a.7
lora_weights: 
batch_size: 512
micro_batch_size: 8
gradient_checkpointing: False
fp16: True
num_epochs: 1
learning_rate: 0.0003
val_set_size: None
val_metrics: []
eval_steps: None
eval_epochs: None
lora_r: 8
lora_alpha: 16
lora_dropout: 0.05
lora_target_modules: None
llama_type: False
group_by_length: False
resume_from_checkpoint: None
ddp: True
local_files_only: False
resume_download: True
warmup_steps: 100
logging_steps: 1
save_steps: None
add_eos_token: False
world_size: 2
local_rank: 0
rank: 0
gpus: 2
device_map: auto
gradient_accumulation_steps: 64
cutoff_len: 512
prompt_type: plain
train_on_inputs: True
Command: finetune.py --base_model=EleutherAI/pythia-6.9b --data_path=h2ogpt-oig-oasst1-instruct-cleaned-v1.json --prompt_type=plain --run_id=7 --micro_batch_size=8 --batch_size=512 --cutoff_len=512
Hash: 5fc91911bc2bfaaf3b6c2de577c4b0ae45a07a4a
Distributed: data parallel
local_rank: 1
global rank: 1

Loading checkpoint shards:   0%|          | 0/2 [00:00<?, ?it/s]
Loading checkpoint shards:   0%|          | 0/2 [00:00<?, ?it/s]
Loading checkpoint shards:  50%|█████     | 1/2 [00:05<00:05,  5.71s/it]
Loading checkpoint shards:  50%|█████     | 1/2 [00:06<00:06,  6.43s/it]
Loading checkpoint shards: 100%|██████████| 2/2 [00:07<00:00,  3.48s/it]
Loading checkpoint shards: 100%|██████████| 2/2 [00:07<00:00,  3.81s/it]
PeftModelForCausalLM(
  (base_model): LoraModel(
    (model): GPTNeoXForCausalLM(
      (gpt_neox): GPTNeoXModel(
        (embed_in): Embedding(50432, 4096)
        (layers): ModuleList(
          (0-31): 32 x GPTNeoXLayer(
            (input_layernorm): LayerNorm((4096,), eps=1e-05, elementwise_affine=True)
            (post_attention_layernorm): LayerNorm((4096,), eps=1e-05, elementwise_affine=True)
            (attention): GPTNeoXAttention(
              (rotary_emb): RotaryEmbedding()
              (query_key_value): MergedLinear8bitLt(
                in_features=4096, out_features=12288, bias=True
                (lora_dropout): Dropout(p=0.05, inplace=False)
                (lora_A): Linear(in_features=4096, out_features=16, bias=False)
                (lora_B): Conv1d(16, 8192, kernel_size=(1,), stride=(1,), groups=2, bias=False)
              )
              (dense): Linear8bitLt(in_features=4096, out_features=4096, bias=True)
            )
            (mlp): GPTNeoXMLP(
              (dense_h_to_4h): Linear8bitLt(in_features=4096, out_features=16384, bias=True)
              (dense_4h_to_h): Linear8bitLt(in_features=16384, out_features=4096, bias=True)
              (act): GELUActivation()
            )
          )
        )
        (final_layer_norm): LayerNorm((4096,), eps=1e-05, elementwise_affine=True)
      )
      (embed_out): Linear(in_features=4096, out_features=50432, bias=False)
    )
  )
)
trainable params: 4194304 || all params: 6861496320 || trainable%: 0.06112812430977155

Loading checkpoint shards: 100%|██████████| 2/2 [00:08<00:00,  4.15s/it]
Loading checkpoint shards: 100%|██████████| 2/2 [00:08<00:00,  4.50s/it]
Found cached dataset json (/home/ubuntu/.cache/huggingface/datasets/json/default-5cb40779a3939ca8/0.0.0/0f7e3662623656454fcd2b650f34e886a7db4b9104504885bd462096cc7a9f51)

  0%|          | 0/1 [00:00<?, ?it/s]
100%|██████████| 1/1 [00:00<00:00, 62.10it/s]

Map (num_proc=16):   0%|          | 0/349837 [00:00<?, ? examples/s]PeftModelForCausalLM(
  (base_model): LoraModel(
    (model): GPTNeoXForCausalLM(
      (gpt_neox): GPTNeoXModel(
        (embed_in): Embedding(50432, 4096)
        (layers): ModuleList(
          (0-31): 32 x GPTNeoXLayer(
            (input_layernorm): LayerNorm((4096,), eps=1e-05, elementwise_affine=True)
            (post_attention_layernorm): LayerNorm((4096,), eps=1e-05, elementwise_affine=True)
            (attention): GPTNeoXAttention(
              (rotary_emb): RotaryEmbedding()
              (query_key_value): MergedLinear8bitLt(
                in_features=4096, out_features=12288, bias=True
                (lora_dropout): Dropout(p=0.05, inplace=False)
                (lora_A): Linear(in_features=4096, out_features=16, bias=False)
                (lora_B): Conv1d(16, 8192, kernel_size=(1,), stride=(1,), groups=2, bias=False)
              )
              (dense): Linear8bitLt(in_features=4096, out_features=4096, bias=True)
            )
            (mlp): GPTNeoXMLP(
              (dense_h_to_4h): Linear8bitLt(in_features=4096, out_features=16384, bias=True)
              (dense_4h_to_h): Linear8bitLt(in_features=16384, out_features=4096, bias=True)
              (act): GELUActivation()
            )
          )
        )
        (final_layer_norm): LayerNorm((4096,), eps=1e-05, elementwise_affine=True)
      )
      (embed_out): Linear(in_features=4096, out_features=50432, bias=False)
    )
  )
)
trainable params: 4194304 || all params: 6861496320 || trainable%: 0.06112812430977155
Using Validation Metrics: []
Supported Metrics: ['bleu', 'rouge', 'sacrebleu', 'meteor']
Auto set val_set_size 1000

Map (num_proc=16):   0%|          | 31/349837 [00:00<56:04, 103.96 examples/s]
Map (num_proc=16):   0%|          | 334/349837 [00:00<05:36, 1039.48 examples/s]
Map (num_proc=16):   0%|          | 1072/349837 [00:00<01:58, 2942.98 examples/s]
Map (num_proc=16):   1%|          | 2502/349837 [00:00<00:54, 6340.92 examples/s]
Map (num_proc=16):   1%|          | 3931/349837 [00:00<00:39, 8686.89 examples/s]
Map (num_proc=16):   2%|▏         | 5505/349837 [00:00<00:32, 10751.01 examples/s]Found cached dataset json (/home/ubuntu/.cache/huggingface/datasets/json/default-5cb40779a3939ca8/0.0.0/0f7e3662623656454fcd2b650f34e886a7db4b9104504885bd462096cc7a9f51)

  0%|          | 0/1 [00:00<?, ?it/s]
100%|██████████| 1/1 [00:00<00:00, 125.71it/s]

Map (num_proc=16):   2%|▏         | 6994/349837 [00:00<00:28, 11970.44 examples/s]
Map (num_proc=16):   2%|▏         | 8576/349837 [00:01<00:26, 13081.72 examples/s]
Map (num_proc=16):   3%|▎         | 10074/349837 [00:01<00:24, 13600.66 examples/s]
Map (num_proc=16):   3%|▎         | 11529/349837 [00:01<00:24, 13709.23 examples/s]
Map (num_proc=16):   0%|          | 0/349837 [00:00<?, ? examples/s]
Map (num_proc=16):   4%|▎         | 13026/349837 [00:01<00:24, 13983.30 examples/s]
Map (num_proc=16):   4%|▍         | 14478/349837 [00:01<00:23, 14060.71 examples/s]
Map (num_proc=16):   0%|          | 61/349837 [00:00<22:23, 260.33 examples/s]
Map (num_proc=16):   5%|▍         | 15943/349837 [00:01<00:25, 13057.86 examples/s]
Map (num_proc=16):   0%|          | 317/349837 [00:00<05:34, 1044.98 examples/s]
Map (num_proc=16):   5%|▍         | 17289/349837 [00:01<00:27, 12209.44 examples/s]
Map (num_proc=16):   0%|          | 1080/349837 [00:00<01:54, 3046.66 examples/s]
Map (num_proc=16):   5%|▌         | 18721/349837 [00:01<00:25, 12751.53 examples/s]
Map (num_proc=16):   1%|          | 2283/349837 [00:00<00:59, 5795.35 examples/s]
Map (num_proc=16):   6%|▌         | 20310/349837 [00:01<00:24, 13535.73 examples/s]
Map (num_proc=16):   1%|          | 3605/349837 [00:00<00:42, 8056.25 examples/s]
Map (num_proc=16):   6%|▋         | 21925/349837 [00:01<00:23, 14049.67 examples/s]
Map (num_proc=16):   1%|▏         | 5002/349837 [00:00<00:35, 9835.77 examples/s]
Map (num_proc=16):   7%|▋         | 23605/349837 [00:02<00:22, 14626.15 examples/s]
Map (num_proc=16):   2%|▏         | 6464/349837 [00:00<00:30, 11264.40 examples/s]
Map (num_proc=16):   7%|▋         | 25254/349837 [00:02<00:21, 15113.31 examples/s]
Map (num_proc=16):   2%|▏         | 8004/349837 [00:00<00:27, 12464.41 examples/s]
Map (num_proc=16):   8%|▊         | 26782/349837 [00:02<00:21, 15085.79 examples/s]
Map (num_proc=16):   3%|▎         | 9503/349837 [00:01<00:25, 13200.99 examples/s]
Map (num_proc=16):   8%|▊         | 28317/349837 [00:02<00:21, 14910.68 examples/s]
Map (num_proc=16):   3%|▎         | 10958/349837 [00:01<00:25, 13375.46 examples/s]
Map (num_proc=16):   9%|▊         | 29851/349837 [00:02<00:21, 14959.16 examples/s]
Map (num_proc=16):   4%|▎         | 12366/349837 [00:01<00:25, 13464.74 examples/s]
Map (num_proc=16):   9%|▉         | 31383/349837 [00:02<00:21, 14703.74 examples/s]
Map (num_proc=16):   4%|▍         | 13817/349837 [00:01<00:24, 13566.44 examples/s]
Map (num_proc=16):   9%|▉         | 32876/349837 [00:02<00:22, 14014.35 examples/s]
Map (num_proc=16):   4%|▍         | 15212/349837 [00:01<00:25, 13105.47 examples/s]
Map (num_proc=16):  10%|▉         | 34318/349837 [00:02<00:22, 13849.49 examples/s]
Map (num_proc=16):   5%|▍         | 16568/349837 [00:01<00:26, 12650.07 examples/s]
Map (num_proc=16):  10%|█         | 35804/349837 [00:02<00:22, 14035.51 examples/s]
Map (num_proc=16):   5%|▌         | 17849/349837 [00:01<00:27, 12241.18 examples/s]
Map (num_proc=16):  11%|█         | 37432/349837 [00:03<00:21, 14626.61 examples/s]
Map (num_proc=16):   6%|▌         | 19245/349837 [00:01<00:26, 12682.26 examples/s]
Map (num_proc=16):  11%|█         | 39033/349837 [00:03<00:20, 14994.50 examples/s]
Map (num_proc=16):   6%|▌         | 20721/349837 [00:01<00:24, 13250.19 examples/s]
Map (num_proc=16):  12%|█▏        | 40615/349837 [00:03<00:20, 15116.06 examples/s]
Map (num_proc=16):   6%|▋         | 22258/349837 [00:02<00:23, 13785.06 examples/s]
Map (num_proc=16):  12%|█▏        | 42137/349837 [00:03<00:20, 15071.88 examples/s]
Map (num_proc=16):   7%|▋         | 23662/349837 [00:02<00:23, 13833.66 examples/s]
Map (num_proc=16):  12%|█▏        | 43649/349837 [00:03<00:20, 14947.79 examples/s]
Map (num_proc=16):   7%|▋         | 25067/349837 [00:02<00:23, 13740.57 examples/s]
Map (num_proc=16):  13%|█▎        | 45193/349837 [00:03<00:20, 14557.99 examples/s]
Map (num_proc=16):   8%|▊         | 26570/349837 [00:02<00:23, 14011.09 examples/s]
Map (num_proc=16):  13%|█▎        | 46655/349837 [00:03<00:20, 14452.33 examples/s]
Map (num_proc=16):   8%|▊         | 28082/349837 [00:02<00:22, 14262.89 examples/s]
Map (num_proc=16):  14%|█▍        | 48116/349837 [00:03<00:21, 13863.11 examples/s]
Map (num_proc=16):   8%|▊         | 29531/349837 [00:02<00:22, 14224.31 examples/s]
Map (num_proc=16):  14%|█▍        | 49522/349837 [00:03<00:22, 13232.55 examples/s]
Map (num_proc=16):   9%|▉         | 30982/349837 [00:02<00:23, 13480.00 examples/s]
Map (num_proc=16):  15%|█▍        | 51002/349837 [00:04<00:22, 13558.96 examples/s]
Map (num_proc=16):   9%|▉         | 32393/349837 [00:02<00:23, 13588.52 examples/s]
Map (num_proc=16):  15%|█▌        | 52590/349837 [00:04<00:21, 14106.42 examples/s]
Map (num_proc=16):  10%|▉         | 33765/349837 [00:02<00:24, 13055.86 examples/s]
Map (num_proc=16):  15%|█▌        | 54167/349837 [00:04<00:20, 14508.54 examples/s]
Map (num_proc=16):  10%|█         | 35110/349837 [00:02<00:24, 13093.66 examples/s]
Map (num_proc=16):  16%|█▌        | 55680/349837 [00:04<00:20, 14572.85 examples/s]
Map (num_proc=16):  10%|█         | 36508/349837 [00:03<00:23, 13321.93 examples/s]
Map (num_proc=16):  16%|█▋        | 57333/349837 [00:04<00:19, 15119.18 examples/s]
Map (num_proc=16):  11%|█         | 37852/349837 [00:03<00:23, 13262.98 examples/s]
Map (num_proc=16):  17%|█▋        | 58862/349837 [00:04<00:19, 15141.97 examples/s]
Map (num_proc=16):  11%|█         | 39316/349837 [00:03<00:22, 13517.49 examples/s]
Map (num_proc=16):  17%|█▋        | 60412/349837 [00:04<00:19, 15165.45 examples/s]
Map (num_proc=16):  12%|█▏        | 40859/349837 [00:03<00:21, 14054.96 examples/s]
Map (num_proc=16):  18%|█▊        | 61937/349837 [00:04<00:19, 14944.81 examples/s]
Map (num_proc=16):  12%|█▏        | 42296/349837 [00:03<00:22, 13912.62 examples/s]
Map (num_proc=16):  18%|█▊        | 63440/349837 [00:04<00:19, 14372.26 examples/s]
Map (num_proc=16):  13%|█▎        | 43827/349837 [00:03<00:21, 14214.46 examples/s]
Map (num_proc=16):  19%|█▊        | 64898/349837 [00:04<00:20, 13822.16 examples/s]
Map (num_proc=16):  13%|█▎        | 45272/349837 [00:03<00:21, 14052.97 examples/s]
Map (num_proc=16):  19%|█▉        | 66293/349837 [00:05<00:21, 13406.87 examples/s]
Map (num_proc=16):  13%|█▎        | 46679/349837 [00:03<00:21, 14004.44 examples/s]
Map (num_proc=16):  19%|█▉        | 67840/349837 [00:05<00:20, 13746.43 examples/s]
Map (num_proc=16):  14%|█▍        | 48110/349837 [00:03<00:23, 13093.92 examples/s]
Map (num_proc=16):  20%|█▉        | 69388/349837 [00:05<00:19, 14219.21 examples/s]
Map (num_proc=16):  14%|█▍        | 49480/349837 [00:04<00:23, 12902.30 examples/s]
Map (num_proc=16):  20%|██        | 70930/349837 [00:05<00:19, 14283.92 examples/s]
Map (num_proc=16):  15%|█▍        | 51063/349837 [00:04<00:21, 13661.56 examples/s]
Map (num_proc=16):  21%|██        | 72557/349837 [00:05<00:18, 14830.65 examples/s]
Map (num_proc=16):  15%|█▌        | 52594/349837 [00:04<00:21, 14098.99 examples/s]
Map (num_proc=16):  21%|██        | 74133/349837 [00:05<00:18, 15002.83 examples/s]
Map (num_proc=16):  15%|█▌        | 54056/349837 [00:04<00:20, 14090.18 examples/s]
Map (num_proc=16):  22%|██▏       | 75656/349837 [00:05<00:18, 14710.96 examples/s]
Map (num_proc=16):  16%|█▌        | 55477/349837 [00:04<00:20, 14051.12 examples/s]
Map (num_proc=16):  22%|██▏       | 77146/349837 [00:05<00:18, 14438.50 examples/s]
Map (num_proc=16):  16%|█▋        | 56913/349837 [00:04<00:21, 13877.72 examples/s]
Map (num_proc=16):  22%|██▏       | 78606/349837 [00:05<00:19, 14141.11 examples/s]
Map (num_proc=16):  17%|█▋        | 58315/349837 [00:04<00:21, 13784.06 examples/s]
Map (num_proc=16):  23%|██▎       | 80041/349837 [00:06<00:19, 13593.06 examples/s]
Map (num_proc=16):  17%|█▋        | 59705/349837 [00:04<00:21, 13735.68 examples/s]
Map (num_proc=16):  23%|██▎       | 81412/349837 [00:06<00:20, 13156.76 examples/s]
Map (num_proc=16):  17%|█▋        | 61087/349837 [00:04<00:21, 13531.39 examples/s]
Map (num_proc=16):  24%|██▎       | 82923/349837 [00:06<00:19, 13618.30 examples/s]
Map (num_proc=16):  18%|█▊        | 62468/349837 [00:04<00:21, 13069.43 examples/s]
Map (num_proc=16):  24%|██▍       | 84495/349837 [00:06<00:18, 14159.33 examples/s]
Map (num_proc=16):  18%|█▊        | 63784/349837 [00:05<00:22, 12550.88 examples/s]
Map (num_proc=16):  25%|██▍       | 86056/349837 [00:06<00:18, 14379.87 examples/s]
Map (num_proc=16):  19%|█▊        | 65341/349837 [00:05<00:21, 13290.21 examples/s]
Map (num_proc=16):  25%|██▌       | 87669/349837 [00:06<00:17, 14838.28 examples/s]
Map (num_proc=16):  19%|█▉        | 66807/349837 [00:05<00:20, 13549.48 examples/s]
Map (num_proc=16):  26%|██▌       | 89296/349837 [00:06<00:17, 15108.74 examples/s]
Map (num_proc=16):  20%|█▉        | 68363/349837 [00:05<00:20, 14048.82 examples/s]
Map (num_proc=16):  26%|██▌       | 90946/349837 [00:06<00:16, 15414.16 examples/s]
Map (num_proc=16):  20%|█▉        | 69783/349837 [00:05<00:20, 13913.20 examples/s]
Map (num_proc=16):  26%|██▋       | 92519/349837 [00:06<00:17, 15024.88 examples/s]
Map (num_proc=16):  20%|██        | 71291/349837 [00:05<00:19, 14251.35 examples/s]
Map (num_proc=16):  27%|██▋       | 94046/349837 [00:06<00:17, 14952.58 examples/s]
Map (num_proc=16):  21%|██        | 72752/349837 [00:05<00:19, 14295.46 examples/s]
Map (num_proc=16):  27%|██▋       | 95581/349837 [00:07<00:17, 14566.61 examples/s]
Map (num_proc=16):  21%|██        | 74239/349837 [00:05<00:19, 14353.92 examples/s]
Map (num_proc=16):  28%|██▊       | 97048/349837 [00:07<00:18, 13649.46 examples/s]
Map (num_proc=16):  22%|██▏       | 75701/349837 [00:05<00:19, 14362.53 examples/s]
Map (num_proc=16):  28%|██▊       | 98430/349837 [00:07<00:18, 13306.67 examples/s]
Map (num_proc=16):  22%|██▏       | 77163/349837 [00:06<00:19, 13914.21 examples/s]
Map (num_proc=16):  29%|██▊       | 99944/349837 [00:07<00:18, 13716.12 examples/s]
Map (num_proc=16):  22%|██▏       | 78571/349837 [00:06<00:19, 13572.55 examples/s]
Map (num_proc=16):  29%|██▉       | 101531/349837 [00:07<00:17, 14202.93 examples/s]
Map (num_proc=16):  23%|██▎       | 79933/349837 [00:06<00:20, 13105.18 examples/s]
Map (num_proc=16):  29%|██▉       | 103004/349837 [00:07<00:17, 14123.64 examples/s]
Map (num_proc=16):  23%|██▎       | 81360/349837 [00:06<00:20, 13303.68 examples/s]
Map (num_proc=16):  30%|██▉       | 104519/349837 [00:07<00:17, 14369.43 examples/s]
Map (num_proc=16):  24%|██▎       | 82820/349837 [00:06<00:19, 13588.90 examples/s]
Map (num_proc=16):  30%|███       | 106170/349837 [00:07<00:16, 14973.89 examples/s]
Map (num_proc=16):  24%|██▍       | 84349/349837 [00:06<00:18, 14064.04 examples/s]
Map (num_proc=16):  31%|███       | 107705/349837 [00:07<00:16, 14905.38 examples/s]
Map (num_proc=16):  25%|██▍       | 85863/349837 [00:06<00:18, 14150.47 examples/s]
Map (num_proc=16):  31%|███       | 109241/349837 [00:08<00:16, 14770.52 examples/s]
Map (num_proc=16):  25%|██▍       | 87324/349837 [00:06<00:18, 14232.41 examples/s]
Map (num_proc=16):  32%|███▏      | 110758/349837 [00:08<00:16, 14779.92 examples/s]
Map (num_proc=16):  25%|██▌       | 88761/349837 [00:06<00:18, 14206.53 examples/s]
Map (num_proc=16):  26%|██▌       | 90221/349837 [00:06<00:18, 14311.01 examples/s]
Map (num_proc=16):  32%|███▏      | 112270/349837 [00:08<00:17, 13969.65 examples/s]
Map (num_proc=16):  26%|██▌       | 91654/349837 [00:07<00:18, 14242.71 examples/s]
Map (num_proc=16):  33%|███▎      | 113700/349837 [00:08<00:18, 12982.92 examples/s]
Map (num_proc=16):  27%|██▋       | 93081/349837 [00:07<00:19, 13380.20 examples/s]
Map (num_proc=16):  33%|███▎      | 115108/349837 [00:08<00:17, 13164.54 examples/s]
Map (num_proc=16):  33%|███▎      | 116593/349837 [00:08<00:17, 13585.83 examples/s]
Map (num_proc=16):  27%|██▋       | 94472/349837 [00:07<00:19, 12916.70 examples/s]
Map (num_proc=16):  34%|███▍      | 118102/349837 [00:08<00:16, 13834.52 examples/s]
Map (num_proc=16):  27%|██▋       | 95860/349837 [00:07<00:19, 13174.98 examples/s]
Map (num_proc=16):  34%|███▍      | 119600/349837 [00:08<00:16, 14115.53 examples/s]
Map (num_proc=16):  28%|██▊       | 97193/349837 [00:07<00:19, 13149.45 examples/s]
Map (num_proc=16):  35%|███▍      | 121153/349837 [00:08<00:15, 14400.24 examples/s]
Map (num_proc=16):  28%|██▊       | 98556/349837 [00:07<00:18, 13225.43 examples/s]
Map (num_proc=16):  29%|██▊       | 100118/349837 [00:07<00:17, 13888.92 examples/s]
Map (num_proc=16):  35%|███▌      | 122720/349837 [00:09<00:15, 14644.09 examples/s]
Map (num_proc=16):  29%|██▉       | 101569/349837 [00:07<00:17, 14044.26 examples/s]
Map (num_proc=16):  36%|███▌      | 124217/349837 [00:09<00:15, 14512.56 examples/s]
Map (num_proc=16):  29%|██▉       | 103094/349837 [00:07<00:17, 14120.94 examples/s]
Map (num_proc=16):  36%|███▌      | 125695/349837 [00:09<00:15, 14208.29 examples/s]
Map (num_proc=16):  30%|██▉       | 104597/349837 [00:08<00:17, 14245.60 examples/s]
Map (num_proc=16):  36%|███▋      | 127142/349837 [00:09<00:15, 14142.26 examples/s]
Map (num_proc=16):  30%|███       | 106171/349837 [00:08<00:16, 14616.18 examples/s]
Map (num_proc=16):  37%|███▋      | 128571/349837 [00:09<00:16, 13795.84 examples/s]
Map (num_proc=16):  37%|███▋      | 129970/349837 [00:09<00:15, 13804.13 examples/s]
Map (num_proc=16):  31%|███       | 107661/349837 [00:08<00:17, 13726.90 examples/s]
Map (num_proc=16):  31%|███       | 109073/349837 [00:08<00:17, 13535.37 examples/s]
Map (num_proc=16):  38%|███▊      | 131364/349837 [00:09<00:16, 13164.29 examples/s]
Map (num_proc=16):  32%|███▏      | 110449/349837 [00:08<00:17, 13481.25 examples/s]
Map (num_proc=16):  38%|███▊      | 132844/349837 [00:09<00:16, 13503.52 examples/s]
Map (num_proc=16):  32%|███▏      | 111915/349837 [00:08<00:17, 13779.35 examples/s]
Map (num_proc=16):  38%|███▊      | 134375/349837 [00:09<00:15, 13933.47 examples/s]
Map (num_proc=16):  39%|███▉      | 135917/349837 [00:09<00:14, 14297.59 examples/s]
Map (num_proc=16):  32%|███▏      | 113327/349837 [00:08<00:17, 13476.82 examples/s]
Map (num_proc=16):  39%|███▉      | 137360/349837 [00:10<00:14, 14209.05 examples/s]
Map (num_proc=16):  33%|███▎      | 114749/349837 [00:08<00:17, 13683.11 examples/s]
Map (num_proc=16):  40%|███▉      | 138957/349837 [00:10<00:14, 14715.14 examples/s]
Map (num_proc=16):  33%|███▎      | 116154/349837 [00:08<00:16, 13771.29 examples/s]
Map (num_proc=16):  34%|███▎      | 117567/349837 [00:08<00:16, 13779.56 examples/s]
Map (num_proc=16):  40%|████      | 140461/349837 [00:10<00:14, 14314.43 examples/s]
Map (num_proc=16):  34%|███▍      | 118973/349837 [00:09<00:16, 13825.44 examples/s]
Map (num_proc=16):  41%|████      | 141918/349837 [00:10<00:14, 14366.47 examples/s]
Map (num_proc=16):  34%|███▍      | 120461/349837 [00:09<00:16, 14130.00 examples/s]
Map (num_proc=16):  41%|████      | 143426/349837 [00:10<00:14, 14322.45 examples/s]
Map (num_proc=16):  35%|███▍      | 122029/349837 [00:09<00:15, 14583.15 examples/s]
Map (num_proc=16):  41%|████▏     | 145005/349837 [00:10<00:13, 14740.88 examples/s]
Map (num_proc=16):  35%|███▌      | 123528/349837 [00:09<00:15, 14257.80 examples/s]
Map (num_proc=16):  42%|████▏     | 146533/349837 [00:10<00:14, 13981.55 examples/s]
Map (num_proc=16):  36%|███▌      | 125002/349837 [00:09<00:16, 13888.47 examples/s]
Map (num_proc=16):  42%|████▏     | 147945/349837 [00:10<00:14, 13891.66 examples/s]
Map (num_proc=16):  36%|███▌      | 126408/349837 [00:09<00:16, 13680.96 examples/s]
Map (num_proc=16):  43%|████▎     | 149595/349837 [00:10<00:13, 14450.52 examples/s]
Map (num_proc=16):  37%|███▋      | 127818/349837 [00:09<00:16, 13734.46 examples/s]
Map (num_proc=16):  43%|████▎     | 151193/349837 [00:11<00:13, 14806.88 examples/s]
Map (num_proc=16):  37%|███▋      | 129224/349837 [00:09<00:15, 13813.22 examples/s]
Map (num_proc=16):  44%|████▎     | 152721/349837 [00:11<00:13, 14930.19 examples/s]
Map (num_proc=16):  37%|███▋      | 130624/349837 [00:09<00:15, 13751.61 examples/s]
Map (num_proc=16):  44%|████▍     | 154401/349837 [00:11<00:12, 15390.90 examples/s]
Map (num_proc=16):  38%|███▊      | 132131/349837 [00:10<00:15, 13921.16 examples/s]
Map (num_proc=16):  45%|████▍     | 155963/349837 [00:11<00:12, 15236.38 examples/s]
Map (num_proc=16):  38%|███▊      | 133696/349837 [00:10<00:15, 14268.67 examples/s]
Map (num_proc=16):  45%|████▌     | 157518/349837 [00:11<00:12, 14823.84 examples/s]
Map (num_proc=16):  39%|███▊      | 135193/349837 [00:10<00:14, 14372.64 examples/s]
Map (num_proc=16):  45%|████▌     | 159048/349837 [00:11<00:12, 14732.84 examples/s]
Map (num_proc=16):  39%|███▉      | 136689/349837 [00:10<00:14, 14513.01 examples/s]
Map (num_proc=16):  46%|████▌     | 160562/349837 [00:11<00:13, 13998.59 examples/s]
Map (num_proc=16):  39%|███▉      | 138160/349837 [00:10<00:14, 14321.58 examples/s]
Map (num_proc=16):  46%|████▋     | 161988/349837 [00:11<00:13, 13997.72 examples/s]
Map (num_proc=16):  40%|███▉      | 139622/349837 [00:10<00:14, 14155.01 examples/s]
Map (num_proc=16):  47%|████▋     | 163410/349837 [00:11<00:13, 13813.72 examples/s]
Map (num_proc=16):  40%|████      | 141061/349837 [00:10<00:15, 13509.77 examples/s]
Map (num_proc=16):  47%|████▋     | 164894/349837 [00:11<00:13, 14085.31 examples/s]
Map (num_proc=16):  48%|████▊     | 166381/349837 [00:12<00:12, 14303.76 examples/s]
Map (num_proc=16):  41%|████      | 142439/349837 [00:10<00:16, 12700.29 examples/s]
Map (num_proc=16):  41%|████      | 143786/349837 [00:10<00:15, 12878.38 examples/s]
Map (num_proc=16):  48%|████▊     | 167960/349837 [00:12<00:12, 14627.84 examples/s]
Map (num_proc=16):  41%|████▏     | 145119/349837 [00:10<00:15, 12928.40 examples/s]
Map (num_proc=16):  48%|████▊     | 169537/349837 [00:12<00:12, 14900.21 examples/s]
Map (num_proc=16):  42%|████▏     | 146640/349837 [00:11<00:14, 13566.41 examples/s]
Map (num_proc=16):  49%|████▉     | 171073/349837 [00:12<00:12, 14456.69 examples/s]
Map (num_proc=16):  42%|████▏     | 148078/349837 [00:11<00:14, 13712.98 examples/s]
Map (num_proc=16):  49%|████▉     | 172608/349837 [00:12<00:12, 14667.46 examples/s]
Map (num_proc=16):  43%|████▎     | 149499/349837 [00:11<00:14, 13687.95 examples/s]
Map (num_proc=16):  50%|████▉     | 174134/349837 [00:12<00:11, 14837.31 examples/s]
Map (num_proc=16):  43%|████▎     | 150997/349837 [00:11<00:14, 14027.21 examples/s]
Map (num_proc=16):  50%|█████     | 175637/349837 [00:12<00:11, 14777.88 examples/s]
Map (num_proc=16):  44%|████▎     | 152420/349837 [00:11<00:14, 13999.08 examples/s]
Map (num_proc=16):  51%|█████     | 177123/349837 [00:12<00:11, 14617.21 examples/s]
Map (num_proc=16):  44%|████▍     | 153917/349837 [00:11<00:13, 14165.40 examples/s]
Map (num_proc=16):  51%|█████     | 178594/349837 [00:12<00:12, 13830.29 examples/s]
Map (num_proc=16):  44%|████▍     | 155345/349837 [00:11<00:14, 13717.64 examples/s]
Map (num_proc=16):  51%|█████▏    | 180002/349837 [00:13<00:12, 13332.28 examples/s]
Map (num_proc=16):  45%|████▍     | 156733/349837 [00:11<00:14, 13538.77 examples/s]
Map (num_proc=16):  52%|█████▏    | 181573/349837 [00:13<00:12, 13827.88 examples/s]
Map (num_proc=16):  45%|████▌     | 158097/349837 [00:11<00:14, 13334.70 examples/s]
Map (num_proc=16):  52%|█████▏    | 183072/349837 [00:13<00:11, 13934.64 examples/s]
Map (num_proc=16):  46%|████▌     | 159490/349837 [00:12<00:14, 13466.53 examples/s]
Map (num_proc=16):  53%|█████▎    | 184529/349837 [00:13<00:11, 14094.07 examples/s]
Map (num_proc=16):  46%|████▌     | 160868/349837 [00:12<00:14, 13398.38 examples/s]
Map (num_proc=16):  53%|█████▎    | 186099/349837 [00:13<00:11, 14492.65 examples/s]
Map (num_proc=16):  46%|████▋     | 162259/349837 [00:12<00:13, 13527.09 examples/s]
Map (num_proc=16):  54%|█████▎    | 187577/349837 [00:13<00:11, 14479.89 examples/s]
Map (num_proc=16):  47%|████▋     | 163796/349837 [00:12<00:13, 13914.11 examples/s]
Map (num_proc=16):  54%|█████▍    | 189046/349837 [00:13<00:11, 14456.74 examples/s]
Map (num_proc=16):  47%|████▋     | 165290/349837 [00:12<00:13, 14093.72 examples/s]
Map (num_proc=16):  54%|█████▍    | 190534/349837 [00:13<00:11, 14467.22 examples/s]
Map (num_proc=16):  48%|████▊     | 166723/349837 [00:12<00:13, 14025.59 examples/s]
Map (num_proc=16):  55%|█████▍    | 192015/349837 [00:13<00:10, 14545.22 examples/s]
Map (num_proc=16):  48%|████▊     | 168199/349837 [00:12<00:12, 14086.50 examples/s]
Map (num_proc=16):  55%|█████▌    | 193478/349837 [00:13<00:10, 14485.46 examples/s]
Map (num_proc=16):  49%|████▊     | 169697/349837 [00:12<00:12, 14331.55 examples/s]
Map (num_proc=16):  56%|█████▌    | 194933/349837 [00:14<00:10, 14426.21 examples/s]
Map (num_proc=16):  49%|████▉     | 171133/349837 [00:12<00:13, 13453.02 examples/s]
Map (num_proc=16):  56%|█████▌    | 196404/349837 [00:14<00:10, 14251.34 examples/s]
Map (num_proc=16):  49%|████▉     | 172496/349837 [00:12<00:13, 13419.00 examples/s]
Map (num_proc=16):  57%|█████▋    | 197861/349837 [00:14<00:10, 14088.81 examples/s]
Map (num_proc=16):  50%|████▉     | 173866/349837 [00:13<00:13, 13357.04 examples/s]
Map (num_proc=16):  57%|█████▋    | 199451/349837 [00:14<00:10, 14513.89 examples/s]
Map (num_proc=16):  50%|█████     | 175280/349837 [00:13<00:12, 13538.51 examples/s]
Map (num_proc=16):  57%|█████▋    | 201045/349837 [00:14<00:10, 14775.65 examples/s]
Map (num_proc=16):  51%|█████     | 176676/349837 [00:13<00:12, 13462.77 examples/s]
Map (num_proc=16):  58%|█████▊    | 202660/349837 [00:14<00:09, 14908.89 examples/s]
Map (num_proc=16):  51%|█████     | 178050/349837 [00:13<00:12, 13275.77 examples/s]
Map (num_proc=16):  58%|█████▊    | 204163/349837 [00:14<00:09, 14789.79 examples/s]
Map (num_proc=16):  51%|█████▏    | 179563/349837 [00:13<00:12, 13740.84 examples/s]
Map (num_proc=16):  59%|█████▉    | 205655/349837 [00:14<00:09, 14628.86 examples/s]
Map (num_proc=16):  52%|█████▏    | 181018/349837 [00:13<00:12, 13916.13 examples/s]
Map (num_proc=16):  59%|█████▉    | 207145/349837 [00:14<00:09, 14602.77 examples/s]
Map (num_proc=16):  52%|█████▏    | 182426/349837 [00:13<00:12, 13898.30 examples/s]
Map (num_proc=16):  60%|█████▉    | 208615/349837 [00:14<00:09, 14147.74 examples/s]
Map (num_proc=16):  53%|█████▎    | 183907/349837 [00:13<00:11, 14129.57 examples/s]
Map (num_proc=16):  60%|██████    | 210058/349837 [00:15<00:09, 14083.93 examples/s]
Map (num_proc=16):  53%|█████▎    | 185346/349837 [00:13<00:12, 13555.89 examples/s]
Map (num_proc=16):  60%|██████    | 211489/349837 [00:15<00:09, 14008.77 examples/s]
Map (num_proc=16):  53%|█████▎    | 186710/349837 [00:14<00:12, 13509.79 examples/s]
Map (num_proc=16):  61%|██████    | 212905/349837 [00:15<00:09, 13741.82 examples/s]
Map (num_proc=16):  54%|█████▍    | 188207/349837 [00:14<00:11, 13776.84 examples/s]
Map (num_proc=16):  61%|██████▏   | 214513/349837 [00:15<00:09, 14371.39 examples/s]
Map (num_proc=16):  54%|█████▍    | 189632/349837 [00:14<00:11, 13771.26 examples/s]
Map (num_proc=16):  62%|██████▏   | 216071/349837 [00:15<00:09, 14688.99 examples/s]
Map (num_proc=16):  55%|█████▍    | 191040/349837 [00:14<00:11, 13545.70 examples/s]
Map (num_proc=16):  62%|██████▏   | 217661/349837 [00:15<00:08, 15006.32 examples/s]
Map (num_proc=16):  55%|█████▌    | 192469/349837 [00:14<00:11, 13668.97 examples/s]
Map (num_proc=16):  63%|██████▎   | 219191/349837 [00:15<00:08, 15022.61 examples/s]
Map (num_proc=16):  55%|█████▌    | 193955/349837 [00:14<00:11, 13978.60 examples/s]
Map (num_proc=16):  63%|██████▎   | 220726/349837 [00:15<00:08, 15067.39 examples/s]
Map (num_proc=16):  56%|█████▌    | 195473/349837 [00:14<00:10, 14274.18 examples/s]
Map (num_proc=16):  64%|██████▎   | 222277/349837 [00:15<00:08, 14302.25 examples/s]
Map (num_proc=16):  56%|█████▋    | 196920/349837 [00:14<00:10, 14322.20 examples/s]
Map (num_proc=16):  64%|██████▍   | 223774/349837 [00:16<00:08, 14242.13 examples/s]
Map (num_proc=16):  57%|█████▋    | 198369/349837 [00:14<00:10, 14357.76 examples/s]
Map (num_proc=16):  64%|██████▍   | 225231/349837 [00:16<00:09, 13837.79 examples/s]
Map (num_proc=16):  57%|█████▋    | 199818/349837 [00:14<00:10, 14304.07 examples/s]
Map (num_proc=16):  65%|██████▍   | 226664/349837 [00:16<00:08, 13690.55 examples/s]
Map (num_proc=16):  58%|█████▊    | 201259/349837 [00:15<00:10, 13690.22 examples/s]
Map (num_proc=16):  65%|██████▌   | 228065/349837 [00:16<00:08, 13630.96 examples/s]
Map (num_proc=16):  58%|█████▊    | 202656/349837 [00:15<00:10, 13508.45 examples/s]
Map (num_proc=16):  66%|██████▌   | 229577/349837 [00:16<00:08, 14022.19 examples/s]
Map (num_proc=16):  58%|█████▊    | 204021/349837 [00:15<00:11, 13211.83 examples/s]
Map (num_proc=16):  66%|██████▌   | 231068/349837 [00:16<00:08, 14101.13 examples/s]
Map (num_proc=16):  59%|█████▊    | 205361/349837 [00:15<00:11, 12964.18 examples/s]
Map (num_proc=16):  67%|██████▋   | 232647/349837 [00:16<00:08, 14570.65 examples/s]
Map (num_proc=16):  59%|█████▉    | 206791/349837 [00:15<00:10, 13217.45 examples/s]
Map (num_proc=16):  67%|██████▋   | 234167/349837 [00:16<00:08, 14341.66 examples/s]
Map (num_proc=16):  60%|█████▉    | 208180/349837 [00:15<00:10, 13368.28 examples/s]
Map (num_proc=16):  67%|██████▋   | 235617/349837 [00:16<00:08, 14055.92 examples/s]
Map (num_proc=16):  60%|█████▉    | 209616/349837 [00:15<00:10, 13642.28 examples/s]
Map (num_proc=16):  68%|██████▊   | 237074/349837 [00:16<00:07, 14132.50 examples/s]
Map (num_proc=16):  60%|██████    | 211124/349837 [00:15<00:09, 13999.45 examples/s]
Map (num_proc=16):  68%|██████▊   | 238525/349837 [00:17<00:07, 14226.00 examples/s]
Map (num_proc=16):  61%|██████    | 212638/349837 [00:15<00:09, 14270.69 examples/s]
Map (num_proc=16):  69%|██████▊   | 240070/349837 [00:17<00:07, 14517.31 examples/s]
Map (num_proc=16):  61%|██████    | 214201/349837 [00:15<00:09, 14521.31 examples/s]
Map (num_proc=16):  69%|██████▉   | 241536/349837 [00:17<00:07, 14134.03 examples/s]
Map (num_proc=16):  62%|██████▏   | 215665/349837 [00:16<00:09, 14398.40 examples/s]
Map (num_proc=16):  69%|██████▉   | 242987/349837 [00:17<00:07, 14061.20 examples/s]
Map (num_proc=16):  62%|██████▏   | 217115/349837 [00:16<00:09, 14363.87 examples/s]
Map (num_proc=16):  70%|██████▉   | 244502/349837 [00:17<00:07, 14195.84 examples/s]
Map (num_proc=16):  62%|██████▏   | 218587/349837 [00:16<00:09, 13839.51 examples/s]
Map (num_proc=16):  70%|███████   | 245953/349837 [00:17<00:07, 14103.42 examples/s]
Map (num_proc=16):  63%|██████▎   | 220040/349837 [00:16<00:09, 14026.31 examples/s]
Map (num_proc=16):  71%|███████   | 247407/349837 [00:17<00:07, 14117.97 examples/s]
Map (num_proc=16):  63%|██████▎   | 221473/349837 [00:16<00:09, 13287.46 examples/s]
Map (num_proc=16):  71%|███████   | 248889/349837 [00:17<00:07, 14297.62 examples/s]
Map (num_proc=16):  64%|██████▎   | 222825/349837 [00:16<00:09, 13185.85 examples/s]
Map (num_proc=16):  72%|███████▏  | 250368/349837 [00:17<00:06, 14292.16 examples/s]
Map (num_proc=16):  64%|██████▍   | 224230/349837 [00:16<00:09, 13270.01 examples/s]
Map (num_proc=16):  72%|███████▏  | 251833/349837 [00:18<00:06, 14328.51 examples/s]
Map (num_proc=16):  65%|██████▍   | 225687/349837 [00:16<00:09, 13635.84 examples/s]
Map (num_proc=16):  72%|███████▏  | 253290/349837 [00:18<00:06, 14294.23 examples/s]
Map (num_proc=16):  65%|██████▍   | 227202/349837 [00:16<00:08, 13869.28 examples/s]
Map (num_proc=16):  73%|███████▎  | 254768/349837 [00:18<00:06, 14081.34 examples/s]
Map (num_proc=16):  65%|██████▌   | 228664/349837 [00:17<00:08, 14033.14 examples/s]
Map (num_proc=16):  73%|███████▎  | 256216/349837 [00:18<00:07, 13034.57 examples/s]
Map (num_proc=16):  66%|██████▌   | 230119/349837 [00:17<00:08, 14056.77 examples/s]
Map (num_proc=16):  74%|███████▎  | 257545/349837 [00:18<00:07, 12299.80 examples/s]
Map (num_proc=16):  66%|██████▌   | 231544/349837 [00:17<00:08, 13942.02 examples/s]
Map (num_proc=16):  74%|███████▍  | 258809/349837 [00:18<00:07, 12231.56 examples/s]
Map (num_proc=16):  67%|██████▋   | 232959/349837 [00:17<00:08, 13812.85 examples/s]
Map (num_proc=16):  74%|███████▍  | 260159/349837 [00:18<00:07, 12517.57 examples/s]
Map (num_proc=16):  67%|██████▋   | 234351/349837 [00:17<00:08, 13732.06 examples/s]
Map (num_proc=16):  75%|███████▍  | 261443/349837 [00:18<00:07, 12159.31 examples/s]
Map (num_proc=16):  67%|██████▋   | 235805/349837 [00:17<00:08, 13915.60 examples/s]
Map (num_proc=16):  75%|███████▌  | 262709/349837 [00:18<00:07, 12096.86 examples/s]
Map (num_proc=16):  68%|██████▊   | 237234/349837 [00:17<00:08, 13724.44 examples/s]
Map (num_proc=16):  76%|███████▌  | 264217/349837 [00:19<00:06, 12556.99 examples/s]
Map (num_proc=16):  68%|██████▊   | 238609/349837 [00:17<00:08, 13613.07 examples/s]
Map (num_proc=16):  76%|███████▌  | 265677/349837 [00:19<00:06, 12800.36 examples/s]
Map (num_proc=16):  69%|██████▊   | 239999/349837 [00:17<00:08, 13540.87 examples/s]
Map (num_proc=16):  76%|███████▋  | 267104/349837 [00:19<00:06, 13166.35 examples/s]
Map (num_proc=16):  69%|██████▉   | 241435/349837 [00:17<00:07, 13736.47 examples/s]
Map (num_proc=16):  77%|███████▋  | 268491/349837 [00:19<00:06, 13273.51 examples/s]
Map (num_proc=16):  69%|██████▉   | 242887/349837 [00:18<00:07, 13916.29 examples/s]
Map (num_proc=16):  77%|███████▋  | 269901/349837 [00:19<00:05, 13453.31 examples/s]
Map (num_proc=16):  70%|██████▉   | 244420/349837 [00:18<00:07, 14233.97 examples/s]
Map (num_proc=16):  78%|███████▊  | 271341/349837 [00:19<00:05, 13670.84 examples/s]
Map (num_proc=16):  70%|███████   | 245852/349837 [00:18<00:07, 14026.18 examples/s]
Map (num_proc=16):  78%|███████▊  | 272858/349837 [00:19<00:05, 13918.98 examples/s]
Map (num_proc=16):  71%|███████   | 247304/349837 [00:18<00:07, 13769.87 examples/s]
Map (num_proc=16):  78%|███████▊  | 274493/349837 [00:19<00:05, 14558.27 examples/s]
Map (num_proc=16):  71%|███████   | 248693/349837 [00:18<00:07, 13169.47 examples/s]
Map (num_proc=16):  79%|███████▉  | 275969/349837 [00:19<00:05, 14398.93 examples/s]
Map (num_proc=16):  71%|███████▏  | 250044/349837 [00:18<00:08, 12251.07 examples/s]
Map (num_proc=16):  79%|███████▉  | 277451/349837 [00:19<00:04, 14493.45 examples/s]
Map (num_proc=16):  72%|███████▏  | 251323/349837 [00:18<00:08, 11576.86 examples/s]
Map (num_proc=16):  80%|███████▉  | 278996/349837 [00:20<00:04, 14665.83 examples/s]
Map (num_proc=16):  72%|███████▏  | 252514/349837 [00:18<00:08, 11501.86 examples/s]
Map (num_proc=16):  80%|████████  | 280494/349837 [00:20<00:04, 14613.66 examples/s]
Map (num_proc=16):  73%|███████▎  | 253740/349837 [00:18<00:08, 11648.12 examples/s]
Map (num_proc=16):  81%|████████  | 282025/349837 [00:20<00:04, 14796.94 examples/s]
Map (num_proc=16):  73%|███████▎  | 254916/349837 [00:19<00:08, 11477.37 examples/s]
Map (num_proc=16):  81%|████████  | 283554/349837 [00:20<00:04, 14620.80 examples/s]
Map (num_proc=16):  73%|███████▎  | 256098/349837 [00:19<00:08, 11449.94 examples/s]
Map (num_proc=16):  81%|████████▏ | 285045/349837 [00:20<00:04, 13976.33 examples/s]
Map (num_proc=16):  74%|███████▎  | 257439/349837 [00:19<00:07, 12007.51 examples/s]
Map (num_proc=16):  82%|████████▏ | 286525/349837 [00:20<00:04, 14065.53 examples/s]
Map (num_proc=16):  74%|███████▍  | 258776/349837 [00:19<00:07, 12389.43 examples/s]
Map (num_proc=16):  82%|████████▏ | 288039/349837 [00:20<00:04, 14332.77 examples/s]
Map (num_proc=16):  74%|███████▍  | 260031/349837 [00:19<00:07, 12346.64 examples/s]
Map (num_proc=16):  83%|████████▎ | 289551/349837 [00:20<00:04, 14511.60 examples/s]
Map (num_proc=16):  75%|███████▍  | 261456/349837 [00:19<00:06, 12884.92 examples/s]
Map (num_proc=16):  83%|████████▎ | 291036/349837 [00:20<00:04, 14484.23 examples/s]
Map (num_proc=16):  75%|███████▌  | 262968/349837 [00:19<00:06, 13503.86 examples/s]
Map (num_proc=16):  84%|████████▎ | 292498/349837 [00:21<00:03, 14444.81 examples/s]
Map (num_proc=16):  76%|███████▌  | 264377/349837 [00:19<00:06, 13089.67 examples/s]
Map (num_proc=16):  84%|████████▍ | 293990/349837 [00:21<00:03, 14541.92 examples/s]
Map (num_proc=16):  76%|███████▌  | 265695/349837 [00:19<00:06, 12725.61 examples/s]
Map (num_proc=16):  84%|████████▍ | 295461/349837 [00:21<00:03, 14435.77 examples/s]
Map (num_proc=16):  76%|███████▋  | 267152/349837 [00:20<00:06, 13237.85 examples/s]
Map (num_proc=16):  85%|████████▍ | 296937/349837 [00:21<00:03, 14299.84 examples/s]
Map (num_proc=16):  77%|███████▋  | 268487/349837 [00:20<00:06, 13265.09 examples/s]
Map (num_proc=16):  85%|████████▌ | 298426/349837 [00:21<00:03, 14287.99 examples/s]
Map (num_proc=16):  77%|███████▋  | 269855/349837 [00:20<00:06, 13312.07 examples/s]
Map (num_proc=16):  86%|████████▌ | 299908/349837 [00:21<00:03, 14153.40 examples/s]
Map (num_proc=16):  78%|███████▊  | 271332/349837 [00:20<00:05, 13602.79 examples/s]
Map (num_proc=16):  86%|████████▌ | 301381/349837 [00:21<00:03, 14277.70 examples/s]
Map (num_proc=16):  78%|███████▊  | 272782/349837 [00:20<00:05, 13847.84 examples/s]
Map (num_proc=16):  87%|████████▋ | 302858/349837 [00:21<00:03, 14392.15 examples/s]
Map (num_proc=16):  78%|███████▊  | 274240/349837 [00:20<00:05, 13987.48 examples/s]
Map (num_proc=16):  87%|████████▋ | 304323/349837 [00:21<00:03, 14271.31 examples/s]
Map (num_proc=16):  79%|███████▉  | 275680/349837 [00:20<00:05, 13929.31 examples/s]
Map (num_proc=16):  87%|████████▋ | 305775/349837 [00:21<00:03, 14313.39 examples/s]
Map (num_proc=16):  79%|███████▉  | 277139/349837 [00:20<00:05, 14019.60 examples/s]
Map (num_proc=16):  88%|████████▊ | 307265/349837 [00:22<00:02, 14413.05 examples/s]
Map (num_proc=16):  80%|███████▉  | 278563/349837 [00:20<00:05, 13542.46 examples/s]
Map (num_proc=16):  88%|████████▊ | 308708/349837 [00:22<00:02, 14400.79 examples/s]
Map (num_proc=16):  80%|████████  | 279930/349837 [00:20<00:05, 13519.70 examples/s]
Map (num_proc=16):  89%|████████▊ | 310179/349837 [00:22<00:02, 14253.88 examples/s]
Map (num_proc=16):  80%|████████  | 281299/349837 [00:21<00:05, 13253.75 examples/s]
Map (num_proc=16):  89%|████████▉ | 311780/349837 [00:22<00:02, 14624.67 examples/s]
Map (num_proc=16):  81%|████████  | 282765/349837 [00:21<00:04, 13565.00 examples/s]
Map (num_proc=16):  90%|████████▉ | 313244/349837 [00:22<00:02, 14092.74 examples/s]
Map (num_proc=16):  81%|████████  | 284167/349837 [00:21<00:04, 13658.50 examples/s]
Map (num_proc=16):  90%|████████▉ | 314821/349837 [00:22<00:02, 14474.31 examples/s]
Map (num_proc=16):  82%|████████▏ | 285556/349837 [00:21<00:04, 13507.65 examples/s]
Map (num_proc=16):  90%|█████████ | 316326/349837 [00:22<00:02, 14176.00 examples/s]
Map (num_proc=16):  82%|████████▏ | 286928/349837 [00:21<00:04, 13463.78 examples/s]
Map (num_proc=16):  91%|█████████ | 317819/349837 [00:22<00:02, 14368.67 examples/s]
Map (num_proc=16):  82%|████████▏ | 288351/349837 [00:21<00:04, 13677.63 examples/s]
Map (num_proc=16):  91%|█████████▏| 319274/349837 [00:22<00:02, 14376.53 examples/s]
Map (num_proc=16):  83%|████████▎ | 289784/349837 [00:21<00:04, 13824.11 examples/s]
Map (num_proc=16):  92%|█████████▏| 320851/349837 [00:22<00:01, 14729.69 examples/s]
Map (num_proc=16):  83%|████████▎ | 291222/349837 [00:21<00:04, 13904.34 examples/s]
Map (num_proc=16):  92%|█████████▏| 322338/349837 [00:23<00:01, 14744.75 examples/s]
Map (num_proc=16):  84%|████████▎ | 292634/349837 [00:21<00:04, 13813.06 examples/s]
Map (num_proc=16):  93%|█████████▎| 323831/349837 [00:23<00:01, 14644.24 examples/s]
Map (num_proc=16):  84%|████████▍ | 294017/349837 [00:21<00:04, 13623.93 examples/s]
Map (num_proc=16):  93%|█████████▎| 325339/349837 [00:23<00:01, 14487.65 examples/s]
Map (num_proc=16):  84%|████████▍ | 295519/349837 [00:22<00:03, 14025.94 examples/s]
Map (num_proc=16):  93%|█████████▎| 326845/349837 [00:23<00:01, 14503.50 examples/s]
Map (num_proc=16):  85%|████████▍ | 296935/349837 [00:22<00:03, 14036.21 examples/s]
Map (num_proc=16):  94%|█████████▍| 328343/349837 [00:23<00:01, 14262.34 examples/s]
Map (num_proc=16):  85%|████████▌ | 298350/349837 [00:22<00:03, 13910.66 examples/s]
Map (num_proc=16):  94%|█████████▍| 329786/349837 [00:23<00:01, 14191.03 examples/s]
Map (num_proc=16):  86%|████████▌ | 299784/349837 [00:22<00:03, 13925.60 examples/s]
Map (num_proc=16):  95%|█████████▍| 331225/349837 [00:23<00:01, 13986.13 examples/s]
Map (num_proc=16):  86%|████████▌ | 301180/349837 [00:22<00:03, 13722.79 examples/s]
Map (num_proc=16):  95%|█████████▌| 332636/349837 [00:23<00:01, 13855.84 examples/s]
Map (num_proc=16):  86%|████████▋ | 302576/349837 [00:22<00:03, 13595.22 examples/s]
Map (num_proc=16):  96%|█████████▌| 334101/349837 [00:23<00:01, 14061.95 examples/s]
Map (num_proc=16):  87%|████████▋ | 304014/349837 [00:22<00:03, 13808.25 examples/s]
Map (num_proc=16):  96%|█████████▌| 335524/349837 [00:24<00:01, 14047.49 examples/s]
Map (num_proc=16):  87%|████████▋ | 305492/349837 [00:22<00:03, 14078.48 examples/s]
Map (num_proc=16):  96%|█████████▋| 336977/349837 [00:24<00:00, 14155.57 examples/s]
Map (num_proc=16):  88%|████████▊ | 306920/349837 [00:22<00:03, 13957.12 examples/s]
Map (num_proc=16):  97%|█████████▋| 338468/349837 [00:24<00:00, 14287.69 examples/s]
Map (num_proc=16):  88%|████████▊ | 308453/349837 [00:22<00:02, 14296.87 examples/s]
Map (num_proc=16):  97%|█████████▋| 339926/349837 [00:24<00:00, 14276.42 examples/s]
Map (num_proc=16):  89%|████████▊ | 309884/349837 [00:23<00:02, 13884.45 examples/s]
Map (num_proc=16):  98%|█████████▊| 341415/349837 [00:24<00:00, 14375.78 examples/s]
Map (num_proc=16):  89%|████████▉ | 311344/349837 [00:23<00:02, 14059.69 examples/s]
Map (num_proc=16):  98%|█████████▊| 342881/349837 [00:24<00:00, 13289.72 examples/s]
Map (num_proc=16):  89%|████████▉ | 312786/349837 [00:23<00:02, 14106.96 examples/s]
Map (num_proc=16):  98%|█████████▊| 344233/349837 [00:24<00:00, 12201.17 examples/s]
Map (num_proc=16):  90%|████████▉ | 314205/349837 [00:23<00:02, 14097.05 examples/s]
Map (num_proc=16):  90%|█████████ | 315622/349837 [00:23<00:02, 13875.76 examples/s]
Map (num_proc=16):  99%|█████████▉| 345499/349837 [00:24<00:00, 10955.54 examples/s]
Map (num_proc=16):  91%|█████████ | 317149/349837 [00:23<00:02, 14277.91 examples/s]
Map (num_proc=16):  99%|█████████▉| 346641/349837 [00:24<00:00, 9957.96 examples/s] 
Map (num_proc=16):  91%|█████████ | 318593/349837 [00:23<00:02, 13603.91 examples/s]
Map (num_proc=16):  91%|█████████▏| 319989/349837 [00:23<00:02, 13579.42 examples/s]
Map (num_proc=16):  99%|█████████▉| 347713/349837 [00:25<00:00, 8578.23 examples/s]
Map (num_proc=16):  92%|█████████▏| 321604/349837 [00:23<00:02, 14093.92 examples/s]
Map (num_proc=16): 100%|█████████▉| 348660/349837 [00:25<00:00, 7540.39 examples/s]
Map (num_proc=16):  92%|█████████▏| 323128/349837 [00:24<00:01, 14401.54 examples/s]
Map (num_proc=16):  93%|█████████▎| 324585/349837 [00:24<00:01, 14266.74 examples/s]
Map (num_proc=16):  93%|█████████▎| 326017/349837 [00:24<00:01, 14054.27 examples/s]
Map (num_proc=16): 100%|█████████▉| 349489/349837 [00:25<00:00, 5126.24 examples/s]
Map (num_proc=16):  94%|█████████▎| 327445/349837 [00:24<00:01, 13616.40 examples/s]
Map (num_proc=16):  94%|█████████▍| 328820/349837 [00:24<00:01, 13397.22 examples/s]
Map (num_proc=16):  94%|█████████▍| 330164/349837 [00:24<00:01, 13348.06 examples/s]
Map (num_proc=16):  95%|█████████▍| 331539/349837 [00:24<00:01, 13408.28 examples/s]
Map (num_proc=16):  95%|█████████▌| 332903/349837 [00:24<00:01, 13445.49 examples/s]
                                                                                   

Map (num_proc=16):  96%|█████████▌| 334254/349837 [00:24<00:01, 12777.73 examples/s]
Map (num_proc=16):  96%|█████████▌| 335578/349837 [00:25<00:01, 11915.67 examples/s]
Map (num_proc=16):  96%|█████████▋| 336805/349837 [00:25<00:01, 11067.21 examples/s]
Map (num_proc=16):  97%|█████████▋| 337976/349837 [00:25<00:01, 10595.17 examples/s]
Map (num_proc=16):  97%|█████████▋| 339079/349837 [00:25<00:01, 9497.70 examples/s] 
Map (num_proc=16):  97%|█████████▋| 340071/349837 [00:25<00:01, 8308.99 examples/s]
Map (num_proc=16):  97%|█████████▋| 340945/349837 [00:25<00:01, 7494.62 examples/s]
Map (num_proc=16):  98%|█████████▊| 341752/349837 [00:25<00:01, 6211.68 examples/s]
Map (num_proc=16):  98%|█████████▊| 342436/349837 [00:26<00:01, 5104.25 examples/s]
Map (num_proc=16):  98%|█████████▊| 343010/349837 [00:26<00:01, 4434.18 examples/s]
Map (num_proc=16):  98%|█████████▊| 343531/349837 [00:26<00:01, 3207.37 examples/s]
Map (num_proc=16):  98%|█████████▊| 343960/349837 [00:26<00:02, 2714.83 examples/s]
Map (num_proc=16):  98%|█████████▊| 344294/349837 [00:27<00:02, 2554.56 examples/s]
Map (num_proc=16):  99%|█████████▊| 344614/349837 [00:27<00:02, 2280.01 examples/s]
Map (num_proc=16):  99%|█████████▊| 344893/349837 [00:27<00:02, 2166.68 examples/s]
Map (num_proc=16):  99%|█████████▊| 345161/349837 [00:27<00:02, 2063.05 examples/s]
Map (num_proc=16):  99%|█████████▊| 345392/349837 [00:27<00:02, 1961.65 examples/s]
Map (num_proc=16):  99%|█████████▉| 345593/349837 [00:27<00:02, 1919.25 examples/s]
Map (num_proc=16):  99%|█████████▉| 345847/349837 [00:27<00:02, 1881.07 examples/s]
Map (num_proc=16):  99%|█████████▉| 346082/349837 [00:28<00:02, 1774.11 examples/s]
Map (num_proc=16):  99%|█████████▉| 346302/349837 [00:28<00:01, 1846.26 examples/s]
Map (num_proc=16):  99%|█████████▉| 346544/349837 [00:28<00:01, 1910.87 examples/s]
Map (num_proc=16):  99%|█████████▉| 346766/349837 [00:28<00:01, 1916.45 examples/s]
Map (num_proc=16):  99%|█████████▉| 346976/349837 [00:28<00:01, 1958.49 examples/s]
Map (num_proc=16):  99%|█████████▉| 347203/349837 [00:28<00:01, 2033.93 examples/s]
Map (num_proc=16):  99%|█████████▉| 347429/349837 [00:28<00:01, 2080.68 examples/s]
Map (num_proc=16):  99%|█████████▉| 347675/349837 [00:28<00:01, 1905.05 examples/s]
Map (num_proc=16):  99%|█████████▉| 347881/349837 [00:29<00:01, 1932.15 examples/s]
Map (num_proc=16): 100%|█████████▉| 348108/349837 [00:29<00:00, 1915.24 examples/s]
Map (num_proc=16): 100%|█████████▉| 348312/349837 [00:29<00:00, 1944.28 examples/s]
Map (num_proc=16): 100%|█████████▉| 348516/349837 [00:29<00:00, 1952.74 examples/s]
Map (num_proc=16): 100%|█████████▉| 348744/349837 [00:29<00:00, 1824.73 examples/s]
Map (num_proc=16): 100%|█████████▉| 348975/349837 [00:29<00:00, 1950.12 examples/s]
Map (num_proc=16): 100%|█████████▉| 349191/349837 [00:29<00:00, 1974.31 examples/s]
Map (num_proc=16): 100%|█████████▉| 349428/349837 [00:29<00:00, 2068.46 examples/s]
Map (num_proc=16): 100%|█████████▉| 349648/349837 [00:30<00:00, 1624.72 examples/s]
Map (num_proc=16): 100%|██████████| 349837/349837 [00:30<00:00, 1232.98 examples/s]
                                                                                   
Final fine-tuning data:
Train Dataset({
    features: ['input', 'source', 'prompt_type', 'input_ids', 'attention_mask', 'labels'],
    num_rows: 349837
})
Valid None
Sample input: {'input': ['<human>: ¿Conoces algún refrán que sirva para enseñar a los niños que deben ser responsables?\n¿Y otro para fomentar el ser crítico y no dar nada por sentado?\n\nSi no conoces, ¿podrías inventártelos?\nLos refranes populares son frases que han sido transmitidas oralmente de generación en generación y que contienen enseñanzas o consejos sobre distintas cuestiones de la vida. \nFomentan valores como por ejemplo la constancia o el esfuerzo y muestran la relevancia de la sabiduría popular en la toma de decisiones.\n<bot>: Un refrán que tenga de moraleja ser responsable es:\n"El que no cuida el limonero, luego no tiene limonada"\n \nPor otro lado un refrán para fomentar el pensamiento crítico sería:\n"Cuando un borrego se tira por el puente, todos los demás van siguiente"\n\nEspero que te sirvan estos dos refranes para enseñar el valor de la responsabilidad y la importancia del pensamiento crítico.\n\n<human>: ¿Crees que los refranes hacen a la persona que los usa parecer más culto? ¿O crees que pasa como en el Quijote dónde el hecho de abusar de los refranes hacen de Sancho Panza un personaje poco ilustrado en comparación al protagonista?\n\n<bot>: Los refranes son expresiones populares que transmiten enseñanzas o consejos basados en la experiencia de generaciones anteriores. Si se usan de manera adecuada y en el contexto adecuado, los refranes pueden ser una forma efectiva de comunicar un mensaje de manera clara y concisa.\n\nSin embargo, el abuso de refranes no necesariamente hace a una persona parecer más culta o sabia. En el caso de Sancho Panza en El Quijote, su constante uso de refranes no lo hacía parecer más sabio o culto que Don Quijote, sino que revelaba su falta de educación formal y su dependencia en la sabiduría popular.\n\nPor lo tanto, la clave está en el uso adecuado de los refranes, saber cuándo y cómo usarlos, y no depender exclusivamente de ellos como una forma de comunicación. La verdadera sabiduría y cultura se reflejan en la capacidad de pensar críticamente, de tener un conocimiento profundo de diferentes temas y de comunicarse de manera efectiva en diferentes situaciones.\n\n<human>: Dame técnicas para usar los refranes de manera efectiva\n\n<bot>: Los refranes son frases populares que resumen de manera ingeniosa una idea o consejo. Pueden ser muy efectivos en la comunicación, tanto en la conversación cotidiana como en la oratoria. Aquí te presento algunas técnicas para usar los refranes de manera efectiva:\n\n1. Conoce los refranes: Asegúrate de conocer los refranes y su significado. Esto te permitirá utilizarlos de manera efectiva en las conversaciones.\n\n2. Elige el refrán adecuado: Selecciona el refrán que mejor se adapte a la situación. No todos los refranes son aplicables en todas las situaciones, así que asegúrate de elegir el más adecuado.\n\n3. Contextualiza el refrán: Es importante explicar el contexto en el que se aplica el refrán. De esta manera, se asegura de que la audiencia lo entienda correctamente y se evita que se malinterprete.\n\n4. Sé conciso: Los refranes son frases cortas y concisas, por lo que es importante utilizarlos de manera breve y al punto. Utilízalos como apoyo a tu mensaje y no como el mensaje principal.\n\n5. Utiliza la entonación adecuada: La entonación es importante para dar énfasis al mensaje. Utiliza la entonación adecuada para destacar el refrán en la conversación.\n\n6. Sé creativo: Puedes crear nuevos refranes o modificar los existentes para adaptarlos a tu situación. La creatividad puede ayudarte a llamar la atención de la audiencia y hacer que tu mensaje sea más memorable.\n\n7. Ten cuidado con las traducciones: Si utilizas refranes en otros idiomas, asegúrate de que la traducción sea precisa y que tenga el mismo significado que el original.\n\nRecuerda que los refranes son una herramienta muy útil para comunicar ideas y consejos de manera efectiva. Utiliza estas técnicas para sacar el máximo provecho de ellos y hacer que tus conversaciones sean más interesantes y efectivas.\n'], 'source': ['OpenAssistant/oasst1'], 'prompt_type': ['plain']}
Auto set eval_steps to 34 out of 683 total training steps
Auto step save_steps to 34
You are adding a <class 'transformers.integrations.TensorBoardCallback'> to the callbacks of this Trainer, but there is already one. The currentlist of callbacks is
:DefaultFlowCallback
TensorBoardCallback
You are adding a <class 'transformers.integrations.TensorBoardCallback'> to the callbacks of this Trainer, but there is already one. The currentlist of callbacks is
:DefaultFlowCallback
TensorBoardCallback

  0%|          | 0/683 [00:00<?, ?it/s]You're using a GPTNeoXTokenizerFast tokenizer. Please note that with a fast tokenizer, using the `__call__` method is faster than using a method to encode the text followed by a call to the `pad` method to get a padded encoding.
You're using a GPTNeoXTokenizerFast tokenizer. Please note that with a fast tokenizer, using the `__call__` method is faster than using a method to encode the text followed by a call to the `pad` method to get a padded encoding.
/home/ubuntu/miniconda3/envs/h2ollm/lib/python3.10/site-packages/bitsandbytes-0.38.0.post2-py3.10.egg/bitsandbytes/autograd/_functions.py:318: UserWarning: MatMul8bitLt: inputs will be cast from torch.float32 to float16 during quantization
  warnings.warn(f"MatMul8bitLt: inputs will be cast from {A.dtype} to float16 during quantization")
/home/ubuntu/miniconda3/envs/h2ollm/lib/python3.10/site-packages/bitsandbytes-0.38.0.post2-py3.10.egg/bitsandbytes/autograd/_functions.py:318: UserWarning: MatMul8bitLt: inputs will be cast from torch.float32 to float16 during quantization
  warnings.warn(f"MatMul8bitLt: inputs will be cast from {A.dtype} to float16 during quantization")
/home/ubuntu/miniconda3/envs/h2ollm/lib/python3.10/site-packages/transformers/models/gpt_neox/modeling_gpt_neox.py:219: UserWarning: where received a uint8 condition tensor. This behavior is deprecated and will be removed in a future version of PyTorch. Use a boolean condition instead. (Triggered internally at ../aten/src/ATen/native/TensorCompare.cpp:493.)
  attn_scores = torch.where(causal_mask, attn_scores, mask_value)
/home/ubuntu/miniconda3/envs/h2ollm/lib/python3.10/site-packages/transformers/models/gpt_neox/modeling_gpt_neox.py:219: UserWarning: where received a uint8 condition tensor. This behavior is deprecated and will be removed in a future version of PyTorch. Use a boolean condition instead. (Triggered internally at ../aten/src/ATen/native/TensorCompare.cpp:493.)
  attn_scores = torch.where(causal_mask, attn_scores, mask_value)

  0%|          | 1/683 [02:14<25:23:46, 134.06s/it]
                                                   
{'loss': 2.2892, 'learning_rate': 2.9999999999999997e-06, 'epoch': 0.0}

  0%|          | 1/683 [02:14<25:23:46, 134.06s/it]
  0%|          | 2/683 [04:25<25:01:55, 132.33s/it]
                                                   
{'loss': 2.2765, 'learning_rate': 5.999999999999999e-06, 'epoch': 0.0}

  0%|          | 2/683 [04:25<25:01:55, 132.33s/it]
  0%|          | 3/683 [06:40<25:16:37, 133.82s/it]
                                                   
{'loss': 2.2881, 'learning_rate': 8.999999999999999e-06, 'epoch': 0.0}

  0%|          | 3/683 [06:40<25:16:37, 133.82s/it]
  1%|          | 4/683 [08:43<24:24:12, 129.39s/it]
                                                   
{'loss': 2.3482, 'learning_rate': 1.1999999999999999e-05, 'epoch': 0.01}

  1%|          | 4/683 [08:43<24:24:12, 129.39s/it]
  1%|          | 5/683 [10:49<24:07:57, 128.14s/it]
                                                   
{'loss': 2.3449, 'learning_rate': 1.4999999999999999e-05, 'epoch': 0.01}

  1%|          | 5/683 [10:49<24:07:57, 128.14s/it]
  1%|          | 6/683 [12:54<23:55:39, 127.24s/it]
                                                   
{'loss': 2.3212, 'learning_rate': 1.7999999999999997e-05, 'epoch': 0.01}

  1%|          | 6/683 [12:54<23:55:39, 127.24s/it]
  1%|          | 7/683 [14:59<23:45:37, 126.53s/it]
                                                   
{'loss': 2.3493, 'learning_rate': 2.1e-05, 'epoch': 0.01}

  1%|          | 7/683 [14:59<23:45:37, 126.53s/it]
  1%|          | 8/683 [17:09<23:55:05, 127.56s/it]
                                                   
{'loss': 2.3399, 'learning_rate': 2.3999999999999997e-05, 'epoch': 0.01}

  1%|          | 8/683 [17:09<23:55:05, 127.56s/it]
  1%|▏         | 9/683 [19:22<24:10:39, 129.14s/it]
                                                   
{'loss': 2.2812, 'learning_rate': 2.6999999999999996e-05, 'epoch': 0.01}

  1%|▏         | 9/683 [19:22<24:10:39, 129.14s/it]
  1%|▏         | 10/683 [21:31<24:07:49, 129.08s/it]
                                                    
{'loss': 2.2964, 'learning_rate': 2.9999999999999997e-05, 'epoch': 0.01}

  1%|▏         | 10/683 [21:31<24:07:49, 129.08s/it]
  2%|▏         | 11/683 [23:39<24:04:21, 128.96s/it]
                                                    
{'loss': 2.2853, 'learning_rate': 3.2999999999999996e-05, 'epoch': 0.02}

  2%|▏         | 11/683 [23:39<24:04:21, 128.96s/it]
  2%|▏         | 12/683 [25:45<23:52:07, 128.06s/it]
                                                    
{'loss': 2.2339, 'learning_rate': 3.5999999999999994e-05, 'epoch': 0.02}

  2%|▏         | 12/683 [25:45<23:52:07, 128.06s/it]
  2%|▏         | 13/683 [27:55<23:56:51, 128.67s/it]
                                                    
{'loss': 2.3212, 'learning_rate': 3.9e-05, 'epoch': 0.02}

  2%|▏         | 13/683 [27:55<23:56:51, 128.67s/it]
  2%|▏         | 14/683 [30:02<23:46:48, 127.96s/it]
                                                    
{'loss': 2.2971, 'learning_rate': 4.2e-05, 'epoch': 0.02}

  2%|▏         | 14/683 [30:02<23:46:48, 127.96s/it]
  2%|▏         | 15/683 [32:08<23:39:00, 127.46s/it]
                                                    
{'loss': 2.2802, 'learning_rate': 4.4999999999999996e-05, 'epoch': 0.02}

  2%|▏         | 15/683 [32:08<23:39:00, 127.46s/it]
  2%|▏         | 16/683 [34:17<23:41:33, 127.88s/it]
                                                    
{'loss': 2.2676, 'learning_rate': 4.7999999999999994e-05, 'epoch': 0.02}

  2%|▏         | 16/683 [34:17<23:41:33, 127.88s/it]
  2%|▏         | 17/683 [36:20<23:23:40, 126.46s/it]
                                                    
{'loss': 2.342, 'learning_rate': 5.1e-05, 'epoch': 0.02}

  2%|▏         | 17/683 [36:20<23:23:40, 126.46s/it]
  3%|▎         | 18/683 [38:23<23:10:31, 125.46s/it]
                                                    
{'loss': 2.2789, 'learning_rate': 5.399999999999999e-05, 'epoch': 0.03}

  3%|▎         | 18/683 [38:23<23:10:31, 125.46s/it]
  3%|▎         | 19/683 [40:33<23:22:57, 126.77s/it]
                                                    
{'loss': 2.2008, 'learning_rate': 5.6999999999999996e-05, 'epoch': 0.03}

  3%|▎         | 19/683 [40:33<23:22:57, 126.77s/it]
  3%|▎         | 20/683 [42:35<23:03:37, 125.22s/it]
                                                    
{'loss': 2.2656, 'learning_rate': 5.9999999999999995e-05, 'epoch': 0.03}

  3%|▎         | 20/683 [42:35<23:03:37, 125.22s/it]
  3%|▎         | 21/683 [44:43<23:13:18, 126.28s/it]
                                                    
{'loss': 2.1816, 'learning_rate': 6.299999999999999e-05, 'epoch': 0.03}

  3%|▎         | 21/683 [44:43<23:13:18, 126.28s/it]
  3%|▎         | 22/683 [46:52<23:20:25, 127.12s/it]
                                                    
{'loss': 2.1892, 'learning_rate': 6.599999999999999e-05, 'epoch': 0.03}

  3%|▎         | 22/683 [46:52<23:20:25, 127.12s/it]
  3%|▎         | 23/683 [48:55<23:03:44, 125.79s/it]
                                                    
{'loss': 2.1845, 'learning_rate': 6.9e-05, 'epoch': 0.03}

  3%|▎         | 23/683 [48:55<23:03:44, 125.79s/it]
  4%|▎         | 24/683 [51:01<23:03:09, 125.93s/it]
                                                    
{'loss': 2.1608, 'learning_rate': 7.199999999999999e-05, 'epoch': 0.04}

  4%|▎         | 24/683 [51:01<23:03:09, 125.93s/it]
  4%|▎         | 25/683 [53:10<23:08:37, 126.62s/it]
                                                    
{'loss': 2.1964, 'learning_rate': 7.5e-05, 'epoch': 0.04}

  4%|▎         | 25/683 [53:10<23:08:37, 126.62s/it]
  4%|▍         | 26/683 [55:19<23:16:54, 127.57s/it]
                                                    
{'loss': 2.092, 'learning_rate': 7.8e-05, 'epoch': 0.04}

  4%|▍         | 26/683 [55:19<23:16:54, 127.57s/it]
  4%|▍         | 27/683 [57:25<23:07:01, 126.86s/it]
                                                    
{'loss': 2.1173, 'learning_rate': 8.1e-05, 'epoch': 0.04}

  4%|▍         | 27/683 [57:25<23:07:01, 126.86s/it]
  4%|▍         | 28/683 [59:33<23:10:18, 127.36s/it]
                                                    
{'loss': 2.1275, 'learning_rate': 8.4e-05, 'epoch': 0.04}

  4%|▍         | 28/683 [59:33<23:10:18, 127.36s/it]
  4%|▍         | 29/683 [1:01:47<23:28:34, 129.23s/it]
                                                      
{'loss': 2.1322, 'learning_rate': 8.699999999999999e-05, 'epoch': 0.04}

  4%|▍         | 29/683 [1:01:47<23:28:34, 129.23s/it]
  4%|▍         | 30/683 [1:03:54<23:21:24, 128.77s/it]
                                                      
{'loss': 2.0525, 'learning_rate': 8.999999999999999e-05, 'epoch': 0.04}

  4%|▍         | 30/683 [1:03:54<23:21:24, 128.77s/it]
  5%|▍         | 31/683 [1:06:02<23:14:12, 128.30s/it]
                                                      
{'loss': 2.1216, 'learning_rate': 9.3e-05, 'epoch': 0.05}

  5%|▍         | 31/683 [1:06:02<23:14:12, 128.30s/it]
  5%|▍         | 32/683 [1:08:09<23:10:27, 128.15s/it]
                                                      
{'loss': 2.0331, 'learning_rate': 9.599999999999999e-05, 'epoch': 0.05}

  5%|▍         | 32/683 [1:08:09<23:10:27, 128.15s/it]
  5%|▍         | 33/683 [1:10:13<22:54:55, 126.92s/it]
                                                      
{'loss': 2.0367, 'learning_rate': 9.9e-05, 'epoch': 0.05}

  5%|▍         | 33/683 [1:10:14<22:54:55, 126.92s/it]
  5%|▍         | 34/683 [1:12:20<22:50:47, 126.73s/it]
                                                      
{'loss': 2.0508, 'learning_rate': 0.000102, 'epoch': 0.05}

  5%|▍         | 34/683 [1:12:20<22:50:47, 126.73s/it]/home/ubuntu/miniconda3/envs/h2ollm/lib/python3.10/site-packages/bitsandbytes-0.38.0.post2-py3.10.egg/bitsandbytes/autograd/_functions.py:318: UserWarning: MatMul8bitLt: inputs will be cast from torch.float32 to float16 during quantization
  warnings.warn(f"MatMul8bitLt: inputs will be cast from {A.dtype} to float16 during quantization")

  5%|▌         | 35/683 [1:14:24<22:40:36, 125.98s/it]
                                                      
{'loss': 2.0359, 'learning_rate': 0.00010499999999999999, 'epoch': 0.05}

  5%|▌         | 35/683 [1:14:24<22:40:36, 125.98s/it]
  5%|▌         | 36/683 [1:16:33<22:47:36, 126.83s/it]
                                                      
{'loss': 1.9973, 'learning_rate': 0.00010799999999999998, 'epoch': 0.05}

  5%|▌         | 36/683 [1:16:33<22:47:36, 126.83s/it]
  5%|▌         | 37/683 [1:18:42<22:53:51, 127.60s/it]
                                                      
{'loss': 2.0065, 'learning_rate': 0.00011099999999999999, 'epoch': 0.05}

  5%|▌         | 37/683 [1:18:42<22:53:51, 127.60s/it]
  6%|▌         | 38/683 [1:20:49<22:49:43, 127.42s/it]
                                                      
{'loss': 1.9972, 'learning_rate': 0.00011399999999999999, 'epoch': 0.06}

  6%|▌         | 38/683 [1:20:49<22:49:43, 127.42s/it]
  6%|▌         | 39/683 [1:23:00<22:57:24, 128.33s/it]
                                                      
{'loss': 2.0698, 'learning_rate': 0.000117, 'epoch': 0.06}

  6%|▌         | 39/683 [1:23:00<22:57:24, 128.33s/it]
  6%|▌         | 40/683 [1:25:05<22:44:29, 127.32s/it]
                                                      
{'loss': 2.0139, 'learning_rate': 0.00011999999999999999, 'epoch': 0.06}

  6%|▌         | 40/683 [1:25:05<22:44:29, 127.32s/it]
  6%|▌         | 41/683 [1:27:15<22:52:15, 128.25s/it]
                                                      
{'loss': 2.0722, 'learning_rate': 0.00012299999999999998, 'epoch': 0.06}

  6%|▌         | 41/683 [1:27:15<22:52:15, 128.25s/it]
  6%|▌         | 42/683 [1:29:24<22:52:41, 128.49s/it]
                                                      
{'loss': 1.9836, 'learning_rate': 0.00012599999999999997, 'epoch': 0.06}

  6%|▌         | 42/683 [1:29:24<22:52:41, 128.49s/it]
  6%|▋         | 43/683 [1:31:32<22:49:35, 128.40s/it]
                                                      
{'loss': 2.0596, 'learning_rate': 0.000129, 'epoch': 0.06}

  6%|▋         | 43/683 [1:31:32<22:49:35, 128.40s/it]
  6%|▋         | 44/683 [1:33:36<22:31:53, 126.94s/it]
                                                      
{'loss': 1.9945, 'learning_rate': 0.00013199999999999998, 'epoch': 0.06}

  6%|▋         | 44/683 [1:33:36<22:31:53, 126.94s/it]
  7%|▋         | 45/683 [1:35:42<22:27:08, 126.69s/it]
                                                      
{'loss': 2.015, 'learning_rate': 0.000135, 'epoch': 0.07}

  7%|▋         | 45/683 [1:35:42<22:27:08, 126.69s/it]
  7%|▋         | 46/683 [1:37:55<22:46:22, 128.70s/it]
                                                      
{'loss': 2.0599, 'learning_rate': 0.000138, 'epoch': 0.07}

  7%|▋         | 46/683 [1:37:55<22:46:22, 128.70s/it]
  7%|▋         | 47/683 [1:40:06<22:49:33, 129.20s/it]
                                                      
{'loss': 2.0138, 'learning_rate': 0.00014099999999999998, 'epoch': 0.07}

  7%|▋         | 47/683 [1:40:06<22:49:33, 129.20s/it]
  7%|▋         | 48/683 [1:42:16<22:50:06, 129.46s/it]
                                                      
{'loss': 2.0237, 'learning_rate': 0.00014399999999999998, 'epoch': 0.07}

  7%|▋         | 48/683 [1:42:16<22:50:06, 129.46s/it]
  7%|▋         | 49/683 [1:44:23<22:41:39, 128.86s/it]
                                                      
{'loss': 1.9877, 'learning_rate': 0.000147, 'epoch': 0.07}

  7%|▋         | 49/683 [1:44:23<22:41:39, 128.86s/it]
  7%|▋         | 50/683 [1:46:29<22:30:53, 128.05s/it]
                                                      
{'loss': 2.0206, 'learning_rate': 0.00015, 'epoch': 0.07}

  7%|▋         | 50/683 [1:46:29<22:30:53, 128.05s/it]
  7%|▋         | 51/683 [1:48:32<22:10:13, 126.29s/it]
                                                      
{'loss': 2.0223, 'learning_rate': 0.00015299999999999998, 'epoch': 0.07}

  7%|▋         | 51/683 [1:48:32<22:10:13, 126.29s/it]
  8%|▊         | 52/683 [1:50:35<21:59:32, 125.47s/it]
                                                      
{'loss': 1.9794, 'learning_rate': 0.000156, 'epoch': 0.08}

  8%|▊         | 52/683 [1:50:35<21:59:32, 125.47s/it]
  8%|▊         | 53/683 [1:52:42<22:01:43, 125.88s/it]
                                                      
{'loss': 2.0211, 'learning_rate': 0.000159, 'epoch': 0.08}

  8%|▊         | 53/683 [1:52:42<22:01:43, 125.88s/it]
  8%|▊         | 54/683 [1:54:47<21:57:19, 125.66s/it]
                                                      
{'loss': 1.9834, 'learning_rate': 0.000162, 'epoch': 0.08}

  8%|▊         | 54/683 [1:54:47<21:57:19, 125.66s/it]
  8%|▊         | 55/683 [1:56:56<22:04:19, 126.53s/it]
                                                      
{'loss': 1.9816, 'learning_rate': 0.000165, 'epoch': 0.08}

  8%|▊         | 55/683 [1:56:56<22:04:19, 126.53s/it]
  8%|▊         | 56/683 [1:59:09<22:22:34, 128.48s/it]
                                                      
{'loss': 2.0383, 'learning_rate': 0.000168, 'epoch': 0.08}

  8%|▊         | 56/683 [1:59:09<22:22:34, 128.48s/it]
  8%|▊         | 57/683 [2:01:14<22:10:32, 127.53s/it]
                                                      
{'loss': 2.0196, 'learning_rate': 0.00017099999999999998, 'epoch': 0.08}

  8%|▊         | 57/683 [2:01:14<22:10:32, 127.53s/it]
  8%|▊         | 58/683 [2:03:19<22:00:43, 126.79s/it]
                                                      
{'loss': 1.993, 'learning_rate': 0.00017399999999999997, 'epoch': 0.08}

  8%|▊         | 58/683 [2:03:19<22:00:43, 126.79s/it]
  9%|▊         | 59/683 [2:05:27<22:02:39, 127.18s/it]
                                                      
{'loss': 1.9932, 'learning_rate': 0.00017699999999999997, 'epoch': 0.09}

  9%|▊         | 59/683 [2:05:27<22:02:39, 127.18s/it]
  9%|▉         | 60/683 [2:07:38<22:11:00, 128.19s/it]
                                                      
{'loss': 1.9433, 'learning_rate': 0.00017999999999999998, 'epoch': 0.09}

  9%|▉         | 60/683 [2:07:38<22:11:00, 128.19s/it]
  9%|▉         | 61/683 [2:09:48<22:16:56, 128.96s/it]
                                                      
{'loss': 1.9012, 'learning_rate': 0.00018299999999999998, 'epoch': 0.09}

  9%|▉         | 61/683 [2:09:48<22:16:56, 128.96s/it]
  9%|▉         | 62/683 [2:11:55<22:08:19, 128.34s/it]
                                                      
{'loss': 1.9889, 'learning_rate': 0.000186, 'epoch': 0.09}

  9%|▉         | 62/683 [2:11:55<22:08:19, 128.34s/it]
  9%|▉         | 63/683 [2:13:59<21:50:18, 126.80s/it]
                                                      
{'loss': 1.9833, 'learning_rate': 0.00018899999999999999, 'epoch': 0.09}

  9%|▉         | 63/683 [2:13:59<21:50:18, 126.80s/it]
  9%|▉         | 64/683 [2:16:05<21:47:40, 126.75s/it]
                                                      
{'loss': 1.9301, 'learning_rate': 0.00019199999999999998, 'epoch': 0.09}

  9%|▉         | 64/683 [2:16:05<21:47:40, 126.75s/it]
 10%|▉         | 65/683 [2:18:15<21:54:54, 127.66s/it]
                                                      
{'loss': 1.9604, 'learning_rate': 0.000195, 'epoch': 0.1}

 10%|▉         | 65/683 [2:18:15<21:54:54, 127.66s/it]
 10%|▉         | 66/683 [2:20:26<22:04:03, 128.76s/it]
                                                      
{'loss': 1.9319, 'learning_rate': 0.000198, 'epoch': 0.1}

 10%|▉         | 66/683 [2:20:26<22:04:03, 128.76s/it]
 10%|▉         | 67/683 [2:22:32<21:53:29, 127.94s/it]
                                                      
{'loss': 1.9975, 'learning_rate': 0.000201, 'epoch': 0.1}

 10%|▉         | 67/683 [2:22:32<21:53:29, 127.94s/it]
 10%|▉         | 68/683 [2:24:40<21:49:50, 127.79s/it]
                                                      
{'loss': 1.9264, 'learning_rate': 0.000204, 'epoch': 0.1}

 10%|▉         | 68/683 [2:24:40<21:49:50, 127.79s/it]/home/ubuntu/miniconda3/envs/h2ollm/lib/python3.10/site-packages/bitsandbytes-0.38.0.post2-py3.10.egg/bitsandbytes/autograd/_functions.py:318: UserWarning: MatMul8bitLt: inputs will be cast from torch.float32 to float16 during quantization
  warnings.warn(f"MatMul8bitLt: inputs will be cast from {A.dtype} to float16 during quantization")

 10%|█         | 69/683 [2:26:42<21:30:21, 126.09s/it]
                                                      
{'loss': 1.9202, 'learning_rate': 0.00020699999999999996, 'epoch': 0.1}

 10%|█         | 69/683 [2:26:42<21:30:21, 126.09s/it]
 10%|█         | 70/683 [2:28:47<21:24:46, 125.75s/it]
                                                      
{'loss': 1.927, 'learning_rate': 0.00020999999999999998, 'epoch': 0.1}

 10%|█         | 70/683 [2:28:47<21:24:46, 125.75s/it]
 10%|█         | 71/683 [2:30:47<21:05:05, 124.03s/it]
                                                      
{'loss': 1.9242, 'learning_rate': 0.00021299999999999997, 'epoch': 0.1}

 10%|█         | 71/683 [2:30:47<21:05:05, 124.03s/it]
 11%|█         | 72/683 [2:32:50<21:01:38, 123.89s/it]
                                                      
{'loss': 1.9312, 'learning_rate': 0.00021599999999999996, 'epoch': 0.11}

 11%|█         | 72/683 [2:32:50<21:01:38, 123.89s/it]
 11%|█         | 73/683 [2:34:52<20:53:23, 123.28s/it]
                                                      
{'loss': 1.9696, 'learning_rate': 0.00021899999999999998, 'epoch': 0.11}

 11%|█         | 73/683 [2:34:52<20:53:23, 123.28s/it]
 11%|█         | 74/683 [2:37:05<21:18:32, 125.96s/it]
                                                      
{'loss': 1.9467, 'learning_rate': 0.00022199999999999998, 'epoch': 0.11}

 11%|█         | 74/683 [2:37:05<21:18:32, 125.96s/it]
 11%|█         | 75/683 [2:39:10<21:14:36, 125.78s/it]
                                                      
{'loss': 1.9129, 'learning_rate': 0.000225, 'epoch': 0.11}

 11%|█         | 75/683 [2:39:10<21:14:36, 125.78s/it]
 11%|█         | 76/683 [2:41:14<21:08:20, 125.37s/it]
                                                      
{'loss': 1.9755, 'learning_rate': 0.00022799999999999999, 'epoch': 0.11}

 11%|█         | 76/683 [2:41:14<21:08:20, 125.37s/it]
 11%|█▏        | 77/683 [2:43:22<21:13:07, 126.05s/it]
                                                      
{'loss': 1.9183, 'learning_rate': 0.00023099999999999998, 'epoch': 0.11}

 11%|█▏        | 77/683 [2:43:22<21:13:07, 126.05s/it]
 11%|█▏        | 78/683 [2:45:27<21:09:30, 125.90s/it]
                                                      
{'loss': 1.9565, 'learning_rate': 0.000234, 'epoch': 0.11}

 11%|█▏        | 78/683 [2:45:27<21:09:30, 125.90s/it]
 12%|█▏        | 79/683 [2:47:32<21:04:33, 125.62s/it]
                                                      
{'loss': 1.8908, 'learning_rate': 0.000237, 'epoch': 0.12}

 12%|█▏        | 79/683 [2:47:32<21:04:33, 125.62s/it]
 12%|█▏        | 80/683 [2:49:40<21:08:53, 126.26s/it]
                                                      
{'loss': 1.9071, 'learning_rate': 0.00023999999999999998, 'epoch': 0.12}

 12%|█▏        | 80/683 [2:49:40<21:08:53, 126.26s/it]
 12%|█▏        | 81/683 [2:51:46<21:04:52, 126.07s/it]
                                                      
{'loss': 1.8842, 'learning_rate': 0.000243, 'epoch': 0.12}

 12%|█▏        | 81/683 [2:51:46<21:04:52, 126.07s/it]
 12%|█▏        | 82/683 [2:53:54<21:08:36, 126.65s/it]
                                                      
{'loss': 1.9255, 'learning_rate': 0.00024599999999999996, 'epoch': 0.12}

 12%|█▏        | 82/683 [2:53:54<21:08:36, 126.65s/it]
 12%|█▏        | 83/683 [2:55:58<20:58:54, 125.89s/it]
                                                      
{'loss': 1.8891, 'learning_rate': 0.000249, 'epoch': 0.12}

 12%|█▏        | 83/683 [2:55:58<20:58:54, 125.89s/it]
 12%|█▏        | 84/683 [2:58:04<20:58:42, 126.08s/it]
                                                      
{'loss': 1.8787, 'learning_rate': 0.00025199999999999995, 'epoch': 0.12}

 12%|█▏        | 84/683 [2:58:05<20:58:42, 126.08s/it]
 12%|█▏        | 85/683 [3:00:13<21:03:41, 126.79s/it]
                                                      
{'loss': 1.8926, 'learning_rate': 0.00025499999999999996, 'epoch': 0.12}

 12%|█▏        | 85/683 [3:00:13<21:03:41, 126.79s/it]
 13%|█▎        | 86/683 [3:02:16<20:51:13, 125.75s/it]
                                                      
{'loss': 1.898, 'learning_rate': 0.000258, 'epoch': 0.13}

 13%|█▎        | 86/683 [3:02:16<20:51:13, 125.75s/it]
 13%|█▎        | 87/683 [3:04:18<20:36:43, 124.50s/it]
                                                      
{'loss': 1.8827, 'learning_rate': 0.000261, 'epoch': 0.13}

 13%|█▎        | 87/683 [3:04:18<20:36:43, 124.50s/it]
 13%|█▎        | 88/683 [3:06:28<20:50:27, 126.10s/it]
                                                      
{'loss': 1.8839, 'learning_rate': 0.00026399999999999997, 'epoch': 0.13}

 13%|█▎        | 88/683 [3:06:28<20:50:27, 126.10s/it]
 13%|█▎        | 89/683 [3:08:27<20:28:43, 124.11s/it]
                                                      
{'loss': 1.8637, 'learning_rate': 0.000267, 'epoch': 0.13}

 13%|█▎        | 89/683 [3:08:27<20:28:43, 124.11s/it]
 13%|█▎        | 90/683 [3:10:35<20:36:24, 125.10s/it]
                                                      
{'loss': 1.8996, 'learning_rate': 0.00027, 'epoch': 0.13}

 13%|█▎        | 90/683 [3:10:35<20:36:24, 125.10s/it]
 13%|█▎        | 91/683 [3:12:36<20:23:42, 124.02s/it]
                                                      
{'loss': 1.8806, 'learning_rate': 0.00027299999999999997, 'epoch': 0.13}

 13%|█▎        | 91/683 [3:12:36<20:23:42, 124.02s/it]
 13%|█▎        | 92/683 [3:14:39<20:18:22, 123.69s/it]
                                                      
{'loss': 1.9193, 'learning_rate': 0.000276, 'epoch': 0.13}

 13%|█▎        | 92/683 [3:14:39<20:18:22, 123.69s/it]
 14%|█▎        | 93/683 [3:16:49<20:34:02, 125.50s/it]
                                                      
{'loss': 1.8696, 'learning_rate': 0.000279, 'epoch': 0.14}

 14%|█▎        | 93/683 [3:16:49<20:34:02, 125.50s/it]
 14%|█▍        | 94/683 [3:18:59<20:45:58, 126.93s/it]
                                                      
{'loss': 1.9024, 'learning_rate': 0.00028199999999999997, 'epoch': 0.14}

 14%|█▍        | 94/683 [3:18:59<20:45:58, 126.93s/it]
 14%|█▍        | 95/683 [3:21:09<20:52:52, 127.84s/it]
                                                      
{'loss': 1.8451, 'learning_rate': 0.000285, 'epoch': 0.14}

 14%|█▍        | 95/683 [3:21:09<20:52:52, 127.84s/it]
 14%|█▍        | 96/683 [3:23:18<20:53:14, 128.10s/it]
                                                      
{'loss': 1.8596, 'learning_rate': 0.00028799999999999995, 'epoch': 0.14}

 14%|█▍        | 96/683 [3:23:18<20:53:14, 128.10s/it]
 14%|█▍        | 97/683 [3:25:28<20:56:46, 128.68s/it]
                                                      
{'loss': 1.8468, 'learning_rate': 0.00029099999999999997, 'epoch': 0.14}

 14%|█▍        | 97/683 [3:25:28<20:56:46, 128.68s/it]
 14%|█▍        | 98/683 [3:27:34<20:46:44, 127.87s/it]
                                                      
{'loss': 1.8443, 'learning_rate': 0.000294, 'epoch': 0.14}

 14%|█▍        | 98/683 [3:27:34<20:46:44, 127.87s/it]
 14%|█▍        | 99/683 [3:29:41<20:44:15, 127.83s/it]
                                                      
{'loss': 1.8631, 'learning_rate': 0.00029699999999999996, 'epoch': 0.14}

 14%|█▍        | 99/683 [3:29:41<20:44:15, 127.83s/it]
 15%|█▍        | 100/683 [3:31:48<20:37:12, 127.33s/it]
                                                       
{'loss': 1.877, 'learning_rate': 0.0003, 'epoch': 0.15}

 15%|█▍        | 100/683 [3:31:48<20:37:12, 127.33s/it]
 15%|█▍        | 101/683 [3:33:57<20:42:40, 128.11s/it]
                                                       
{'loss': 1.8604, 'learning_rate': 0.0002994854202401372, 'epoch': 0.15}

 15%|█▍        | 101/683 [3:33:57<20:42:40, 128.11s/it]
 15%|█▍        | 102/683 [3:36:09<20:51:02, 129.19s/it]
                                                       
{'loss': 1.9098, 'learning_rate': 0.0002989708404802744, 'epoch': 0.15}

 15%|█▍        | 102/683 [3:36:09<20:51:02, 129.19s/it]/home/ubuntu/miniconda3/envs/h2ollm/lib/python3.10/site-packages/bitsandbytes-0.38.0.post2-py3.10.egg/bitsandbytes/autograd/_functions.py:318: UserWarning: MatMul8bitLt: inputs will be cast from torch.float32 to float16 during quantization
  warnings.warn(f"MatMul8bitLt: inputs will be cast from {A.dtype} to float16 during quantization")

 15%|█▌        | 103/683 [3:38:22<21:00:01, 130.35s/it]
                                                       
{'loss': 1.8667, 'learning_rate': 0.0002984562607204116, 'epoch': 0.15}

 15%|█▌        | 103/683 [3:38:22<21:00:01, 130.35s/it]
 15%|█▌        | 104/683 [3:40:29<20:46:45, 129.20s/it]
                                                       
{'loss': 1.8411, 'learning_rate': 0.0002979416809605489, 'epoch': 0.15}

 15%|█▌        | 104/683 [3:40:29<20:46:45, 129.20s/it]
 15%|█▌        | 105/683 [3:42:37<20:40:27, 128.77s/it]
                                                       
{'loss': 1.8557, 'learning_rate': 0.0002974271012006861, 'epoch': 0.15}

 15%|█▌        | 105/683 [3:42:37<20:40:27, 128.77s/it]
 16%|█▌        | 106/683 [3:44:37<20:15:24, 126.39s/it]
                                                       
{'loss': 1.8332, 'learning_rate': 0.00029691252144082333, 'epoch': 0.16}

 16%|█▌        | 106/683 [3:44:37<20:15:24, 126.39s/it]
 16%|█▌        | 107/683 [3:46:43<20:11:18, 126.18s/it]
                                                       
{'loss': 1.8544, 'learning_rate': 0.00029639794168096053, 'epoch': 0.16}

 16%|█▌        | 107/683 [3:46:43<20:11:18, 126.18s/it]
 16%|█▌        | 108/683 [3:48:49<20:09:14, 126.18s/it]
                                                       
{'loss': 1.8272, 'learning_rate': 0.00029588336192109773, 'epoch': 0.16}

 16%|█▌        | 108/683 [3:48:49<20:09:14, 126.18s/it]
 16%|█▌        | 109/683 [3:50:51<19:53:47, 124.79s/it]
                                                       
{'loss': 1.816, 'learning_rate': 0.00029536878216123493, 'epoch': 0.16}

 16%|█▌        | 109/683 [3:50:51<19:53:47, 124.79s/it]
 16%|█▌        | 110/683 [3:52:58<20:00:07, 125.67s/it]
                                                       
{'loss': 1.8386, 'learning_rate': 0.0002948542024013722, 'epoch': 0.16}

 16%|█▌        | 110/683 [3:52:59<20:00:07, 125.67s/it]
 16%|█▋        | 111/683 [3:55:11<20:17:27, 127.71s/it]
                                                       
{'loss': 1.8042, 'learning_rate': 0.0002943396226415094, 'epoch': 0.16}

 16%|█▋        | 111/683 [3:55:11<20:17:27, 127.71s/it]
 16%|█▋        | 112/683 [3:57:22<20:23:33, 128.57s/it]
                                                       
{'loss': 1.8244, 'learning_rate': 0.00029382504288164664, 'epoch': 0.16}

 16%|█▋        | 112/683 [3:57:22<20:23:33, 128.57s/it]
 17%|█▋        | 113/683 [3:59:29<20:18:03, 128.22s/it]
                                                       
{'loss': 1.8601, 'learning_rate': 0.0002933104631217839, 'epoch': 0.17}

 17%|█▋        | 113/683 [3:59:29<20:18:03, 128.22s/it]
 17%|█▋        | 114/683 [4:01:36<20:13:25, 127.95s/it]
                                                       
{'loss': 1.8417, 'learning_rate': 0.0002927958833619211, 'epoch': 0.17}

 17%|█▋        | 114/683 [4:01:36<20:13:25, 127.95s/it]
 17%|█▋        | 115/683 [4:03:41<20:01:48, 126.95s/it]
                                                       
{'loss': 1.8638, 'learning_rate': 0.0002922813036020583, 'epoch': 0.17}

 17%|█▋        | 115/683 [4:03:41<20:01:48, 126.95s/it]
 17%|█▋        | 116/683 [4:05:49<20:02:39, 127.27s/it]
                                                       
{'loss': 1.8062, 'learning_rate': 0.0002917667238421955, 'epoch': 0.17}

 17%|█▋        | 116/683 [4:05:49<20:02:39, 127.27s/it]
 17%|█▋        | 117/683 [4:07:57<20:03:56, 127.63s/it]
                                                       
{'loss': 1.8676, 'learning_rate': 0.00029125214408233274, 'epoch': 0.17}

 17%|█▋        | 117/683 [4:07:57<20:03:56, 127.63s/it]
 17%|█▋        | 118/683 [4:10:07<20:08:03, 128.29s/it]
                                                       
{'loss': 1.852, 'learning_rate': 0.00029073756432246994, 'epoch': 0.17}

 17%|█▋        | 118/683 [4:10:07<20:08:03, 128.29s/it]
 17%|█▋        | 119/683 [4:12:11<19:53:23, 126.96s/it]
                                                       
{'loss': 1.8327, 'learning_rate': 0.0002902229845626072, 'epoch': 0.17}

 17%|█▋        | 119/683 [4:12:11<19:53:23, 126.96s/it]
 18%|█▊        | 120/683 [4:14:16<19:44:45, 126.26s/it]
                                                       
{'loss': 1.8556, 'learning_rate': 0.0002897084048027444, 'epoch': 0.18}

 18%|█▊        | 120/683 [4:14:16<19:44:45, 126.26s/it]
 18%|█▊        | 121/683 [4:16:20<19:37:40, 125.73s/it]
                                                       
{'loss': 1.8188, 'learning_rate': 0.00028919382504288165, 'epoch': 0.18}

 18%|█▊        | 121/683 [4:16:20<19:37:40, 125.73s/it]
 18%|█▊        | 122/683 [4:18:27<19:39:13, 126.12s/it]
                                                       
{'loss': 1.7937, 'learning_rate': 0.00028867924528301885, 'epoch': 0.18}

 18%|█▊        | 122/683 [4:18:27<19:39:13, 126.12s/it]
 18%|█▊        | 123/683 [4:20:32<19:32:59, 125.68s/it]
                                                       
{'loss': 1.8655, 'learning_rate': 0.00028816466552315605, 'epoch': 0.18}

 18%|█▊        | 123/683 [4:20:32<19:32:59, 125.68s/it]
 18%|█▊        | 124/683 [4:22:42<19:42:17, 126.90s/it]
                                                       
{'loss': 1.8704, 'learning_rate': 0.00028765008576329325, 'epoch': 0.18}

 18%|█▊        | 124/683 [4:22:42<19:42:17, 126.90s/it]
 18%|█▊        | 125/683 [4:24:46<19:31:52, 126.01s/it]
                                                       
{'loss': 1.8461, 'learning_rate': 0.0002871355060034305, 'epoch': 0.18}

 18%|█▊        | 125/683 [4:24:46<19:31:52, 126.01s/it]
 18%|█▊        | 126/683 [4:26:51<19:28:12, 125.84s/it]
                                                       
{'loss': 1.8171, 'learning_rate': 0.0002866209262435677, 'epoch': 0.18}

 18%|█▊        | 126/683 [4:26:51<19:28:12, 125.84s/it]
 19%|█▊        | 127/683 [4:29:01<19:37:40, 127.09s/it]
                                                       
{'loss': 1.8268, 'learning_rate': 0.00028610634648370496, 'epoch': 0.19}

 19%|█▊        | 127/683 [4:29:01<19:37:40, 127.09s/it]
 19%|█▊        | 128/683 [4:31:06<19:30:24, 126.53s/it]
                                                       
{'loss': 1.8834, 'learning_rate': 0.0002855917667238422, 'epoch': 0.19}

 19%|█▊        | 128/683 [4:31:06<19:30:24, 126.53s/it]
 19%|█▉        | 129/683 [4:33:12<19:25:49, 126.26s/it]
                                                       
{'loss': 1.8482, 'learning_rate': 0.0002850771869639794, 'epoch': 0.19}

 19%|█▉        | 129/683 [4:33:12<19:25:49, 126.26s/it]
 19%|█▉        | 130/683 [4:35:20<19:29:29, 126.89s/it]
                                                       
{'loss': 1.8427, 'learning_rate': 0.0002845626072041166, 'epoch': 0.19}

 19%|█▉        | 130/683 [4:35:20<19:29:29, 126.89s/it]
 19%|█▉        | 131/683 [4:37:28<19:29:21, 127.10s/it]
                                                       
{'loss': 1.7924, 'learning_rate': 0.0002840480274442538, 'epoch': 0.19}

 19%|█▉        | 131/683 [4:37:28<19:29:21, 127.10s/it]
 19%|█▉        | 132/683 [4:39:33<19:22:47, 126.62s/it]
                                                       
{'loss': 1.7854, 'learning_rate': 0.00028353344768439106, 'epoch': 0.19}

 19%|█▉        | 132/683 [4:39:33<19:22:47, 126.62s/it]
 19%|█▉        | 133/683 [4:41:44<19:32:33, 127.91s/it]
                                                       
{'loss': 1.7638, 'learning_rate': 0.00028301886792452826, 'epoch': 0.19}

 19%|█▉        | 133/683 [4:41:44<19:32:33, 127.91s/it]
 20%|█▉        | 134/683 [4:43:52<19:29:35, 127.82s/it]
                                                       
{'loss': 1.8356, 'learning_rate': 0.0002825042881646655, 'epoch': 0.2}

 20%|█▉        | 134/683 [4:43:52<19:29:35, 127.82s/it]
 20%|█▉        | 135/683 [4:45:59<19:26:04, 127.67s/it]
                                                       
{'loss': 1.863, 'learning_rate': 0.0002819897084048027, 'epoch': 0.2}

 20%|█▉        | 135/683 [4:45:59<19:26:04, 127.67s/it]
 20%|█▉        | 136/683 [4:48:08<19:27:28, 128.06s/it]
                                                       
{'loss': 1.8163, 'learning_rate': 0.00028147512864493997, 'epoch': 0.2}

 20%|█▉        | 136/683 [4:48:08<19:27:28, 128.06s/it]/home/ubuntu/miniconda3/envs/h2ollm/lib/python3.10/site-packages/bitsandbytes-0.38.0.post2-py3.10.egg/bitsandbytes/autograd/_functions.py:318: UserWarning: MatMul8bitLt: inputs will be cast from torch.float32 to float16 during quantization
  warnings.warn(f"MatMul8bitLt: inputs will be cast from {A.dtype} to float16 during quantization")

 20%|██        | 137/683 [4:50:14<19:20:05, 127.48s/it]
                                                       
{'loss': 1.8333, 'learning_rate': 0.00028096054888507717, 'epoch': 0.2}

 20%|██        | 137/683 [4:50:14<19:20:05, 127.48s/it]
 20%|██        | 138/683 [4:52:18<19:06:45, 126.25s/it]
                                                       
{'loss': 1.8536, 'learning_rate': 0.00028044596912521437, 'epoch': 0.2}

 20%|██        | 138/683 [4:52:18<19:06:45, 126.25s/it]
 20%|██        | 139/683 [4:54:25<19:06:42, 126.47s/it]
                                                       
{'loss': 1.8254, 'learning_rate': 0.0002799313893653516, 'epoch': 0.2}

 20%|██        | 139/683 [4:54:25<19:06:42, 126.47s/it]
 20%|██        | 140/683 [4:56:28<18:57:29, 125.69s/it]
                                                       
{'loss': 1.7823, 'learning_rate': 0.0002794168096054888, 'epoch': 0.2}

 20%|██        | 140/683 [4:56:28<18:57:29, 125.69s/it]
 21%|██        | 141/683 [4:58:29<18:41:04, 124.10s/it]
                                                       
{'loss': 1.846, 'learning_rate': 0.0002789022298456261, 'epoch': 0.21}

 21%|██        | 141/683 [4:58:29<18:41:04, 124.10s/it]
 21%|██        | 142/683 [5:00:36<18:46:52, 124.98s/it]
                                                       
{'loss': 1.8223, 'learning_rate': 0.00027838765008576327, 'epoch': 0.21}

 21%|██        | 142/683 [5:00:36<18:46:52, 124.98s/it]
 21%|██        | 143/683 [5:02:45<18:57:03, 126.34s/it]
                                                       
{'loss': 1.8367, 'learning_rate': 0.0002778730703259005, 'epoch': 0.21}

 21%|██        | 143/683 [5:02:45<18:57:03, 126.34s/it]
 21%|██        | 144/683 [5:04:51<18:52:02, 126.02s/it]
                                                       
{'loss': 1.785, 'learning_rate': 0.0002773584905660377, 'epoch': 0.21}

 21%|██        | 144/683 [5:04:51<18:52:02, 126.02s/it]
 21%|██        | 145/683 [5:06:56<18:49:26, 125.96s/it]
                                                       
{'loss': 1.8043, 'learning_rate': 0.0002768439108061749, 'epoch': 0.21}

 21%|██        | 145/683 [5:06:57<18:49:26, 125.96s/it]
 21%|██▏       | 146/683 [5:09:05<18:55:11, 126.84s/it]
                                                       
{'loss': 1.7985, 'learning_rate': 0.0002763293310463121, 'epoch': 0.21}

 21%|██▏       | 146/683 [5:09:05<18:55:11, 126.84s/it]
 22%|██▏       | 147/683 [5:11:15<19:00:59, 127.72s/it]
                                                       
{'loss': 1.8308, 'learning_rate': 0.0002758147512864494, 'epoch': 0.22}

 22%|██▏       | 147/683 [5:11:15<19:00:59, 127.72s/it]
 22%|██▏       | 148/683 [5:13:21<18:54:10, 127.20s/it]
                                                       
{'loss': 1.8332, 'learning_rate': 0.0002753001715265866, 'epoch': 0.22}

 22%|██▏       | 148/683 [5:13:21<18:54:10, 127.20s/it]
 22%|██▏       | 149/683 [5:15:29<18:53:55, 127.41s/it]
                                                       
{'loss': 1.8269, 'learning_rate': 0.00027478559176672383, 'epoch': 0.22}

 22%|██▏       | 149/683 [5:15:29<18:53:55, 127.41s/it]
 22%|██▏       | 150/683 [5:17:34<18:44:44, 126.61s/it]
                                                       
{'loss': 1.8292, 'learning_rate': 0.00027427101200686103, 'epoch': 0.22}

 22%|██▏       | 150/683 [5:17:34<18:44:44, 126.61s/it]
 22%|██▏       | 151/683 [5:19:40<18:41:26, 126.48s/it]
                                                       
{'loss': 1.8129, 'learning_rate': 0.0002737564322469983, 'epoch': 0.22}

 22%|██▏       | 151/683 [5:19:40<18:41:26, 126.48s/it]
 22%|██▏       | 152/683 [5:21:49<18:45:22, 127.16s/it]
                                                       
{'loss': 1.8019, 'learning_rate': 0.0002732418524871355, 'epoch': 0.22}

 22%|██▏       | 152/683 [5:21:49<18:45:22, 127.16s/it]
 22%|██▏       | 153/683 [5:23:57<18:46:22, 127.51s/it]
                                                       
{'loss': 1.7918, 'learning_rate': 0.0002727272727272727, 'epoch': 0.22}

 22%|██▏       | 153/683 [5:23:57<18:46:22, 127.51s/it]
 23%|██▎       | 154/683 [5:26:06<18:47:51, 127.92s/it]
                                                       
{'loss': 1.7868, 'learning_rate': 0.00027221269296740994, 'epoch': 0.23}

 23%|██▎       | 154/683 [5:26:06<18:47:51, 127.92s/it]
 23%|██▎       | 155/683 [5:28:10<18:36:08, 126.83s/it]
                                                       
{'loss': 1.8266, 'learning_rate': 0.00027169811320754714, 'epoch': 0.23}

 23%|██▎       | 155/683 [5:28:10<18:36:08, 126.83s/it]
 23%|██▎       | 156/683 [5:30:20<18:42:28, 127.80s/it]
                                                       
{'loss': 1.7893, 'learning_rate': 0.0002711835334476844, 'epoch': 0.23}

 23%|██▎       | 156/683 [5:30:20<18:42:28, 127.80s/it]
 23%|██▎       | 157/683 [5:32:26<18:36:04, 127.31s/it]
                                                       
{'loss': 1.8536, 'learning_rate': 0.0002706689536878216, 'epoch': 0.23}

 23%|██▎       | 157/683 [5:32:26<18:36:04, 127.31s/it]
 23%|██▎       | 158/683 [5:34:35<18:37:35, 127.72s/it]
                                                       
{'loss': 1.8151, 'learning_rate': 0.00027015437392795884, 'epoch': 0.23}

 23%|██▎       | 158/683 [5:34:35<18:37:35, 127.72s/it]
 23%|██▎       | 159/683 [5:36:43<18:34:33, 127.62s/it]
                                                       
{'loss': 1.8229, 'learning_rate': 0.00026963979416809604, 'epoch': 0.23}

 23%|██▎       | 159/683 [5:36:43<18:34:33, 127.62s/it]
 23%|██▎       | 160/683 [5:38:49<18:28:56, 127.22s/it]
                                                       
{'loss': 1.8129, 'learning_rate': 0.00026912521440823324, 'epoch': 0.23}

 23%|██▎       | 160/683 [5:38:49<18:28:56, 127.22s/it]
 24%|██▎       | 161/683 [5:41:02<18:43:43, 129.16s/it]
                                                       
{'loss': 1.7571, 'learning_rate': 0.00026861063464837044, 'epoch': 0.24}

 24%|██▎       | 161/683 [5:41:03<18:43:43, 129.16s/it]
 24%|██▎       | 162/683 [5:43:08<18:31:51, 128.04s/it]
                                                       
{'loss': 1.7888, 'learning_rate': 0.0002680960548885077, 'epoch': 0.24}

 24%|██▎       | 162/683 [5:43:08<18:31:51, 128.04s/it]
 24%|██▍       | 163/683 [5:45:14<18:23:43, 127.35s/it]
                                                       
{'loss': 1.7818, 'learning_rate': 0.0002675814751286449, 'epoch': 0.24}

 24%|██▍       | 163/683 [5:45:14<18:23:43, 127.35s/it]
 24%|██▍       | 164/683 [5:47:22<18:25:26, 127.80s/it]
                                                       
{'loss': 1.7855, 'learning_rate': 0.00026706689536878215, 'epoch': 0.24}

 24%|██▍       | 164/683 [5:47:23<18:25:26, 127.80s/it]
 24%|██▍       | 165/683 [5:49:30<18:22:15, 127.67s/it]
                                                       
{'loss': 1.844, 'learning_rate': 0.0002665523156089194, 'epoch': 0.24}

 24%|██▍       | 165/683 [5:49:30<18:22:15, 127.67s/it]
 24%|██▍       | 166/683 [5:51:31<18:03:11, 125.71s/it]
                                                       
{'loss': 1.8301, 'learning_rate': 0.0002660377358490566, 'epoch': 0.24}

 24%|██▍       | 166/683 [5:51:31<18:03:11, 125.71s/it]
 24%|██▍       | 167/683 [5:53:38<18:04:08, 126.06s/it]
                                                       
{'loss': 1.7983, 'learning_rate': 0.0002655231560891938, 'epoch': 0.24}

 24%|██▍       | 167/683 [5:53:38<18:04:08, 126.06s/it]
 25%|██▍       | 168/683 [5:55:43<18:00:19, 125.86s/it]
                                                       
{'loss': 1.7527, 'learning_rate': 0.000265008576329331, 'epoch': 0.25}

 25%|██▍       | 168/683 [5:55:43<18:00:19, 125.86s/it]
 25%|██▍       | 169/683 [5:57:48<17:55:14, 125.52s/it]
                                                       
{'loss': 1.7848, 'learning_rate': 0.00026449399656946825, 'epoch': 0.25}

 25%|██▍       | 169/683 [5:57:48<17:55:14, 125.52s/it]
 25%|██▍       | 170/683 [5:59:51<17:47:01, 124.80s/it]
                                                       
{'loss': 1.7959, 'learning_rate': 0.00026397941680960545, 'epoch': 0.25}

 25%|██▍       | 170/683 [5:59:51<17:47:01, 124.80s/it]/home/ubuntu/miniconda3/envs/h2ollm/lib/python3.10/site-packages/bitsandbytes-0.38.0.post2-py3.10.egg/bitsandbytes/autograd/_functions.py:318: UserWarning: MatMul8bitLt: inputs will be cast from torch.float32 to float16 during quantization
  warnings.warn(f"MatMul8bitLt: inputs will be cast from {A.dtype} to float16 during quantization")

 25%|██▌       | 171/683 [6:01:58<17:51:13, 125.53s/it]
                                                       
{'loss': 1.8102, 'learning_rate': 0.0002634648370497427, 'epoch': 0.25}

 25%|██▌       | 171/683 [6:01:58<17:51:13, 125.53s/it]
 25%|██▌       | 172/683 [6:04:03<17:47:40, 125.36s/it]
                                                       
{'loss': 1.7607, 'learning_rate': 0.0002629502572898799, 'epoch': 0.25}

 25%|██▌       | 172/683 [6:04:03<17:47:40, 125.36s/it]
 25%|██▌       | 173/683 [6:06:16<18:04:45, 127.62s/it]
                                                       
{'loss': 1.827, 'learning_rate': 0.00026243567753001716, 'epoch': 0.25}

 25%|██▌       | 173/683 [6:06:16<18:04:45, 127.62s/it]
 25%|██▌       | 174/683 [6:08:28<18:12:49, 128.82s/it]
                                                       
{'loss': 1.7983, 'learning_rate': 0.00026192109777015436, 'epoch': 0.25}

 25%|██▌       | 174/683 [6:08:28<18:12:49, 128.82s/it]
 26%|██▌       | 175/683 [6:10:40<18:19:19, 129.84s/it]
                                                       
{'loss': 1.8822, 'learning_rate': 0.00026140651801029156, 'epoch': 0.26}

 26%|██▌       | 175/683 [6:10:40<18:19:19, 129.84s/it]
 26%|██▌       | 176/683 [6:12:48<18:11:41, 129.19s/it]
                                                       
{'loss': 1.8417, 'learning_rate': 0.00026089193825042876, 'epoch': 0.26}

 26%|██▌       | 176/683 [6:12:48<18:11:41, 129.19s/it]
 26%|██▌       | 177/683 [6:14:57<18:09:05, 129.14s/it]
                                                       
{'loss': 1.7885, 'learning_rate': 0.000260377358490566, 'epoch': 0.26}

 26%|██▌       | 177/683 [6:14:57<18:09:05, 129.14s/it]
 26%|██▌       | 178/683 [6:17:07<18:08:55, 129.38s/it]
                                                       
{'loss': 1.7848, 'learning_rate': 0.0002598627787307032, 'epoch': 0.26}

 26%|██▌       | 178/683 [6:17:07<18:08:55, 129.38s/it]
 26%|██▌       | 179/683 [6:19:17<18:08:45, 129.61s/it]
                                                       
{'loss': 1.7322, 'learning_rate': 0.00025934819897084047, 'epoch': 0.26}

 26%|██▌       | 179/683 [6:19:17<18:08:45, 129.61s/it]
 26%|██▋       | 180/683 [6:21:25<18:02:41, 129.15s/it]
                                                       
{'loss': 1.8017, 'learning_rate': 0.0002588336192109777, 'epoch': 0.26}

 26%|██▋       | 180/683 [6:21:25<18:02:41, 129.15s/it]
 27%|██▋       | 181/683 [6:23:35<18:03:18, 129.48s/it]
                                                       
{'loss': 1.7997, 'learning_rate': 0.0002583190394511149, 'epoch': 0.26}

 27%|██▋       | 181/683 [6:23:35<18:03:18, 129.48s/it]
 27%|██▋       | 182/683 [6:25:43<17:58:06, 129.12s/it]
                                                       
{'loss': 1.8207, 'learning_rate': 0.0002578044596912521, 'epoch': 0.27}

 27%|██▋       | 182/683 [6:25:43<17:58:06, 129.12s/it]
 27%|██▋       | 183/683 [6:27:49<17:47:03, 128.05s/it]
                                                       
{'loss': 1.7082, 'learning_rate': 0.0002572898799313893, 'epoch': 0.27}

 27%|██▋       | 183/683 [6:27:49<17:47:03, 128.05s/it]
 27%|██▋       | 184/683 [6:29:57<17:44:58, 128.05s/it]
                                                       
{'loss': 1.769, 'learning_rate': 0.00025677530017152657, 'epoch': 0.27}

 27%|██▋       | 184/683 [6:29:57<17:44:58, 128.05s/it]
 27%|██▋       | 185/683 [6:32:06<17:46:05, 128.44s/it]
                                                       
{'loss': 1.7922, 'learning_rate': 0.00025626072041166377, 'epoch': 0.27}

 27%|██▋       | 185/683 [6:32:06<17:46:05, 128.44s/it]
 27%|██▋       | 186/683 [6:34:15<17:44:56, 128.56s/it]
                                                       
{'loss': 1.782, 'learning_rate': 0.000255746140651801, 'epoch': 0.27}

 27%|██▋       | 186/683 [6:34:15<17:44:56, 128.56s/it]
 27%|██▋       | 187/683 [6:36:28<17:53:42, 129.88s/it]
                                                       
{'loss': 1.7926, 'learning_rate': 0.0002552315608919382, 'epoch': 0.27}

 27%|██▋       | 187/683 [6:36:28<17:53:42, 129.88s/it]
 28%|██▊       | 188/683 [6:38:36<17:45:45, 129.18s/it]
                                                       
{'loss': 1.7872, 'learning_rate': 0.0002547169811320755, 'epoch': 0.28}

 28%|██▊       | 188/683 [6:38:36<17:45:45, 129.18s/it]
 28%|██▊       | 189/683 [6:40:43<17:38:48, 128.60s/it]
                                                       
{'loss': 1.7356, 'learning_rate': 0.0002542024013722127, 'epoch': 0.28}

 28%|██▊       | 189/683 [6:40:43<17:38:48, 128.60s/it]
 28%|██▊       | 190/683 [6:42:46<17:23:00, 126.94s/it]
                                                       
{'loss': 1.8178, 'learning_rate': 0.0002536878216123499, 'epoch': 0.28}

 28%|██▊       | 190/683 [6:42:46<17:23:00, 126.94s/it]
 28%|██▊       | 191/683 [6:44:54<17:23:20, 127.24s/it]
                                                       
{'loss': 1.7944, 'learning_rate': 0.00025317324185248713, 'epoch': 0.28}

 28%|██▊       | 191/683 [6:44:54<17:23:20, 127.24s/it]
 28%|██▊       | 192/683 [6:46:57<17:09:58, 125.86s/it]
                                                       
{'loss': 1.7353, 'learning_rate': 0.00025265866209262433, 'epoch': 0.28}

 28%|██▊       | 192/683 [6:46:57<17:09:58, 125.86s/it]
 28%|██▊       | 193/683 [6:49:03<17:07:54, 125.87s/it]
                                                       
{'loss': 1.7382, 'learning_rate': 0.00025214408233276153, 'epoch': 0.28}

 28%|██▊       | 193/683 [6:49:03<17:07:54, 125.87s/it]
 28%|██▊       | 194/683 [6:51:16<17:25:15, 128.25s/it]
                                                       
{'loss': 1.8369, 'learning_rate': 0.0002516295025728988, 'epoch': 0.28}

 28%|██▊       | 194/683 [6:51:16<17:25:15, 128.25s/it]
 29%|██▊       | 195/683 [6:53:27<17:27:45, 128.82s/it]
                                                       
{'loss': 1.7312, 'learning_rate': 0.00025111492281303604, 'epoch': 0.29}

 29%|██▊       | 195/683 [6:53:27<17:27:45, 128.82s/it]
 29%|██▊       | 196/683 [6:55:30<17:12:39, 127.23s/it]
                                                       
{'loss': 1.8034, 'learning_rate': 0.00025060034305317324, 'epoch': 0.29}

 29%|██▊       | 196/683 [6:55:30<17:12:39, 127.23s/it]
 29%|██▉       | 197/683 [6:57:32<16:57:32, 125.62s/it]
                                                       
{'loss': 1.7898, 'learning_rate': 0.00025008576329331044, 'epoch': 0.29}

 29%|██▉       | 197/683 [6:57:32<16:57:32, 125.62s/it]
 29%|██▉       | 198/683 [6:59:37<16:55:01, 125.57s/it]
                                                       
{'loss': 1.7165, 'learning_rate': 0.00024957118353344764, 'epoch': 0.29}

 29%|██▉       | 198/683 [6:59:37<16:55:01, 125.57s/it]
 29%|██▉       | 199/683 [7:01:42<16:50:06, 125.22s/it]
                                                       
{'loss': 1.8136, 'learning_rate': 0.0002490566037735849, 'epoch': 0.29}

 29%|██▉       | 199/683 [7:01:42<16:50:06, 125.22s/it]
 29%|██▉       | 200/683 [7:03:50<16:56:09, 126.23s/it]
                                                       
{'loss': 1.823, 'learning_rate': 0.0002485420240137221, 'epoch': 0.29}

 29%|██▉       | 200/683 [7:03:50<16:56:09, 126.23s/it]
 29%|██▉       | 201/683 [7:05:53<16:46:18, 125.27s/it]
                                                       
{'loss': 1.7666, 'learning_rate': 0.00024802744425385934, 'epoch': 0.29}

 29%|██▉       | 201/683 [7:05:53<16:46:18, 125.27s/it]
 30%|██▉       | 202/683 [7:08:04<16:56:09, 126.76s/it]
                                                       
{'loss': 1.8252, 'learning_rate': 0.00024751286449399654, 'epoch': 0.3}

 30%|██▉       | 202/683 [7:08:04<16:56:09, 126.76s/it]
 30%|██▉       | 203/683 [7:10:08<16:49:01, 126.13s/it]
                                                       
{'loss': 1.7623, 'learning_rate': 0.0002469982847341338, 'epoch': 0.3}

 30%|██▉       | 203/683 [7:10:08<16:49:01, 126.13s/it]
 30%|██▉       | 204/683 [7:12:10<16:35:42, 124.72s/it]
                                                       
{'loss': 1.7796, 'learning_rate': 0.000246483704974271, 'epoch': 0.3}

 30%|██▉       | 204/683 [7:12:10<16:35:42, 124.72s/it]/home/ubuntu/miniconda3/envs/h2ollm/lib/python3.10/site-packages/bitsandbytes-0.38.0.post2-py3.10.egg/bitsandbytes/autograd/_functions.py:318: UserWarning: MatMul8bitLt: inputs will be cast from torch.float32 to float16 during quantization
  warnings.warn(f"MatMul8bitLt: inputs will be cast from {A.dtype} to float16 during quantization")

 30%|███       | 205/683 [7:14:12<16:27:59, 124.02s/it]
                                                       
{'loss': 1.8312, 'learning_rate': 0.0002459691252144082, 'epoch': 0.3}

 30%|███       | 205/683 [7:14:12<16:27:59, 124.02s/it]
 30%|███       | 206/683 [7:16:15<16:23:22, 123.70s/it]
                                                       
{'loss': 1.8161, 'learning_rate': 0.00024545454545454545, 'epoch': 0.3}

 30%|███       | 206/683 [7:16:15<16:23:22, 123.70s/it]
 30%|███       | 207/683 [7:18:21<16:26:04, 124.30s/it]
                                                       
{'loss': 1.7935, 'learning_rate': 0.00024493996569468265, 'epoch': 0.3}

 30%|███       | 207/683 [7:18:21<16:26:04, 124.30s/it]
 30%|███       | 208/683 [7:20:25<16:24:33, 124.37s/it]
                                                       
{'loss': 1.77, 'learning_rate': 0.00024442538593481985, 'epoch': 0.3}

 30%|███       | 208/683 [7:20:25<16:24:33, 124.37s/it]
 31%|███       | 209/683 [7:22:39<16:45:08, 127.23s/it]
                                                       
{'loss': 1.7749, 'learning_rate': 0.00024391080617495707, 'epoch': 0.31}

 31%|███       | 209/683 [7:22:39<16:45:08, 127.23s/it]
 31%|███       | 210/683 [7:24:49<16:49:13, 128.02s/it]
                                                       
{'loss': 1.7383, 'learning_rate': 0.00024339622641509433, 'epoch': 0.31}

 31%|███       | 210/683 [7:24:49<16:49:13, 128.02s/it]
 31%|███       | 211/683 [7:26:55<16:41:47, 127.35s/it]
                                                       
{'loss': 1.7696, 'learning_rate': 0.00024288164665523155, 'epoch': 0.31}

 31%|███       | 211/683 [7:26:55<16:41:47, 127.35s/it]
 31%|███       | 212/683 [7:29:03<16:41:43, 127.61s/it]
                                                       
{'loss': 1.7509, 'learning_rate': 0.00024236706689536875, 'epoch': 0.31}

 31%|███       | 212/683 [7:29:03<16:41:43, 127.61s/it]
 31%|███       | 213/683 [7:31:03<16:22:29, 125.42s/it]
                                                       
{'loss': 1.712, 'learning_rate': 0.00024185248713550598, 'epoch': 0.31}

 31%|███       | 213/683 [7:31:03<16:22:29, 125.42s/it]
 31%|███▏      | 214/683 [7:33:11<16:26:41, 126.23s/it]
                                                       
{'loss': 1.8024, 'learning_rate': 0.0002413379073756432, 'epoch': 0.31}

 31%|███▏      | 214/683 [7:33:11<16:26:41, 126.23s/it]
 31%|███▏      | 215/683 [7:35:21<16:31:36, 127.13s/it]
                                                       
{'loss': 1.7825, 'learning_rate': 0.00024082332761578043, 'epoch': 0.31}

 31%|███▏      | 215/683 [7:35:21<16:31:36, 127.13s/it]
 32%|███▏      | 216/683 [7:37:25<16:24:00, 126.43s/it]
                                                       
{'loss': 1.7907, 'learning_rate': 0.00024030874785591763, 'epoch': 0.32}

 32%|███▏      | 216/683 [7:37:25<16:24:00, 126.43s/it]
 32%|███▏      | 217/683 [7:39:31<16:20:28, 126.24s/it]
                                                       
{'loss': 1.7279, 'learning_rate': 0.00023979416809605489, 'epoch': 0.32}

 32%|███▏      | 217/683 [7:39:31<16:20:28, 126.24s/it]
 32%|███▏      | 218/683 [7:41:41<16:26:42, 127.32s/it]
                                                       
{'loss': 1.8093, 'learning_rate': 0.00023927958833619209, 'epoch': 0.32}

 32%|███▏      | 218/683 [7:41:41<16:26:42, 127.32s/it]
 32%|███▏      | 219/683 [7:43:46<16:19:03, 126.60s/it]
                                                       
{'loss': 1.7183, 'learning_rate': 0.0002387650085763293, 'epoch': 0.32}

 32%|███▏      | 219/683 [7:43:46<16:19:03, 126.60s/it]
 32%|███▏      | 220/683 [7:45:55<16:22:45, 127.36s/it]
                                                       
{'loss': 1.7684, 'learning_rate': 0.0002382504288164665, 'epoch': 0.32}

 32%|███▏      | 220/683 [7:45:55<16:22:45, 127.36s/it]
 32%|███▏      | 221/683 [7:48:00<16:14:07, 126.51s/it]
                                                       
{'loss': 1.7852, 'learning_rate': 0.00023773584905660377, 'epoch': 0.32}

 32%|███▏      | 221/683 [7:48:00<16:14:07, 126.51s/it]
 33%|███▎      | 222/683 [7:50:05<16:09:15, 126.15s/it]
                                                       
{'loss': 1.8057, 'learning_rate': 0.000237221269296741, 'epoch': 0.32}

 33%|███▎      | 222/683 [7:50:05<16:09:15, 126.15s/it]
 33%|███▎      | 223/683 [7:52:12<16:08:25, 126.32s/it]
                                                       
{'loss': 1.7588, 'learning_rate': 0.0002367066895368782, 'epoch': 0.33}

 33%|███▎      | 223/683 [7:52:12<16:08:25, 126.32s/it]
 33%|███▎      | 224/683 [7:54:14<15:56:54, 125.09s/it]
                                                       
{'loss': 1.7292, 'learning_rate': 0.0002361921097770154, 'epoch': 0.33}

 33%|███▎      | 224/683 [7:54:14<15:56:54, 125.09s/it]
 33%|███▎      | 225/683 [7:56:21<15:58:22, 125.55s/it]
                                                       
{'loss': 1.7162, 'learning_rate': 0.00023567753001715264, 'epoch': 0.33}

 33%|███▎      | 225/683 [7:56:21<15:58:22, 125.55s/it]
 33%|███▎      | 226/683 [7:58:30<16:05:59, 126.83s/it]
                                                       
{'loss': 1.7676, 'learning_rate': 0.00023516295025728987, 'epoch': 0.33}

 33%|███▎      | 226/683 [7:58:30<16:05:59, 126.83s/it]
 33%|███▎      | 227/683 [8:00:35<15:58:08, 126.07s/it]
                                                       
{'loss': 1.8027, 'learning_rate': 0.00023464837049742707, 'epoch': 0.33}

 33%|███▎      | 227/683 [8:00:35<15:58:08, 126.07s/it]
 33%|███▎      | 228/683 [8:02:45<16:06:08, 127.40s/it]
                                                       
{'loss': 1.7817, 'learning_rate': 0.0002341337907375643, 'epoch': 0.33}

 33%|███▎      | 228/683 [8:02:45<16:06:08, 127.40s/it]
 34%|███▎      | 229/683 [8:04:57<16:13:13, 128.62s/it]
                                                       
{'loss': 1.7997, 'learning_rate': 0.00023361921097770152, 'epoch': 0.34}

 34%|███▎      | 229/683 [8:04:57<16:13:13, 128.62s/it]
 34%|███▎      | 230/683 [8:07:04<16:08:31, 128.28s/it]
                                                       
{'loss': 1.7319, 'learning_rate': 0.00023310463121783875, 'epoch': 0.34}

 34%|███▎      | 230/683 [8:07:04<16:08:31, 128.28s/it]
 34%|███▍      | 231/683 [8:09:10<16:01:59, 127.70s/it]
                                                       
{'loss': 1.7076, 'learning_rate': 0.00023259005145797595, 'epoch': 0.34}

 34%|███▍      | 231/683 [8:09:10<16:01:59, 127.70s/it]
 34%|███▍      | 232/683 [8:11:19<16:01:28, 127.91s/it]
                                                       
{'loss': 1.7633, 'learning_rate': 0.0002320754716981132, 'epoch': 0.34}

 34%|███▍      | 232/683 [8:11:19<16:01:28, 127.91s/it]
 34%|███▍      | 233/683 [8:13:23<15:50:37, 126.75s/it]
                                                       
{'loss': 1.7528, 'learning_rate': 0.0002315608919382504, 'epoch': 0.34}

 34%|███▍      | 233/683 [8:13:23<15:50:37, 126.75s/it]
 34%|███▍      | 234/683 [8:15:31<15:52:25, 127.27s/it]
                                                       
{'loss': 1.7968, 'learning_rate': 0.00023104631217838763, 'epoch': 0.34}

 34%|███▍      | 234/683 [8:15:31<15:52:25, 127.27s/it]
 34%|███▍      | 235/683 [8:17:40<15:53:52, 127.75s/it]
                                                       
{'loss': 1.784, 'learning_rate': 0.00023053173241852483, 'epoch': 0.34}

 34%|███▍      | 235/683 [8:17:40<15:53:52, 127.75s/it]
 35%|███▍      | 236/683 [8:19:44<15:41:53, 126.43s/it]
                                                       
{'loss': 1.7434, 'learning_rate': 0.00023001715265866208, 'epoch': 0.35}

 35%|███▍      | 236/683 [8:19:44<15:41:53, 126.43s/it]
 35%|███▍      | 237/683 [8:21:47<15:32:08, 125.40s/it]
                                                       
{'loss': 1.723, 'learning_rate': 0.0002295025728987993, 'epoch': 0.35}

 35%|███▍      | 237/683 [8:21:47<15:32:08, 125.40s/it]
 35%|███▍      | 238/683 [8:23:49<15:23:55, 124.57s/it]
                                                       
{'loss': 1.7696, 'learning_rate': 0.0002289879931389365, 'epoch': 0.35}

 35%|███▍      | 238/683 [8:23:49<15:23:55, 124.57s/it]/home/ubuntu/miniconda3/envs/h2ollm/lib/python3.10/site-packages/bitsandbytes-0.38.0.post2-py3.10.egg/bitsandbytes/autograd/_functions.py:318: UserWarning: MatMul8bitLt: inputs will be cast from torch.float32 to float16 during quantization
  warnings.warn(f"MatMul8bitLt: inputs will be cast from {A.dtype} to float16 during quantization")

 35%|███▍      | 239/683 [8:25:56<15:27:24, 125.33s/it]
                                                       
{'loss': 1.7645, 'learning_rate': 0.00022847341337907373, 'epoch': 0.35}

 35%|███▍      | 239/683 [8:25:56<15:27:24, 125.33s/it]
 35%|███▌      | 240/683 [8:28:04<15:31:05, 126.11s/it]
                                                       
{'loss': 1.7432, 'learning_rate': 0.00022795883361921096, 'epoch': 0.35}

 35%|███▌      | 240/683 [8:28:04<15:31:05, 126.11s/it]
 35%|███▌      | 241/683 [8:30:10<15:28:51, 126.09s/it]
                                                       
{'loss': 1.7427, 'learning_rate': 0.0002274442538593482, 'epoch': 0.35}

 35%|███▌      | 241/683 [8:30:10<15:28:51, 126.09s/it]
 35%|███▌      | 242/683 [8:32:21<15:37:53, 127.61s/it]
                                                       
{'loss': 1.7542, 'learning_rate': 0.0002269296740994854, 'epoch': 0.35}

 35%|███▌      | 242/683 [8:32:21<15:37:53, 127.61s/it]
 36%|███▌      | 243/683 [8:34:31<15:39:18, 128.09s/it]
                                                       
{'loss': 1.7991, 'learning_rate': 0.00022641509433962264, 'epoch': 0.36}

 36%|███▌      | 243/683 [8:34:31<15:39:18, 128.09s/it]
 36%|███▌      | 244/683 [8:36:40<15:40:16, 128.51s/it]
                                                       
{'loss': 1.7638, 'learning_rate': 0.00022590051457975984, 'epoch': 0.36}

 36%|███▌      | 244/683 [8:36:40<15:40:16, 128.51s/it]
 36%|███▌      | 245/683 [8:38:51<15:43:35, 129.26s/it]
                                                       
{'loss': 1.7546, 'learning_rate': 0.00022538593481989707, 'epoch': 0.36}

 36%|███▌      | 245/683 [8:38:51<15:43:35, 129.26s/it]
 36%|███▌      | 246/683 [8:40:56<15:31:10, 127.85s/it]
                                                       
{'loss': 1.8003, 'learning_rate': 0.00022487135506003427, 'epoch': 0.36}

 36%|███▌      | 246/683 [8:40:56<15:31:10, 127.85s/it]
 36%|███▌      | 247/683 [8:43:01<15:22:53, 127.00s/it]
                                                       
{'loss': 1.7559, 'learning_rate': 0.00022435677530017152, 'epoch': 0.36}

 36%|███▌      | 247/683 [8:43:01<15:22:53, 127.00s/it]
 36%|███▋      | 248/683 [8:45:08<15:20:23, 126.95s/it]
                                                       
{'loss': 1.7957, 'learning_rate': 0.00022384219554030872, 'epoch': 0.36}

 36%|███▋      | 248/683 [8:45:08<15:20:23, 126.95s/it]
 36%|███▋      | 249/683 [8:47:10<15:08:49, 125.64s/it]
                                                       
{'loss': 1.7368, 'learning_rate': 0.00022332761578044595, 'epoch': 0.36}

 36%|███▋      | 249/683 [8:47:10<15:08:49, 125.64s/it]
 37%|███▋      | 250/683 [8:49:24<15:24:01, 128.04s/it]
                                                       
{'loss': 1.7638, 'learning_rate': 0.00022281303602058315, 'epoch': 0.37}

 37%|███▋      | 250/683 [8:49:24<15:24:01, 128.04s/it]
 37%|███▋      | 251/683 [8:51:36<15:31:15, 129.34s/it]
                                                       
{'loss': 1.7824, 'learning_rate': 0.0002222984562607204, 'epoch': 0.37}

 37%|███▋      | 251/683 [8:51:36<15:31:15, 129.34s/it]
 37%|███▋      | 252/683 [8:53:41<15:20:17, 128.12s/it]
                                                       
{'loss': 1.7696, 'learning_rate': 0.00022178387650085763, 'epoch': 0.37}

 37%|███▋      | 252/683 [8:53:41<15:20:17, 128.12s/it]
 37%|███▋      | 253/683 [8:55:44<15:06:16, 126.46s/it]
                                                       
{'loss': 1.7742, 'learning_rate': 0.00022126929674099483, 'epoch': 0.37}

 37%|███▋      | 253/683 [8:55:44<15:06:16, 126.46s/it]
 37%|███▋      | 254/683 [8:57:53<15:08:49, 127.11s/it]
                                                       
{'loss': 1.7801, 'learning_rate': 0.00022075471698113205, 'epoch': 0.37}

 37%|███▋      | 254/683 [8:57:53<15:08:49, 127.11s/it]
 37%|███▋      | 255/683 [9:00:00<15:06:19, 127.06s/it]
                                                       
{'loss': 1.7053, 'learning_rate': 0.00022024013722126928, 'epoch': 0.37}

 37%|███▋      | 255/683 [9:00:00<15:06:19, 127.06s/it]
 37%|███▋      | 256/683 [9:02:03<14:56:11, 125.93s/it]
                                                       
{'loss': 1.7625, 'learning_rate': 0.0002197255574614065, 'epoch': 0.37}

 37%|███▋      | 256/683 [9:02:03<14:56:11, 125.93s/it]
 38%|███▊      | 257/683 [9:04:09<14:54:34, 126.00s/it]
                                                       
{'loss': 1.725, 'learning_rate': 0.0002192109777015437, 'epoch': 0.38}

 38%|███▊      | 257/683 [9:04:09<14:54:34, 126.00s/it]
 38%|███▊      | 258/683 [9:06:15<14:52:24, 125.99s/it]
                                                       
{'loss': 1.738, 'learning_rate': 0.00021869639794168096, 'epoch': 0.38}

 38%|███▊      | 258/683 [9:06:15<14:52:24, 125.99s/it]
 38%|███▊      | 259/683 [9:08:19<14:47:04, 125.53s/it]
                                                       
{'loss': 1.7661, 'learning_rate': 0.00021818181818181816, 'epoch': 0.38}

 38%|███▊      | 259/683 [9:08:20<14:47:04, 125.53s/it]
 38%|███▊      | 260/683 [9:10:25<14:44:34, 125.47s/it]
                                                       
{'loss': 1.7785, 'learning_rate': 0.00021766723842195538, 'epoch': 0.38}

 38%|███▊      | 260/683 [9:10:25<14:44:34, 125.47s/it]
 38%|███▊      | 261/683 [9:12:30<14:41:54, 125.39s/it]
                                                       
{'loss': 1.7716, 'learning_rate': 0.00021715265866209258, 'epoch': 0.38}

 38%|███▊      | 261/683 [9:12:30<14:41:54, 125.39s/it]
 38%|███▊      | 262/683 [9:14:40<14:49:14, 126.73s/it]
                                                       
{'loss': 1.7761, 'learning_rate': 0.00021663807890222984, 'epoch': 0.38}

 38%|███▊      | 262/683 [9:14:40<14:49:14, 126.73s/it]
 39%|███▊      | 263/683 [9:16:42<14:37:21, 125.34s/it]
                                                       
{'loss': 1.7526, 'learning_rate': 0.00021612349914236706, 'epoch': 0.38}

 39%|███▊      | 263/683 [9:16:42<14:37:21, 125.34s/it]
 39%|███▊      | 264/683 [9:18:55<14:50:37, 127.54s/it]
                                                       
{'loss': 1.7878, 'learning_rate': 0.00021560891938250426, 'epoch': 0.39}

 39%|███▊      | 264/683 [9:18:55<14:50:37, 127.54s/it]
 39%|███▉      | 265/683 [9:21:02<14:47:32, 127.40s/it]
                                                       
{'loss': 1.7713, 'learning_rate': 0.00021509433962264146, 'epoch': 0.39}

 39%|███▉      | 265/683 [9:21:02<14:47:32, 127.40s/it]
 39%|███▉      | 266/683 [9:23:05<14:36:22, 126.10s/it]
                                                       
{'loss': 1.7763, 'learning_rate': 0.00021457975986277872, 'epoch': 0.39}

 39%|███▉      | 266/683 [9:23:05<14:36:22, 126.10s/it]
 39%|███▉      | 267/683 [9:25:13<14:39:16, 126.82s/it]
                                                       
{'loss': 1.7351, 'learning_rate': 0.00021406518010291594, 'epoch': 0.39}

 39%|███▉      | 267/683 [9:25:13<14:39:16, 126.82s/it]
 39%|███▉      | 268/683 [9:27:24<14:44:47, 127.92s/it]
                                                       
{'loss': 1.7583, 'learning_rate': 0.00021355060034305314, 'epoch': 0.39}

 39%|███▉      | 268/683 [9:27:24<14:44:47, 127.92s/it]
 39%|███▉      | 269/683 [9:29:30<14:38:45, 127.36s/it]
                                                       
{'loss': 1.7564, 'learning_rate': 0.0002130360205831904, 'epoch': 0.39}

 39%|███▉      | 269/683 [9:29:30<14:38:45, 127.36s/it]
 40%|███▉      | 270/683 [9:31:27<14:15:58, 124.35s/it]
                                                       
{'loss': 1.7476, 'learning_rate': 0.0002125214408233276, 'epoch': 0.4}

 40%|███▉      | 270/683 [9:31:27<14:15:58, 124.35s/it]
 40%|███▉      | 271/683 [9:33:31<14:12:35, 124.16s/it]
                                                       
{'loss': 1.7818, 'learning_rate': 0.00021200686106346482, 'epoch': 0.4}

 40%|███▉      | 271/683 [9:33:31<14:12:35, 124.16s/it]
 40%|███▉      | 272/683 [9:35:36<14:11:48, 124.35s/it]
                                                       
{'loss': 1.7391, 'learning_rate': 0.00021149228130360202, 'epoch': 0.4}

 40%|███▉      | 272/683 [9:35:36<14:11:48, 124.35s/it]/home/ubuntu/miniconda3/envs/h2ollm/lib/python3.10/site-packages/bitsandbytes-0.38.0.post2-py3.10.egg/bitsandbytes/autograd/_functions.py:318: UserWarning: MatMul8bitLt: inputs will be cast from torch.float32 to float16 during quantization
  warnings.warn(f"MatMul8bitLt: inputs will be cast from {A.dtype} to float16 during quantization")

 40%|███▉      | 273/683 [9:37:46<14:21:13, 126.03s/it]
                                                       
{'loss': 1.7433, 'learning_rate': 0.00021097770154373928, 'epoch': 0.4}

 40%|███▉      | 273/683 [9:37:46<14:21:13, 126.03s/it]
 40%|████      | 274/683 [9:39:52<14:20:01, 126.16s/it]
                                                       
{'loss': 1.6982, 'learning_rate': 0.00021046312178387647, 'epoch': 0.4}

 40%|████      | 274/683 [9:39:52<14:20:01, 126.16s/it]
 40%|████      | 275/683 [9:42:02<14:24:40, 127.16s/it]
                                                       
{'loss': 1.8138, 'learning_rate': 0.0002099485420240137, 'epoch': 0.4}

 40%|████      | 275/683 [9:42:02<14:24:40, 127.16s/it]
 40%|████      | 276/683 [9:44:07<14:18:44, 126.60s/it]
                                                       
{'loss': 1.7901, 'learning_rate': 0.0002094339622641509, 'epoch': 0.4}

 40%|████      | 276/683 [9:44:07<14:18:44, 126.60s/it]
 41%|████      | 277/683 [9:46:12<14:14:25, 126.27s/it]
                                                       
{'loss': 1.7542, 'learning_rate': 0.00020891938250428815, 'epoch': 0.41}

 41%|████      | 277/683 [9:46:12<14:14:25, 126.27s/it]
 41%|████      | 278/683 [9:48:25<14:24:26, 128.06s/it]
                                                       
{'loss': 1.7713, 'learning_rate': 0.00020840480274442538, 'epoch': 0.41}

 41%|████      | 278/683 [9:48:25<14:24:26, 128.06s/it]
 41%|████      | 279/683 [9:50:33<14:23:05, 128.18s/it]
                                                       
{'loss': 1.7976, 'learning_rate': 0.00020789022298456258, 'epoch': 0.41}

 41%|████      | 279/683 [9:50:33<14:23:05, 128.18s/it]
 41%|████      | 280/683 [9:52:36<14:10:46, 126.67s/it]
                                                       
{'loss': 1.6813, 'learning_rate': 0.0002073756432246998, 'epoch': 0.41}

 41%|████      | 280/683 [9:52:36<14:10:46, 126.67s/it]
 41%|████      | 281/683 [9:54:41<14:04:37, 126.06s/it]
                                                       
{'loss': 1.7543, 'learning_rate': 0.00020686106346483703, 'epoch': 0.41}

 41%|████      | 281/683 [9:54:41<14:04:37, 126.06s/it]
 41%|████▏     | 282/683 [9:56:45<13:59:37, 125.63s/it]
                                                       
{'loss': 1.7239, 'learning_rate': 0.00020634648370497426, 'epoch': 0.41}

 41%|████▏     | 282/683 [9:56:45<13:59:37, 125.63s/it]
 41%|████▏     | 283/683 [9:58:55<14:05:44, 126.86s/it]
                                                       
{'loss': 1.7683, 'learning_rate': 0.00020583190394511146, 'epoch': 0.41}

 41%|████▏     | 283/683 [9:58:55<14:05:44, 126.86s/it]
 42%|████▏     | 284/683 [10:01:03<14:05:31, 127.15s/it]
                                                        
{'loss': 1.7813, 'learning_rate': 0.00020531732418524871, 'epoch': 0.42}

 42%|████▏     | 284/683 [10:01:03<14:05:31, 127.15s/it]
 42%|████▏     | 285/683 [10:03:17<14:17:13, 129.23s/it]
                                                        
{'loss': 1.7073, 'learning_rate': 0.0002048027444253859, 'epoch': 0.42}

 42%|████▏     | 285/683 [10:03:17<14:17:13, 129.23s/it]
 42%|████▏     | 286/683 [10:05:32<14:25:57, 130.87s/it]
                                                        
{'loss': 1.7392, 'learning_rate': 0.00020428816466552314, 'epoch': 0.42}

 42%|████▏     | 286/683 [10:05:32<14:25:57, 130.87s/it]
 42%|████▏     | 287/683 [10:07:37<14:12:53, 129.23s/it]
                                                        
{'loss': 1.7474, 'learning_rate': 0.00020377358490566034, 'epoch': 0.42}

 42%|████▏     | 287/683 [10:07:37<14:12:53, 129.23s/it]
 42%|████▏     | 288/683 [10:09:43<14:03:29, 128.12s/it]
                                                        
{'loss': 1.7332, 'learning_rate': 0.0002032590051457976, 'epoch': 0.42}

 42%|████▏     | 288/683 [10:09:43<14:03:29, 128.12s/it]
 42%|████▏     | 289/683 [10:11:50<13:59:22, 127.82s/it]
                                                        
{'loss': 1.7201, 'learning_rate': 0.0002027444253859348, 'epoch': 0.42}

 42%|████▏     | 289/683 [10:11:50<13:59:22, 127.82s/it]
 42%|████▏     | 290/683 [10:13:56<13:53:31, 127.26s/it]
                                                        
{'loss': 1.7371, 'learning_rate': 0.00020222984562607202, 'epoch': 0.42}

 42%|████▏     | 290/683 [10:13:56<13:53:31, 127.26s/it]
 43%|████▎     | 291/683 [10:16:09<14:02:07, 128.90s/it]
                                                        
{'loss': 1.7938, 'learning_rate': 0.00020171526586620922, 'epoch': 0.43}

 43%|████▎     | 291/683 [10:16:09<14:02:07, 128.90s/it]
 43%|████▎     | 292/683 [10:18:16<13:56:38, 128.39s/it]
                                                        
{'loss': 1.7247, 'learning_rate': 0.00020120068610634647, 'epoch': 0.43}

 43%|████▎     | 292/683 [10:18:16<13:56:38, 128.39s/it]
 43%|████▎     | 293/683 [10:20:21<13:48:55, 127.53s/it]
                                                        
{'loss': 1.7502, 'learning_rate': 0.0002006861063464837, 'epoch': 0.43}

 43%|████▎     | 293/683 [10:20:21<13:48:55, 127.53s/it]
 43%|████▎     | 294/683 [10:22:24<13:37:08, 126.04s/it]
                                                        
{'loss': 1.7183, 'learning_rate': 0.0002001715265866209, 'epoch': 0.43}

 43%|████▎     | 294/683 [10:22:24<13:37:08, 126.04s/it]
 43%|████▎     | 295/683 [10:24:35<13:44:51, 127.56s/it]
                                                        
{'loss': 1.7466, 'learning_rate': 0.00019965694682675815, 'epoch': 0.43}

 43%|████▎     | 295/683 [10:24:35<13:44:51, 127.56s/it]
 43%|████▎     | 296/683 [10:26:39<13:36:22, 126.57s/it]
                                                        
{'loss': 1.7272, 'learning_rate': 0.00019914236706689535, 'epoch': 0.43}

 43%|████▎     | 296/683 [10:26:39<13:36:22, 126.57s/it]
 43%|████▎     | 297/683 [10:28:41<13:25:54, 125.27s/it]
                                                        
{'loss': 1.7486, 'learning_rate': 0.00019862778730703258, 'epoch': 0.43}

 43%|████▎     | 297/683 [10:28:41<13:25:54, 125.27s/it]
 44%|████▎     | 298/683 [10:30:51<13:32:12, 126.58s/it]
                                                        
{'loss': 1.7453, 'learning_rate': 0.00019811320754716978, 'epoch': 0.44}

 44%|████▎     | 298/683 [10:30:51<13:32:12, 126.58s/it]
 44%|████▍     | 299/683 [10:32:59<13:32:05, 126.89s/it]
                                                        
{'loss': 1.7735, 'learning_rate': 0.00019759862778730703, 'epoch': 0.44}

 44%|████▍     | 299/683 [10:32:59<13:32:05, 126.89s/it]
 44%|████▍     | 300/683 [10:35:05<13:29:52, 126.87s/it]
                                                        
{'loss': 1.7184, 'learning_rate': 0.00019708404802744423, 'epoch': 0.44}

 44%|████▍     | 300/683 [10:35:06<13:29:52, 126.87s/it]
 44%|████▍     | 301/683 [10:37:08<13:19:31, 125.58s/it]
                                                        
{'loss': 1.7525, 'learning_rate': 0.00019656946826758146, 'epoch': 0.44}

 44%|████▍     | 301/683 [10:37:08<13:19:31, 125.58s/it]
 44%|████▍     | 302/683 [10:39:14<13:17:40, 125.62s/it]
                                                        
{'loss': 1.7877, 'learning_rate': 0.00019605488850771866, 'epoch': 0.44}

 44%|████▍     | 302/683 [10:39:14<13:17:40, 125.62s/it]
 44%|████▍     | 303/683 [10:41:22<13:20:23, 126.38s/it]
                                                        
{'loss': 1.7541, 'learning_rate': 0.0001955403087478559, 'epoch': 0.44}

 44%|████▍     | 303/683 [10:41:22<13:20:23, 126.38s/it]
 45%|████▍     | 304/683 [10:43:30<13:22:04, 126.98s/it]
                                                        
{'loss': 1.8052, 'learning_rate': 0.00019502572898799314, 'epoch': 0.44}

 45%|████▍     | 304/683 [10:43:30<13:22:04, 126.98s/it]
 45%|████▍     | 305/683 [10:45:37<13:18:32, 126.75s/it]
                                                        
{'loss': 1.7624, 'learning_rate': 0.00019451114922813034, 'epoch': 0.45}

 45%|████▍     | 305/683 [10:45:37<13:18:32, 126.75s/it]
 45%|████▍     | 306/683 [10:47:43<13:15:36, 126.62s/it]
                                                        
{'loss': 1.7472, 'learning_rate': 0.00019399656946826754, 'epoch': 0.45}

 45%|████▍     | 306/683 [10:47:43<13:15:36, 126.62s/it]/home/ubuntu/miniconda3/envs/h2ollm/lib/python3.10/site-packages/bitsandbytes-0.38.0.post2-py3.10.egg/bitsandbytes/autograd/_functions.py:318: UserWarning: MatMul8bitLt: inputs will be cast from torch.float32 to float16 during quantization
  warnings.warn(f"MatMul8bitLt: inputs will be cast from {A.dtype} to float16 during quantization")

 45%|████▍     | 307/683 [10:49:46<13:07:42, 125.70s/it]
                                                        
{'loss': 1.7443, 'learning_rate': 0.0001934819897084048, 'epoch': 0.45}

 45%|████▍     | 307/683 [10:49:46<13:07:42, 125.70s/it]
 45%|████▌     | 308/683 [10:51:58<13:17:11, 127.55s/it]
                                                        
{'loss': 1.6785, 'learning_rate': 0.00019296740994854202, 'epoch': 0.45}

 45%|████▌     | 308/683 [10:51:58<13:17:11, 127.55s/it]
 45%|████▌     | 309/683 [10:54:14<13:29:41, 129.90s/it]
                                                        
{'loss': 1.803, 'learning_rate': 0.00019245283018867922, 'epoch': 0.45}

 45%|████▌     | 309/683 [10:54:14<13:29:41, 129.90s/it]
 45%|████▌     | 310/683 [10:56:14<13:10:12, 127.11s/it]
                                                        
{'loss': 1.6834, 'learning_rate': 0.00019193825042881647, 'epoch': 0.45}

 45%|████▌     | 310/683 [10:56:14<13:10:12, 127.11s/it]
 46%|████▌     | 311/683 [10:58:20<13:05:59, 126.77s/it]
                                                        
{'loss': 1.7298, 'learning_rate': 0.00019142367066895367, 'epoch': 0.46}

 46%|████▌     | 311/683 [10:58:20<13:05:59, 126.77s/it]
 46%|████▌     | 312/683 [11:00:29<13:06:56, 127.27s/it]
                                                        
{'loss': 1.7025, 'learning_rate': 0.0001909090909090909, 'epoch': 0.46}

 46%|████▌     | 312/683 [11:00:29<13:06:56, 127.27s/it]
 46%|████▌     | 313/683 [11:02:31<12:55:01, 125.68s/it]
                                                        
{'loss': 1.7336, 'learning_rate': 0.0001903945111492281, 'epoch': 0.46}

 46%|████▌     | 313/683 [11:02:31<12:55:01, 125.68s/it]
 46%|████▌     | 314/683 [11:04:34<12:48:53, 125.02s/it]
                                                        
{'loss': 1.7338, 'learning_rate': 0.00018987993138936535, 'epoch': 0.46}

 46%|████▌     | 314/683 [11:04:34<12:48:53, 125.02s/it]
 46%|████▌     | 315/683 [11:06:37<12:43:47, 124.53s/it]
                                                        
{'loss': 1.7505, 'learning_rate': 0.00018936535162950255, 'epoch': 0.46}

 46%|████▌     | 315/683 [11:06:38<12:43:47, 124.53s/it]
 46%|████▋     | 316/683 [11:08:46<12:49:02, 125.73s/it]
                                                        
{'loss': 1.7755, 'learning_rate': 0.00018885077186963977, 'epoch': 0.46}

 46%|████▋     | 316/683 [11:08:46<12:49:02, 125.73s/it]
 46%|████▋     | 317/683 [11:10:53<12:50:00, 126.23s/it]
                                                        
{'loss': 1.7304, 'learning_rate': 0.00018833619210977697, 'epoch': 0.46}

 46%|████▋     | 317/683 [11:10:53<12:50:00, 126.23s/it]
 47%|████▋     | 318/683 [11:13:03<12:54:18, 127.28s/it]
                                                        
{'loss': 1.7772, 'learning_rate': 0.00018782161234991423, 'epoch': 0.47}

 47%|████▋     | 318/683 [11:13:03<12:54:18, 127.28s/it]
 47%|████▋     | 319/683 [11:15:06<12:43:38, 125.88s/it]
                                                        
{'loss': 1.719, 'learning_rate': 0.00018730703259005145, 'epoch': 0.47}

 47%|████▋     | 319/683 [11:15:06<12:43:38, 125.88s/it]
 47%|████▋     | 320/683 [11:17:12<12:41:37, 125.89s/it]
                                                        
{'loss': 1.7242, 'learning_rate': 0.00018679245283018865, 'epoch': 0.47}

 47%|████▋     | 320/683 [11:17:12<12:41:37, 125.89s/it]
 47%|████▋     | 321/683 [11:19:16<12:36:23, 125.37s/it]
                                                        
{'loss': 1.7273, 'learning_rate': 0.0001862778730703259, 'epoch': 0.47}

 47%|████▋     | 321/683 [11:19:16<12:36:23, 125.37s/it]
 47%|████▋     | 322/683 [11:21:25<12:41:04, 126.50s/it]
                                                        
{'loss': 1.7277, 'learning_rate': 0.0001857632933104631, 'epoch': 0.47}

 47%|████▋     | 322/683 [11:21:25<12:41:04, 126.50s/it]
 47%|████▋     | 323/683 [11:23:38<12:51:26, 128.57s/it]
                                                        
{'loss': 1.725, 'learning_rate': 0.00018524871355060033, 'epoch': 0.47}

 47%|████▋     | 323/683 [11:23:38<12:51:26, 128.57s/it]
 47%|████▋     | 324/683 [11:25:43<12:41:35, 127.29s/it]
                                                        
{'loss': 1.7282, 'learning_rate': 0.00018473413379073753, 'epoch': 0.47}

 47%|████▋     | 324/683 [11:25:43<12:41:35, 127.29s/it]
 48%|████▊     | 325/683 [11:27:52<12:42:28, 127.79s/it]
                                                        
{'loss': 1.7389, 'learning_rate': 0.00018421955403087479, 'epoch': 0.48}

 48%|████▊     | 325/683 [11:27:52<12:42:28, 127.79s/it]
 48%|████▊     | 326/683 [11:29:56<12:35:07, 126.91s/it]
                                                        
{'loss': 1.7527, 'learning_rate': 0.00018370497427101199, 'epoch': 0.48}

 48%|████▊     | 326/683 [11:29:57<12:35:07, 126.91s/it]
 48%|████▊     | 327/683 [11:32:04<12:34:33, 127.17s/it]
                                                        
{'loss': 1.7246, 'learning_rate': 0.0001831903945111492, 'epoch': 0.48}

 48%|████▊     | 327/683 [11:32:04<12:34:33, 127.17s/it]
 48%|████▊     | 328/683 [11:34:11<12:31:51, 127.07s/it]
                                                        
{'loss': 1.7404, 'learning_rate': 0.0001826758147512864, 'epoch': 0.48}

 48%|████▊     | 328/683 [11:34:11<12:31:51, 127.07s/it]
 48%|████▊     | 329/683 [11:36:18<12:29:26, 127.02s/it]
                                                        
{'loss': 1.7853, 'learning_rate': 0.00018216123499142367, 'epoch': 0.48}

 48%|████▊     | 329/683 [11:36:18<12:29:26, 127.02s/it]
 48%|████▊     | 330/683 [11:38:20<12:19:16, 125.66s/it]
                                                        
{'loss': 1.7479, 'learning_rate': 0.00018164665523156086, 'epoch': 0.48}

 48%|████▊     | 330/683 [11:38:20<12:19:16, 125.66s/it]
 48%|████▊     | 331/683 [11:40:25<12:15:56, 125.44s/it]
                                                        
{'loss': 1.7861, 'learning_rate': 0.0001811320754716981, 'epoch': 0.48}

 48%|████▊     | 331/683 [11:40:25<12:15:56, 125.44s/it]
 49%|████▊     | 332/683 [11:42:33<12:18:09, 126.18s/it]
                                                        
{'loss': 1.73, 'learning_rate': 0.0001806174957118353, 'epoch': 0.49}

 49%|████▊     | 332/683 [11:42:33<12:18:09, 126.18s/it]
 49%|████▉     | 333/683 [11:44:35<12:07:58, 124.79s/it]
                                                        
{'loss': 1.7452, 'learning_rate': 0.00018010291595197254, 'epoch': 0.49}

 49%|████▉     | 333/683 [11:44:35<12:07:58, 124.79s/it]
 49%|████▉     | 334/683 [11:46:41<12:08:21, 125.22s/it]
                                                        
{'loss': 1.7593, 'learning_rate': 0.00017958833619210977, 'epoch': 0.49}

 49%|████▉     | 334/683 [11:46:41<12:08:21, 125.22s/it]
 49%|████▉     | 335/683 [11:48:46<12:05:34, 125.10s/it]
                                                        
{'loss': 1.7328, 'learning_rate': 0.00017907375643224697, 'epoch': 0.49}

 49%|████▉     | 335/683 [11:48:46<12:05:34, 125.10s/it]
 49%|████▉     | 336/683 [11:50:51<12:03:15, 125.06s/it]
                                                        
{'loss': 1.7366, 'learning_rate': 0.00017855917667238422, 'epoch': 0.49}

 49%|████▉     | 336/683 [11:50:51<12:03:15, 125.06s/it]
 49%|████▉     | 337/683 [11:52:52<11:55:09, 124.02s/it]
                                                        
{'loss': 1.7217, 'learning_rate': 0.00017804459691252142, 'epoch': 0.49}

 49%|████▉     | 337/683 [11:52:52<11:55:09, 124.02s/it]
 49%|████▉     | 338/683 [11:54:51<11:43:16, 122.31s/it]
                                                        
{'loss': 1.7522, 'learning_rate': 0.00017753001715265865, 'epoch': 0.49}

 49%|████▉     | 338/683 [11:54:51<11:43:16, 122.31s/it]
 50%|████▉     | 339/683 [11:56:57<11:47:43, 123.44s/it]
                                                        
{'loss': 1.7395, 'learning_rate': 0.00017701543739279585, 'epoch': 0.5}

 50%|████▉     | 339/683 [11:56:57<11:47:43, 123.44s/it]
 50%|████▉     | 340/683 [11:59:04<11:51:36, 124.48s/it]
                                                        
{'loss': 1.8049, 'learning_rate': 0.0001765008576329331, 'epoch': 0.5}

 50%|████▉     | 340/683 [11:59:04<11:51:36, 124.48s/it]/home/ubuntu/miniconda3/envs/h2ollm/lib/python3.10/site-packages/bitsandbytes-0.38.0.post2-py3.10.egg/bitsandbytes/autograd/_functions.py:318: UserWarning: MatMul8bitLt: inputs will be cast from torch.float32 to float16 during quantization
  warnings.warn(f"MatMul8bitLt: inputs will be cast from {A.dtype} to float16 during quantization")

 50%|████▉     | 341/683 [12:01:09<11:51:10, 124.77s/it]
                                                        
{'loss': 1.7783, 'learning_rate': 0.0001759862778730703, 'epoch': 0.5}

 50%|████▉     | 341/683 [12:01:09<11:51:10, 124.77s/it]
 50%|█████     | 342/683 [12:03:14<11:49:25, 124.83s/it]
                                                        
{'loss': 1.7068, 'learning_rate': 0.00017547169811320753, 'epoch': 0.5}

 50%|█████     | 342/683 [12:03:14<11:49:25, 124.83s/it]
 50%|█████     | 343/683 [12:05:15<11:40:22, 123.60s/it]
                                                        
{'loss': 1.7102, 'learning_rate': 0.00017495711835334473, 'epoch': 0.5}

 50%|█████     | 343/683 [12:05:15<11:40:22, 123.60s/it]
 50%|█████     | 344/683 [12:07:23<11:46:44, 125.09s/it]
                                                        
{'loss': 1.8066, 'learning_rate': 0.00017444253859348198, 'epoch': 0.5}

 50%|█████     | 344/683 [12:07:23<11:46:44, 125.09s/it]
 51%|█████     | 345/683 [12:09:29<11:45:48, 125.29s/it]
                                                        
{'loss': 1.7969, 'learning_rate': 0.0001739279588336192, 'epoch': 0.5}

 51%|█████     | 345/683 [12:09:29<11:45:48, 125.29s/it]
 51%|█████     | 346/683 [12:11:29<11:34:33, 123.66s/it]
                                                        
{'loss': 1.7113, 'learning_rate': 0.0001734133790737564, 'epoch': 0.51}

 51%|█████     | 346/683 [12:11:29<11:34:33, 123.66s/it]
 51%|█████     | 347/683 [12:13:41<11:46:33, 126.17s/it]
                                                        
{'loss': 1.7534, 'learning_rate': 0.00017289879931389366, 'epoch': 0.51}

 51%|█████     | 347/683 [12:13:41<11:46:33, 126.17s/it]
 51%|█████     | 348/683 [12:15:42<11:35:21, 124.54s/it]
                                                        
{'loss': 1.7441, 'learning_rate': 0.00017238421955403086, 'epoch': 0.51}

 51%|█████     | 348/683 [12:15:42<11:35:21, 124.54s/it]
 51%|█████     | 349/683 [12:17:50<11:39:37, 125.68s/it]
                                                        
{'loss': 1.7064, 'learning_rate': 0.0001718696397941681, 'epoch': 0.51}

 51%|█████     | 349/683 [12:17:50<11:39:37, 125.68s/it]
 51%|█████     | 350/683 [12:19:55<11:35:59, 125.40s/it]
                                                        
{'loss': 1.8158, 'learning_rate': 0.0001713550600343053, 'epoch': 0.51}

 51%|█████     | 350/683 [12:19:55<11:35:59, 125.40s/it]
 51%|█████▏    | 351/683 [12:22:01<11:35:33, 125.70s/it]
                                                        
{'loss': 1.7801, 'learning_rate': 0.00017084048027444254, 'epoch': 0.51}

 51%|█████▏    | 351/683 [12:22:01<11:35:33, 125.70s/it]
 52%|█████▏    | 352/683 [12:24:08<11:34:14, 125.85s/it]
                                                        
{'loss': 1.755, 'learning_rate': 0.00017032590051457974, 'epoch': 0.52}

 52%|█████▏    | 352/683 [12:24:08<11:34:14, 125.85s/it]
 52%|█████▏    | 353/683 [12:26:13<11:31:26, 125.72s/it]
                                                        
{'loss': 1.7614, 'learning_rate': 0.00016981132075471697, 'epoch': 0.52}

 52%|█████▏    | 353/683 [12:26:13<11:31:26, 125.72s/it]
 52%|█████▏    | 354/683 [12:28:15<11:23:02, 124.57s/it]
                                                        
{'loss': 1.707, 'learning_rate': 0.00016929674099485417, 'epoch': 0.52}

 52%|█████▏    | 354/683 [12:28:15<11:23:02, 124.57s/it]
 52%|█████▏    | 355/683 [12:30:20<11:22:44, 124.89s/it]
                                                        
{'loss': 1.7059, 'learning_rate': 0.00016878216123499142, 'epoch': 0.52}

 52%|█████▏    | 355/683 [12:30:20<11:22:44, 124.89s/it]
 52%|█████▏    | 356/683 [12:32:30<11:28:09, 126.27s/it]
                                                        
{'loss': 1.7652, 'learning_rate': 0.00016826758147512862, 'epoch': 0.52}

 52%|█████▏    | 356/683 [12:32:30<11:28:09, 126.27s/it]
 52%|█████▏    | 357/683 [12:34:35<11:24:41, 126.02s/it]
                                                        
{'loss': 1.6931, 'learning_rate': 0.00016775300171526585, 'epoch': 0.52}

 52%|█████▏    | 357/683 [12:34:35<11:24:41, 126.02s/it]
 52%|█████▏    | 358/683 [12:36:45<11:28:47, 127.16s/it]
                                                        
{'loss': 1.7383, 'learning_rate': 0.00016723842195540305, 'epoch': 0.52}

 52%|█████▏    | 358/683 [12:36:45<11:28:47, 127.16s/it]
 53%|█████▎    | 359/683 [12:38:50<11:22:44, 126.43s/it]
                                                        
{'loss': 1.7791, 'learning_rate': 0.0001667238421955403, 'epoch': 0.53}

 53%|█████▎    | 359/683 [12:38:50<11:22:44, 126.43s/it]
 53%|█████▎    | 360/683 [12:41:02<11:29:56, 128.16s/it]
                                                        
{'loss': 1.7412, 'learning_rate': 0.00016620926243567753, 'epoch': 0.53}

 53%|█████▎    | 360/683 [12:41:02<11:29:56, 128.16s/it]
 53%|█████▎    | 361/683 [12:43:04<11:16:58, 126.14s/it]
                                                        
{'loss': 1.7253, 'learning_rate': 0.00016569468267581473, 'epoch': 0.53}

 53%|█████▎    | 361/683 [12:43:04<11:16:58, 126.14s/it]
 53%|█████▎    | 362/683 [12:45:07<11:10:59, 125.42s/it]
                                                        
{'loss': 1.8106, 'learning_rate': 0.00016518010291595198, 'epoch': 0.53}

 53%|█████▎    | 362/683 [12:45:07<11:10:59, 125.42s/it]
 53%|█████▎    | 363/683 [12:47:18<11:17:01, 126.94s/it]
                                                        
{'loss': 1.7371, 'learning_rate': 0.00016466552315608918, 'epoch': 0.53}

 53%|█████▎    | 363/683 [12:47:18<11:17:01, 126.94s/it]
 53%|█████▎    | 364/683 [12:49:26<11:17:31, 127.43s/it]
                                                        
{'loss': 1.7265, 'learning_rate': 0.0001641509433962264, 'epoch': 0.53}

 53%|█████▎    | 364/683 [12:49:26<11:17:31, 127.43s/it]
 53%|█████▎    | 365/683 [12:51:31<11:11:02, 126.61s/it]
                                                        
{'loss': 1.7597, 'learning_rate': 0.0001636363636363636, 'epoch': 0.53}

 53%|█████▎    | 365/683 [12:51:31<11:11:02, 126.61s/it]
 54%|█████▎    | 366/683 [12:53:44<11:18:47, 128.48s/it]
                                                        
{'loss': 1.7201, 'learning_rate': 0.00016312178387650086, 'epoch': 0.54}

 54%|█████▎    | 366/683 [12:53:44<11:18:47, 128.48s/it]
 54%|█████▎    | 367/683 [12:55:56<11:22:51, 129.66s/it]
                                                        
{'loss': 1.7743, 'learning_rate': 0.00016260720411663806, 'epoch': 0.54}

 54%|█████▎    | 367/683 [12:55:56<11:22:51, 129.66s/it]
 54%|█████▍    | 368/683 [12:58:05<11:19:01, 129.34s/it]
                                                        
{'loss': 1.7858, 'learning_rate': 0.00016209262435677528, 'epoch': 0.54}

 54%|█████▍    | 368/683 [12:58:05<11:19:01, 129.34s/it]
 54%|█████▍    | 369/683 [13:00:10<11:10:46, 128.17s/it]
                                                        
{'loss': 1.7414, 'learning_rate': 0.00016157804459691248, 'epoch': 0.54}

 54%|█████▍    | 369/683 [13:00:10<11:10:46, 128.17s/it]
 54%|█████▍    | 370/683 [13:02:13<10:59:29, 126.42s/it]
                                                        
{'loss': 1.7057, 'learning_rate': 0.00016106346483704974, 'epoch': 0.54}

 54%|█████▍    | 370/683 [13:02:13<10:59:29, 126.42s/it]
 54%|█████▍    | 371/683 [13:04:27<11:08:55, 128.64s/it]
                                                        
{'loss': 1.7273, 'learning_rate': 0.00016054888507718694, 'epoch': 0.54}

 54%|█████▍    | 371/683 [13:04:27<11:08:55, 128.64s/it]
 54%|█████▍    | 372/683 [13:06:32<11:02:03, 127.73s/it]
                                                        
{'loss': 1.7307, 'learning_rate': 0.00016003430531732416, 'epoch': 0.54}

 54%|█████▍    | 372/683 [13:06:32<11:02:03, 127.73s/it]
 55%|█████▍    | 373/683 [13:08:37<10:55:54, 126.95s/it]
                                                        
{'loss': 1.7646, 'learning_rate': 0.00015951972555746142, 'epoch': 0.55}

 55%|█████▍    | 373/683 [13:08:37<10:55:54, 126.95s/it]
 55%|█████▍    | 374/683 [13:10:50<11:02:30, 128.64s/it]
                                                        
{'loss': 1.7557, 'learning_rate': 0.00015900514579759862, 'epoch': 0.55}

 55%|█████▍    | 374/683 [13:10:50<11:02:30, 128.64s/it]/home/ubuntu/miniconda3/envs/h2ollm/lib/python3.10/site-packages/bitsandbytes-0.38.0.post2-py3.10.egg/bitsandbytes/autograd/_functions.py:318: UserWarning: MatMul8bitLt: inputs will be cast from torch.float32 to float16 during quantization
  warnings.warn(f"MatMul8bitLt: inputs will be cast from {A.dtype} to float16 during quantization")

 55%|█████▍    | 375/683 [13:13:00<11:02:35, 129.08s/it]
                                                        
{'loss': 1.7774, 'learning_rate': 0.00015849056603773584, 'epoch': 0.55}

 55%|█████▍    | 375/683 [13:13:00<11:02:35, 129.08s/it]
 55%|█████▌    | 376/683 [13:15:07<10:57:22, 128.48s/it]
                                                        
{'loss': 1.6666, 'learning_rate': 0.00015797598627787304, 'epoch': 0.55}

 55%|█████▌    | 376/683 [13:15:07<10:57:22, 128.48s/it]
 55%|█████▌    | 377/683 [13:17:11<10:48:13, 127.10s/it]
                                                        
{'loss': 1.7288, 'learning_rate': 0.0001574614065180103, 'epoch': 0.55}

 55%|█████▌    | 377/683 [13:17:11<10:48:13, 127.10s/it]
 55%|█████▌    | 378/683 [13:19:22<10:51:38, 128.19s/it]
                                                        
{'loss': 1.7964, 'learning_rate': 0.0001569468267581475, 'epoch': 0.55}

 55%|█████▌    | 378/683 [13:19:22<10:51:38, 128.19s/it]
 55%|█████▌    | 379/683 [13:21:25<10:42:35, 126.83s/it]
                                                        
{'loss': 1.6994, 'learning_rate': 0.00015643224699828472, 'epoch': 0.55}

 55%|█████▌    | 379/683 [13:21:25<10:42:35, 126.83s/it]
 56%|█████▌    | 380/683 [13:23:28<10:34:55, 125.73s/it]
                                                        
{'loss': 1.7081, 'learning_rate': 0.00015591766723842192, 'epoch': 0.56}

 56%|█████▌    | 380/683 [13:23:28<10:34:55, 125.73s/it]
 56%|█████▌    | 381/683 [13:25:37<10:36:34, 126.47s/it]
                                                        
{'loss': 1.7255, 'learning_rate': 0.00015540308747855918, 'epoch': 0.56}

 56%|█████▌    | 381/683 [13:25:37<10:36:34, 126.47s/it]
 56%|█████▌    | 382/683 [13:27:48<10:41:24, 127.86s/it]
                                                        
{'loss': 1.747, 'learning_rate': 0.00015488850771869638, 'epoch': 0.56}

 56%|█████▌    | 382/683 [13:27:48<10:41:24, 127.86s/it]
 56%|█████▌    | 383/683 [13:29:57<10:40:54, 128.18s/it]
                                                        
{'loss': 1.749, 'learning_rate': 0.0001543739279588336, 'epoch': 0.56}

 56%|█████▌    | 383/683 [13:29:57<10:40:54, 128.18s/it]
 56%|█████▌    | 384/683 [13:31:58<10:28:58, 126.22s/it]
                                                        
{'loss': 1.6919, 'learning_rate': 0.0001538593481989708, 'epoch': 0.56}

 56%|█████▌    | 384/683 [13:31:58<10:28:58, 126.22s/it]
 56%|█████▋    | 385/683 [13:34:06<10:28:52, 126.62s/it]
                                                        
{'loss': 1.6996, 'learning_rate': 0.00015334476843910805, 'epoch': 0.56}

 56%|█████▋    | 385/683 [13:34:06<10:28:52, 126.62s/it]
 57%|█████▋    | 386/683 [13:36:17<10:33:37, 128.01s/it]
                                                        
{'loss': 1.7852, 'learning_rate': 0.00015283018867924528, 'epoch': 0.56}

 57%|█████▋    | 386/683 [13:36:17<10:33:37, 128.01s/it]
 57%|█████▋    | 387/683 [13:38:20<10:23:43, 126.43s/it]
                                                        
{'loss': 1.763, 'learning_rate': 0.00015231560891938248, 'epoch': 0.57}

 57%|█████▋    | 387/683 [13:38:20<10:23:43, 126.43s/it]
 57%|█████▋    | 388/683 [13:40:29<10:25:12, 127.16s/it]
                                                        
{'loss': 1.6814, 'learning_rate': 0.00015180102915951973, 'epoch': 0.57}

 57%|█████▋    | 388/683 [13:40:29<10:25:12, 127.16s/it]
 57%|█████▋    | 389/683 [13:42:38<10:26:03, 127.77s/it]
                                                        
{'loss': 1.6782, 'learning_rate': 0.00015128644939965693, 'epoch': 0.57}

 57%|█████▋    | 389/683 [13:42:38<10:26:03, 127.77s/it]
 57%|█████▋    | 390/683 [13:44:46<10:24:33, 127.90s/it]
                                                        
{'loss': 1.7172, 'learning_rate': 0.00015077186963979416, 'epoch': 0.57}

 57%|█████▋    | 390/683 [13:44:46<10:24:33, 127.90s/it]
 57%|█████▋    | 391/683 [13:46:48<10:13:51, 126.14s/it]
                                                        
{'loss': 1.8101, 'learning_rate': 0.00015025728987993136, 'epoch': 0.57}

 57%|█████▋    | 391/683 [13:46:48<10:13:51, 126.14s/it]
 57%|█████▋    | 392/683 [13:49:00<10:19:49, 127.80s/it]
                                                        
{'loss': 1.7498, 'learning_rate': 0.0001497427101200686, 'epoch': 0.57}

 57%|█████▋    | 392/683 [13:49:00<10:19:49, 127.80s/it]
 58%|█████▊    | 393/683 [13:51:08<10:17:54, 127.84s/it]
                                                        
{'loss': 1.797, 'learning_rate': 0.0001492281303602058, 'epoch': 0.58}

 58%|█████▊    | 393/683 [13:51:08<10:17:54, 127.84s/it]
 58%|█████▊    | 394/683 [13:53:18<10:19:38, 128.64s/it]
                                                        
{'loss': 1.6842, 'learning_rate': 0.00014871355060034304, 'epoch': 0.58}

 58%|█████▊    | 394/683 [13:53:18<10:19:38, 128.64s/it]
 58%|█████▊    | 395/683 [13:55:25<10:14:52, 128.10s/it]
                                                        
{'loss': 1.7393, 'learning_rate': 0.00014819897084048027, 'epoch': 0.58}

 58%|█████▊    | 395/683 [13:55:25<10:14:52, 128.10s/it]
 58%|█████▊    | 396/683 [13:57:27<10:03:24, 126.15s/it]
                                                        
{'loss': 1.7307, 'learning_rate': 0.00014768439108061747, 'epoch': 0.58}

 58%|█████▊    | 396/683 [13:57:27<10:03:24, 126.15s/it]
 58%|█████▊    | 397/683 [13:59:31<9:58:58, 125.66s/it] 
                                                       
{'loss': 1.7297, 'learning_rate': 0.0001471698113207547, 'epoch': 0.58}

 58%|█████▊    | 397/683 [13:59:31<9:58:58, 125.66s/it]
 58%|█████▊    | 398/683 [14:01:40<10:01:06, 126.55s/it]
                                                        
{'loss': 1.7213, 'learning_rate': 0.00014665523156089195, 'epoch': 0.58}

 58%|█████▊    | 398/683 [14:01:40<10:01:06, 126.55s/it]
 58%|█████▊    | 399/683 [14:03:38<9:46:25, 123.89s/it] 
                                                       
{'loss': 1.7119, 'learning_rate': 0.00014614065180102915, 'epoch': 0.58}

 58%|█████▊    | 399/683 [14:03:38<9:46:25, 123.89s/it]
 59%|█████▊    | 400/683 [14:05:48<9:54:19, 126.00s/it]
                                                       
{'loss': 1.6966, 'learning_rate': 0.00014562607204116637, 'epoch': 0.59}

 59%|█████▊    | 400/683 [14:05:48<9:54:19, 126.00s/it]
 59%|█████▊    | 401/683 [14:07:56<9:54:12, 126.43s/it]
                                                       
{'loss': 1.7354, 'learning_rate': 0.0001451114922813036, 'epoch': 0.59}

 59%|█████▊    | 401/683 [14:07:56<9:54:12, 126.43s/it]
 59%|█████▉    | 402/683 [14:10:08<10:00:18, 128.18s/it]
                                                        
{'loss': 1.7703, 'learning_rate': 0.00014459691252144083, 'epoch': 0.59}

 59%|█████▉    | 402/683 [14:10:08<10:00:18, 128.18s/it]
 59%|█████▉    | 403/683 [14:12:11<9:50:55, 126.63s/it] 
                                                       
{'loss': 1.7017, 'learning_rate': 0.00014408233276157802, 'epoch': 0.59}

 59%|█████▉    | 403/683 [14:12:11<9:50:55, 126.63s/it]
 59%|█████▉    | 404/683 [14:14:17<9:48:22, 126.53s/it]
                                                       
{'loss': 1.7611, 'learning_rate': 0.00014356775300171525, 'epoch': 0.59}

 59%|█████▉    | 404/683 [14:14:17<9:48:22, 126.53s/it]
 59%|█████▉    | 405/683 [14:16:26<9:49:00, 127.13s/it]
                                                       
{'loss': 1.7321, 'learning_rate': 0.00014305317324185248, 'epoch': 0.59}

 59%|█████▉    | 405/683 [14:16:26<9:49:00, 127.13s/it]
 59%|█████▉    | 406/683 [14:18:33<9:46:09, 126.97s/it]
                                                       
{'loss': 1.729, 'learning_rate': 0.0001425385934819897, 'epoch': 0.59}

 59%|█████▉    | 406/683 [14:18:33<9:46:09, 126.97s/it]
 60%|█████▉    | 407/683 [14:20:43<9:48:15, 127.88s/it]
                                                       
{'loss': 1.7844, 'learning_rate': 0.0001420240137221269, 'epoch': 0.6}

 60%|█████▉    | 407/683 [14:20:43<9:48:15, 127.88s/it]
 60%|█████▉    | 408/683 [14:22:47<9:40:58, 126.76s/it]
                                                       
{'loss': 1.7808, 'learning_rate': 0.00014150943396226413, 'epoch': 0.6}

 60%|█████▉    | 408/683 [14:22:47<9:40:58, 126.76s/it]/home/ubuntu/miniconda3/envs/h2ollm/lib/python3.10/site-packages/bitsandbytes-0.38.0.post2-py3.10.egg/bitsandbytes/autograd/_functions.py:318: UserWarning: MatMul8bitLt: inputs will be cast from torch.float32 to float16 during quantization
  warnings.warn(f"MatMul8bitLt: inputs will be cast from {A.dtype} to float16 during quantization")

 60%|█████▉    | 409/683 [14:24:54<9:39:12, 126.84s/it]
                                                       
{'loss': 1.7314, 'learning_rate': 0.00014099485420240136, 'epoch': 0.6}

 60%|█████▉    | 409/683 [14:24:54<9:39:12, 126.84s/it]
 60%|██████    | 410/683 [14:26:55<9:28:55, 125.04s/it]
                                                       
{'loss': 1.748, 'learning_rate': 0.00014048027444253858, 'epoch': 0.6}

 60%|██████    | 410/683 [14:26:55<9:28:55, 125.04s/it]
 60%|██████    | 411/683 [14:29:05<9:34:24, 126.71s/it]
                                                       
{'loss': 1.6963, 'learning_rate': 0.0001399656946826758, 'epoch': 0.6}

 60%|██████    | 411/683 [14:29:05<9:34:24, 126.71s/it]
 60%|██████    | 412/683 [14:31:13<9:33:32, 126.98s/it]
                                                       
{'loss': 1.7294, 'learning_rate': 0.00013945111492281304, 'epoch': 0.6}

 60%|██████    | 412/683 [14:31:13<9:33:32, 126.98s/it]
 60%|██████    | 413/683 [14:33:17<9:27:44, 126.16s/it]
                                                       
{'loss': 1.735, 'learning_rate': 0.00013893653516295026, 'epoch': 0.6}

 60%|██████    | 413/683 [14:33:17<9:27:44, 126.16s/it]
 61%|██████    | 414/683 [14:35:28<9:32:02, 127.59s/it]
                                                       
{'loss': 1.6932, 'learning_rate': 0.00013842195540308746, 'epoch': 0.61}

 61%|██████    | 414/683 [14:35:28<9:32:02, 127.59s/it]
 61%|██████    | 415/683 [14:37:34<9:27:50, 127.13s/it]
                                                       
{'loss': 1.7498, 'learning_rate': 0.0001379073756432247, 'epoch': 0.61}

 61%|██████    | 415/683 [14:37:34<9:27:50, 127.13s/it]
 61%|██████    | 416/683 [14:39:42<9:27:18, 127.48s/it]
                                                       
{'loss': 1.7453, 'learning_rate': 0.00013739279588336192, 'epoch': 0.61}

 61%|██████    | 416/683 [14:39:42<9:27:18, 127.48s/it]
 61%|██████    | 417/683 [14:41:45<9:19:00, 126.09s/it]
                                                       
{'loss': 1.789, 'learning_rate': 0.00013687821612349914, 'epoch': 0.61}

 61%|██████    | 417/683 [14:41:45<9:19:00, 126.09s/it]
 61%|██████    | 418/683 [14:43:50<9:14:33, 125.56s/it]
                                                       
{'loss': 1.7455, 'learning_rate': 0.00013636363636363634, 'epoch': 0.61}

 61%|██████    | 418/683 [14:43:50<9:14:33, 125.56s/it]
 61%|██████▏   | 419/683 [14:45:51<9:07:02, 124.33s/it]
                                                       
{'loss': 1.6993, 'learning_rate': 0.00013584905660377357, 'epoch': 0.61}

 61%|██████▏   | 419/683 [14:45:51<9:07:02, 124.33s/it]
 61%|██████▏   | 420/683 [14:48:00<9:10:34, 125.61s/it]
                                                       
{'loss': 1.7554, 'learning_rate': 0.0001353344768439108, 'epoch': 0.61}

 61%|██████▏   | 420/683 [14:48:00<9:10:34, 125.61s/it]
 62%|██████▏   | 421/683 [14:50:02<9:04:43, 124.75s/it]
                                                       
{'loss': 1.6896, 'learning_rate': 0.00013481989708404802, 'epoch': 0.62}

 62%|██████▏   | 421/683 [14:50:02<9:04:43, 124.75s/it]
 62%|██████▏   | 422/683 [14:52:09<9:04:45, 125.23s/it]
                                                       
{'loss': 1.7623, 'learning_rate': 0.00013430531732418522, 'epoch': 0.62}

 62%|██████▏   | 422/683 [14:52:09<9:04:45, 125.23s/it]
 62%|██████▏   | 423/683 [14:54:17<9:07:05, 126.25s/it]
                                                       
{'loss': 1.7315, 'learning_rate': 0.00013379073756432245, 'epoch': 0.62}

 62%|██████▏   | 423/683 [14:54:17<9:07:05, 126.25s/it]
 62%|██████▏   | 424/683 [14:56:31<9:14:10, 128.38s/it]
                                                       
{'loss': 1.7451, 'learning_rate': 0.0001332761578044597, 'epoch': 0.62}

 62%|██████▏   | 424/683 [14:56:31<9:14:10, 128.38s/it]
 62%|██████▏   | 425/683 [14:58:44<9:17:59, 129.77s/it]
                                                       
{'loss': 1.7263, 'learning_rate': 0.0001327615780445969, 'epoch': 0.62}

 62%|██████▏   | 425/683 [14:58:44<9:17:59, 129.77s/it]
 62%|██████▏   | 426/683 [15:00:46<9:06:22, 127.56s/it]
                                                       
{'loss': 1.7311, 'learning_rate': 0.00013224699828473413, 'epoch': 0.62}

 62%|██████▏   | 426/683 [15:00:46<9:06:22, 127.56s/it]
 63%|██████▎   | 427/683 [15:02:56<9:07:04, 128.22s/it]
                                                       
{'loss': 1.7394, 'learning_rate': 0.00013173241852487135, 'epoch': 0.62}

 63%|██████▎   | 427/683 [15:02:56<9:07:04, 128.22s/it]
 63%|██████▎   | 428/683 [15:05:08<9:09:35, 129.32s/it]
                                                       
{'loss': 1.7192, 'learning_rate': 0.00013121783876500858, 'epoch': 0.63}

 63%|██████▎   | 428/683 [15:05:08<9:09:35, 129.32s/it]
 63%|██████▎   | 429/683 [15:07:18<9:09:13, 129.74s/it]
                                                       
{'loss': 1.7807, 'learning_rate': 0.00013070325900514578, 'epoch': 0.63}

 63%|██████▎   | 429/683 [15:07:18<9:09:13, 129.74s/it]
 63%|██████▎   | 430/683 [15:09:15<8:50:20, 125.77s/it]
                                                       
{'loss': 1.6819, 'learning_rate': 0.000130188679245283, 'epoch': 0.63}

 63%|██████▎   | 430/683 [15:09:15<8:50:20, 125.77s/it]
 63%|██████▎   | 431/683 [15:11:15<8:41:12, 124.10s/it]
                                                       
{'loss': 1.7519, 'learning_rate': 0.00012967409948542023, 'epoch': 0.63}

 63%|██████▎   | 431/683 [15:11:15<8:41:12, 124.10s/it]
 63%|██████▎   | 432/683 [15:13:20<8:39:50, 124.27s/it]
                                                       
{'loss': 1.7422, 'learning_rate': 0.00012915951972555746, 'epoch': 0.63}

 63%|██████▎   | 432/683 [15:13:20<8:39:50, 124.27s/it]
 63%|██████▎   | 433/683 [15:15:26<8:40:30, 124.92s/it]
                                                       
{'loss': 1.7051, 'learning_rate': 0.00012864493996569466, 'epoch': 0.63}

 63%|██████▎   | 433/683 [15:15:26<8:40:30, 124.92s/it]
 64%|██████▎   | 434/683 [15:17:35<8:43:48, 126.22s/it]
                                                       
{'loss': 1.7312, 'learning_rate': 0.00012813036020583189, 'epoch': 0.64}

 64%|██████▎   | 434/683 [15:17:36<8:43:48, 126.22s/it]
 64%|██████▎   | 435/683 [15:19:32<8:30:03, 123.40s/it]
                                                       
{'loss': 1.6944, 'learning_rate': 0.0001276157804459691, 'epoch': 0.64}

 64%|██████▎   | 435/683 [15:19:32<8:30:03, 123.40s/it]
 64%|██████▍   | 436/683 [15:21:37<8:29:11, 123.69s/it]
                                                       
{'loss': 1.7888, 'learning_rate': 0.00012710120068610634, 'epoch': 0.64}

 64%|██████▍   | 436/683 [15:21:37<8:29:11, 123.69s/it]
 64%|██████▍   | 437/683 [15:23:49<8:37:44, 126.28s/it]
                                                       
{'loss': 1.7656, 'learning_rate': 0.00012658662092624357, 'epoch': 0.64}

 64%|██████▍   | 437/683 [15:23:49<8:37:44, 126.28s/it]
 64%|██████▍   | 438/683 [15:25:55<8:35:34, 126.26s/it]
                                                       
{'loss': 1.7506, 'learning_rate': 0.00012607204116638076, 'epoch': 0.64}

 64%|██████▍   | 438/683 [15:25:55<8:35:34, 126.26s/it]
 64%|██████▍   | 439/683 [15:28:04<8:36:41, 127.06s/it]
                                                       
{'loss': 1.7901, 'learning_rate': 0.00012555746140651802, 'epoch': 0.64}

 64%|██████▍   | 439/683 [15:28:04<8:36:41, 127.06s/it]
 64%|██████▍   | 440/683 [15:30:18<8:43:27, 129.25s/it]
                                                       
{'loss': 1.7142, 'learning_rate': 0.00012504288164665522, 'epoch': 0.64}

 64%|██████▍   | 440/683 [15:30:19<8:43:27, 129.25s/it]
 65%|██████▍   | 441/683 [15:32:27<8:40:08, 128.96s/it]
                                                       
{'loss': 1.7335, 'learning_rate': 0.00012452830188679244, 'epoch': 0.65}

 65%|██████▍   | 441/683 [15:32:27<8:40:08, 128.96s/it]
 65%|██████▍   | 442/683 [15:34:33<8:34:18, 128.04s/it]
                                                       
{'loss': 1.7443, 'learning_rate': 0.00012401372212692967, 'epoch': 0.65}

 65%|██████▍   | 442/683 [15:34:33<8:34:18, 128.04s/it]/home/ubuntu/miniconda3/envs/h2ollm/lib/python3.10/site-packages/bitsandbytes-0.38.0.post2-py3.10.egg/bitsandbytes/autograd/_functions.py:318: UserWarning: MatMul8bitLt: inputs will be cast from torch.float32 to float16 during quantization
  warnings.warn(f"MatMul8bitLt: inputs will be cast from {A.dtype} to float16 during quantization")

 65%|██████▍   | 443/683 [15:36:39<8:29:58, 127.49s/it]
                                                       
{'loss': 1.7683, 'learning_rate': 0.0001234991423670669, 'epoch': 0.65}

 65%|██████▍   | 443/683 [15:36:39<8:29:58, 127.49s/it]
 65%|██████▌   | 444/683 [15:38:46<8:26:52, 127.25s/it]
                                                       
{'loss': 1.7314, 'learning_rate': 0.0001229845626072041, 'epoch': 0.65}

 65%|██████▌   | 444/683 [15:38:46<8:26:52, 127.25s/it]
 65%|██████▌   | 445/683 [15:40:48<8:18:27, 125.66s/it]
                                                       
{'loss': 1.7687, 'learning_rate': 0.00012246998284734132, 'epoch': 0.65}

 65%|██████▌   | 445/683 [15:40:48<8:18:27, 125.66s/it]
 65%|██████▌   | 446/683 [15:42:57<8:20:27, 126.70s/it]
                                                       
{'loss': 1.7404, 'learning_rate': 0.00012195540308747854, 'epoch': 0.65}

 65%|██████▌   | 446/683 [15:42:57<8:20:27, 126.70s/it]
 65%|██████▌   | 447/683 [15:44:59<8:13:38, 125.50s/it]
                                                       
{'loss': 1.7322, 'learning_rate': 0.00012144082332761578, 'epoch': 0.65}

 65%|██████▌   | 447/683 [15:44:59<8:13:38, 125.50s/it]
 66%|██████▌   | 448/683 [15:47:02<8:08:09, 124.64s/it]
                                                       
{'loss': 1.7203, 'learning_rate': 0.00012092624356775299, 'epoch': 0.66}

 66%|██████▌   | 448/683 [15:47:02<8:08:09, 124.64s/it]
 66%|██████▌   | 449/683 [15:49:05<8:04:15, 124.17s/it]
                                                       
{'loss': 1.71, 'learning_rate': 0.00012041166380789022, 'epoch': 0.66}

 66%|██████▌   | 449/683 [15:49:05<8:04:15, 124.17s/it]
 66%|██████▌   | 450/683 [15:51:15<8:09:00, 125.93s/it]
                                                       
{'loss': 1.7486, 'learning_rate': 0.00011989708404802744, 'epoch': 0.66}

 66%|██████▌   | 450/683 [15:51:15<8:09:00, 125.93s/it]
 66%|██████▌   | 451/683 [15:53:24<8:10:05, 126.75s/it]
                                                       
{'loss': 1.7535, 'learning_rate': 0.00011938250428816466, 'epoch': 0.66}

 66%|██████▌   | 451/683 [15:53:24<8:10:05, 126.75s/it]
 66%|██████▌   | 452/683 [15:55:33<8:10:23, 127.38s/it]
                                                       
{'loss': 1.7122, 'learning_rate': 0.00011886792452830188, 'epoch': 0.66}

 66%|██████▌   | 452/683 [15:55:33<8:10:23, 127.38s/it]
 66%|██████▋   | 453/683 [15:57:36<8:04:11, 126.31s/it]
                                                       
{'loss': 1.6976, 'learning_rate': 0.0001183533447684391, 'epoch': 0.66}

 66%|██████▋   | 453/683 [15:57:36<8:04:11, 126.31s/it]
 66%|██████▋   | 454/683 [15:59:46<8:06:01, 127.34s/it]
                                                       
{'loss': 1.8049, 'learning_rate': 0.00011783876500857632, 'epoch': 0.66}

 66%|██████▋   | 454/683 [15:59:46<8:06:01, 127.34s/it]
 67%|██████▋   | 455/683 [16:01:57<8:08:25, 128.53s/it]
                                                       
{'loss': 1.7307, 'learning_rate': 0.00011732418524871354, 'epoch': 0.67}

 67%|██████▋   | 455/683 [16:01:57<8:08:25, 128.53s/it]
 67%|██████▋   | 456/683 [16:04:07<8:07:16, 128.80s/it]
                                                       
{'loss': 1.7385, 'learning_rate': 0.00011680960548885076, 'epoch': 0.67}

 67%|██████▋   | 456/683 [16:04:07<8:07:16, 128.80s/it]
 67%|██████▋   | 457/683 [16:06:21<8:10:49, 130.31s/it]
                                                       
{'loss': 1.7537, 'learning_rate': 0.00011629502572898797, 'epoch': 0.67}

 67%|██████▋   | 457/683 [16:06:21<8:10:49, 130.31s/it]
 67%|██████▋   | 458/683 [16:08:23<7:59:46, 127.94s/it]
                                                       
{'loss': 1.7122, 'learning_rate': 0.0001157804459691252, 'epoch': 0.67}

 67%|██████▋   | 458/683 [16:08:23<7:59:46, 127.94s/it]
 67%|██████▋   | 459/683 [16:10:26<7:52:11, 126.48s/it]
                                                       
{'loss': 1.718, 'learning_rate': 0.00011526586620926241, 'epoch': 0.67}

 67%|██████▋   | 459/683 [16:10:26<7:52:11, 126.48s/it]
 67%|██████▋   | 460/683 [16:12:36<7:53:48, 127.48s/it]
                                                       
{'loss': 1.7371, 'learning_rate': 0.00011475128644939965, 'epoch': 0.67}

 67%|██████▋   | 460/683 [16:12:36<7:53:48, 127.48s/it]
 67%|██████▋   | 461/683 [16:14:44<7:52:14, 127.63s/it]
                                                       
{'loss': 1.7176, 'learning_rate': 0.00011423670668953687, 'epoch': 0.67}

 67%|██████▋   | 461/683 [16:14:44<7:52:14, 127.63s/it]
 68%|██████▊   | 462/683 [16:16:45<7:42:28, 125.56s/it]
                                                       
{'loss': 1.7995, 'learning_rate': 0.0001137221269296741, 'epoch': 0.68}

 68%|██████▊   | 462/683 [16:16:45<7:42:28, 125.56s/it]
 68%|██████▊   | 463/683 [16:18:46<7:35:35, 124.25s/it]
                                                       
{'loss': 1.7087, 'learning_rate': 0.00011320754716981132, 'epoch': 0.68}

 68%|██████▊   | 463/683 [16:18:46<7:35:35, 124.25s/it]
 68%|██████▊   | 464/683 [16:20:56<7:39:36, 125.92s/it]
                                                       
{'loss': 1.7178, 'learning_rate': 0.00011269296740994853, 'epoch': 0.68}

 68%|██████▊   | 464/683 [16:20:56<7:39:36, 125.92s/it]
 68%|██████▊   | 465/683 [16:23:06<7:41:48, 127.10s/it]
                                                       
{'loss': 1.6972, 'learning_rate': 0.00011217838765008576, 'epoch': 0.68}

 68%|██████▊   | 465/683 [16:23:06<7:41:48, 127.10s/it]
 68%|██████▊   | 466/683 [16:25:09<7:35:12, 125.86s/it]
                                                       
{'loss': 1.7688, 'learning_rate': 0.00011166380789022297, 'epoch': 0.68}

 68%|██████▊   | 466/683 [16:25:09<7:35:12, 125.86s/it]
 68%|██████▊   | 467/683 [16:27:19<7:38:09, 127.27s/it]
                                                       
{'loss': 1.7678, 'learning_rate': 0.0001111492281303602, 'epoch': 0.68}

 68%|██████▊   | 467/683 [16:27:19<7:38:09, 127.27s/it]
 69%|██████▊   | 468/683 [16:29:28<7:38:14, 127.88s/it]
                                                       
{'loss': 1.6651, 'learning_rate': 0.00011063464837049741, 'epoch': 0.68}

 69%|██████▊   | 468/683 [16:29:28<7:38:14, 127.88s/it]
 69%|██████▊   | 469/683 [16:31:32<7:31:51, 126.69s/it]
                                                       
{'loss': 1.687, 'learning_rate': 0.00011012006861063464, 'epoch': 0.69}

 69%|██████▊   | 469/683 [16:31:32<7:31:51, 126.69s/it]
 69%|██████▉   | 470/683 [16:33:36<7:26:08, 125.68s/it]
                                                       
{'loss': 1.7356, 'learning_rate': 0.00010960548885077185, 'epoch': 0.69}

 69%|██████▉   | 470/683 [16:33:36<7:26:08, 125.68s/it]
 69%|██████▉   | 471/683 [16:35:44<7:27:16, 126.59s/it]
                                                       
{'loss': 1.7336, 'learning_rate': 0.00010909090909090908, 'epoch': 0.69}

 69%|██████▉   | 471/683 [16:35:44<7:27:16, 126.59s/it]
 69%|██████▉   | 472/683 [16:37:53<7:27:16, 127.19s/it]
                                                       
{'loss': 1.6999, 'learning_rate': 0.00010857632933104629, 'epoch': 0.69}

 69%|██████▉   | 472/683 [16:37:53<7:27:16, 127.19s/it]
 69%|██████▉   | 473/683 [16:40:00<7:25:04, 127.17s/it]
                                                       
{'loss': 1.7295, 'learning_rate': 0.00010806174957118353, 'epoch': 0.69}

 69%|██████▉   | 473/683 [16:40:00<7:25:04, 127.17s/it]
 69%|██████▉   | 474/683 [16:42:10<7:25:39, 127.94s/it]
                                                       
{'loss': 1.756, 'learning_rate': 0.00010754716981132073, 'epoch': 0.69}

 69%|██████▉   | 474/683 [16:42:10<7:25:39, 127.94s/it]
 70%|██████▉   | 475/683 [16:44:19<7:24:44, 128.29s/it]
                                                       
{'loss': 1.6909, 'learning_rate': 0.00010703259005145797, 'epoch': 0.7}

 70%|██████▉   | 475/683 [16:44:19<7:24:44, 128.29s/it]
 70%|██████▉   | 476/683 [16:46:29<7:24:21, 128.80s/it]
                                                       
{'loss': 1.7029, 'learning_rate': 0.0001065180102915952, 'epoch': 0.7}

 70%|██████▉   | 476/683 [16:46:29<7:24:21, 128.80s/it]/home/ubuntu/miniconda3/envs/h2ollm/lib/python3.10/site-packages/bitsandbytes-0.38.0.post2-py3.10.egg/bitsandbytes/autograd/_functions.py:318: UserWarning: MatMul8bitLt: inputs will be cast from torch.float32 to float16 during quantization
  warnings.warn(f"MatMul8bitLt: inputs will be cast from {A.dtype} to float16 during quantization")

 70%|██████▉   | 477/683 [16:48:36<7:20:55, 128.42s/it]
                                                       
{'loss': 1.7238, 'learning_rate': 0.00010600343053173241, 'epoch': 0.7}

 70%|██████▉   | 477/683 [16:48:36<7:20:55, 128.42s/it]
 70%|██████▉   | 478/683 [16:50:44<7:17:30, 128.05s/it]
                                                       
{'loss': 1.7774, 'learning_rate': 0.00010548885077186964, 'epoch': 0.7}

 70%|██████▉   | 478/683 [16:50:44<7:17:30, 128.05s/it]
 70%|███████   | 479/683 [16:52:48<7:11:23, 126.88s/it]
                                                       
{'loss': 1.7292, 'learning_rate': 0.00010497427101200685, 'epoch': 0.7}

 70%|███████   | 479/683 [16:52:48<7:11:23, 126.88s/it]
 70%|███████   | 480/683 [16:54:57<7:11:42, 127.60s/it]
                                                       
{'loss': 1.7647, 'learning_rate': 0.00010445969125214408, 'epoch': 0.7}

 70%|███████   | 480/683 [16:54:57<7:11:42, 127.60s/it]
 70%|███████   | 481/683 [16:57:03<7:08:00, 127.13s/it]
                                                       
{'loss': 1.7391, 'learning_rate': 0.00010394511149228129, 'epoch': 0.7}

 70%|███████   | 481/683 [16:57:03<7:08:00, 127.13s/it]
 71%|███████   | 482/683 [16:59:08<7:03:17, 126.36s/it]
                                                       
{'loss': 1.7368, 'learning_rate': 0.00010343053173241852, 'epoch': 0.71}

 71%|███████   | 482/683 [16:59:08<7:03:17, 126.36s/it]
 71%|███████   | 483/683 [17:01:15<7:02:18, 126.69s/it]
                                                       
{'loss': 1.7158, 'learning_rate': 0.00010291595197255573, 'epoch': 0.71}

 71%|███████   | 483/683 [17:01:15<7:02:18, 126.69s/it]
 71%|███████   | 484/683 [17:03:24<7:02:28, 127.38s/it]
                                                       
{'loss': 1.7481, 'learning_rate': 0.00010240137221269296, 'epoch': 0.71}

 71%|███████   | 484/683 [17:03:24<7:02:28, 127.38s/it]
 71%|███████   | 485/683 [17:05:41<7:09:27, 130.14s/it]
                                                       
{'loss': 1.7441, 'learning_rate': 0.00010188679245283017, 'epoch': 0.71}

 71%|███████   | 485/683 [17:05:41<7:09:27, 130.14s/it]
 71%|███████   | 486/683 [17:07:52<7:08:45, 130.58s/it]
                                                       
{'loss': 1.7335, 'learning_rate': 0.0001013722126929674, 'epoch': 0.71}

 71%|███████   | 486/683 [17:07:52<7:08:45, 130.58s/it]
 71%|███████▏  | 487/683 [17:09:58<7:01:44, 129.10s/it]
                                                       
{'loss': 1.6974, 'learning_rate': 0.00010085763293310461, 'epoch': 0.71}

 71%|███████▏  | 487/683 [17:09:58<7:01:44, 129.10s/it]
 71%|███████▏  | 488/683 [17:12:06<6:58:39, 128.82s/it]
                                                       
{'loss': 1.7107, 'learning_rate': 0.00010034305317324185, 'epoch': 0.71}

 71%|███████▏  | 488/683 [17:12:06<6:58:39, 128.82s/it]
 72%|███████▏  | 489/683 [17:14:19<7:00:33, 130.07s/it]
                                                       
{'loss': 1.7327, 'learning_rate': 9.982847341337908e-05, 'epoch': 0.72}

 72%|███████▏  | 489/683 [17:14:19<7:00:33, 130.07s/it]
 72%|███████▏  | 490/683 [17:16:25<6:54:27, 128.84s/it]
                                                       
{'loss': 1.7837, 'learning_rate': 9.931389365351629e-05, 'epoch': 0.72}

 72%|███████▏  | 490/683 [17:16:25<6:54:27, 128.84s/it]
 72%|███████▏  | 491/683 [17:18:30<6:48:37, 127.69s/it]
                                                       
{'loss': 1.7429, 'learning_rate': 9.879931389365352e-05, 'epoch': 0.72}

 72%|███████▏  | 491/683 [17:18:30<6:48:37, 127.69s/it]
 72%|███████▏  | 492/683 [17:20:34<6:42:27, 126.43s/it]
                                                       
{'loss': 1.7492, 'learning_rate': 9.828473413379073e-05, 'epoch': 0.72}

 72%|███████▏  | 492/683 [17:20:34<6:42:27, 126.43s/it]
 72%|███████▏  | 493/683 [17:22:45<6:45:29, 128.05s/it]
                                                       
{'loss': 1.7055, 'learning_rate': 9.777015437392795e-05, 'epoch': 0.72}

 72%|███████▏  | 493/683 [17:22:45<6:45:29, 128.05s/it]
 72%|███████▏  | 494/683 [17:24:50<6:39:53, 126.95s/it]
                                                       
{'loss': 1.7126, 'learning_rate': 9.725557461406517e-05, 'epoch': 0.72}

 72%|███████▏  | 494/683 [17:24:50<6:39:53, 126.95s/it]
 72%|███████▏  | 495/683 [17:26:59<6:39:41, 127.56s/it]
                                                       
{'loss': 1.7981, 'learning_rate': 9.67409948542024e-05, 'epoch': 0.72}

 72%|███████▏  | 495/683 [17:26:59<6:39:41, 127.56s/it]
 73%|███████▎  | 496/683 [17:29:08<6:38:43, 127.94s/it]
                                                       
{'loss': 1.8003, 'learning_rate': 9.622641509433961e-05, 'epoch': 0.73}

 73%|███████▎  | 496/683 [17:29:08<6:38:43, 127.94s/it]
 73%|███████▎  | 497/683 [17:31:11<6:32:18, 126.55s/it]
                                                       
{'loss': 1.6889, 'learning_rate': 9.571183533447683e-05, 'epoch': 0.73}

 73%|███████▎  | 497/683 [17:31:11<6:32:18, 126.55s/it]
 73%|███████▎  | 498/683 [17:33:23<6:35:29, 128.27s/it]
                                                       
{'loss': 1.7474, 'learning_rate': 9.519725557461405e-05, 'epoch': 0.73}

 73%|███████▎  | 498/683 [17:33:23<6:35:29, 128.27s/it]
 73%|███████▎  | 499/683 [17:35:31<6:33:06, 128.19s/it]
                                                       
{'loss': 1.7819, 'learning_rate': 9.468267581475127e-05, 'epoch': 0.73}

 73%|███████▎  | 499/683 [17:35:31<6:33:06, 128.19s/it]
 73%|███████▎  | 500/683 [17:37:38<6:29:53, 127.83s/it]
                                                       
{'loss': 1.7288, 'learning_rate': 9.416809605488849e-05, 'epoch': 0.73}

 73%|███████▎  | 500/683 [17:37:38<6:29:53, 127.83s/it]
 73%|███████▎  | 501/683 [17:39:51<6:31:51, 129.19s/it]
                                                       
{'loss': 1.7336, 'learning_rate': 9.365351629502573e-05, 'epoch': 0.73}

 73%|███████▎  | 501/683 [17:39:51<6:31:51, 129.19s/it]
 73%|███████▎  | 502/683 [17:41:55<6:25:09, 127.68s/it]
                                                       
{'loss': 1.7847, 'learning_rate': 9.313893653516295e-05, 'epoch': 0.73}

 73%|███████▎  | 502/683 [17:41:55<6:25:09, 127.68s/it]
 74%|███████▎  | 503/683 [17:44:07<6:27:23, 129.13s/it]
                                                       
{'loss': 1.7278, 'learning_rate': 9.262435677530017e-05, 'epoch': 0.74}

 74%|███████▎  | 503/683 [17:44:07<6:27:23, 129.13s/it]
 74%|███████▍  | 504/683 [17:46:10<6:19:11, 127.10s/it]
                                                       
{'loss': 1.6901, 'learning_rate': 9.210977701543739e-05, 'epoch': 0.74}

 74%|███████▍  | 504/683 [17:46:10<6:19:11, 127.10s/it]
 74%|███████▍  | 505/683 [17:48:21<6:21:20, 128.54s/it]
                                                       
{'loss': 1.7902, 'learning_rate': 9.15951972555746e-05, 'epoch': 0.74}

 74%|███████▍  | 505/683 [17:48:22<6:21:20, 128.54s/it]
 74%|███████▍  | 506/683 [17:50:27<6:16:52, 127.75s/it]
                                                       
{'loss': 1.7295, 'learning_rate': 9.108061749571183e-05, 'epoch': 0.74}

 74%|███████▍  | 506/683 [17:50:27<6:16:52, 127.75s/it]
 74%|███████▍  | 507/683 [17:52:33<6:13:00, 127.16s/it]
                                                       
{'loss': 1.7793, 'learning_rate': 9.056603773584905e-05, 'epoch': 0.74}

 74%|███████▍  | 507/683 [17:52:33<6:13:00, 127.16s/it]
 74%|███████▍  | 508/683 [17:54:39<6:09:41, 126.75s/it]
                                                       
{'loss': 1.7219, 'learning_rate': 9.005145797598627e-05, 'epoch': 0.74}

 74%|███████▍  | 508/683 [17:54:39<6:09:41, 126.75s/it]
 75%|███████▍  | 509/683 [17:56:47<6:08:45, 127.16s/it]
                                                       
{'loss': 1.7819, 'learning_rate': 8.953687821612349e-05, 'epoch': 0.74}

 75%|███████▍  | 509/683 [17:56:47<6:08:45, 127.16s/it]
 75%|███████▍  | 510/683 [17:58:58<6:09:49, 128.26s/it]
                                                       
{'loss': 1.7339, 'learning_rate': 8.902229845626071e-05, 'epoch': 0.75}

 75%|███████▍  | 510/683 [17:58:58<6:09:49, 128.26s/it]/home/ubuntu/miniconda3/envs/h2ollm/lib/python3.10/site-packages/bitsandbytes-0.38.0.post2-py3.10.egg/bitsandbytes/autograd/_functions.py:318: UserWarning: MatMul8bitLt: inputs will be cast from torch.float32 to float16 during quantization
  warnings.warn(f"MatMul8bitLt: inputs will be cast from {A.dtype} to float16 during quantization")

 75%|███████▍  | 511/683 [18:01:06<6:07:35, 128.23s/it]
                                                       
{'loss': 1.7344, 'learning_rate': 8.850771869639792e-05, 'epoch': 0.75}

 75%|███████▍  | 511/683 [18:01:06<6:07:35, 128.23s/it]
 75%|███████▍  | 512/683 [18:03:13<6:04:28, 127.89s/it]
                                                       
{'loss': 1.6737, 'learning_rate': 8.799313893653515e-05, 'epoch': 0.75}

 75%|███████▍  | 512/683 [18:03:13<6:04:28, 127.89s/it]
 75%|███████▌  | 513/683 [18:05:24<6:05:09, 128.88s/it]
                                                       
{'loss': 1.6936, 'learning_rate': 8.747855917667236e-05, 'epoch': 0.75}

 75%|███████▌  | 513/683 [18:05:24<6:05:09, 128.88s/it]
 75%|███████▌  | 514/683 [18:07:31<6:01:13, 128.24s/it]
                                                       
{'loss': 1.7301, 'learning_rate': 8.69639794168096e-05, 'epoch': 0.75}

 75%|███████▌  | 514/683 [18:07:31<6:01:13, 128.24s/it]
 75%|███████▌  | 515/683 [18:09:40<5:59:55, 128.54s/it]
                                                       
{'loss': 1.6991, 'learning_rate': 8.644939965694683e-05, 'epoch': 0.75}

 75%|███████▌  | 515/683 [18:09:40<5:59:55, 128.54s/it]
 76%|███████▌  | 516/683 [18:11:50<5:58:30, 128.81s/it]
                                                       
{'loss': 1.7081, 'learning_rate': 8.593481989708404e-05, 'epoch': 0.76}

 76%|███████▌  | 516/683 [18:11:50<5:58:30, 128.81s/it]
 76%|███████▌  | 517/683 [18:13:58<5:55:32, 128.51s/it]
                                                       
{'loss': 1.7398, 'learning_rate': 8.542024013722127e-05, 'epoch': 0.76}

 76%|███████▌  | 517/683 [18:13:58<5:55:32, 128.51s/it]
 76%|███████▌  | 518/683 [18:16:05<5:52:39, 128.24s/it]
                                                       
{'loss': 1.7446, 'learning_rate': 8.490566037735848e-05, 'epoch': 0.76}

 76%|███████▌  | 518/683 [18:16:05<5:52:39, 128.24s/it]
 76%|███████▌  | 519/683 [18:18:18<5:54:04, 129.54s/it]
                                                       
{'loss': 1.7257, 'learning_rate': 8.439108061749571e-05, 'epoch': 0.76}

 76%|███████▌  | 519/683 [18:18:18<5:54:04, 129.54s/it]
 76%|███████▌  | 520/683 [18:20:23<5:48:33, 128.30s/it]
                                                       
{'loss': 1.6923, 'learning_rate': 8.387650085763292e-05, 'epoch': 0.76}

 76%|███████▌  | 520/683 [18:20:23<5:48:33, 128.30s/it]
 76%|███████▋  | 521/683 [18:22:31<5:46:13, 128.23s/it]
                                                       
{'loss': 1.757, 'learning_rate': 8.336192109777015e-05, 'epoch': 0.76}

 76%|███████▋  | 521/683 [18:22:31<5:46:13, 128.23s/it]
 76%|███████▋  | 522/683 [18:24:34<5:39:52, 126.66s/it]
                                                       
{'loss': 1.7201, 'learning_rate': 8.284734133790736e-05, 'epoch': 0.76}

 76%|███████▋  | 522/683 [18:24:34<5:39:52, 126.66s/it]
 77%|███████▋  | 523/683 [18:26:40<5:37:22, 126.52s/it]
                                                       
{'loss': 1.7835, 'learning_rate': 8.233276157804459e-05, 'epoch': 0.77}

 77%|███████▋  | 523/683 [18:26:40<5:37:22, 126.52s/it]
 77%|███████▋  | 524/683 [18:28:50<5:37:40, 127.42s/it]
                                                       
{'loss': 1.7082, 'learning_rate': 8.18181818181818e-05, 'epoch': 0.77}

 77%|███████▋  | 524/683 [18:28:50<5:37:40, 127.42s/it]
 77%|███████▋  | 525/683 [18:30:58<5:35:53, 127.55s/it]
                                                       
{'loss': 1.7288, 'learning_rate': 8.130360205831903e-05, 'epoch': 0.77}

 77%|███████▋  | 525/683 [18:30:58<5:35:53, 127.55s/it]
 77%|███████▋  | 526/683 [18:33:10<5:37:30, 128.98s/it]
                                                       
{'loss': 1.7238, 'learning_rate': 8.078902229845624e-05, 'epoch': 0.77}

 77%|███████▋  | 526/683 [18:33:10<5:37:30, 128.98s/it]
 77%|███████▋  | 527/683 [18:35:21<5:36:41, 129.50s/it]
                                                       
{'loss': 1.7431, 'learning_rate': 8.027444253859347e-05, 'epoch': 0.77}

 77%|███████▋  | 527/683 [18:35:21<5:36:41, 129.50s/it]
 77%|███████▋  | 528/683 [18:37:26<5:30:56, 128.10s/it]
                                                       
{'loss': 1.7256, 'learning_rate': 7.975986277873071e-05, 'epoch': 0.77}

 77%|███████▋  | 528/683 [18:37:26<5:30:56, 128.10s/it]
 77%|███████▋  | 529/683 [18:39:35<5:29:58, 128.56s/it]
                                                       
{'loss': 1.7401, 'learning_rate': 7.924528301886792e-05, 'epoch': 0.77}

 77%|███████▋  | 529/683 [18:39:35<5:29:58, 128.56s/it]
 78%|███████▊  | 530/683 [18:41:40<5:25:06, 127.49s/it]
                                                       
{'loss': 1.7428, 'learning_rate': 7.873070325900515e-05, 'epoch': 0.78}

 78%|███████▊  | 530/683 [18:41:40<5:25:06, 127.49s/it]
 78%|███████▊  | 531/683 [18:43:45<5:21:06, 126.75s/it]
                                                       
{'loss': 1.7651, 'learning_rate': 7.821612349914236e-05, 'epoch': 0.78}

 78%|███████▊  | 531/683 [18:43:45<5:21:06, 126.75s/it]
 78%|███████▊  | 532/683 [18:45:56<5:21:54, 127.91s/it]
                                                       
{'loss': 1.7647, 'learning_rate': 7.770154373927959e-05, 'epoch': 0.78}

 78%|███████▊  | 532/683 [18:45:56<5:21:54, 127.91s/it]
 78%|███████▊  | 533/683 [18:48:01<5:17:58, 127.19s/it]
                                                       
{'loss': 1.7656, 'learning_rate': 7.71869639794168e-05, 'epoch': 0.78}

 78%|███████▊  | 533/683 [18:48:01<5:17:58, 127.19s/it]
 78%|███████▊  | 534/683 [18:50:11<5:17:37, 127.90s/it]
                                                       
{'loss': 1.6923, 'learning_rate': 7.667238421955403e-05, 'epoch': 0.78}

 78%|███████▊  | 534/683 [18:50:11<5:17:37, 127.90s/it]
 78%|███████▊  | 535/683 [18:52:26<5:20:48, 130.06s/it]
                                                       
{'loss': 1.7343, 'learning_rate': 7.615780445969124e-05, 'epoch': 0.78}

 78%|███████▊  | 535/683 [18:52:26<5:20:48, 130.06s/it]
 78%|███████▊  | 536/683 [18:54:23<5:08:59, 126.12s/it]
                                                       
{'loss': 1.6744, 'learning_rate': 7.564322469982847e-05, 'epoch': 0.78}

 78%|███████▊  | 536/683 [18:54:23<5:08:59, 126.12s/it]
 79%|███████▊  | 537/683 [18:56:34<5:10:27, 127.59s/it]
                                                       
{'loss': 1.7202, 'learning_rate': 7.512864493996568e-05, 'epoch': 0.79}

 79%|███████▊  | 537/683 [18:56:34<5:10:27, 127.59s/it]
 79%|███████▉  | 538/683 [18:58:45<5:10:43, 128.58s/it]
                                                       
{'loss': 1.7164, 'learning_rate': 7.46140651801029e-05, 'epoch': 0.79}

 79%|███████▉  | 538/683 [18:58:45<5:10:43, 128.58s/it]
 79%|███████▉  | 539/683 [19:00:48<5:04:37, 126.93s/it]
                                                       
{'loss': 1.734, 'learning_rate': 7.409948542024013e-05, 'epoch': 0.79}

 79%|███████▉  | 539/683 [19:00:48<5:04:37, 126.93s/it]
 79%|███████▉  | 540/683 [19:02:58<5:04:28, 127.75s/it]
                                                       
{'loss': 1.7564, 'learning_rate': 7.358490566037735e-05, 'epoch': 0.79}

 79%|███████▉  | 540/683 [19:02:58<5:04:28, 127.75s/it]
 79%|███████▉  | 541/683 [19:05:04<5:01:24, 127.36s/it]
                                                       
{'loss': 1.7429, 'learning_rate': 7.307032590051457e-05, 'epoch': 0.79}

 79%|███████▉  | 541/683 [19:05:04<5:01:24, 127.36s/it]
 79%|███████▉  | 542/683 [19:07:05<4:54:39, 125.39s/it]
                                                       
{'loss': 1.7352, 'learning_rate': 7.25557461406518e-05, 'epoch': 0.79}

 79%|███████▉  | 542/683 [19:07:05<4:54:39, 125.39s/it]
 80%|███████▉  | 543/683 [19:09:09<4:51:56, 125.11s/it]
                                                       
{'loss': 1.7191, 'learning_rate': 7.204116638078901e-05, 'epoch': 0.79}

 80%|███████▉  | 543/683 [19:09:09<4:51:56, 125.11s/it]
 80%|███████▉  | 544/683 [19:11:14<4:49:19, 124.89s/it]
                                                       
{'loss': 1.7642, 'learning_rate': 7.152658662092624e-05, 'epoch': 0.8}

 80%|███████▉  | 544/683 [19:11:14<4:49:19, 124.89s/it]/home/ubuntu/miniconda3/envs/h2ollm/lib/python3.10/site-packages/bitsandbytes-0.38.0.post2-py3.10.egg/bitsandbytes/autograd/_functions.py:318: UserWarning: MatMul8bitLt: inputs will be cast from torch.float32 to float16 during quantization
  warnings.warn(f"MatMul8bitLt: inputs will be cast from {A.dtype} to float16 during quantization")

 80%|███████▉  | 545/683 [19:13:25<4:51:44, 126.85s/it]
                                                       
{'loss': 1.7299, 'learning_rate': 7.101200686106345e-05, 'epoch': 0.8}

 80%|███████▉  | 545/683 [19:13:25<4:51:44, 126.85s/it]
 80%|███████▉  | 546/683 [19:15:32<4:49:37, 126.84s/it]
                                                       
{'loss': 1.7606, 'learning_rate': 7.049742710120068e-05, 'epoch': 0.8}

 80%|███████▉  | 546/683 [19:15:32<4:49:37, 126.84s/it]
 80%|████████  | 547/683 [19:17:39<4:47:22, 126.79s/it]
                                                       
{'loss': 1.7333, 'learning_rate': 6.99828473413379e-05, 'epoch': 0.8}

 80%|████████  | 547/683 [19:17:39<4:47:22, 126.79s/it]
 80%|████████  | 548/683 [19:19:45<4:45:11, 126.75s/it]
                                                       
{'loss': 1.6729, 'learning_rate': 6.946826758147513e-05, 'epoch': 0.8}

 80%|████████  | 548/683 [19:19:45<4:45:11, 126.75s/it]
 80%|████████  | 549/683 [19:21:54<4:44:25, 127.35s/it]
                                                       
{'loss': 1.7559, 'learning_rate': 6.895368782161234e-05, 'epoch': 0.8}

 80%|████████  | 549/683 [19:21:54<4:44:25, 127.35s/it]
 81%|████████  | 550/683 [19:23:55<4:38:00, 125.42s/it]
                                                       
{'loss': 1.7493, 'learning_rate': 6.843910806174957e-05, 'epoch': 0.8}

 81%|████████  | 550/683 [19:23:55<4:38:00, 125.42s/it]
 81%|████████  | 551/683 [19:25:58<4:34:12, 124.64s/it]
                                                       
{'loss': 1.6838, 'learning_rate': 6.792452830188678e-05, 'epoch': 0.81}

 81%|████████  | 551/683 [19:25:58<4:34:12, 124.64s/it]
 81%|████████  | 552/683 [19:28:06<4:34:38, 125.79s/it]
                                                       
{'loss': 1.6781, 'learning_rate': 6.740994854202401e-05, 'epoch': 0.81}

 81%|████████  | 552/683 [19:28:06<4:34:38, 125.79s/it]
 81%|████████  | 553/683 [19:30:14<4:33:41, 126.32s/it]
                                                       
{'loss': 1.7452, 'learning_rate': 6.689536878216122e-05, 'epoch': 0.81}

 81%|████████  | 553/683 [19:30:14<4:33:41, 126.32s/it]
 81%|████████  | 554/683 [19:32:19<4:30:55, 126.01s/it]
                                                       
{'loss': 1.704, 'learning_rate': 6.638078902229845e-05, 'epoch': 0.81}

 81%|████████  | 554/683 [19:32:19<4:30:55, 126.01s/it]
 81%|████████▏ | 555/683 [19:34:20<4:25:22, 124.39s/it]
                                                       
{'loss': 1.7327, 'learning_rate': 6.586620926243568e-05, 'epoch': 0.81}

 81%|████████▏ | 555/683 [19:34:20<4:25:22, 124.39s/it]
 81%|████████▏ | 556/683 [19:36:31<4:27:49, 126.53s/it]
                                                       
{'loss': 1.7907, 'learning_rate': 6.535162950257289e-05, 'epoch': 0.81}

 81%|████████▏ | 556/683 [19:36:31<4:27:49, 126.53s/it]
 82%|████████▏ | 557/683 [19:38:35<4:23:59, 125.71s/it]
                                                       
{'loss': 1.7342, 'learning_rate': 6.483704974271012e-05, 'epoch': 0.82}

 82%|████████▏ | 557/683 [19:38:35<4:23:59, 125.71s/it]
 82%|████████▏ | 558/683 [19:40:38<4:20:07, 124.86s/it]
                                                       
{'loss': 1.7205, 'learning_rate': 6.432246998284733e-05, 'epoch': 0.82}

 82%|████████▏ | 558/683 [19:40:38<4:20:07, 124.86s/it]
 82%|████████▏ | 559/683 [19:42:36<4:13:30, 122.67s/it]
                                                       
{'loss': 1.6357, 'learning_rate': 6.380789022298456e-05, 'epoch': 0.82}

 82%|████████▏ | 559/683 [19:42:36<4:13:30, 122.67s/it]
 82%|████████▏ | 560/683 [19:44:39<4:12:03, 122.96s/it]
                                                       
{'loss': 1.7639, 'learning_rate': 6.329331046312178e-05, 'epoch': 0.82}

 82%|████████▏ | 560/683 [19:44:39<4:12:03, 122.96s/it]
 82%|████████▏ | 561/683 [19:46:47<4:12:53, 124.37s/it]
                                                       
{'loss': 1.8062, 'learning_rate': 6.277873070325901e-05, 'epoch': 0.82}

 82%|████████▏ | 561/683 [19:46:47<4:12:53, 124.37s/it]
 82%|████████▏ | 562/683 [19:48:52<4:11:19, 124.63s/it]
                                                       
{'loss': 1.7071, 'learning_rate': 6.226415094339622e-05, 'epoch': 0.82}

 82%|████████▏ | 562/683 [19:48:52<4:11:19, 124.63s/it]
 82%|████████▏ | 563/683 [19:50:59<4:10:50, 125.42s/it]
                                                       
{'loss': 1.7036, 'learning_rate': 6.174957118353345e-05, 'epoch': 0.82}

 82%|████████▏ | 563/683 [19:50:59<4:10:50, 125.42s/it]
 83%|████████▎ | 564/683 [19:53:09<4:11:28, 126.79s/it]
                                                       
{'loss': 1.7142, 'learning_rate': 6.123499142367066e-05, 'epoch': 0.83}

 83%|████████▎ | 564/683 [19:53:09<4:11:28, 126.79s/it]
 83%|████████▎ | 565/683 [19:55:17<4:09:47, 127.01s/it]
                                                       
{'loss': 1.778, 'learning_rate': 6.072041166380789e-05, 'epoch': 0.83}

 83%|████████▎ | 565/683 [19:55:17<4:09:47, 127.01s/it]
 83%|████████▎ | 566/683 [19:57:17<4:03:25, 124.83s/it]
                                                       
{'loss': 1.6779, 'learning_rate': 6.020583190394511e-05, 'epoch': 0.83}

 83%|████████▎ | 566/683 [19:57:17<4:03:25, 124.83s/it]
 83%|████████▎ | 567/683 [19:59:17<3:59:00, 123.62s/it]
                                                       
{'loss': 1.7272, 'learning_rate': 5.969125214408233e-05, 'epoch': 0.83}

 83%|████████▎ | 567/683 [19:59:17<3:59:00, 123.62s/it]
 83%|████████▎ | 568/683 [20:01:26<3:59:43, 125.07s/it]
                                                       
{'loss': 1.7327, 'learning_rate': 5.917667238421955e-05, 'epoch': 0.83}

 83%|████████▎ | 568/683 [20:01:26<3:59:43, 125.07s/it]
 83%|████████▎ | 569/683 [20:03:35<3:59:41, 126.16s/it]
                                                       
{'loss': 1.7171, 'learning_rate': 5.866209262435677e-05, 'epoch': 0.83}

 83%|████████▎ | 569/683 [20:03:35<3:59:41, 126.16s/it]
 83%|████████▎ | 570/683 [20:05:41<3:57:49, 126.28s/it]
                                                       
{'loss': 1.731, 'learning_rate': 5.814751286449399e-05, 'epoch': 0.83}

 83%|████████▎ | 570/683 [20:05:41<3:57:49, 126.28s/it]
 84%|████████▎ | 571/683 [20:07:52<3:58:06, 127.56s/it]
                                                       
{'loss': 1.7747, 'learning_rate': 5.763293310463121e-05, 'epoch': 0.84}

 84%|████████▎ | 571/683 [20:07:52<3:58:06, 127.56s/it]
 84%|████████▎ | 572/683 [20:09:58<3:55:14, 127.15s/it]
                                                       
{'loss': 1.7916, 'learning_rate': 5.7118353344768434e-05, 'epoch': 0.84}

 84%|████████▎ | 572/683 [20:09:58<3:55:14, 127.15s/it]
 84%|████████▍ | 573/683 [20:12:12<3:56:43, 129.12s/it]
                                                       
{'loss': 1.756, 'learning_rate': 5.660377358490566e-05, 'epoch': 0.84}

 84%|████████▍ | 573/683 [20:12:12<3:56:43, 129.12s/it]
 84%|████████▍ | 574/683 [20:14:24<3:56:34, 130.22s/it]
                                                       
{'loss': 1.741, 'learning_rate': 5.608919382504288e-05, 'epoch': 0.84}

 84%|████████▍ | 574/683 [20:14:24<3:56:34, 130.22s/it]
 84%|████████▍ | 575/683 [20:16:30<3:52:03, 128.92s/it]
                                                       
{'loss': 1.7513, 'learning_rate': 5.55746140651801e-05, 'epoch': 0.84}

 84%|████████▍ | 575/683 [20:16:30<3:52:03, 128.92s/it]
 84%|████████▍ | 576/683 [20:18:37<3:48:55, 128.37s/it]
                                                       
{'loss': 1.6569, 'learning_rate': 5.506003430531732e-05, 'epoch': 0.84}

 84%|████████▍ | 576/683 [20:18:37<3:48:55, 128.37s/it]
 84%|████████▍ | 577/683 [20:20:46<3:46:51, 128.41s/it]
                                                       
{'loss': 1.7588, 'learning_rate': 5.454545454545454e-05, 'epoch': 0.84}

 84%|████████▍ | 577/683 [20:20:46<3:46:51, 128.41s/it]
 85%|████████▍ | 578/683 [20:22:52<3:43:32, 127.73s/it]
                                                       
{'loss': 1.7819, 'learning_rate': 5.4030874785591766e-05, 'epoch': 0.85}

 85%|████████▍ | 578/683 [20:22:52<3:43:32, 127.73s/it]/home/ubuntu/miniconda3/envs/h2ollm/lib/python3.10/site-packages/bitsandbytes-0.38.0.post2-py3.10.egg/bitsandbytes/autograd/_functions.py:318: UserWarning: MatMul8bitLt: inputs will be cast from torch.float32 to float16 during quantization
  warnings.warn(f"MatMul8bitLt: inputs will be cast from {A.dtype} to float16 during quantization")

 85%|████████▍ | 579/683 [20:25:03<3:43:03, 128.68s/it]
                                                       
{'loss': 1.7378, 'learning_rate': 5.3516295025728986e-05, 'epoch': 0.85}

 85%|████████▍ | 579/683 [20:25:03<3:43:03, 128.68s/it]
 85%|████████▍ | 580/683 [20:27:16<3:42:57, 129.88s/it]
                                                       
{'loss': 1.6942, 'learning_rate': 5.3001715265866206e-05, 'epoch': 0.85}

 85%|████████▍ | 580/683 [20:27:16<3:42:57, 129.88s/it]
 85%|████████▌ | 581/683 [20:29:23<3:39:34, 129.16s/it]
                                                       
{'loss': 1.7191, 'learning_rate': 5.2487135506003425e-05, 'epoch': 0.85}

 85%|████████▌ | 581/683 [20:29:23<3:39:34, 129.16s/it]
 85%|████████▌ | 582/683 [20:31:31<3:36:43, 128.74s/it]
                                                       
{'loss': 1.7427, 'learning_rate': 5.1972555746140645e-05, 'epoch': 0.85}

 85%|████████▌ | 582/683 [20:31:31<3:36:43, 128.74s/it]
 85%|████████▌ | 583/683 [20:33:38<3:33:52, 128.32s/it]
                                                       
{'loss': 1.746, 'learning_rate': 5.1457975986277865e-05, 'epoch': 0.85}

 85%|████████▌ | 583/683 [20:33:38<3:33:52, 128.32s/it]
 86%|████████▌ | 584/683 [20:35:48<3:32:33, 128.82s/it]
                                                       
{'loss': 1.734, 'learning_rate': 5.0943396226415085e-05, 'epoch': 0.85}

 86%|████████▌ | 584/683 [20:35:48<3:32:33, 128.82s/it]
 86%|████████▌ | 585/683 [20:37:56<3:29:52, 128.49s/it]
                                                       
{'loss': 1.7233, 'learning_rate': 5.0428816466552305e-05, 'epoch': 0.86}

 86%|████████▌ | 585/683 [20:37:56<3:29:52, 128.49s/it]
 86%|████████▌ | 586/683 [20:39:58<3:24:47, 126.68s/it]
                                                       
{'loss': 1.7147, 'learning_rate': 4.991423670668954e-05, 'epoch': 0.86}

 86%|████████▌ | 586/683 [20:39:58<3:24:47, 126.68s/it]
 86%|████████▌ | 587/683 [20:42:07<3:23:37, 127.26s/it]
                                                       
{'loss': 1.7282, 'learning_rate': 4.939965694682676e-05, 'epoch': 0.86}

 86%|████████▌ | 587/683 [20:42:07<3:23:37, 127.26s/it]
 86%|████████▌ | 588/683 [20:44:18<3:23:15, 128.37s/it]
                                                       
{'loss': 1.7214, 'learning_rate': 4.888507718696398e-05, 'epoch': 0.86}

 86%|████████▌ | 588/683 [20:44:18<3:23:15, 128.37s/it]
 86%|████████▌ | 589/683 [20:46:29<3:22:14, 129.09s/it]
                                                       
{'loss': 1.7389, 'learning_rate': 4.83704974271012e-05, 'epoch': 0.86}

 86%|████████▌ | 589/683 [20:46:29<3:22:14, 129.09s/it]
 86%|████████▋ | 590/683 [20:48:33<3:17:43, 127.57s/it]
                                                       
{'loss': 1.6967, 'learning_rate': 4.785591766723842e-05, 'epoch': 0.86}

 86%|████████▋ | 590/683 [20:48:33<3:17:43, 127.57s/it]
 87%|████████▋ | 591/683 [20:50:33<3:12:05, 125.27s/it]
                                                       
{'loss': 1.6956, 'learning_rate': 4.734133790737564e-05, 'epoch': 0.86}

 87%|████████▋ | 591/683 [20:50:33<3:12:05, 125.27s/it]
 87%|████████▋ | 592/683 [20:52:41<3:11:19, 126.15s/it]
                                                       
{'loss': 1.7162, 'learning_rate': 4.6826758147512863e-05, 'epoch': 0.87}

 87%|████████▋ | 592/683 [20:52:41<3:11:19, 126.15s/it]
 87%|████████▋ | 593/683 [20:54:46<3:09:01, 126.01s/it]
                                                       
{'loss': 1.7373, 'learning_rate': 4.631217838765008e-05, 'epoch': 0.87}

 87%|████████▋ | 593/683 [20:54:46<3:09:01, 126.01s/it]
 87%|████████▋ | 594/683 [20:56:47<3:04:35, 124.44s/it]
                                                       
{'loss': 1.7271, 'learning_rate': 4.57975986277873e-05, 'epoch': 0.87}

 87%|████████▋ | 594/683 [20:56:47<3:04:35, 124.44s/it]
 87%|████████▋ | 595/683 [20:58:46<2:59:59, 122.72s/it]
                                                       
{'loss': 1.7575, 'learning_rate': 4.528301886792452e-05, 'epoch': 0.87}

 87%|████████▋ | 595/683 [20:58:46<2:59:59, 122.72s/it]
 87%|████████▋ | 596/683 [21:00:52<2:59:19, 123.68s/it]
                                                       
{'loss': 1.7168, 'learning_rate': 4.476843910806174e-05, 'epoch': 0.87}

 87%|████████▋ | 596/683 [21:00:52<2:59:19, 123.68s/it]
 87%|████████▋ | 597/683 [21:02:52<2:55:49, 122.66s/it]
                                                       
{'loss': 1.7215, 'learning_rate': 4.425385934819896e-05, 'epoch': 0.87}

 87%|████████▋ | 597/683 [21:02:52<2:55:49, 122.66s/it]
 88%|████████▊ | 598/683 [21:04:58<2:55:12, 123.68s/it]
                                                       
{'loss': 1.8059, 'learning_rate': 4.373927958833618e-05, 'epoch': 0.88}

 88%|████████▊ | 598/683 [21:04:58<2:55:12, 123.68s/it]
 88%|████████▊ | 599/683 [21:07:01<2:52:54, 123.51s/it]
                                                       
{'loss': 1.7368, 'learning_rate': 4.3224699828473416e-05, 'epoch': 0.88}

 88%|████████▊ | 599/683 [21:07:01<2:52:54, 123.51s/it]
 88%|████████▊ | 600/683 [21:09:13<2:54:15, 125.97s/it]
                                                       
{'loss': 1.7971, 'learning_rate': 4.2710120068610635e-05, 'epoch': 0.88}

 88%|████████▊ | 600/683 [21:09:13<2:54:15, 125.97s/it]
 88%|████████▊ | 601/683 [21:11:22<2:53:23, 126.87s/it]
                                                       
{'loss': 1.7063, 'learning_rate': 4.2195540308747855e-05, 'epoch': 0.88}

 88%|████████▊ | 601/683 [21:11:22<2:53:23, 126.87s/it]
 88%|████████▊ | 602/683 [21:13:30<2:51:41, 127.18s/it]
                                                       
{'loss': 1.7199, 'learning_rate': 4.1680960548885075e-05, 'epoch': 0.88}

 88%|████████▊ | 602/683 [21:13:30<2:51:41, 127.18s/it]
 88%|████████▊ | 603/683 [21:15:45<2:52:37, 129.47s/it]
                                                       
{'loss': 1.7352, 'learning_rate': 4.1166380789022295e-05, 'epoch': 0.88}

 88%|████████▊ | 603/683 [21:15:45<2:52:37, 129.47s/it]
 88%|████████▊ | 604/683 [21:17:51<2:49:01, 128.38s/it]
                                                       
{'loss': 1.7351, 'learning_rate': 4.0651801029159514e-05, 'epoch': 0.88}

 88%|████████▊ | 604/683 [21:17:51<2:49:01, 128.38s/it]
 89%|████████▊ | 605/683 [21:19:59<2:47:04, 128.53s/it]
                                                       
{'loss': 1.7345, 'learning_rate': 4.0137221269296734e-05, 'epoch': 0.89}

 89%|████████▊ | 605/683 [21:19:59<2:47:04, 128.53s/it]
 89%|████████▊ | 606/683 [21:22:08<2:45:04, 128.63s/it]
                                                       
{'loss': 1.6952, 'learning_rate': 3.962264150943396e-05, 'epoch': 0.89}

 89%|████████▊ | 606/683 [21:22:08<2:45:04, 128.63s/it]
 89%|████████▉ | 607/683 [21:24:13<2:41:27, 127.47s/it]
                                                       
{'loss': 1.6926, 'learning_rate': 3.910806174957118e-05, 'epoch': 0.89}

 89%|████████▉ | 607/683 [21:24:13<2:41:27, 127.47s/it]
 89%|████████▉ | 608/683 [21:26:20<2:39:02, 127.23s/it]
                                                       
{'loss': 1.7236, 'learning_rate': 3.85934819897084e-05, 'epoch': 0.89}

 89%|████████▉ | 608/683 [21:26:20<2:39:02, 127.23s/it]
 89%|████████▉ | 609/683 [21:28:22<2:35:06, 125.76s/it]
                                                       
{'loss': 1.6573, 'learning_rate': 3.807890222984562e-05, 'epoch': 0.89}

 89%|████████▉ | 609/683 [21:28:22<2:35:06, 125.76s/it]
 89%|████████▉ | 610/683 [21:30:22<2:31:03, 124.15s/it]
                                                       
{'loss': 1.6781, 'learning_rate': 3.756432246998284e-05, 'epoch': 0.89}

 89%|████████▉ | 610/683 [21:30:22<2:31:03, 124.15s/it]
 89%|████████▉ | 611/683 [21:32:32<2:30:46, 125.65s/it]
                                                       
{'loss': 1.7564, 'learning_rate': 3.7049742710120067e-05, 'epoch': 0.89}

 89%|████████▉ | 611/683 [21:32:32<2:30:46, 125.65s/it]
 90%|████████▉ | 612/683 [21:34:38<2:28:49, 125.77s/it]
                                                       
{'loss': 1.7474, 'learning_rate': 3.6535162950257286e-05, 'epoch': 0.9}

 90%|████████▉ | 612/683 [21:34:38<2:28:49, 125.77s/it]/home/ubuntu/miniconda3/envs/h2ollm/lib/python3.10/site-packages/bitsandbytes-0.38.0.post2-py3.10.egg/bitsandbytes/autograd/_functions.py:318: UserWarning: MatMul8bitLt: inputs will be cast from torch.float32 to float16 during quantization
  warnings.warn(f"MatMul8bitLt: inputs will be cast from {A.dtype} to float16 during quantization")

 90%|████████▉ | 613/683 [21:36:41<2:26:00, 125.15s/it]
                                                       
{'loss': 1.6794, 'learning_rate': 3.6020583190394506e-05, 'epoch': 0.9}

 90%|████████▉ | 613/683 [21:36:41<2:26:00, 125.15s/it]
 90%|████████▉ | 614/683 [21:38:46<2:23:45, 125.01s/it]
                                                       
{'loss': 1.7559, 'learning_rate': 3.5506003430531726e-05, 'epoch': 0.9}

 90%|████████▉ | 614/683 [21:38:46<2:23:45, 125.01s/it]
 90%|█████████ | 615/683 [21:40:52<2:22:04, 125.36s/it]
                                                       
{'loss': 1.752, 'learning_rate': 3.499142367066895e-05, 'epoch': 0.9}

 90%|█████████ | 615/683 [21:40:52<2:22:04, 125.36s/it]
 90%|█████████ | 616/683 [21:43:01<2:21:03, 126.33s/it]
                                                       
{'loss': 1.7049, 'learning_rate': 3.447684391080617e-05, 'epoch': 0.9}

 90%|█████████ | 616/683 [21:43:01<2:21:03, 126.33s/it]
 90%|█████████ | 617/683 [21:45:08<2:19:08, 126.49s/it]
                                                       
{'loss': 1.7351, 'learning_rate': 3.396226415094339e-05, 'epoch': 0.9}

 90%|█████████ | 617/683 [21:45:08<2:19:08, 126.49s/it]
 90%|█████████ | 618/683 [21:47:16<2:17:35, 127.01s/it]
                                                       
{'loss': 1.6997, 'learning_rate': 3.344768439108061e-05, 'epoch': 0.9}

 90%|█████████ | 618/683 [21:47:16<2:17:35, 127.01s/it]
 91%|█████████ | 619/683 [21:49:21<2:14:53, 126.46s/it]
                                                       
{'loss': 1.7248, 'learning_rate': 3.293310463121784e-05, 'epoch': 0.91}

 91%|█████████ | 619/683 [21:49:21<2:14:53, 126.46s/it]
 91%|█████████ | 620/683 [21:51:24<2:11:35, 125.33s/it]
                                                       
{'loss': 1.7721, 'learning_rate': 3.241852487135506e-05, 'epoch': 0.91}

 91%|█████████ | 620/683 [21:51:24<2:11:35, 125.33s/it]
 91%|█████████ | 621/683 [21:53:30<2:09:50, 125.65s/it]
                                                       
{'loss': 1.7408, 'learning_rate': 3.190394511149228e-05, 'epoch': 0.91}

 91%|█████████ | 621/683 [21:53:30<2:09:50, 125.65s/it]
 91%|█████████ | 622/683 [21:55:37<2:07:58, 125.88s/it]
                                                       
{'loss': 1.7153, 'learning_rate': 3.1389365351629505e-05, 'epoch': 0.91}

 91%|█████████ | 622/683 [21:55:37<2:07:58, 125.88s/it]
 91%|█████████ | 623/683 [21:57:47<2:07:13, 127.22s/it]
                                                       
{'loss': 1.7789, 'learning_rate': 3.0874785591766724e-05, 'epoch': 0.91}

 91%|█████████ | 623/683 [21:57:47<2:07:13, 127.22s/it]
 91%|█████████▏| 624/683 [21:59:51<2:04:03, 126.16s/it]
                                                       
{'loss': 1.6835, 'learning_rate': 3.0360205831903944e-05, 'epoch': 0.91}

 91%|█████████▏| 624/683 [21:59:51<2:04:03, 126.16s/it]
 92%|█████████▏| 625/683 [22:01:52<2:00:38, 124.81s/it]
                                                       
{'loss': 1.716, 'learning_rate': 2.9845626072041164e-05, 'epoch': 0.91}

 92%|█████████▏| 625/683 [22:01:52<2:00:38, 124.81s/it]
 92%|█████████▏| 626/683 [22:04:00<1:59:26, 125.73s/it]
                                                       
{'loss': 1.7123, 'learning_rate': 2.9331046312178384e-05, 'epoch': 0.92}

 92%|█████████▏| 626/683 [22:04:00<1:59:26, 125.73s/it]
 92%|█████████▏| 627/683 [22:05:59<1:55:30, 123.75s/it]
                                                       
{'loss': 1.6924, 'learning_rate': 2.8816466552315604e-05, 'epoch': 0.92}

 92%|█████████▏| 627/683 [22:05:59<1:55:30, 123.75s/it]
 92%|█████████▏| 628/683 [22:08:04<1:53:35, 123.91s/it]
                                                       
{'loss': 1.6901, 'learning_rate': 2.830188679245283e-05, 'epoch': 0.92}

 92%|█████████▏| 628/683 [22:08:04<1:53:35, 123.91s/it]
 92%|█████████▏| 629/683 [22:10:12<1:52:40, 125.19s/it]
                                                       
{'loss': 1.7018, 'learning_rate': 2.778730703259005e-05, 'epoch': 0.92}

 92%|█████████▏| 629/683 [22:10:12<1:52:40, 125.19s/it]
 92%|█████████▏| 630/683 [22:12:21<1:51:46, 126.53s/it]
                                                       
{'loss': 1.7554, 'learning_rate': 2.727272727272727e-05, 'epoch': 0.92}

 92%|█████████▏| 630/683 [22:12:21<1:51:46, 126.53s/it]
 92%|█████████▏| 631/683 [22:14:26<1:49:14, 126.05s/it]
                                                       
{'loss': 1.7427, 'learning_rate': 2.6758147512864493e-05, 'epoch': 0.92}

 92%|█████████▏| 631/683 [22:14:26<1:49:14, 126.05s/it]
 93%|█████████▎| 632/683 [22:16:32<1:47:03, 125.95s/it]
                                                       
{'loss': 1.7532, 'learning_rate': 2.6243567753001713e-05, 'epoch': 0.92}

 93%|█████████▎| 632/683 [22:16:32<1:47:03, 125.95s/it]
 93%|█████████▎| 633/683 [22:18:34<1:43:54, 124.69s/it]
                                                       
{'loss': 1.7455, 'learning_rate': 2.5728987993138932e-05, 'epoch': 0.93}

 93%|█████████▎| 633/683 [22:18:34<1:43:54, 124.69s/it]
 93%|█████████▎| 634/683 [22:20:41<1:42:21, 125.34s/it]
                                                       
{'loss': 1.7273, 'learning_rate': 2.5214408233276152e-05, 'epoch': 0.93}

 93%|█████████▎| 634/683 [22:20:41<1:42:21, 125.34s/it]
 93%|█████████▎| 635/683 [22:22:49<1:40:53, 126.10s/it]
                                                       
{'loss': 1.7296, 'learning_rate': 2.469982847341338e-05, 'epoch': 0.93}

 93%|█████████▎| 635/683 [22:22:49<1:40:53, 126.10s/it]
 93%|█████████▎| 636/683 [22:24:54<1:38:37, 125.90s/it]
                                                       
{'loss': 1.6587, 'learning_rate': 2.41852487135506e-05, 'epoch': 0.93}

 93%|█████████▎| 636/683 [22:24:54<1:38:37, 125.90s/it]
 93%|█████████▎| 637/683 [22:27:06<1:38:00, 127.83s/it]
                                                       
{'loss': 1.7086, 'learning_rate': 2.367066895368782e-05, 'epoch': 0.93}

 93%|█████████▎| 637/683 [22:27:06<1:38:00, 127.83s/it]
 93%|█████████▎| 638/683 [22:29:12<1:35:25, 127.24s/it]
                                                       
{'loss': 1.7126, 'learning_rate': 2.315608919382504e-05, 'epoch': 0.93}

 93%|█████████▎| 638/683 [22:29:12<1:35:25, 127.24s/it]
 94%|█████████▎| 639/683 [22:31:19<1:33:16, 127.18s/it]
                                                       
{'loss': 1.6716, 'learning_rate': 2.264150943396226e-05, 'epoch': 0.94}

 94%|█████████▎| 639/683 [22:31:19<1:33:16, 127.18s/it]
 94%|█████████▎| 640/683 [22:33:24<1:30:33, 126.37s/it]
                                                       
{'loss': 1.7204, 'learning_rate': 2.212692967409948e-05, 'epoch': 0.94}

 94%|█████████▎| 640/683 [22:33:24<1:30:33, 126.37s/it]
 94%|█████████▍| 641/683 [22:35:27<1:27:43, 125.32s/it]
                                                       
{'loss': 1.7606, 'learning_rate': 2.1612349914236708e-05, 'epoch': 0.94}

 94%|█████████▍| 641/683 [22:35:27<1:27:43, 125.32s/it]
 94%|█████████▍| 642/683 [22:37:36<1:26:25, 126.47s/it]
                                                       
{'loss': 1.7156, 'learning_rate': 2.1097770154373928e-05, 'epoch': 0.94}

 94%|█████████▍| 642/683 [22:37:36<1:26:25, 126.47s/it]
 94%|█████████▍| 643/683 [22:39:46<1:25:04, 127.61s/it]
                                                       
{'loss': 1.7184, 'learning_rate': 2.0583190394511147e-05, 'epoch': 0.94}

 94%|█████████▍| 643/683 [22:39:46<1:25:04, 127.61s/it]
 94%|█████████▍| 644/683 [22:41:53<1:22:54, 127.56s/it]
                                                       
{'loss': 1.7536, 'learning_rate': 2.0068610634648367e-05, 'epoch': 0.94}

 94%|█████████▍| 644/683 [22:41:53<1:22:54, 127.56s/it]
 94%|█████████▍| 645/683 [22:43:52<1:18:59, 124.73s/it]
                                                       
{'loss': 1.6798, 'learning_rate': 1.955403087478559e-05, 'epoch': 0.94}

 94%|█████████▍| 645/683 [22:43:52<1:18:59, 124.73s/it]
 95%|█████████▍| 646/683 [22:45:59<1:17:22, 125.48s/it]
                                                       
{'loss': 1.7, 'learning_rate': 1.903945111492281e-05, 'epoch': 0.95}

 95%|█████████▍| 646/683 [22:45:59<1:17:22, 125.48s/it]/home/ubuntu/miniconda3/envs/h2ollm/lib/python3.10/site-packages/bitsandbytes-0.38.0.post2-py3.10.egg/bitsandbytes/autograd/_functions.py:318: UserWarning: MatMul8bitLt: inputs will be cast from torch.float32 to float16 during quantization
  warnings.warn(f"MatMul8bitLt: inputs will be cast from {A.dtype} to float16 during quantization")

 95%|█████████▍| 647/683 [22:48:08<1:16:00, 126.68s/it]
                                                       
{'loss': 1.7523, 'learning_rate': 1.8524871355060033e-05, 'epoch': 0.95}

 95%|█████████▍| 647/683 [22:48:08<1:16:00, 126.68s/it]
 95%|█████████▍| 648/683 [22:50:11<1:13:11, 125.47s/it]
                                                       
{'loss': 1.7206, 'learning_rate': 1.8010291595197253e-05, 'epoch': 0.95}

 95%|█████████▍| 648/683 [22:50:11<1:13:11, 125.47s/it]
 95%|█████████▌| 649/683 [22:52:17<1:11:10, 125.60s/it]
                                                       
{'loss': 1.7224, 'learning_rate': 1.7495711835334476e-05, 'epoch': 0.95}

 95%|█████████▌| 649/683 [22:52:17<1:11:10, 125.60s/it]
 95%|█████████▌| 650/683 [22:54:24<1:09:19, 126.05s/it]
                                                       
{'loss': 1.7235, 'learning_rate': 1.6981132075471696e-05, 'epoch': 0.95}

 95%|█████████▌| 650/683 [22:54:24<1:09:19, 126.05s/it]
 95%|█████████▌| 651/683 [22:56:37<1:08:16, 128.03s/it]
                                                       
{'loss': 1.7538, 'learning_rate': 1.646655231560892e-05, 'epoch': 0.95}

 95%|█████████▌| 651/683 [22:56:37<1:08:16, 128.03s/it]
 95%|█████████▌| 652/683 [22:58:47<1:06:34, 128.87s/it]
                                                       
{'loss': 1.7322, 'learning_rate': 1.595197255574614e-05, 'epoch': 0.95}

 95%|█████████▌| 652/683 [22:58:47<1:06:34, 128.87s/it]
 96%|█████████▌| 653/683 [23:00:54<1:04:03, 128.12s/it]
                                                       
{'loss': 1.7051, 'learning_rate': 1.5437392795883362e-05, 'epoch': 0.96}

 96%|█████████▌| 653/683 [23:00:54<1:04:03, 128.12s/it]
 96%|█████████▌| 654/683 [23:02:58<1:01:22, 126.99s/it]
                                                       
{'loss': 1.7392, 'learning_rate': 1.4922813036020582e-05, 'epoch': 0.96}

 96%|█████████▌| 654/683 [23:02:58<1:01:22, 126.99s/it]
 96%|█████████▌| 655/683 [23:04:56<58:03, 124.40s/it]  
                                                     
{'loss': 1.6984, 'learning_rate': 1.4408233276157802e-05, 'epoch': 0.96}

 96%|█████████▌| 655/683 [23:04:56<58:03, 124.40s/it]
 96%|█████████▌| 656/683 [23:07:06<56:36, 125.80s/it]
                                                     
{'loss': 1.6953, 'learning_rate': 1.3893653516295025e-05, 'epoch': 0.96}

 96%|█████████▌| 656/683 [23:07:06<56:36, 125.80s/it]
 96%|█████████▌| 657/683 [23:09:12<54:34, 125.93s/it]
                                                     
{'loss': 1.7531, 'learning_rate': 1.3379073756432246e-05, 'epoch': 0.96}

 96%|█████████▌| 657/683 [23:09:12<54:34, 125.93s/it]
 96%|█████████▋| 658/683 [23:11:19<52:37, 126.31s/it]
                                                     
{'loss': 1.7418, 'learning_rate': 1.2864493996569466e-05, 'epoch': 0.96}

 96%|█████████▋| 658/683 [23:11:19<52:37, 126.31s/it]
 96%|█████████▋| 659/683 [23:13:24<50:24, 126.00s/it]
                                                     
{'loss': 1.7669, 'learning_rate': 1.234991423670669e-05, 'epoch': 0.96}

 96%|█████████▋| 659/683 [23:13:24<50:24, 126.00s/it]
 97%|█████████▋| 660/683 [23:15:28<48:04, 125.43s/it]
                                                     
{'loss': 1.7116, 'learning_rate': 1.183533447684391e-05, 'epoch': 0.97}

 97%|█████████▋| 660/683 [23:15:28<48:04, 125.43s/it]
 97%|█████████▋| 661/683 [23:17:34<45:58, 125.39s/it]
                                                     
{'loss': 1.6681, 'learning_rate': 1.132075471698113e-05, 'epoch': 0.97}

 97%|█████████▋| 661/683 [23:17:34<45:58, 125.39s/it]
 97%|█████████▋| 662/683 [23:19:37<43:38, 124.68s/it]
                                                     
{'loss': 1.688, 'learning_rate': 1.0806174957118354e-05, 'epoch': 0.97}

 97%|█████████▋| 662/683 [23:19:37<43:38, 124.68s/it]
 97%|█████████▋| 663/683 [23:21:45<41:54, 125.71s/it]
                                                     
{'loss': 1.7317, 'learning_rate': 1.0291595197255574e-05, 'epoch': 0.97}

 97%|█████████▋| 663/683 [23:21:45<41:54, 125.71s/it]
 97%|█████████▋| 664/683 [23:23:50<39:44, 125.50s/it]
                                                     
{'loss': 1.7569, 'learning_rate': 9.777015437392795e-06, 'epoch': 0.97}

 97%|█████████▋| 664/683 [23:23:50<39:44, 125.50s/it]
 97%|█████████▋| 665/683 [23:25:51<37:16, 124.23s/it]
                                                     
{'loss': 1.7615, 'learning_rate': 9.262435677530017e-06, 'epoch': 0.97}

 97%|█████████▋| 665/683 [23:25:51<37:16, 124.23s/it]
 98%|█████████▊| 666/683 [23:27:54<35:03, 123.75s/it]
                                                     
{'loss': 1.74, 'learning_rate': 8.747855917667238e-06, 'epoch': 0.97}

 98%|█████████▊| 666/683 [23:27:54<35:03, 123.75s/it]
 98%|█████████▊| 667/683 [23:30:02<33:20, 125.04s/it]
                                                     
{'loss': 1.759, 'learning_rate': 8.23327615780446e-06, 'epoch': 0.98}

 98%|█████████▊| 667/683 [23:30:02<33:20, 125.04s/it]
 98%|█████████▊| 668/683 [23:32:10<31:28, 125.92s/it]
                                                     
{'loss': 1.7476, 'learning_rate': 7.718696397941681e-06, 'epoch': 0.98}

 98%|█████████▊| 668/683 [23:32:10<31:28, 125.92s/it]
 98%|█████████▊| 669/683 [23:34:13<29:13, 125.27s/it]
                                                     
{'loss': 1.7257, 'learning_rate': 7.204116638078901e-06, 'epoch': 0.98}

 98%|█████████▊| 669/683 [23:34:13<29:13, 125.27s/it]
 98%|█████████▊| 670/683 [23:36:22<27:22, 126.38s/it]
                                                     
{'loss': 1.7538, 'learning_rate': 6.689536878216123e-06, 'epoch': 0.98}

 98%|█████████▊| 670/683 [23:36:22<27:22, 126.38s/it]
 98%|█████████▊| 671/683 [23:38:31<25:24, 127.07s/it]
                                                     
{'loss': 1.7697, 'learning_rate': 6.174957118353345e-06, 'epoch': 0.98}

 98%|█████████▊| 671/683 [23:38:31<25:24, 127.07s/it]
 98%|█████████▊| 672/683 [23:40:37<23:13, 126.66s/it]
                                                     
{'loss': 1.7155, 'learning_rate': 5.660377358490565e-06, 'epoch': 0.98}

 98%|█████████▊| 672/683 [23:40:37<23:13, 126.66s/it]
 99%|█████████▊| 673/683 [23:42:45<21:10, 127.05s/it]
                                                     
{'loss': 1.703, 'learning_rate': 5.145797598627787e-06, 'epoch': 0.98}

 99%|█████████▊| 673/683 [23:42:45<21:10, 127.05s/it]
 99%|█████████▊| 674/683 [23:44:51<19:00, 126.68s/it]
                                                     
{'loss': 1.7183, 'learning_rate': 4.631217838765008e-06, 'epoch': 0.99}

 99%|█████████▊| 674/683 [23:44:51<19:00, 126.68s/it]
 99%|█████████▉| 675/683 [23:47:01<17:01, 127.66s/it]
                                                     
{'loss': 1.7301, 'learning_rate': 4.11663807890223e-06, 'epoch': 0.99}

 99%|█████████▉| 675/683 [23:47:01<17:01, 127.66s/it]
 99%|█████████▉| 676/683 [23:49:06<14:48, 126.90s/it]
                                                     
{'loss': 1.7157, 'learning_rate': 3.6020583190394504e-06, 'epoch': 0.99}

 99%|█████████▉| 676/683 [23:49:06<14:48, 126.90s/it]
 99%|█████████▉| 677/683 [23:51:11<12:37, 126.29s/it]
                                                     
{'loss': 1.759, 'learning_rate': 3.0874785591766724e-06, 'epoch': 0.99}

 99%|█████████▉| 677/683 [23:51:11<12:37, 126.29s/it]
 99%|█████████▉| 678/683 [23:53:15<10:28, 125.79s/it]
                                                     
{'loss': 1.7458, 'learning_rate': 2.5728987993138934e-06, 'epoch': 0.99}

 99%|█████████▉| 678/683 [23:53:15<10:28, 125.79s/it]
 99%|█████████▉| 679/683 [23:55:18<08:19, 124.94s/it]
                                                     
{'loss': 1.7052, 'learning_rate': 2.058319039451115e-06, 'epoch': 0.99}

 99%|█████████▉| 679/683 [23:55:18<08:19, 124.94s/it]
100%|█████████▉| 680/683 [23:57:28<06:19, 126.43s/it]
                                                     
{'loss': 1.7781, 'learning_rate': 1.5437392795883362e-06, 'epoch': 1.0}

100%|█████████▉| 680/683 [23:57:28<06:19, 126.43s/it]/home/ubuntu/miniconda3/envs/h2ollm/lib/python3.10/site-packages/bitsandbytes-0.38.0.post2-py3.10.egg/bitsandbytes/autograd/_functions.py:318: UserWarning: MatMul8bitLt: inputs will be cast from torch.float32 to float16 during quantization
  warnings.warn(f"MatMul8bitLt: inputs will be cast from {A.dtype} to float16 during quantization")

100%|█████████▉| 681/683 [23:59:32<04:11, 125.82s/it]
                                                     
{'loss': 1.728, 'learning_rate': 1.0291595197255575e-06, 'epoch': 1.0}

100%|█████████▉| 681/683 [23:59:32<04:11, 125.82s/it]
100%|█████████▉| 682/683 [24:01:38<02:05, 125.85s/it]
                                                     
{'loss': 1.7037, 'learning_rate': 5.145797598627787e-07, 'epoch': 1.0}

100%|█████████▉| 682/683 [24:01:38<02:05, 125.85s/it]
100%|██████████| 683/683 [24:03:45<00:00, 125.99s/it]
                                                     
{'loss': 1.6836, 'learning_rate': 0.0, 'epoch': 1.0}

100%|██████████| 683/683 [24:03:45<00:00, 125.99s/it]
                                                     
{'train_runtime': 86626.1367, 'train_samples_per_second': 4.038, 'train_steps_per_second': 0.008, 'train_loss': 1.794932335920599, 'epoch': 1.0}

100%|██████████| 683/683 [24:03:45<00:00, 125.99s/it]
100%|██████████| 683/683 [24:03:45<00:00, 126.83s/it]

 If there's a warning about missing keys above, please disregard :)
